Lewdiculous/

MN-12B-Lyra-v4-GGUF-IQ-Imatrix

[!TIP] Presets:
You can use the built in ChatML presets within SillyTavern and adjust from there.
Alternatively, check out Virt-io's ChatML v1.9 presets here, make sure you read the repository page for how to use them properly.

[!NOTE] Request page:
https://huggingface.co/Lewdiculous/Model-Requests/discussions/75

Model link:
https://huggingface.co/Sao10K/MN-12B-Lyra-v4

Quantized with llama.cpp:
b3707