Quantization made by Richard Erkhov.
This model is a fine-tune on a custom dataset + glaive to work specifically and leverage all the
LocalAI features of constrained grammar.
Specifically, the model once enters in tools mode will always reply with JSON.
If you like my work, consider up donating so can get resources for my fine-tunes!
