You can deploy this model and start earning money today!

mudler/
LocalAI-Llama3.1-8b-Function-Call-v0.3-GGUF

Name: LocalAI-Llama3.1-8b-Function-Call-v0.3-GGUF
Availability: InStock

Views

No views yet

LocalAI-Llama3.1-8b-Function-Call-v0.3

This model is a fine-tune on a custom dataset + glaive to work specifically and leverage all the LocalAI features of constrained grammar.

Specifically, the model once enters in tools mode will always reply with JSON.

To run on LocalAI:

local-ai run huggingface://mudler/LocalAI-Llama3.1-8b-Function-Call-v0.3-GGUF/localai-q4_k_m.yaml

If you like my work, consider up donating so can get resources for my fine-tunes!