GGUF quantizations of a LoRA fine-tune of
empero-ai/Qwen3.8-9B, supervised fine-tuned on
Salesforce/xlam-function-calling-60k.
Quantized from
ermiaazarkhalili/Qwen3.8-9B-Function-Calling-xLAM-Unsloth. See that repository for the full-precision weights.
1huggingface-cli download ermiaazarkhalili/Qwen3.8-9B-Function-Calling-xLAM-Unsloth-GGUF qwen3.8-9b-function-calling-xlam-unsloth.q4_k_m.gguf --local-dir .
2llama-cli -m qwen3.8-9b-function-calling-xlam-unsloth.q4_k_m.gguf -p "Explain gradient checkpointing in two sentences." -n 256
1echo 'FROM ./qwen3.8-9b-function-calling-xlam-unsloth.q4_k_m.gguf' > Modelfile
2ollama create qwen3.8-9b-function-calling-xlam-unsloth-gguf -f Modelfile
3ollama run qwen3.8-9b-function-calling-xlam-unsloth-gguf
Measured from our SLURM logs for this configuration. These are training-loss
observations only — no downstream benchmark evaluation has been run on this
model, so they should not be read as a quality claim.