You can deploy this model and start earning money today!

colesmcintosh/
llama-3.2-3B-gsm8k-q4_k_m-GGUF

Name: llama-3.2-3B-gsm8k-q4_k_m-GGUF
Availability: InStock

Views

No views yet

Llama-3.2-3B GRPO on GSM8K Q4_K_M - GGUF

This is the GGUF conversion of the Llama 3.2 3B model fine-tuned using Group Relative Policy Optimization (GRPO) on the GSM8K dataset for improved mathematical reasoning capabilities. The finetuning was performed 2x faster with Unsloth and Huggingface's TRL library.

Example usage:

For text only LLMs: llama-cli --hf repo_id/model_name -p "why is the sky blue?"
For multimodal models: llama-mtmd-cli -m model_name.gguf --mmproj mmproj_file.gguf

Available Model files:

Llama-3.2-3B-GRPO-GSM8K.Q4_K_M.gguf

Ollama

An Ollama Modelfile is included for easy deployment.

colesmcintosh/llama-3.2-3B-gsm8k-q4_k_m-GGUF

Llama-3.2-3B GRPO on GSM8K Q4_K_M - GGUF

Available Model files:

Ollama

colesmcintosh/
llama-3.2-3B-gsm8k-q4_k_m-GGUF