File	Type	Size
`gemma-4-12b-vedic-v2-f16.gguf`	F16 (float16)	23.8 GB
`gemma-4-12b-vedic-v2-q8_0.gguf`	Q8_0 (8-bit)	12.7 GB
`gemma-4-12b-vedic-v2-q4_k_m.gguf`	Q4_K_M (4-bit)	7.0 GB

Usage with llama.cpp

bash

./main -m gemma-4-12b-vedic-v2-q4_k_m.gguf \
  --temp 0.2 \
  --top-p 0.95 \
  --repeat-penalty 1.15 \
  -p "<|turn>user\nWhat is Ṛta in the Rig Veda?<turn|>\n<|turn>model\n"

License

Apache 2.0

cyborgxx101/gemma4-vedic-opus-finetuned-v2-gguf

Gemma 4 12B — Vedic Opus Finetuned v2 (GGUF)

Files

Usage with llama.cpp

License

cyborgxx101/
gemma4-vedic-opus-finetuned-v2-gguf