A scholarly-grade fine-tune of Gemma 4 12B (text-only) for rigorous Vedic studies. Built to answer questions about the Ṛgveda, Brāhmaṇas, Upaniṣads, Vedāṅgas, Pūrva Mīmāṃsā, and Vedānta with philological precision.
Key Features
Chronological awareness — training examples tagged with [Epoch: Saṃhitā], [Epoch: Upaniṣad], etc. so the model distinguishes Vedic layers
Trace semantic evolution (e.g., brahman from "sacred utterance" to "ultimate reality")
Answer sensitive topics (animal sacrifice, varṇa hierarchy) dispassionately using traditional frameworks
Detect anachronistic projections of later concepts onto earlier texts
Example
User: What does the Rig Veda say about reincarnation?
Assistant: The Rig Veda Saṃhitā does NOT contain the concept of
reincarnation (saṃsāra) as a cycle of rebirth. The dead go to
the world of the fathers (pitṛ-loka) to dwell with Yama — they
do not return. The earliest clear formulation of saṃsāra occurs
in the Bṛhadāraṇyaka Upaniṣad (BU 4.4.5-6). What the Rig Veda
does describe is punar-janman in the sense of new progeny — a
man is 'born again' through his son. This is genealogical, not
soteriological.
Recommended Inference Settings
temperature: 0.2
top_p: 0.95
repetition_penalty: 1.15 # use in llama.cpp / HF generate
HumanEval Benchmark
Metric
Result
Accuracy
91.5% (150/164)
Wrong
14 / 164
The model was evaluated on the HumanEval benchmark in the MLX environment (Q4_K_M quantization, temperature 0.2, top_p 0.95). This is competitive with SOTA 12B models and confirms that Vedic fine-tuning did not degrade general coding/reasoning capability.
