Views
No views yet
| File | Quantization | Size | Quality | Recommended For |
|---|---|---|---|---|
| AyurParam-F16.gguf | F16 | ~5.34GB | Full precision | Evaluation, testing |
| AyurParam-Q4_K_M.gguf | Q4_K_M | ~1.7GB | Good | ✅ Production use |
1# Pull directly from HuggingFace
2ollama run hf.co/A-Aryam/AyurParam-GGUF:Q4_K_M
3
4# Or download and create manually
5ollama create ayurparam -f ModelfileFROM ./AyurParam-Q4_K_M.gguf
PARAMETER temperature 0.6
PARAMETER top_p 0.95
PARAMETER top_k 501./llama-cli -m AyurParam-Q4_K_M.gguf \
2 -p "<user> What is Vata dosha? <assistant>" \
3 --temp 0.6 --top-p 0.95A-Aryam/AyurParam-GGUFAyurParam-Q4_K_M.gguf<user> your question here <assistant><user> What is the Ayurvedic treatment for Amavata? <assistant>