Views
No views yet
1from llama_cpp import Llama
2
3llm = Llama.from_pretrained(
4 repo_id="Chaitu6969/Vitas-Ayurveda-Phi3",
5 filename="ayurveda_phi3_q4km.gguf",
6 n_ctx=4096,
7 n_gpu_layers=-1
8)| Metric | Score |
|---|---|
| ROUGE-1 | 0.4257 |
| ROUGE-2 | 0.2116 |
| ROUGE-L | 0.3379 |
| Mean PPL | 9.49 |