Views
No views yet
⚠️ These are the official GGUF quantizations provided directly by the model creator. They are verified to maintain the specialized instruction-following capabilities and olfactory knowledge of the Nafha-Expert core. For the best experience, use this repo rather than third-party conversions.
| Filename | Quantization | Size | Description |
|---|---|---|---|
Nafha-Llama3.1-8B-Perfumery-Expert-v1.Q4_K_M.gguf | Q4_K_M | ~4.9 GB | ⭐ Most popular — best for 8GB VRAM GPUs |
Nafha-Llama3.1-8B-Perfumery-Expert-v1.Q5_K_M.gguf | Q5_K_M | ~5.7 GB | Great balance of quality and size |
Nafha-Llama3.1-8B-Perfumery-Expert-v1.Q8_0.gguf | Q8_0 | ~8.5 GB | Highest quality quantization |
Nafha-Llama3.1-8B-Perfumery-Expert-v1.f16.gguf | F16 | ~16 GB | Full precision GGUF (reference) |
Modelfile:FROM ./Nafha-Llama3.1-8B-Perfumery-Expert-v1.Q4_K_M.gguf
TEMPLATE """<|begin_of_text|><|start_header_id|>system<|end_header_id|>
{{ .System }}<|eot_id|><|start_header_id|>user<|end_header_id|>
{{ .Prompt }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
"""
SYSTEM "You are Nafha, an expert perfumer AI with deep knowledge of fragrance chemistry, ingredient science, and perfume composition."
PARAMETER temperature 0.7
PARAMETER top_p 0.91ollama create nafha-expert -f Modelfile
2ollama run nafha-expert "Explain the role of Hedione in modern perfumery."1./llama-cli -m Nafha-Llama3.1-8B-Perfumery-Expert-v1.Q4_K_M.gguf \
2 -p "Explain the difference between a fougère and a chypre accord." \
3 -n 512 --temp 0.7