Views
No views yet
llama-3.2-1b-instruct.Q4_K_M.gguf) fine-tuned specifically to generate empathetic, department-aware, and category-contextualized Customer Support Auto-Replies.| Metric | Score | Performance Level |
|---|---|---|
| Mean ROUGE-L Score | 36.63% | High structural & phrasing alignment |
| Mean Cosine Similarity | 64.16% | High semantic context relevance |
Context Window (num_ctx) | 2,048 Tokens | Reduced KV Cache (~60MB RAM footprint) |
| Quantization Format | Q4_K_M GGUF | Compact ~807MB binary weight file |
negative sentiment, or expresses enthusiasm for positive feedback.annoyance, frustration, joy).llama-3.2-1b-instruct.Q4_K_M.gguf: 4-bit quantized GGUF model file (~807 MB).Modelfile: Ollama model registration file with LLaMA 3.2 chat template, parameters, and stop sequences (stop "Context:").finetune_review_train_45K.jsonl: Training dataset used during QLoRA fine-tuning.finetune_review_test_5K.jsonl : Validation datase.llama-3.2-1b-instruct.Q4_K_M.gguf and Modelfile, then run:1# Register model in Ollama
2ollama create feedbackiq-agent -f Modelfile
3
4# Run inference
5"Customer Review: The bluetooth connection drops every 5 minutes on these headphones.`nContext: Category: Electronics, Sentiment: negative, Emotion: annoyance, Urgency: urgent, Department: Hardware & Product Quality, Star Rating: 2.0" | ollama run feedbackiq-agent