• unsloth
• llama-3
• kubernetes
• devops
• gguf
• text-generation license: apache-2.0 language:
• en

Kubernetes Expert Llama-3.1-8B (GGUF)

🚀 Model Features

• Format: GGUF (Quantized to Q4_K_M)
• Use Case: Answering technical K8s questions, debugging pods (CrashLoopBackOff), and generating YAML configurations.
• Performance: 2x faster inference speed compared to the baseline model with significantly better domain knowledge.

📦 How to Use with Ollama

1. Download the Model Download k8s-expert-rescue.Q4_K_M.gguf from the Files tab.
2. Create a Modelfile Create a file named Modelfile with the following content:
   dockerfile

   1FROM ./k8s-expert-rescue.Q4_K_M.gguf 2 3TEMPLATE """Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request. 4 5### Instruction: 6You are a Kubernetes expert. Provide a technical solution to the following problem. 7 8### Input: 9{{ .Prompt }} 10 11### Response: 12""" 13 14PARAMETER temperature 0.6 15PARAMETER num_ctx 4096 16PARAMETER stop "<|end_of_text|>" 17PARAMETER stop "### Instruction:" 18PARAMETER stop "### Input:"