Views
No views yet
| Dosya | Quant | Boyut | Kalite | Önerilen |
|---|---|---|---|---|
Gemma_E4B_Kizagan_Abliterated-Q4_K_M.gguf | Q4_K_M | ~5 GB | ⭐⭐⭐⭐ | 8GB VRAM, dengeli kullanım |
Gemma_E4B_Kizagan_Abliterated-F16.gguf | F16 | ~15 GB | ⭐⭐⭐⭐⭐ | 16GB+ VRAM, maksimum kalite |
1# Q4_K_M
2llama-cli -hf canyrtcn/Gemma_E4B_Kizagan_Abliterated-GGUF:Q4_K_M \
3 --chat-template gemma
4
5# F16
6llama-cli -hf canyrtcn/Gemma_E4B_Kizagan_Abliterated-GGUF:F16 \
7 --chat-template gemmaollama create kizagan-abliterated -f ModelfileModelfile:FROM ./Gemma_E4B_Kizagan_Abliterated-Q4_K_M.gguf
PARAMETER temperature 0.3
PARAMETER top_p 0.95
PARAMETER top_k 20
PARAMETER repeat_penalty 1.05
TEMPLATE """{{ if .System }}<|turn>system
{{ .System }}<turn|>
{{ end }}<|turn>user
{{ .Prompt }}<turn|>
<|turn>model
"""| Parametre | Değer |
|---|---|
temperature | 0.3 |
top_p | 0.95 |
min_p | 0.05 |
top_k | 20 |
repeat_penalty | 1.05 |