Views
No views yet
1llama-server -c 131072 \
2 -ngl 999 \
3 -m gemma-4-26B-A4B-it-abliterated-Q4_K_M.gguf \
4 -ctk turbo4 \
5 -ctv turbo3 \
6 -ub 2048-ctk turbo4 -ctv turbo3 enables asymmetric KV cache quantization — halves KV VRAM with near-zero perplexity impact.FROM DuoNeural/gemma-4-26B-A4B-it-abliterated-GGUF
PARAMETER num_ctx 32768
PARAMETER temperature 0.7
PARAMETER top_p 0.9-ctk turbo4 -ctv turbo3, reduced context| 🤗 HuggingFace | huggingface.co/DuoNeural |
| 🐙 GitHub | github.com/DuoNeural |
| 🐦 X / Twitter | @DuoNeural |
| duoneural@proton.me | |
| 📬 Newsletter | duoneural.beehiiv.com |
| ☕ Support | buymeacoffee.com/duoneural |
| 🌐 Site | duoneural.com |