Views
No views yet
blk.64) is present and pinned to Q8_0
in every quant so speculative decoding stays accurate (block_count = 65).llama-server --spec-type draft-mtp (MTP confirmed engaged) and scored 3-way on 50 harmful + 20 benign
(thinking OFF). Results below.| Quantization | Size | Repository |
|---|---|---|
| Q8_0 | 28 GB | Qwen3.8-27B-Heretic-Uncensored-Q8_0-GGUF |
| Q6_K | 21 GB | Qwen3.8-27B-Heretic-Uncensored-Q6_K-GGUF |
| Q5_K_M | 19 GB | Qwen3.8-27B-Heretic-Uncensored-Q5_K_M-GGUF |
| Q4_K_M | 16 GB | Qwen3.8-27B-Heretic-Uncensored-Q4_K_M-GGUF |
| IQ4_XS | 15 GB | Qwen3.8-27B-Heretic-Uncensored-IQ4_XS-GGUF |
| IQ2_M | 9.8 GB | Qwen3.8-27B-Heretic-Uncensored-IQ2_M-GGUF |
| Quant | harmful %direct | harmful %refuse | benign %refuse |
|---|---|---|---|
| Q8_0 | 84.0 | 2.0 | 0.0 |
| Q6_K | 86.0 | 2.0 | 0.0 |
| Q5_K_M | 84.0 | 4.0 | 0.0 |
| Q4_K_M | 78.0 | 2.0 | 0.0 |
| IQ4_XS | 80.0 | 4.0 | 0.0 |
| IQ2_M | 78.0 | 2.0 | 0.0 |
qwen35),
enabling MTP speculative decoding and thinking-OFF:1llama-server -m qwen3.8-27b-heretic-uncensored-Q8_0.gguf \
2 --spec-type draft-mtp -ngl 99 -c 4096enable_thinking: false in the chat template (or the equivalent flag in your
client). Ollama users can ollama create from the GGUF directly.Abliteration removes safety alignment. Use responsibly and in accordance with your local laws and the upstream Apache-2.0 license.