Views
No views yet
--export-strategy=ADAPTER, then the LoRA was merged into the base weights.harmful_behaviors. The model is less censorious but still refuses many requests — Qwen 3.6's four PEFT-adapters distribute refusal patterns across multiple subspaces, so a single direction was hard to find.| File | Quant | Size | Notes |
|---|---|---|---|
VeriLoop-Coder-E1-Abliterated-Q8_0.gguf | Q8_0 | 26.6 GB | Reference (no imatrix needed) |
abl_iq4_nl.gguf | IQ4_NL | 14.7 GB | Best quality/size balance |
abl_iq4_xs.gguf | IQ4_XS | 14.1 GB | Faster, slightly lower quality |
abl_iq3_xxs.gguf | IQ3_XXS | 10.4 GB | Good for 12-16 GB VRAM |
abl_iq2_xxs.gguf | IQ2_XXS | 7.9 GB | Fits 8 GB VRAM, quality drops |
imatrix.dat | — | 10 MB | Importance matrix used for IQ quants |
imatrix.dat (code-focused calibration dataset).1llama-cli -m abl_iq4_nl.gguf -p "def fib(n):" -n 64
2# or with a server:
3llama-server -m abl_iq4_nl.gguf -c 8192 --port 8080imatrix.dat can be re-applied with llama-quantize --imatrix imatrix.dat if you want to re-quantize.