CRACK-abliterated Ornith 1.5 9B — GGUF quants for llama.cpp. Four quantizations
(Q8_0 / Q6_K / Q4_K_M / Q2_K) in one repository. Refusal behavior removed while preserving
the model's knowledge, reasoning ("thinking"), and full Vision-Language capability.
Ornith 1.5 is a hybrid GatedDeltaNet (SSM) + attention architecture; CRACK uses
architecture-aware weight surgery targeting the attention pathways, so knowledge and
coherence are retained (MMLU within ±3% of base at every quant).
Research artifact with reduced safety guardrails. Use responsibly and lawfully.
Quantizations
File
Size
Notes
Ornith-1.5-9B-CRACK-Q8_0.gguf
8.9 GB
near-lossless reference
Ornith-1.5-9B-CRACK-Q6_K.gguf
7.4 GB
near-lossless
Ornith-1.5-9B-CRACK-Q5_K_M.gguf
6.5 GB
high quality
Ornith-1.5-9B-CRACK-Q4_K_M.gguf
5.6 GB
balanced (recommended)
Ornith-1.5-9B-CRACK-Q3_K_M.gguf
4.6 GB
small
Ornith-1.5-9B-CRACK-Q2_K.gguf
3.6 GB
smallest
Pick one text file plus the vision projector mmproj-Ornith-1.5-9B-f16.gguf for image
input. Each quant is independently tuned (its own surgery strength) and verified — there
is no single strength shared across quants. Sub-8-bit quants use an AWQ (activation-aware)
pass plus an importance matrix for maximum quality.
Benchmarks
Evaluated through llama.cpp. MMLU is logit-mode accuracy (base vs. CRACK at the same
quant — isolates knowledge retention from quantization). HarmBench is coherence-gated
attack-success-rate over the 240 standard/contextual harm behaviors (copyright behaviors
excluded from the safety gate).
Quant
MMLU (base)
MMLU (CRACK)
ΔMMLU
HarmBench harm-ASR
Q8_0
78.1%
77.5%
-0.53 pp
99.6%
Q6_K
76.5%
76.5%
+0.00 pp
99.6%
Q5_K_M
76.5%
76.5%
+0.00 pp
99.2%
Q4_K_M
78.3%
76.5%
-1.76 pp
99.6%
Q3_K_M
73.3%
74.4%
+1.06 pp
99.2%
Q2_K
50.5%
50.5%
+0.00 pp
99.2%
MMLU is retained within ±3 pp of base at every quant. (Q2_K's absolute MMLU is lower because
2-bit quantization alone costs ~27 pp on a 9B — the surgery adds no further loss.)
Ornith 1.5 emits a <think> reasoning trace and it is ON by default. To disable it, pass
{"chat_template_kwargs": {"enable_thinking": false}} to the chat endpoint. Works out of the
box in LM Studio.
Vision (image + text)
This is a multimodal model. Download a text quant andmmproj-Ornith-1.5-9B-f16.gguf:
bash
1llama-mtmd-cli -m Ornith-1.5-9B-CRACK-Q4_K_M.gguf \2 --mmproj mmproj-Ornith-1.5-9B-f16.gguf --jinja \3 --image photo.jpg -p "Describe this image."4# or serve with vision:5llama-server -m Ornith-1.5-9B-CRACK-Q4_K_M.gguf \6 --mmproj mmproj-Ornith-1.5-9B-f16.gguf --jinja -c 8192
The same mmproj works with all four text quants.
License
MIT (inherited from the upstream Ornith 1.5 base model).