Views
No views yet
| File | Quant | Size / RAM | Description |
|---|---|---|---|
Ornith-1.5-35B-A3B-abliterated-Q4_K_M.gguf | Q4_K_M | Recommended | Best balance between memory usage, speed, and quality. |
Ornith-1.5-35B-A3B-abliterated-Q5_K_M.gguf | Q5_K_M | Medium-High | Higher quality, minimal perplexity degradation. |
Ornith-1.5-35B-A3B-abliterated-Q6_K.gguf | Q6_K | High | Near-lossless output quality. |
Ornith-1.5-35B-A3B-abliterated-Q8_0.gguf | Q8_0 | Very High | Full 8-bit precision, closest to 16-bit original. |
1llama-cli \
2 -m Ornith-1.5-35B-A3B-abliterated-Q4_K_M.gguf \
3 -p "You are a helpful assistant." \
4 -c 32768 \
5 -ngl 99 \
6 --temp 0.7NjProVk/Ornith-1.5-35B-A3B-abliterated-GGUF0.6 – 0.8 (Lower for coding/logic, higher for creative roleplay/writing)0.9 – 0.950.05