Views
No views yet
Q4_K_M model for fast, targeted downloading. If you need smaller or larger quantizations (such as Q3_K_M, Q5_K_M, Q6_K, or Q8_0), please visit the main repository here:
👉 Abiray/Huihui-Qwen3.6-27B-abliterated-GGUFllama-cli commands. Since the model is abliterated, you do not need to wrap prompts in heavy system instructions.1# Basic inference
2./llama-cli -m qwen3.6-27b-abliterated-Q4_K_M.gguf -p "Your prompt here" -n 512 -c 4096
3
4# Interactive conversation mode
5./llama-cli -m qwen3.6-27b-abliterated-Q4_K_M.gguf -i -cnv -c 8192