huggingface-cli download richardyoung/Qwen3-14B-abliterated-GGUF \
    --include "*Q4_K_M*" --local-dir ./models

./llama-cli -m ./models/*Q4_K_M*.gguf \
    -p "You are a helpful assistant." \
    --chat-template chatml -ngl 99

With Python (llama-cpp-python)

python

from llama_cpp import Llama

llm = Llama.from_pretrained(
    repo_id="richardyoung/Qwen3-14B-abliterated-GGUF",
    filename="*Q4_K_M*",
    n_gpu_layers=-1,
)

output = llm.create_chat_completion(
    messages=[{"role": "user", "content": "Explain abliteration in simple terms."}]
)
print(output["choices"][0]["message"]["content"])

Available Quantizations

Quantization	Use Case
Q4_K_M	Recommended — good balance
Q5_K_M	Higher quality
Q8_0	Maximum quality

What is Abliteration?

Abliteration removes the "refusal direction" from a model's residual stream — a surgical modification that disables safety refusals without retraining. See Refusal in Language Models Is Mediated by a Single Direction.

Intended Use

Research, creative writing, education on alignment techniques, and unrestricted local inference.

Other Models by richardyoung

Abliterated/Uncensored models: Qwen2.5-7B | Qwen3-14B | DeepSeek-R1-32B | Qwen3-8B
MLX quantizations (Apple Silicon): Kimi-K2 series | olmOCR MLX
OCR & Vision: olmOCR GGUF
Healthcare/Medical: Synthea 575K patients dataset | CardioEmbed
Research: LLM Instruction-Following Evaluation (arxiv:2510.18892)