Abliteration is a mechanistic interpretability technique that identifies and orthogonalizes the "refusal direction" in a model's activation space, surgically removing refusal behavior without full fine-tuning.

Abliteration Parameters

Parameter	Value
Base model	`./models/gemma-4-31b-it-8bit`
Ablation method	`projection`
Refusal vector policy	`per-layer`
Refusal direction method	`projected`
Ablation strength	`2.0`
Probed layers	`5,11,17,23,29,35,41,47,53,59`
PCA components (ablate-k)	`1`
Attention only	`True`
Excluded modules	`none`
Timestamp	2026-04-04T23:12:19 UTC

This model uses a Mixture-of-Experts (MoE) architecture. Abliteration targets only the attention projection weights (q/k/v/o_proj) to preserve expert routing quality.

⚠️ Disclaimer

This model is intended for research, experimentation, and testing purposes only.

This model may produce harmful, offensive, inappropriate, or otherwise objectionable content.
The abliteration process removes safety guardrails that were intentionally built into the original model.
Do not use this model in production systems, consumer-facing applications, or any context where harmful outputs could cause real-world harm.
The authors and contributors of this toolkit bear no responsibility for any misuse of this model or any harm caused by outputs generated by this model.
By using this model, you agree that you are solely responsible for ensuring its use complies with all applicable laws and ethical guidelines.

This model is shared purely for academic and technical exploration of model internals.

cs2764/gemma-4-31b-it-8bit-abliterated-mlx

gemma-4-31b-it-8bit-abliterated

Base Model

What is Abliteration?

Abliteration Parameters

⚠️ Disclaimer

cs2764/
gemma-4-31b-it-8bit-abliterated-mlx