Qwen2.5-VL-7B-Instruct-Ablit (Abliterated Qwen-Image-2512 Text-Encoder)

Abliterated Qwen2.5-VL-7B-Instruct — full-precision BF16 safetensors. This is a vision-language model with refusal directions removed, enabling uncensored text generation while preserving multimodal capabilities. Image Generation Use Case: Qwen2.5-VL-7B-Instruct is the text encoder for Qwen-Image-2512. This abliterated version provides a drop-in replacement for uncensored image generation workflows in ComfyUI and other diffusion tooling.

Usage

Abliteration Method

Heretic-Style Single Direction

1. Direction computation — A single refusal direction is computed per layer using hidden states from the final token in the residual stream.
   • Harmful prompts: A curated set of text-only harmful requests
   • Harmless prompts: A matching set of benign requests
   Each prompt was run through the base model and the hidden states at the final token were captured per layer. Every response was then classified by refusal type (hard / redirect / none), and each classification was reviewed for accuracy before the activations fed into the direction computation.
2. Single merged direction — Rather than maintaining separate per-category directions, the refusal direction is computed as the normalized difference between the mean of all refusal activations (hard + redirect) and the mean of all non-refusal activations (none).
   python

   1refusal_mean = mean(hard_states + redirect_states) 2complied_mean = mean(none_states) 3direction = normalize(refusal_mean - complied_mean)
3. Weight orthogonalization — The refusal direction is ablated from the model weights using orthogonal projection:
   • For attention/MLP projection weights: W' = W - factor * (direction ⊗ (direction^T @ W))
   • For lm_head: W' = W - factor * ((W @ direction) ⊗ direction^T)
   The ablation is applied to every decoder layer (1–27) and the lm_head at a uniform factor across all layers.

Why Single Direction for VL Models?

• Simplicity — Vision-language models have more complex architectures; a single direction reduces the ablation surface area and potential interactions with the vision tower.
• Text-only abliteration — Refusal primarily manifests in the text decoder; the vision encoder is unaffected.
• Sufficient for VL use cases — The single-direction approach has proven effective for text models, and VL refusal patterns follow similar geometry.

Notes & Limitations

• Abliteration is not alignment removal or capability addition. It suppresses the refusal direction; it does not add knowledge or skills the base model lacks, and it can occasionally weaken instruction-following near the edited layers.
• Vision capabilities preserved — The vision tower is unchanged; image understanding and multimodal reasoning remain intact.
• Responsibility: Removing refusals shifts the safety burden entirely onto the deployer. Use within your own policy.

Attribution

• Base weights: Qwen team (Qwen/Qwen2.5-VL-7B-Instruct).
• Refusal-direction abliteration builds on the "refusal is mediated by a direction" line of interpretability work.
• Heretic-style single-direction method: adapted for VL from classic abliteration techniques.
• AblitVL implementation: eric-merritt (adaptation of ablitMD for vision-language models).