You can deploy this model and start earning money today!

knoveleng/
Qwen3.5-4B-Uncensored

Name: Qwen3.5-4B-Uncensored
Availability: InStock

Views

No views yet

Qwen/Qwen3.5-4B (abliterated)

This model is a weight-level orthogonalized ("abliterated") version of Qwen/Qwen3.5-4B, produced with orthex — an implementation of the technique from Arditi et al., "Refusal in Language Models Is Mediated by a Single Direction" (NeurIPS 2024).

What was done

Architecture adapter: qwen3_5
Selected candidate: layer 31, site resid_pre
Ablation targets: embed_tokens, and every layer's attn_out and mlp_out — orthogonalized in place in the weights (not a runtime hook; this checkpoint behaves this way standalone, with no orthex dependency at inference time)

Evaluation

metric	pre	post	delta
refusal rate	0.969	0.000	-0.969
perplexity	11.211	11.248	0.037

See evaluation_report.json in this repo for the full per-prompt breakdown (refusal_samples) and the ranked candidate list considered during selection (selection_report).

Responsible use

This model has had refusal behavior removed and may comply with requests the base model would normally decline. It is intended for red-teaming, robustness research, and model-behavior analysis. Usage remains subject to the base model's original license and usage policy — this repo does not grant any additional rights beyond what Qwen/Qwen3.5-4B's license allows.

License

Not set automatically — inherits obligations from the base model Qwen/Qwen3.5-4B's license; set this field explicitly before publishing.

knoveleng/Qwen3.5-4B-Uncensored