Qwen3.8-27B-Uncensored-MLX

An abliterated (refusal-removed) MLX build of Qwen's Qwen3.8-27B — 2 / 4 / 6 / 8-bit for Apple Silicon

One Gateway. Every Model. — Route Smarter · Ship Safer · Spend Less.

Website · Model Catalog · Model API · GitHub · Discord · X

An abliterated (refusal-removed) build of Qwen/Qwen3.8-27B — a 27B-parameter dense, hybrid-attention (Gated DeltaNet linear + full attention) native vision-language model with thinking control, tool-calling and an MTP head — quantized to MLX format for Apple Silicon. Four precisions are provided — 2 / 4 / 6 / 8-bit (affine, group size 64) — each as a subfolder, with the 4-bit build also mirrored at the repo root so that orcarouter/Qwen3.8-27B-Uncensored-MLX loads directly in LM Studio and other tools that treat a repo as a single model. The vision tower, norms and conv layers are kept in BF16; only the language-model linear weights (including embed_tokens / lm_head) are quantized. Browse all models in the OrcaRouter Model Catalog. This model is deployed as API here.

⚠️ Disclaimer & risks — read before use

• It will comply with harmful, unethical, offensive, or illegal requests that the original Qwen3.8-27B would refuse. It has no meaningful built-in guardrails.
• It is released strictly for legitimate research — interpretability, AI-safety and refusal-mechanism study, red-teaming, robustness evaluation, and controlled experiments.
• You assume full responsibility and liability for how you use it and for everything it generates. Add your own safety, moderation and abuse-prevention layers before any deployment.
• Use must comply with the Apache 2.0 License inherited from the base model, and all laws and regulations that apply to you.
• The authors and uploaders accept no liability for any misuse or harm. Outputs do not reflect the views of the uploaders or of Qwen / Alibaba.

Specific risks

• Harmful content on demand — it will produce instructions for malware, exploits, weapons, fraud and other illegal or dangerous activity when asked.
• No refusals — jailbreak / safety probes "succeed" trivially; do not mistake this for a passing safety evaluation.
• Confident falsehoods & bias — it can generate false, defamatory, biased or offensive text and present it authoritatively.
• Expanded attack surface — preserved vision, tool-calling and 262K context mean these risks extend to image understanding and autonomous / agentic use.
• Quantization noise — lower-bit builds (esp. 2-bit) add instability on top of the above; outputs can be degraded or nonsensical.

Intended use vs out of scope

• Intended: AI-safety and interpretability research, refusal-mechanism study, red-teaming, guardrail and robustness evaluation, controlled academic experiments.
• Out of scope: any deployment to end users, minors, or production without your own moderation / safety layer; any unlawful, harmful, or rights-infringing use.

Available quantizations

2-bit warning: at 27B, 2-bit quantization collapses generation quality (repetition loops, garbled output). It is included only as an extreme-compression archive; do not use it for real work — prefer 4-bit or higher.

Repo root = 4-bit/. The root of this repo holds a copy of the 4-bit build, so --model orcarouter/Qwen3.8-27B-Uncensored-MLX (no subfolder) resolves to 4-bit. Use the subfolder paths to pick any other precision.

Verification & test results

• Uncensored preserved: red-team probes (exploit walkthrough, controversial argument) return substantive content with zero refusals on 4 / 6 / 8-bit.
• Multimodal preserved: shapes, colors, position, background and text in a probe image are described correctly on 4 / 6 / 8-bit.
• Speed: ~32–37 tok/s steady-state on a single H200 (MLX CUDA backend). MLX's native target is Apple Silicon (Metal).

Note: on 6-bit, mlx's offline mx.dequantize mis-unpacks these weights (a library edge case), so correctness is verified by clean generation — inference is unaffected.

Usage (mlx-vlm, Apple Silicon)

Usage (LM Studio)

1. This repo is gated. LM Studio downloads anonymously by default and will get an HTTP 401. Accept the terms on the model page once, then paste a Hugging Face read token into LM Studio under Settings → Integrations → Hugging Face.
2. Turn off KV cache quantization. MLX vision models do not support it on this architecture, and loading fails during initialization if it is enabled (mlx-engine#286).
3. Pick a quant that fits. 8-bit is ~29.5 GB on disk and wants a 64 GB Mac; 6-bit suits 48 GB; 4-bit (~16 GB) is the right choice on a 32 GB Mac. LM Studio's "Likely too large" badge is a RAM warning, not an error.

Model details