A 4-bit MLX quantization of
Li101/Qwen3.5-35B-A3B-Uncensored-Aggressive-safetensors, converted for fast local inference on Apple Silicon.
This is a 35B-parameter A3B Mixture-of-Experts model (~3B active parameters per token), which makes it run considerably faster than a dense 35B while keeping a large effective capacity.
1mlx_lm.convert \
2 --hf-path Li101/Qwen3.5-35B-A3B-Uncensored-Aggressive-safetensors \
3 --mlx-path Qwen3.5-35B-A3B-Uncensored-Aggressive-mlx-4bit \
4 -q --q-bits 4 --q-group-size 64
Tested on MacBook Pro M3 36GB (shows 39 GB usable memory) served via
oMLX with an 8-bit KV cache and a 64K context window.
Apache-2.0, inherited from the base model. Credit to Li101 for the original fine-tune.