A 4-bit MLX quantization of
null-space/gemma-4-31b-it-abliterated, tuned for fast on-device inference on Apple Silicon.
The default model in
nicedreamzapp/claude-code-local used to point at a
mlx-community/... repo that never actually existed. This is the real, working 4-bit quant — drop-in replacement.
1from mlx_lm import load, generate
2
3model, tokenizer = load("divinetribe/gemma-4-31b-it-abliterated-4bit-mlx")
4print(generate(model, tokenizer, prompt="Hello", max_tokens=200))
1MLX_MODEL=divinetribe/gemma-4-31b-it-abliterated-4bit-mlx \
2 bash scripts/start-mlx-server.sh
Refusal-direction projection per Arditi et al. (2024). Use responsibly — you are now the moderator.
This model was built by
Matt Macosko (
@nicedreamzapp) for the
claude-code-local stack — run Claude Code 100% on-device with local AI on Apple Silicon (⭐ 2,664 on GitHub).
Part of the
Abliterated MLX for Apple Silicon
collection — 11 uncensored models converted for Macs, from Gemma 4 12B up to
Llama 3.3 70B, plus Qwen3, Qwen3-VL, Hermes 4 and Muse Glimmer 30B.
This model is one of the fighters in
Claude Code Local (3.2k★), which runs Claude Code 100% on-device on Apple Silicon through an MLX-native Anthropic-API server. Not sure which local model to run as an agent? Check the
Agent-12 local agent leaderboard: real agent tasks, judged by the filesystem, same hardware for every row.
Built by
Matt Macosko in Arcata, CA. Open to work on local-AI and Apple Silicon inference:
matt@ineedhemp.com.
