Views
No views yet
mlx_lm — the canonical MLX
runtime for qwen3_next — and smoke-verified (chat + code probes) on Apple Silicon
with this exact payload before publishing. See PROVENANCE.md.| Property | Value |
|---|---|
| Base Model | Qwen/Qwen3-Coder-Next |
| Parameters | 80 billion total (~3 billion active per token) |
| Architecture | MoE, hybrid Gated DeltaNet + Gated Attention (qwen3_next) |
| Modality | Text-only (code-focused) |
| Context Length | 256k tokens |
| License | Apache 2.0 |
| Weight Quantization | 6-bit affine, group size 64 (~65 GB) |
| Framework | MLX (Apple Silicon), mlx-lm >= 0.31 |
1from mlx_lm import load, generate
2
3model, tokenizer = load("majentik/Qwen3-Coder-Next-MLX-6bit")
4
5prompt = tokenizer.apply_chat_template(
6 [{"role": "user", "content": "Write a Python function that merges two sorted lists."}],
7 add_generation_prompt=True, tokenize=False,
8)
9print(generate(model, tokenizer, prompt=prompt, max_tokens=512))mlx_lm.generate --model majentik/Qwen3-Coder-Next-MLX-6bit --prompt "Refactor this function ..."| Variant | Approx size | Use case |
|---|---|---|
| 2bit | ~25 GB | Smallest; quality floor |
| 3bit | ~35 GB | Low-RAM Macs |
| 4bit | ~45 GB | Balanced default |
| 5bit | ~55 GB | Higher fidelity |
| 6bit(https://huggingface.co/majentik/Qwen3-Coder-Next-MLX-6bit) | ~65 GB | Near-8bit quality |
| 8bit | ~84 GB | Reference fidelity |