Views
No views yet
| Property | Value |
|---|---|
| Method | 5-bit (5.501 bits per weight) |
| Tool | mlx-lm 0.31.1 via mlx-lm.convert |
| Size | ~18.5GB |
Tested on Apple M1 Max, 32GB · macOS 15.7.5 · avg of 5 runs ~20k tokens generated each
| Metric | Engine | Model load time | Generation speed |
|---|---|---|---|
| MLX 5bit | mlx-lm 0.31.1 | 2.47 seconds | 12.43 tokens/sec |
| GGUF Q4_K_M | llama.cpp 2.8.0 | 1.23 seconds | 8.73 tokens/sec |
1mlx_lm.convert \
2 --hf-path Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2 \
3 --mlx-path ./output \
4 --q \
5 --q-bits 5