Views
No views yet
| Variant | Repo | Disk | ~Min unified RAM | Role |
|---|---|---|---|---|
| MLX bf16 | Qwopus3.6-35B-A3B-v1-MLX-bf16 | 69.3 GB | ~72 GB | Reference |
| MLX 8bit | Qwopus3.6-35B-A3B-v1-MLX-8bit | 36.8 GB | ~40 GB | Near-lossless |
| MLX 6bit | Qwopus3.6-35B-A3B-v1-MLX-6bit | 28.2 GB | ~32 GB | Quality / size middle |
| MLX 4bit (this repo) | this | 19.5 GB | ~22 GB | Standard daily-use tier |
| MLX 3bit | Qwopus3.6-35B-A3B-v1-MLX-3bit | 15.2 GB | ~18 GB | Smallest practical |
1pip install mlx-lm
2mlx_lm.generate --model zaydiscold/Qwopus3.6-35B-A3B-v1-MLX-4bit \
3 --prompt "Explain quantum entanglement in one paragraph" --max-tokens 2001python -m mlx_lm convert \
2 --hf-path Jackrong/Qwopus3.6-35B-A3B-v1 \
3 --mlx-path ./Qwopus3.6-35B-A3B-v1-MLX-4bit \
4 -q --q-bits 4Q4_K_M is a llama.cpp format. MLX has no literal Q4_K_M — MLX 4-bit is the practical peer at a different quantizer.