Views
No views yet
| Field | Value |
|---|---|
| Method | OptiQ mixed-precision MLX |
| Target BPW | 6 |
| Achieved BPW | 6.12 |
| Candidate bits | 4, 8 |
| Group size | 64 |
| Calibration | optiq (24 samples) |
| Model size | 18.64 GiB |
| Layer allocation | 163 high-bit / 228 low-bit |
| Layer policy entries | 391 |
1huggingface-cli download dawncr0w/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-6bpw-MLX --local-dir Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-6bpw-MLX
2python -m mlx_lm.generate --model Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-6bpw-MLX --prompt "Write a short greeting."