Views
No views yet
| Field | Value |
|---|---|
| Method | OptiQ mixed-precision MLX |
| Target BPW | 4 |
| Achieved BPW | 4.07 |
| Candidate bits | 4, 8 |
| Group size | 64 |
| Calibration | optiq (24 samples) |
| Model size | 18.17 GiB |
| Layer allocation | 14 high-bit / 377 low-bit |
| Layer policy entries | 391 |
1huggingface-cli download dawncr0w/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-4bit-MLX --local-dir Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-4bit-MLX
2python -m mlx_lm.generate --model Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-4bit-MLX --prompt "Write a short greeting."