Views
No views yet
| Model | File size | MMLU | JMMLU | HELLASWAG | ARC_CHALLENGE | GSM8K |
|---|---|---|---|---|---|---|
| MLX-Qwen3.5-4B-Neo-4bit | 2.22 GB | 43.0% | 18.0% | 13.3% | 50.0% | 86.7% |
| Qwen3.5-4B-Neo-oQ4 | 2.32 GB | 39.3% | 17.7% | 13.3% | 40.0% | 83.3% |
| Qwen3.5-4B-oQ4 | 2.94 GB | 67.3% | 62.7% | 80.0% | 83.3% | 86.7% |
| Model | Benchmark | Accuracy | Correct | Total | Time(s) |
|---|---|---|---|---|---|
| MLX-Qwen3.5-4B-Neo-4bit | MMLU | 43.0% | 129 | 300 | 942.6 |
| Qwen3.5-4B-Neo-oQ4 | MMLU | 39.3% | 118 | 300 | 944.1 |
| MLX-Qwen3.5-4B-Neo-4bit | JMMLU | 18.0% | 54 | 300 | 564.3 |
| Qwen3.5-4B-Neo-oQ4 | JMMLU | 17.7% | 53 | 300 | 574.9 |
| MLX-Qwen3.5-4B-Neo-4bit | HELLASWAG | 13.3% | 4 | 30 | 64.2 |
| Qwen3.5-4B-Neo-oQ4 | HELLASWAG | 13.3% | 4 | 30 | 64.5 |
| Qwen3.5-4B-oQ4 | HELLASWAG | 80.0% | 24 | 30 | 14.4 |
| MLX-Qwen3.5-4B-Neo-4bit | ARC_CHALLENGE | 50.0% | 15 | 30 | 55.6 |
| Qwen3.5-4B-Neo-oQ4 | ARC_CHALLENGE | 40.0% | 12 | 30 | 56.6 |
| Qwen3.5-4B-oQ4 | ARC_CHALLENGE | 83.3% | 25 | 30 | 7.7 |