1The qx86-hi quants of the base models
2Agent 0.603,0.817,0.838,0.743,0.426,0.780,0.708
3Eva-4B 0.539,0.747,0.864,0.606,0.412,0.751,0.605
4
5Qwen3-4B-Agent-Eva
6bf16 0.565,0.779,0.872,0.700,0.418,0.776,0.653
7qx86-hi 0.568,0.775,0.872,0.699,0.418,0.777,0.654
8
9Qwen3-4B-Thinking-2507-R32-claude-cp55
10qx86-hi 0.404,0.518,0.693,0.597,0.366,0.725,0.606
11qx64-hi 0.392,0.507,0.743,0.592,0.366,0.727,0.608
12mxfp4 0.400,0.525,0.758,0.579,0.374,0.730,0.582
13
14Qwen3-4B-Thinking-16bit-2507-R32-claude-cp55
15qx86-hi 0.401,0.524,0.669,0.589,0.374,0.728,0.580
16qx64-hi 0.400,0.509,0.712,0.585,0.376,0.726,0.582
17mxfp4 0.394,0.521,0.718,0.573,0.366,0.719,0.569
18
19Qwen3-4B-Thinking2-Claude
20qx86-hi 0.468,0.619,0.741,0.629,0.400,0.750,0.632
21qx64-hi 0.474,0.607,0.764,0.626,0.416,0.749,0.630
22mxfp4 0.429,0.502,0.781,0.606,0.374,0.736,0.626
23
24Qwen3-4B-Element16
25qx86-hi 0.550,0.756,0.869,0.685,0.408,0.773,0.647
26qx64-hi 0.553,0.758,0.860,0.672,0.412,0.771,0.648
27mxfp4 0.515,0.739,0.850,0.663,0.424,0.768,0.651
28
29Qwen3-4B-Element18
30qx86-hi 0.532,0.738,0.864,0.681,0.414,0.767,0.646
31qx64-hi 0.530,0.744,0.854,0.667,0.410,0.763,0.642
32mxfp4 0.517,0.743,0.846,0.670,0.400,0.760,0.640
33
34Perplexity
35qx86-hi 4.495 ± 0.028
36qx64-hi 4.599 ± 0.028
37mxfp4 4.895 ± 0.031