Views
No views yet
| Quant | Size | Mixture | PPL | 1-(Mean PPL(Q)/PPL(base)) | KLD |
|---|---|---|---|---|---|
| Q8_0 | 306.66 GiB (8.50 BPW) | Unknown / TBD | 5.134769 ± 0.030261 | +0.1230% | 0.012010 ± 0.000150 |
| Q5_K_M | 213.39 GiB (5.92 BPW) | Q8_0 / Q5_K / Q5_K / Q6_K | 5.147654 ± 0.030377 | +0.3743% | 0.014752 ± 0.000240 |
| Q4_K_M | 177.68 GiB (4.93 BPW) | Q8_0 / Q4_K / Q4_K / Q5_K | 5.202785 ± 0.030828 | +1.4493% | 0.020631 ± 0.000251 |
| IQ4_XS | 137.75 GiB (3.82 BPW) | Q8_0 / IQ3_S / IQ3_S / IQ4_XS | 5.272594 ± 0.031193 | +2.8105% | 0.041508 ± 0.000343 |
| IQ3_S | 106.31 GiB (2.95 BPW) | Q6_K / IQ2_S / IQ2_S / IQ3_S | 5.545001 ± 0.033188 | +8.1221% | 0.092415 ± 0.000600 |