Views
No views yet
| Metric | This Model | Original Model |
|---|---|---|
| KL divergence | 0.0182 | 0 (by definition) |
| Refusals | 0/108 | 97/108 |
| Quant | Filename | PPL ± Error |
|---|---|---|
| Q8_0 | Magistral-Small-2509-Q8_0.gguf (original baseline) | 4.7603 +/- 0.02610 |
| Q8_0 | Magistral-Small-2509-Heretic-v1.2-Q8_0.gguf | 4.7682 +/- 0.02613 |
| Q4_K_M | Magistral-Small-2509-Heretic-v1.2-Q4_K_M.gguf | 4.8542 +/- 0.02673 |
| Benchmark | Magistral-Small-2509-Q8_0.gguf | Magistral-Small-2509-Q4_K_M.gguf | Magistral-Small-2509-Heretic-v1.2-Q4_K_M.gguf |
|---|---|---|---|
| Perplexity (Wikitext-2) | 4.7603 | 4.8370 | 4.8542 |
| HellaSwag | 82.50% | 82.50% | 82.50% |
| Winogrande | 78.77% | 78.37% | 78.93% |
| ARC-Challenge | 56.86% | 58.86% | 57.19% |
| MMLU | 43.28% | 42.96% | 42.96% |