Views
No views yet
| Benchmark | Measure | 160M MiniPile | 160M Pile Deduplicated | |
|---|---|---|---|---|
| ARC-Challenge | acc | ↑ | 0.2125 ± 0.0120 | 0.1997 ± 0.0117 |
| MMLU | acc | ↑ | 0.2699 ± 0.0037 | 0.2299 ± 0.0035 |
| HellaSwag | acc | ↑ | 0.2560 ± 0.0044 | 0.2903 ± 0.0045 |
| WinoGrande | acc | ↑ | 0.4720 ± 0.0140 | 0.4964 ± 0.0141 |
| Lambada (OpenAI) | acc | ↑ | 0.0000 ± 0.0000 | 0.3689 ± 0.0067 |
| Lambada (OpenAI) | perplexity | ↓ | 3033175.2693 ± 288926.5827 | 31.2589 ± 1.1594 |
| Lambada (Std) | acc | ↑ | 0.0000 ± 0.0000 | 0.2335 ± 0.0059 |
| Lambada (Std) | perplexity | ↓ | 27067951.3461 ± 2710040.1910 | 172.7619 ± 7.7265 |
| BLiMP | acc | ↑ | 0.5194 ± 0.0018 | 0.7294 ± 0.0015 |