mlfoundations-dev/

a1_science_fineweb_1744691386_eval_1331

Precomputed model outputs for evaluation.

	Evaluation Results




	
	Summary




	

Metric AIME24 AMC23 MATH500 GPQADiamond JEEBench MMLUPro LiveCodeBench CodeElo

Accuracy 16.3 53.0 76.2 39.2 35.3 28.8 17.2 2.9

Average Accuracy: 16.33% ± 1.20% Number of Runs: 10

Run Accuracy Questions Solved Total Questions

1 20.00% 6 30

2 16.67% 5 30

3 23.33% 7 30

4 10.00% 3 30

5… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations-dev/a1_science_fineweb_1744691386_eval_1331.