mlfoundations-dev/

a1_math_openmathinstruct2_eval_1331

Precomputed model outputs for evaluation.

	Evaluation Results




	
	Summary




	

Metric AIME24 AMC23 MATH500 MMLUPro JEEBench GPQADiamond LiveCodeBench CodeElo

Accuracy 22.0 64.2 79.4 28.2 43.4 37.7 17.7 2.9

Average Accuracy: 22.00% ± 1.17% Number of Runs: 10

Run Accuracy Questions Solved Total Questions

1 23.33% 7 30

2 26.67% 8 30

3 20.00% 6 30

4 16.67% 5 30

5… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations-dev/a1_math_openmathinstruct2_eval_1331.