mlfoundations-dev/

OpenThinker-7B_1744669112_eval_1331

Precomputed model outputs for evaluation.

	Evaluation Results




	
	Summary




	

Metric AIME24 AMC23 MATH500 MMLUPro JEEBench GPQADiamond LiveCodeBench CodeElo

Accuracy 30.7 68.5 83.6 32.0 44.0 43.9 38.4 10.0

Average Accuracy: 30.67% ± 1.23% Number of Runs: 10

Run Accuracy Questions Solved Total Questions

1 30.00% 9 30

2 36.67% 11 30

3 26.67% 8 30

4 36.67% 11 30

5… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations-dev/OpenThinker-7B_1744669112_eval_1331.