mlfoundations-dev/

a1_science_pubmed_science_1744691443_eval_1331

Precomputed model outputs for evaluation.

	Evaluation Results




	
	Summary




	

Metric AIME24 AMC23 MATH500 GPQADiamond JEEBench MMLUPro LiveCodeBench CodeElo

Accuracy 8.3 44.5 68.0 18.9 31.3 24.6 10.7 4.4

Average Accuracy: 8.33% ± 1.27% Number of Runs: 10

Run Accuracy Questions Solved Total Questions

1 6.67% 2 30

2 3.33% 1 30

3 6.67% 2 30

4 10.00% 3 30… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations-dev/a1_science_pubmed_science_1744691443_eval_1331.