mlfoundations-dev/

a1_code_reflection_eval_636d

Precomputed model outputs for evaluation.

	Evaluation Results




	
	Summary




	

Metric AIME24 AMC23 MATH500 LiveCodeBench CodeElo CodeForces GPQADiamond JEEBench MMLUPro

Accuracy 13.3 52.8 70.6 27.9 7.2 9.4 35.2 35.3 26.0

Average Accuracy: 13.33% ± 1.25% Number of Runs: 10

Run Accuracy Questions Solved Total Questions

1 16.67% 5 30

2 16.67% 5 30

3 16.67% 5 30

4 13.33% 4 30… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations-dev/a1_code_reflection_eval_636d.