mlfoundations-dev/

a1_code_primeintellect_stack_exchange_1744623234_eval_1331

Precomputed model outputs for evaluation.

	Evaluation Results




	
	Summary




	

Metric AIME24 AMC23 MATH500 GPQADiamond JEEBench MMLUPro LiveCodeBench CodeElo

Accuracy 14.0 53.2 76.0 33.2 30.4 25.8 8.9 3.0

Average Accuracy: 14.00% ± 1.48% Number of Runs: 10

Run Accuracy Questions Solved Total Questions

1 13.33% 4 30

2 10.00% 3 30

3 16.67% 5 30… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations-dev/a1_code_primeintellect_stack_exchange_1744623234_eval_1331.