mlfoundations-dev/

nemo_nano_math_10k_eval_2e29

Precomputed model outputs for evaluation.

	Evaluation Results




	
	Summary




	

Metric AIME24 AMC23 MATH500 MMLUPro JEEBench GPQADiamond LiveCodeBench CodeElo CodeForces AIME25 HLE LiveCodeBenchv5

Accuracy 9.3 45.8 63.2 24.0 24.2 31.0 2.7 0.3 0.1 9.7 0.0 0.4

Average Accuracy: 9.33% ± 1.87% Number of Runs: 10

Run Accuracy Questions Solved Total Questions

1 3.33% 1 30

2 6.67%… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations-dev/nemo_nano_math_10k_eval_2e29.