NousResearch/

eval-DeepSeek-V3-0324

	dsv3 Evaluation Results




	
	Summary




	

Benchmark Score Metric Samples Overlong rate

aime24 0.506 math_pass@1:64_samples 64 100.0%

aime25 0.422 math_pass@1:64_samples 64 100.0%

arenahard 0.926 eval/overall_winrate 500 0.0%

bbh_generative 0.868 extractive_match 1 100.0%

creative-writing-v3 0.767 creative_writing_score 96 0.0%

drop_generative_nous 0.829 drop_acc 1 100.0%

eqbench3 0.831 eqbench_score 135 0.0%

gpqa_diamond 0.680 gpqa_pass@1:8_samples8 100.0%… See the full description on the dataset page: https://huggingface.co/datasets/NousResearch/eval-DeepSeek-V3-0324.