NousResearch/

eval-Cogito-v2-preview-70B-reasoning

	cogito-thinking Evaluation Results




	
	Summary




	

Benchmark Score Metric Samples Overlong rate

aime24 0.322 math_pass@1:64_samples 64 35.2%

aime25 0.221 math_pass@1:64_samples 64 33.3%

arenahard 0.869 eval/overall_winrate 500 0.0%

bbh_generative 0.893 extractive_match 1 2.9%

creative-writing-v3 0.636 creative_writing_score 96 0.0%

drop_generative_nous 0.860 drop_acc 1 0.8%

eqbench3 0.657 eqbench_score 135 0.0%

gpqa_diamond 0.591 gpqa_pass@1:8_samples8… See the full description on the dataset page: https://huggingface.co/datasets/NousResearch/eval-Cogito-v2-preview-70B-reasoning.