NousResearch/

eval-Cogito-v2-preview-70B-nonreasoning

	cogito-70b-nonthinking Evaluation Results




	
	Summary




	

Benchmark Score Metric Samples Overlong rate

aime24 0.122 math_pass@1:64_samples 64 100.0%

aime25 0.060 math_pass@1:64_samples 64 100.0%

arenahard 0.819 eval/overall_winrate 500 0.0%

bbh_generative 0.876 extractive_match 1 100.0%

creative-writing-v3 0.655 creative_writing_score 96 0.0%

drop_generative_nous 0.841 drop_acc 1 100.0%

eqbench3 0.681 eqbench_score 135 0.0%

gpqa_diamond 0.528… See the full description on the dataset page: https://huggingface.co/datasets/NousResearch/eval-Cogito-v2-preview-70B-nonreasoning.