reasoning-degeneration-dev/

t1-full-q25-14b-it-8arg

Full Semantic Knowledge Enhanced evaluation: base eval, knowledge synthesis, and enhanced+heldout evaluation.

	Performance Comparison





	

Metric Base (original) Enhanced: Original 8-arg Enhanced: Heldout 8-arg Enhanced: Easier 7-arg Enhanced: Harder 9-arg

pass@1 0.0000 (0.0%) 0.0400 (4.0%) 0.0000 (0.0%) 0.0400 (4.0%) 0.0000 (0.0%)

pass@2 0.0200 (2.0%) 0.0400 (4.0%) 0.0000 (0.0%) 0.0400 (4.0%) 0.0000 (0.0%)

pass@3 0.0200 (2.0%) 0.0400… See the full description on the dataset page: https://huggingface.co/datasets/reasoning-degeneration-dev/t1-full-q25-14b-it-8arg.