reasoning-degeneration-dev/

t1-full-l3p2-1b-it-4arg

Full Semantic Knowledge Enhanced evaluation: base eval, knowledge synthesis, and enhanced+heldout evaluation.

	Performance Comparison





	

Metric Base (original) Enhanced: Original 4-arg Enhanced: Heldout 4-arg Enhanced: Easier 3-arg Enhanced: Harder 5-arg

pass@1 0.0200 (2.0%) 0.0000 (0.0%) 0.0000 (0.0%) 0.0400 (4.0%) 0.0000 (0.0%)

pass@2 0.0200 (2.0%) 0.0000 (0.0%) 0.0000 (0.0%) 0.1000 (10.0%) 0.0200 (2.0%)

pass@3 0.0200 (2.0%) 0.0200… See the full description on the dataset page: https://huggingface.co/datasets/reasoning-degeneration-dev/t1-full-l3p2-1b-it-4arg.