reasoning-degeneration-dev/

t1-strategy-countdown-anti-together_ai-qwen-qwen3-next-80b-a3b-inst-d15f53bb

Strategy compliance evaluation on countdown arithmetic — anti-strategy variant. Model was explicitly told NOT to use tree search (anti-strategy control). Judge still scores against tree search rubric. Compliance is scored by an LLM judge (1-5 Likert).

	Results




	

Metric Value

pass@1 0.0000

Strategy compliance (mean) 1.67

Strategy compliance (min) 1

Strategy compliance (max) 2

Total… See the full description on the dataset page: https://huggingface.co/datasets/reasoning-degeneration-dev/t1-strategy-countdown-anti-together_ai-qwen-qwen3-next-80b-a3b-inst-d15f53bb.