NoOp distractor clauses for GSM-Symbolic questions, audited for genuine irrelevance by an independent model (GPT-5.5), plus per-model evaluation results.
Accompanies the post Revisiting GSM-Symbolic: Do 2026 Frontier Models Still Fail at Confounded Grade School Math? and the code at github.com/BenSturgeon/gsm-symbolic-revisited.
The GSM-Symbolic paper (Mirzadeh et al., Apple, ICLR 2025) reported that adding an irrelevant "NoOp" clause collapses… See the full description on the dataset page:
https://huggingface.co/datasets/Experimental-Orange/gsm-noop-audited.
