DaydreamerMZM/

SenseMath

SenseMath is a controlled benchmark for measuring whether LLMs can exploit number-sense shortcuts.

	Files




	

File Description

data/sensemath_v2_d2.json 400 families, 2-digit operands

data/sensemath_v2_d4.json 400 families, 4-digit operands

data/sensemath_v2_d8.json 400 families, 8-digit operands

data/sensemath_v2_d16.json 400 families, 16-digit operands

data/judge_j1.json J1 task: shortcut… See the full description on the dataset page: https://huggingface.co/datasets/DaydreamerMZM/SenseMath.