Multilingual GSM-Symbolic is a benchmark for evaluating arithmetic reasoning in large language models across multiple languages. It extends Apple's GSM-Symbolic approach by providing symbolic templates that generate thousands of structurally equivalent but numerically distinct math problems. Templates and generation are handled by the multilingual-gsm-symbolic package.
The dataset lets you test whether a model genuinely understands a problem or merely… See the full description on the dataset page:
https://huggingface.co/datasets/danish-foundation-models/multilingual-gsm-symbolic.