MGSM-Pro is a multilingual grade school math benchmark covering 9 languages. It extends MGSM with the GSM-Symbolic approach: instead of evaluating a model on a single phrasing of each problem, MGSM-Pro provides multiple instantiations of the same underlying problem, generated by varying names, digits, and irrelevant context. The motivation is that a… See the full description on the dataset page: https://huggingface.co/datasets/McGill-NLP/mgsm-pro.