GSM-Plus aims to evaluate the robustness of LLMs' math reasoning capability by testing a wide range of question variations. GSM-Plus is an adversarial grade school math dataset, an extension of GSM8K augmented with various mathematical perturbations. Motivated by the capability taxonomy for solving math problems mentioned in Polya’s principles, we identify 5 perspectives to guide the development of GSM-PLUS:
numerical variation refers to altering the numerical… See the full description on the dataset page:
https://huggingface.co/datasets/qintongli/GSM-Plus.