This project accompanies the research paper, GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models.
In our first release, we provide data for GSM-Symbolic, GSM-Symbolic-P1, and GSM-Symbolic-P2 variants. For each variant, we have released both templates (available on Github), and a sample of generated data that can be used for evaluation.
To load the data, you can use the following code. Note that in… See the full description on the dataset page:
https://huggingface.co/datasets/apple/GSM-Symbolic.
