Some erroneous labels exist in the GSM8K dataset.
This dataset is fixed from
https://github.com/openai/grade-school-math/blob/master/grade_school_math/data/train.jsonl with the code appended at the end.
The errors are located by delving into unreasonably low pass rates by the strong DeepSeekMath-7B-RL and hopefully should be exhaustive.
This dataset is used by the 🎯DART-Math project to synthesize data.
[!WARNING]
⚠️ Only the training set has been fixed so far.
for… See the full description on the dataset page:
https://huggingface.co/datasets/hkust-nlp/gsm8k-fix.