This repository contains a dataset generated by reproducing the MathScaleQA using the GPT-3.5-0613 API, resulting in 2M data points. Additionally, we have attempted to reproduce the MathScale-Mistral model by finetuning the Mistral-7B-v0.1 on this dataset, following the hyperparameters in their original paper to ensure the effectiveness of our reproduction.
Fortunately, the reproduction was smooth, and we managed to match the reported… See the full description on the dataset page:
https://huggingface.co/datasets/fdqerq22ds/MathScaleQA-2M.
