Code:
https://github.com/GAIR-NLP/MegaScience
Project Page:
https://huggingface.co/MegaScience
MegaScience is a large-scale mixture of high-quality open-source datasets consisting of 1.25 million instances. We first collect multiple public datasets, then conduct comprehensive ablation studies across different data selection methods to identify the optimal approach for each dataset, thereby… See the full description on the dataset page:
https://huggingface.co/datasets/mkzheng/MegaScience.