Pre-built HRM-Text pretraining dataset from raw data using the data_io cleaning scripts.
If you find this project or our paper useful, please consider citing our paper:
@misc{wang2026hrmtextefficientpretrainingscaling,
title={HRM-Text: Efficient Pretraining Beyond Scaling},
author={Guan Wang and Changling Liu and Chenyu Wang and Cai Zhou and Yuhao Sun and Yifei Wu and Shuai Zhen and Luca Scimeca and Yasin Abbasi Yadkori},
year={2026}… See the full description on the dataset page:
https://huggingface.co/datasets/sapientinc/HRM-Text-data-io-cleaned-20260515.
