Is this your dataset? Claim it with the Hugging Face account that owns it.

sail/
regmix-data

Name: regmix-data
Creator: sail
License: https://spdx.org/licenses/MIT.html

Views

No views yet

	RegMix Data




	
	Dataset Description

The RegMix Data is a curated dataset derived from the Pile-Uncopyrighted, specifically designed for the RegMix paper (https://huggingface.co/papers/2407.01492). This dataset aims to facilitate the automatic identification of high-performing data mixtures for language model pre-training by formulating it as a regression task.

Key Features:

Size: Approximately 1TB disk space, 250B tokens Distribution: Follows the natural token… See the full description on the dataset page: https://huggingface.co/datasets/sail/regmix-data.