Is this your dataset? Claim it with the Hugging Face account that owns it.

OptimalScale/
ClimbMix

Name: ClimbMix
Creator: OptimalScale
License: https://spdx.org/licenses/Apache-2.0.html

Views

No views yet

ClimbMix is a high-quality pre-training corpus released by NVIDIA. Here is the description:

ClimbMix is a compact yet powerful 400-billion-token dataset designed for efficient pre-training that delivers superior performance under an equal token budget. It was introduced in this paper. We proposed a new algorithm to filter and mix the dataset. First, we grouped the data into 1,000 groups based on topic information. Then we applied two classifiers: one to detect advertisements and another to… See the full description on the dataset page: https://huggingface.co/datasets/OptimalScale/ClimbMix.