krisbailey/

RedPajama-1B-Weighted

A canonical 1 Billion token weighted subset of the RedPajama-Data-1T dataset.

This is a strict, downsampled version of the RedPajama-10B-Weighted dataset. It maintains the exact domain distributions of the full 1T dataset, resized to a lightweight 1 Billion token footprint. This dataset is ideal for:

Rapid Prototyping: Train small models or debug pipelines in minutes rather than days. Reference Baselines: Use a standard… See the full description on the dataset page: https://huggingface.co/datasets/krisbailey/RedPajama-1B-Weighted.