bluelightai-dev/

clt-pretrain-data-v2-dedup

Generated on 2025-11-12 21:12:06 UTC.

Total samples: 3,264,000 Train samples: 3,100,799 Validation samples: 163,201 Train fraction: 0.95 Shuffle seed: 98482

Source Dataset ID Samples

math_pile bluelightai-dev/MathPile_Commercial-formatted 96,000

dclm_baseline bluelightai-dev/dclm-full-deduped-sample 2,048,000

common_corpus_culture bluelightai-dev/common-corpus-sample-open-culture 64,000

common_corpus_government… See the full description on the dataset page: https://huggingface.co/datasets/bluelightai-dev/clt-pretrain-data-v2-dedup.