A curated 1-billion-token English pretraining corpus sampled from HuggingFaceTB/smollm-corpus, designed for training small language models (~20M parameters).

	Dataset Composition

Source Ratio Tokens Documents

FineWeb-Edu (dedup) 87% ~870M 849,577

Cosmopedia v2 13% ~130M 161,889

Total 100% ~1B 1,011,466

Rationale for the Split

The 87/13 ratio mirrors the natural token distribution of the full… See the full description on the dataset page: https://huggingface.co/datasets/ecreeth/1b-smollm-corpus.