Is this your dataset? Claim it with the Hugging Face account that owns it.

allenai/
dolma3_mix-150B-1025

Name: dolma3_mix-150B-1025
Creator: allenai
License: https://spdx.org/licenses/ODC-By-1.0.html

Views

No views yet

	Dolma 3 Sample: 150B Mix




	
	Dataset Sources

Sample of data for 1Bx5C and 7Bx1B. For the full Dolma 3 pool, see: https://huggingface.co/datasets/allenai/dolma3

Source Type Tokens Documents

Common Crawl Web pages 121B (76.9%) 84.5M

olmOCR Science PDFs Academic documents 19.9B (12.6%) 2.25M

Stack-Edu (Rebalanced) GitHub code 11.1B (7.06%) 14.3M

arXiv Papers with LaTeX 1.29B (0.82%) 247K

FineMath 3+ Math web pages 4.10B (2.60%) 2.57M

Wikipedia & Wikibooks… See the full description on the dataset page: https://huggingface.co/datasets/allenai/dolma3_mix-150B-1025.