Is this your dataset? Claim it with the Hugging Face account that owns it.

allenai/
dolma3_longmino_mix-50B-1025

Name: dolma3_longmino_mix-50B-1025
Creator: allenai
License: https://spdx.org/licenses/ODC-By-1.0.html

Views

No views yet

Dolma 3 Longmino Mix (50B)

The Dolma 3 Longmino Mix (50B) is the mixture of data used for the third stage of training for Olmo 3 7B model.

	Dataset Sources

Source Type Tokens Docs

LC-s2pdf-REX 32k-64k Synth PDFs 6.08B (12.2%) 217K

LC-s2pdf-CWE 32k-64k Synth PDFs 1.94B (3.88%) 71.3K

LC-s2pdf 32k-64k PDFs 4.81B (9.63%) 177K

LC-s2pdf 8k-32k (8-16k) PDFs 2.27B (4.55%) 235K

LC-s2pdf 8k-32k (16-32k) PDFs 1.85B (3.70%) 110K

Midtraining Data Mix 33.0B… See the full description on the dataset page: https://huggingface.co/datasets/allenai/dolma3_longmino_mix-50B-1025.