You can deploy this model and start earning money today!

allenai/
dolma3_longmino_pool

Views

No views yet

⚠️ IMPORTANT NOTICE ⚠️ This is the Dolma 3 Longmino pool; it hasn't been mixed. If you are interested in the data used to train:

Olmo 3 7B: allenai/dolma3_longmino_mix-50B-1025 Olmo 3 32B: allenai/dolma3_dolmino_mix-100B-1125

Dolma 3 Longmino Pool (639B)

Dolma 3 Longmino Pool is the full pool of documents considered for stage 3 (long context) extension trainin of Olmo 3 7B.

	Dataset Sources

Source Type Tokens Docs

LC-s2pdf-REX 32k-64k Synth PDFs 24.1B… See the full description on the dataset page: https://huggingface.co/datasets/allenai/dolma3_longmino_pool.