Smaller mixture of high-quality data. 10B is the size at which we ran all micro anneals for Olmo 3 stage 2 training. For the full mixture, please see:
https://huggingface.co/datasets/allenai/dolma3_dolmino_mix-100B-1025
Dolma 3 Dolmino is licensed under the Open Data Commons Attribution License v1.0 (ODC-By). It is intended for research and educational use. For more… See the full description on the dataset page:
https://huggingface.co/datasets/allenai/dolma3_dolmino_mix-10B-1025.