Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
olmo-mix-1124 – Dataset by allenai | AlphaNeural AI
You can deploy this model and start earning money today!
allenai
/
olmo-mix-1124
like
0
text-generation
en
odc-by
1B<n<10B
text
us
Views
No views yet
Model card
Files and Versions
Community
API
OLMo 2 (November 2024) Pretraining set
Collection of data used to train OLMo-2-1124 models. The majority of this dataset comes from DCLM-Baseline with no additional filtering, but we provide the explicit breakdowns below.
Name Tokens Bytes (uncompressed) Documents License
DCLM-Baseline 3.70T 21.3TB 2.95B CC-BY-4.0
Arxiv 20.8B 77.2GB 3.95M ODC-BY
pes2o 58.6B 412GB 38M ODC-BY
starcoder 83.0B 458GB 78.7M ODC-BY
Algebraic-stack 11.8B 44.0GB 2.83M ODC-BY… See the full description on the dataset page:
https://huggingface.co/datasets/allenai/olmo-mix-1124
.
