Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
allenai_olmo2_superbpe_10G_1M_tokenizer_tulu-3-sft-olmo-2-mixture-0225-bpe-to-superbpe – Dataset by yvonne90190 | AlphaNeural AI
You can deploy this model and start earning money today!
yvonne90190
/
allenai_olmo2_superbpe_10G_1M_tokenizer_tulu-3-sft-olmo-2-mixture-0225-bpe-to-superbpe
like
0
us
Views
No views yet
Model card
Files and Versions
Community
API
samples processed: 866138 Total user BPE tokens: 252198220 Total assistant BPE tokens: 402038966 Total assistant SuperBPE tokens: 198274197 Assistant reduction vs BPE = 50.68284077717979%