Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
cosmo2-tokenizer – AI Model by HuggingFaceTB | AlphaNeural AI
You can deploy this model and start earning money today!
HuggingFaceTB
/
cosmo2-tokenizer
like
0
transformers
HuggingFaceTB/cosmo2_training_data_subset_1M
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
cosmo2-tokenizer
Tokenizer for the training of cosmo2. This tokenizer was trained on 1M samples from:
FineWeb-Edu 70%
Cosmopedia v2 15%
StarCoderData 8%
OpenWebMath 5%
StackOverFlow 2%