Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
tok_custom_scratch – AI Model by manu | AlphaNeural AI
You can deploy this model and start earning money today!
manu
/
tok_custom_scratch
like
0
fr
en
manu/tok_corpus
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
BPE Tokenizer fitted on a custom corpus, with digit separation, byte fallback and other features from LlamaTokenizer.
Only fitted on 1,000,000 samples.