Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
BPE_tokenizer_trained_wikitxt – AI Model by Ak128umar | AlphaNeural AI | AlphaNeural AI
You can deploy this model and start earning money today!
Ak128umar
/
BPE_tokenizer_trained_wikitxt
like
0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Hi, This is the new tokenizer based on BPE algorithm trained from scratch using the wikitext dataset as a corpus.
Request you to use it and let me know if you find any issues in understanding this.