Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
phi3-jamo-ko-tokenizer – AI Model by devngho | AlphaNeural AI
You can deploy this model and start earning money today!
devngho
/
phi3-jamo-ko-tokenizer
like
0
transformers
ko
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
based on phi-3 tokenizer, expanded 17291 tokens
Following
The Optimal Vocabulary Size Predictor
, I recommend using this tokenizer with 3-4B model such as phi-3-mini