Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
pika-2 – AI Model by qikp | AlphaNeural AI
You can deploy this model and start earning money today!
qikp
/
pika-2
like
0
transformers
tokenization
en
HuggingFaceTB/cosmopedia-100k
cc0-1.0
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
pika
🎉 You are looking at pika 2, which incorporates the following changes:
🇬🇧 Usage of an English dataset
🤏 Smaller size (8K vocabulary)
🚫 No unknown token
pika is a simple and public domain-like tokenizer.
Special Tokens
End-of-Sequence token:
[EOS]
Padding token:
[PAD]
Training
pika was trained on the first 6K rows of a
Cosmopedia sample
.
Limitations
Due to its small corpus, pika may split words into smaller pieces. Also, some uncommon special tokens aren't present, you'll have to add them manually if needed.