Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
merged-moe-tinyllama-1-1b-chat-v1-0-x-tinyllama-1-1b-intermediate-step-1431k-3t-1779838660 – AI Model by EugeneTentacle | AlphaNeural AI
You can deploy this model and start earning money today!
EugeneTentacle
/
merged-moe-tinyllama-1-1b-chat-v1-0-x-tinyllama-1-1b-intermediate-step-1431k-3t-1779838660
like
0
safetensors
mixtral
merge
mergekit
moe
TinyLlama/TinyLlama-1.1B-Chat-v1.0
merge
TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
merge
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
merged-moe-tinyllama-1-1b-chat-v1-0-x-tinyllama-1-1b-intermediate-step-1431k-3t-1779838660
A moe merge of:
TinyLlama/TinyLlama-1.1B-Chat-v1.0
TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
Benchmark (wikitext-2-raw-v1 perplexity, 100 samples)
Model
Perplexity
TinyLlama/TinyLlama-1.1B-Chat-v1.0
12.9189
TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
12.7071
this merge
12.6381
Win criterion
best
: merged 12.638 < min(parents) 12.707.
Generated by
merge-model-monolithic.py
.