Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
dolphin-2.9.1-yi-1.5-34b-8.0bit-exl2 – AI Model by bdambrosio | AlphaNeural AI
You can deploy this model and start earning money today!
bdambrosio
/
dolphin-2.9.1-yi-1.5-34b-8.0bit-exl2
like
0
transformers
safetensors
llama
text-generation
conversational
autotrain_compatible
text-generation-inference
endpoints_compatible
8-bit
exl2
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
A simple (ie, I don't really know what I'm doing) 8bit quant of
cognitivecomputations/dolphin-2.9.1-yi-1.5-34b
python3 convert.py -i ../models/dolphin-2.9.1-yi-1.5-34b -o dolphin-2.9.1-yi-1.5-34b -cf dolphin-2.9.1-yi-1.5-34b -l 2048 -b 8.0 -hb 8 -ss 8192
