Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Lyra4-Gutenberg2-12B-6bpw-h8-exl2 – AI Model by riveRiPH | AlphaNeural AI
You can deploy this model and start earning money today!
riveRiPH
/
Lyra4-Gutenberg2-12B-6bpw-h8-exl2
like
0
transformers
safetensors
mistral
text-generation
conversational
nbeerbower/Lyra4-Gutenberg2-12B
quantized
cc-by-nc-4.0
autotrain_compatible
text-generation-inference
endpoints_compatible
6-bit
exl2
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
image/png
Lyra4-Gutenberg2-12B-6bpw-h8-exl2
This is a 6bpw h8 exl2 quant of
Lyra4-Gutenberg2-12B
Built-in(default) calibration dataset is used.
