Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
Lyra-Gutenberg-12b-EXL2-6bpw – AI Model by Statuo | AlphaNeural AI
You can deploy this model and start earning money today!
Statuo
/
Lyra-Gutenberg-12b-EXL2-6bpw
like
0
transformers
safetensors
mistral
text-generation
jondurbin/gutenberg-dpo-v0.1
Sao10K/MN-12B-Lyra-v1
quantized
apache-2.0
autotrain_compatible
text-generation-inference
endpoints_compatible
6-bit
exl2
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Mostly quanting this to try it out, didn't see any other quants for EXL2 on this so here we are.
This is the 6bpw version of this model. Find the original here.
For the 8bpw version, go here
For the 4bpw version, go here
mistral-nemo-gutenberg-12B-v4
Sao10K/MN-12B-Lyra-v1
finetuned on
jondurbin/gutenberg-dpo-v0.1
.
Method
Finetuned using an A100 on Google Colab for 3 epochs.
Fine-tune Llama 3 with ORPO
