Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Violet_Magcap-12B-EXL3 – AI Model by s1arsky | AlphaNeural AI
You can deploy this model and start earning money today!
s1arsky
/
Violet_Magcap-12B-EXL3
like
0
exl3
Nitral-AI/Violet_Magcap-12B
quantized
other
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Quantized using the default exllamav3 (0.0.4) quantization process.
Original model:
Nitral-AI/Violet_Magcap-12B
- refer for more details on the model.
exllamav3:
https://github.com/turboderp-org/exllamav3
EXL3 quants available:
3.5bpw, 4.0bpw, 5bpw, 6.0bpw
Go to "Files and versions", then click on "Main" to choose your quant
download command example 'git clone -b 4.0bpw
https://huggingface.co/s1arsky/Violet_Magcap-12B-EXL3
'
