Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
Impish_Nemo_12B-Q6_K_XL-GGUF – AI Model by Valeciela | AlphaNeural AI | AlphaNeural AI
You can deploy this model and start earning money today!
Valeciela
/
Impish_Nemo_12B-Q6_K_XL-GGUF
like
0
gguf
mistral
not-for-all-audiences
en
SicariusSicariiStuff/Impish_Nemo_12B
quantized
apache-2.0
endpoints_compatible
us
conversational
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Static quantization of
Impish Nemo 12B
File
Notes
Impish_Nemo_12B.Q6_K_XL.gguf
Q6_K with select tensors quantized to Q8_0
7.23 bpw
~10% increase in size relative to Q6_K
Quantized from BF16
Very close in fidelity to full precision
Impish_Nemo_12B.BF16.gguf
Native precision GGUF
BF16
