You can deploy this model and start earning money today!

featherless-ai-quants/
M4-ai-neural-chat-mini-v2.2-1.8B-GGUF

Name: M4-ai-neural-chat-mini-v2.2-1.8B-GGUF
Availability: InStock

Views

No views yet

M4-ai/neural-chat-mini-v2.2-1.8B GGUF Quantizations 🚀

Optimized GGUF quantization files for enhanced model performance

Powered by Featherless AI - run any model you'd like for a simple small fee.

Quantization Type	File	Size
IQ4_XS	M4-ai-neural-chat-mini-v2.2-1.8B-IQ4_XS.gguf	1036.99 MB
Q2_K	M4-ai-neural-chat-mini-v2.2-1.8B-Q2_K.gguf	807.35 MB
Q3_K_L	M4-ai-neural-chat-mini-v2.2-1.8B-Q3_K_L.gguf	1007.27 MB
Q3_K_M	M4-ai-neural-chat-mini-v2.2-1.8B-Q3_K_M.gguf	968.82 MB
Q3_K_S	M4-ai-neural-chat-mini-v2.2-1.8B-Q3_K_S.gguf	909.40 MB
Q4_K_M	M4-ai-neural-chat-mini-v2.2-1.8B-Q4_K_M.gguf	1161.34 MB
Q4_K_S	M4-ai-neural-chat-mini-v2.2-1.8B-Q4_K_S.gguf	1104.61 MB
Q5_K_M	M4-ai-neural-chat-mini-v2.2-1.8B-Q5_K_M.gguf	1313.00 MB
Q5_K_S	M4-ai-neural-chat-mini-v2.2-1.8B-Q5_K_S.gguf	1266.31 MB
Q6_K	M4-ai-neural-chat-mini-v2.2-1.8B-Q6_K.gguf	1505.88 MB
Q8_0	M4-ai-neural-chat-mini-v2.2-1.8B-Q8_0.gguf	1867.59 MB

Links:
Get Started | Documentation | Models