You can deploy this model and start earning money today!

featherless-ai-quants/
farooqkhan2840503-gemma-Instruct-Finetune-simpleinput_20_0.001-GGUF

Name: farooqkhan2840503-gemma-Instruct-Finetune-simpleinput_20_0.001-GGUF
Availability: InStock

Views

No views yet

farooqkhan2840503/gemma-Instruct-Finetune-simpleinput_20_0.001 GGUF Quantizations 🚀

Optimized GGUF quantization files for enhanced model performance

Powered by Featherless AI - run any model you'd like for a simple small fee.

Quantization Type	File	Size
IQ4_XS	farooqkhan2840503-gemma-Instruct-Finetune-simpleinput_20_0.001-IQ4_XS.gguf	1431.67 MB
Q2_K	farooqkhan2840503-gemma-Instruct-Finetune-simpleinput_20_0.001-Q2_K.gguf	1104.28 MB
Q3_K_L	farooqkhan2840503-gemma-Instruct-Finetune-simpleinput_20_0.001-Q3_K_L.gguf	1397.70 MB
Q3_K_M	farooqkhan2840503-gemma-Instruct-Finetune-simpleinput_20_0.001-Q3_K_M.gguf	1319.70 MB
Q3_K_S	farooqkhan2840503-gemma-Instruct-Finetune-simpleinput_20_0.001-Q3_K_S.gguf	1228.31 MB
Q4_K_M	farooqkhan2840503-gemma-Instruct-Finetune-simpleinput_20_0.001-Q4_K_M.gguf	1554.74 MB
Q4_K_S	farooqkhan2840503-gemma-Instruct-Finetune-simpleinput_20_0.001-Q4_K_S.gguf	1487.58 MB
Q5_K_M	farooqkhan2840503-gemma-Instruct-Finetune-simpleinput_20_0.001-Q5_K_M.gguf	1754.43 MB
Q5_K_S	farooqkhan2840503-gemma-Instruct-Finetune-simpleinput_20_0.001-Q5_K_S.gguf	1715.58 MB
Q6_K	farooqkhan2840503-gemma-Instruct-Finetune-simpleinput_20_0.001-Q6_K.gguf	1966.60 MB
Q8_0	farooqkhan2840503-gemma-Instruct-Finetune-simpleinput_20_0.001-Q8_0.gguf	2545.42 MB

Links:
Get Started | Documentation | Models