You can deploy this model and start earning money today!

saikiran1211/
ruku-py-chat-model-GGUF

Name: ruku-py-chat-model-GGUF
Availability: InStock

gguf

endpoints_compatible

conversational

Views

No views yet

GGUF quantizations of Python Chat 9B for llama.cpp, LM Studio, Jan, KoboldCpp, Ollama-style runtimes, and other GGUF-compatible local inference tools.

This is a Python-only chat/coding model fine-tuned by Ruku.

Files

File	Quant	Notes
Ruku-Python-Master-Chat-9B-Q4_K_M.gguf	Q4_K_M	Recommended default, smallest practical file
Ruku-Python-Master-Chat-9B-Q5_K_M.gguf	Q5_K_M	Better quality / balanced size
Ruku-Python-Master-Chat-9B-Q6_K.gguf	Q6_K	High quality
Ruku-Python-Master-Chat-9B-Q8_0.gguf	Q8_0	Near-lossless, larger file
Ruku-Python-Master-Chat-9B-F16.gguf	F16	Full precision GGUF conversion base

If unsure, start with Q4_K_M.
If you have enough RAM/VRAM, use Q8_0.

saikiran1211/ruku-py-chat-model-GGUF

Files

saikiran1211/
ruku-py-chat-model-GGUF