File	Quant	Size	Notes
mythos-9b-unhinged-Q4_K_M.gguf	Q4_K_M	5.03 GB	⭐ Best size/quality balance
mythos-9b-unhinged-IQ4_XS.gguf	IQ4_XS	4.56 GB	imatrix — great quality, smaller
mythos-9b-unhinged-IQ3_M.gguf	IQ3_M	3.90 GB	imatrix — low RAM option
mythos-9b-unhinged-Q2_K.gguf	Q2_K	3.28 GB	Very low quality, last resort

Additional quants available in the source repo.

Usage

llama.cpp:

llama-cli -hf fableforge-ai/mythos-9b-unhinged-GGUF:Q4_K_M -p "Hello!"

Ollama:

ollama run hf.co/fableforge-ai/mythos-9b-unhinged-GGUF:Q4_K_M

🔗 Related models