Views
No views yet
| File | Quant | Size |
|---|---|---|
| qwen-0.5b-fp16.gguf | FP16 | 948 MB |
| qwen-0.5b-q8_0.gguf | Q8_0 | 506 MB |
| qwen-0.5b-q6_K.gguf | Q6_K | 482 MB |
| qwen-0.5b-q5_k_m.gguf | Q5_K_M | 401 MB |
| qwen-0.5b-q4_k_m.gguf | Q4_K_M | 379 MB |
| qwen-0.5b-q3_k_m.gguf | Q3_K_M | 339 MB |
ollama run hf.co/mmondol/qwen-0.5b-gguf:Q4_K_Mllama cli -m qwen-0.5b-q4_k_m.gguf -p "Hello!"