Views
No views yet
| Format | Use Case |
|---|---|
Q8_0 | Near-lossless, good balance of quality and size |
Q6_K | High quality with moderate compression |
Q5_K_M | Good quality with stronger compression |
Q4_K_M | Maximum compression, acceptable quality loss |
1# Example with llama.cpp
2./llama-cli -m Qwopus-3.5-27B-V3-Stabbed-Q4_K_M.gguf -p "Your prompt here"