You can deploy this model and start earning money today!

zaydiscold/
Qwopus3.6-27B-v2-Q5_K_S-GGUF

Name: Qwopus3.6-27B-v2-Q5_K_S-GGUF
Availability: InStock

Jackrong/Qwopus3.6-27B-v2

Views

No views yet

Qwopus3.6-27B-v2 Q5_K_S GGUF

Q5_K_S quantization of Jackrong/Qwopus3.6-27B-v2 via stock llama.cpp (ggml-org/llama.cpp), built on Apple Silicon with Metal support. Preserves MTP draft heads.

Use

llama-cli -m Qwopus3.6-27B-v2-Q5_K_S.gguf -p "Hi"

Author's temperature recommendation: 0.75–1.0.

Credits

Source: Jackrong/Qwopus3.6-27B-v2 by Jackrong
GGUF conversion by zaydiscold

Mix brought by the NOTORIOUS MLX.

zaydiscold/Qwopus3.6-27B-v2-Q5_K_S-GGUF

Qwopus3.6-27B-v2 Q5_K_S GGUF

Use

Credits

zaydiscold/
Qwopus3.6-27B-v2-Q5_K_S-GGUF