You can deploy this model and start earning money today!

zaydiscold/
Qwopus3.6-27B-v2-IQ4_XS-GGUF

Name: Qwopus3.6-27B-v2-IQ4_XS-GGUF
Availability: InStock

Jackrong/Qwopus3.6-27B-v2

Views

No views yet

Qwopus3.6-27B-v2 IQ4_XS GGUF

IQ4_XS quantization of Jackrong/Qwopus3.6-27B-v2 via stock llama.cpp (ggml-org/llama.cpp), built on Apple Silicon with Metal support. Preserves MTP draft heads.

Use

llama-cli -m Qwopus3.6-27B-v2-IQ4_XS.gguf -p "Hi"

Author's temperature recommendation: 0.75–1.0.

Credits

Source: Jackrong/Qwopus3.6-27B-v2 by Jackrong
GGUF conversion by zaydiscold

Mix brought by the NOTORIOUS MLX.

zaydiscold/Qwopus3.6-27B-v2-IQ4_XS-GGUF

Qwopus3.6-27B-v2 IQ4_XS GGUF

Use

Credits

zaydiscold/
Qwopus3.6-27B-v2-IQ4_XS-GGUF