You can deploy this model and start earning money today!

Sepolian/
Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-Q4_K_M

Name: Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-Q4_K_M
Availability: InStock

Views

No views yet

Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-Q4_K_M

GGUF 4bit conversion of huihui-ai/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated.

bash

llama-cli \
  -m path/to/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-Q4_K_M.gguf \
  --n-gpu-layers all \
  --ctx-size 262144 \
  --flash-attn on