You can deploy this model and start earning money today!

Flowseal/
Qwen3.6-27B-nq

Name: Qwen3.6-27B-nq
Rating: 2.5 (7 reviews)

Views

No views yet

Flowseal/Qwen3.6-27B-nq

NanoQuant-GPTQ quantization of Qwen/Qwen3.6-27B (recipe: int4_all) -- group-wise affine integer weights with GPTQ error correction. Text-only (vision dropped).

Custom format (bit-packed group-int + quant_manifest.json) -- NOT a standard HF checkpoint. Load with the NanoQuant repo:

python

from huggingface_hub import snapshot_download
from src.pipeline.group_io import load_group_quant_model
d = snapshot_download("Flowseal/Qwen3.6-27B-nq")
model, tok = load_group_quant_model(d, device="cuda", strip_vision=True)