Quantizations of Qwen3.5-397B-A17B using the Gutenberg (Q_K_G) quantization strategy.

KLD and Same Top P measured against Q8_0 reference logits (8192 context, 10 chunks).

Standard quantization (K_M) applies uniform rules to all tensors. Gutenberg uses KLD sensitivity data to allocate precision where it should matter most, upgrading the tensors that have the highest measured impact on output quality while keeping less important tensors at the base level. Non-expert tensors are kept at Q8_0 for their disproportionate quality impact.

The result is significantly better quality than standard quants at the same model size (on paper).

Fully compatible with stock llama.cpp, llama-server, LM Studio, and any GGUF-compatible runtime. No custom builds required.