Extended Calibration (EC) INT4 AutoRound quantization of Qwen/Qwen3.5-122B-A10B, a 122B MoE (10B active) multimodal model. Drop-in replacement for Intel/Qwen3.5-122B-A10B-int4-AutoRound with wider calibration settings for improved quality on long-context and reasoning-heavy workloads.

Effective calibration batch size is 8 in both cases (1×8 vs 8×1) — mathematically equivalent signal per optimizer step, just different memory/latency profile during quantization.

If you build an FP8-dense hybrid on top of this checkpoint (e.g. via albond's build-hybrid-checkpoint.py), the hybrid builder will report more unmatched FP8 tensors than on Intel's checkpoint (≈ 741 vs 408) because our visual encoder lives in a separate model_visual.safetensors file rather than inline in the main shards. The builder only scans main shards, so the FP8 visual tensors go unmatched and visual stays at BF16 in the resulting hybrid. This is functionally harmless — visual adds only ~0.9 GB at BF16 vs ~0.45 GB at FP8, no quality difference, no impact on text throughput. Pass --force to the hybrid builder to proceed.

If you only serve text (vast majority of use cases) or run vLLM against this checkpoint directly without building a hybrid, this note does not apply.

Apache 2.0 (inherits from Qwen/Qwen3.5-122B-A10B).