02/03/2026: Added MTP (multi-token prediction) weights from source checkpoint, enabling speculative decoding with vLLM.
25/02/2026: Initial upload.

Calibration

Samples: 512 (256 from each dataset)
Datasets:
- HuggingFaceH4/ultrachat_200k (train_sft split)
- nvidia/Nemotron-Post-Training-Dataset-v2 (chat split)
Max sequence length: 4096
All experts calibrated: moe_calibrate_all_experts=True

Creation

This model was created using VLLM's LLM Compressor with Qwen3.5 MoE support added via PR #2383. The PR adds a custom CalibrationQwen3MoeSparseMoeBlock that routes calibration data to all experts during quantization, ensuring every expert receives proper calibration for accurate NVFP4 quantization.

Sehyo/Qwen3.5-122B-A10B-NVFP4

Qwen3.5-122B-A10B-NVFP4

Changelog

Calibration

Creation

Sehyo/
Qwen3.5-122B-A10B-NVFP4