GLM-5.2-NVFP4 is an NVFP4-quantized version of
zai-org/GLM-5.2, a 744B-parameter Mixture-of-Experts language model with 40B active parameters, 256 experts per MoE layer (8 activated per token), and DeepSeek Sparse Attention (DSA).
Quantized directly from the full BF16 checkpoint (
zai-org/GLM-5.2,
not the FP8 release, to NVFP4 (4-bit with blockwise FP8 scales per 16 elements) using
NVIDIA Model Optimizer.
Calibration uses natural top-k routing rather than forcing all experts to activate, so each expert's quantization scales reflect the token distributions it actually sees during inference. To compensate, calibration was run on a much larger number of samples than typical to ensure broad expert coverage through natural routing alone.
