Views
No views yet
"INT8 ConvRot is row-wise INT8 with parameters and activations rotated before quantization via ConvRot." — ComfyUI-INT8-Fast Metrics.md
GGUF Q8 > INT8 ConvRot > MXFP8 > FP8 >= INT8 Row > INT8 Tensorwisepip install -U convert-to-quantINT8 kernels require Triton (native on Linux; usetriton-windowson Windows). PyTorch must be installed separately with the correct CUDA version.
1ctq -i source_model_bf16.safetensors -o converted_model_int8_convrot.safetensors \
2 --int8 --scaling_mode row --simple --convrot --convrot-group-size [64,256,1024] \
3 --comfy_quant --save-quant-metadata --<model-arch-flag>--convrot-group-size accepts 64, 256, or 1024. It is recommended to choose a value that divides evenly into all of the model's layer dimensions.--<model-arch-flag> selects the layer-exclusion preset for your model architecture
(e.g. --wan, --flux2, --zimage). Run ctq --help-filters (or ctq -hf) for
the full list.