Views
No views yet
INT4 for non-Blackwell GPUs (pre-50-series), NVFP4 for Blackwell GPUs (50-series).
Rank:r32 for faster inference,r128 for better quality but slower inference,r256 for highest quality (slowest inference).| Data Type | Rank | Model Name | Comment |
|---|---|---|---|
| INT4 | r32 | svdq-int4_r32-z-image-turbo.safetensors | |
| r128 | svdq-int4_r128-z-image-turbo.safetensors | ||
| r256 | svdq-int4_r256-z-image-turbo.safetensors | ||
| NVFP4 | r32 | svdq-fp4_r32-z-image-turbo.safetensors | |
| r128 | svdq-fp4_r128-z-image-turbo.safetensors |
1@inproceedings{
2 li2024svdquant,
3 title={SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models},
4 author={Li*, Muyang and Lin*, Yujun and Zhang*, Zhekai and Cai, Tianle and Li, Xiuyu and Guo, Junxian and Xie, Enze and Meng, Chenlin and Zhu, Jun-Yan and Han, Song},
5 booktitle={The Thirteenth International Conference on Learning Representations},
6 year={2025}
7}