Views
No views yet
NVFP4 Quantization-Aware Step Distillation for Blackwell Architecture
1# 1. Install LightX2V
2git clone https://github.com/ModelTC/LightX2V.git
3cd LightX2V
4uv pip install -v .
5
6# 2. Install NVFP4 Kernel
7pip install scikit_build_core uv
8git clone https://github.com/NVIDIA/cutlass.git
9cd lightx2v_kernel
10
11MAX_JOBS=$(nproc) CMAKE_BUILD_PARALLEL_LEVEL=$(nproc) \
12uv build --wheel \
13 -Cbuild-dir=build . \
14 -Ccmake.define.CUTLASS_PATH=/path/to/cutlass \
15 --verbose --color=always --no-build-isolation
16
17pip install dist/*whl --force-reinstall --no-deps
18
19# 3. Run inference
20# config
21https://github.com/ModelTC/LightX2V/blob/main/configs/self_forcing/wan_t2v_sf_nvfp4.json| Self-Forcing-1.3B-BF16 | Self-Forcing-1.3B-NVFP4 |
|---|---|
| Self-Forcing-1.3B-BF16 | Self-Forcing-1.3B-NVFP4 |
|---|---|