Views
No views yet
An extremely efficient Wan 2.2 14B variant: NVFP4 Quantization-Aware Step Distillation with Sparse Attention for Blackwell Architecture
1# 1. Pull LightX2V Docker image
2docker pull lightx2v/lightx2v:26052801-cu130-5090
3
4# 2. Run single-GPU inference
5# Text-to-video
6bash scripts/wan22/extreme/run_wan22_moe_t2v_extreme.sh
7# Image-to-video
8bash scripts/wan22/extreme/run_wan22_moe_i2v_extreme.sh
9
10# 3. Run multi-GPU sequence-parallel inference
11# Text-to-video
12bash scripts/wan22/extreme/run_wan22_moe_t2v_extreme_sp_parallel.sh
13# Image-to-video
14bash scripts/wan22/extreme/run_wan22_moe_i2v_extreme_sp_parallel.sh1# 1. Install LightX2V
2git clone https://github.com/ModelTC/LightX2V.git
3cd LightX2V
4uv pip install -v .
5
6# 2. Install NVFP4 Kernel
7pip install scikit_build_core uv
8git clone https://github.com/NVIDIA/cutlass.git
9cd lightx2v_kernel
10
11MAX_JOBS=$(nproc) CMAKE_BUILD_PARALLEL_LEVEL=$(nproc) \
12uv build --wheel \
13 -Cbuild-dir=build . \
14 -Ccmake.define.CUTLASS_PATH=/path/to/cutlass \
15 --verbose --color=always --no-build-isolation
16
17pip install dist/*whl --force-reinstall --no-deps
18
19# 3. Run single-GPU inference
20# Text-to-video
21bash scripts/wan22/extreme/run_wan22_moe_t2v_extreme.sh
22# Image-to-video
23bash scripts/wan22/extreme/run_wan22_moe_i2v_extreme.sh
24
25# 4. Run multi-GPU sequence-parallel inference
26# Text-to-video
27bash scripts/wan22/extreme/run_wan22_moe_t2v_extreme_sp_parallel.sh
28# Image-to-video
29bash scripts/wan22/extreme/run_wan22_moe_i2v_extreme_sp_parallel.sh| Resolution | Wan2.2-T2V-14B | LightWan2.2-A14B |
|---|---|---|
| 480p | ||
| 720p |
| Method | Task | GPU Number | Resolution | NFE | E2E Latency | Speedup |
|---|---|---|---|---|---|---|
| Wan2.2-T2V-14B | T2V | 1 | 480p | 40 | 734.0s | 1.0x |
| LightWan2.2-A14B | T2V | 1 | 480p | 4 | 9.1s | 80.7x |
| Wan2.2-T2V-14B | T2V | 1 | 720p | 40 | 2668.0s | 1.0x |
| LightWan2.2-A14B | T2V | 1 | 720p | 4 | 22.5s | 118.7x |
| Wan2.2-I2V-14B | I2V | 1 | 480p | 40 | 787.0s | 1.0x |
| LightWan2.2-A14B | I2V | 1 | 480p | 4 | 10.7s | 73.9x |
| Wan2.2-I2V-14B | I2V | 1 | 720p | 40 | 2685.0s | 1.0x |
| LightWan2.2-A14B | I2V | 1 | 720p | 4 | 26.7s | 100.5x |
lightx2v/lightx2v:26052801-cu130-5090.