Views
No views yet
pip install git+https://github.com/Disty0/sdnq1import torch
2import diffusers
3from sdnq import SDNQConfig # import sdnq to register it into diffusers and transformers
4
5pipe = diffusers.QwenImagePipeline.from_pretrained("Disty0/Qwen-Image-Lightning-SDNQ-uint4-svd-r32", torch_dtype=torch.bfloat16)
6pipe.enable_model_cpu_offload()
7
8prompt = "a tiny astronaut hatching from an egg on the moon, Ultra HD, 4K, cinematic composition."
9negative_prompt = " "
10image = pipe(
11 prompt=prompt,
12 negative_prompt=negative_prompt,
13 width=1024,
14 height=1024,
15 num_inference_steps=8,
16 true_cfg_scale=1.0,
17 generator=torch.manual_seed(0),
18).images[0]
19
20image.save("qwen-image-lightning-sdnq-uint4-svd-r32.png")| Quantization | Model Size | Visualization |
|---|---|---|
| Original BF16 | 40.9 GB | ![]() |
| SDNQ UINT4 | 11.6 GB | ![]() |