Views
No views yet
#nvfp4
100%|███████████████████| 4/4 [00:01<00:00, 2.52it/s]
Prompt executed in 3.45 seconds
#fp8mixed
100%|███████████████████| 4/4 [00:04<00:00, 1.02s/it]
Prompt executed in 6.09 seconds
#bf16
100%|███████████████████| 4/4 [00:06<00:00, 1.62s/it]
Prompt executed in 9.80 seconds1{
2 "block_name": "transformer_blocks",
3 "rules": [
4 { "policy": "keep", "match": [] },
5 { "policy": "float8_e4m3fn", "match": ["img_mod.1", "txt_mlp.net.0.proj", "txt_mlp.net.2", "txt_mod.1"] },
6 { "policy": "nvfp4","match": ["attn.to_k", "attn.to_q", "attn.to_v", "attn.to_out.0", "img_mlp.net.0.proj", "img_mlp.net.2"] }
7 ]
8}quantize.py configs/qwen-image-edit-2511.json <SOURCE> uncalibrated.safetensorsadd_input_scale.py calibs/qwen-image-edit-2511.json uncalibrated.safetensors <TARGET>