Views
No views yet
diffusers workflows, by including a vae argument to the StableDiffusionPipeline1from diffusers.models import AutoencoderKL
2from diffusers import StableDiffusionPipeline
3
4model = "stabilityai/your-stable-diffusion-model"
5vae = AutoencoderKL.from_pretrained("stabilityai/sdxl-vae")
6pipe = StableDiffusionPipeline.from_pretrained(model, vae=vae)| Model | rFID | PSNR | SSIM | PSIM | Link | Comments |
|---|---|---|---|---|---|---|
| SDXL-VAE | 4.42 | 24.7 +/- 3.9 | 0.73 +/- 0.13 | 0.88 +/- 0.27 | https://huggingface.co/stabilityai/sdxl-vae/blob/main/sdxl_vae.safetensors | as used in SDXL |
| original | 4.99 | 23.4 +/- 3.8 | 0.69 +/- 0.14 | 1.01 +/- 0.28 | https://ommer-lab.com/files/latent-diffusion/kl-f8.zip | as used in SD |
| ft-MSE | 4.70 | 24.5 +/- 3.7 | 0.71 +/- 0.13 | 0.92 +/- 0.27 | https://huggingface.co/stabilityai/sd-vae-ft-mse-original/resolve/main/vae-ft-mse-840000-ema-pruned.ckpt | resumed with EMA from ft-EMA, emphasis on MSE (rec. loss = MSE + 0.1 * LPIPS), smoother outputs |