https://github.com/liaopeiyuan/artbench samples encoded to float16 SDXL latents via Ollin VAE.
Dataset created using this script.
Didn't bother saving mean & logvar, because variance is low enough it's not worth the doubling of filesize to retain.Sampled from diagonal gaussian distribution, saved the resulting latents.Also kept the original image.
Schema/usage:
from typing import TypedDict, Iterator
from webdataset import WebDataset
Sample = TypedDict('Sample', {
'
key': str,
'
url':… See the full description on the dataset page:
https://huggingface.co/datasets/Birchlabs/sdxl-latents-artbench.