This contains the merge of the SDXL VAE, with the SD1.5 unet, in assorted formats.
It's not particularly usable by itself. The colors are all wrong, etc.
It is mostly here as an open-source documented starting point for the XLsd model, which is currently in development.
Feel free to try to train it yourself! :)
Note that there are THREE versions of this model
a fp32 model, and a bf16 model, in single checkpoint format, and then the full huggingface diffusers format across the multiple subdirs.
Current advice, until proven otherwise, is that it is best to train on the fp32 model, in fp32, until it starts giving actual good output.
If you are in a hurry, the traditional "mixed precision" training method is to load fp32, tell your training program to use mixed
precision (bf16), but then STILL SAVE IN FP32. This is the critical bit.
Tbe bf16 model is here basically just for the curious, who want to poke at it on a small VRAM machine. Do not train on it.
Sample output:
image/png
PS: technically, I manually and seperately recreated the diffusers-format stuff after I had created the lone single-file versions.
I would not think anyone would really care, but I believe in full disclosure of resources.
