This is my second attempt to create such model. This time i changed dataset to always consist 9 frames, but it doesn't help much.
Appendix
This is demonstration only. This is my first time where i wrote training script of such complicated model in flax framework. Scirpt is probably full of bugs. Dataset that i prepared is also far from perfect. But I'm happy that i can train, save, and load my custom SDXL model.
How to use
Intented to use with FLAX
Model will generate ugly sprite animations, out of shape, deformed, pixelated and uneven.
Prompt ideas
"Pixel-art animation of a blue water droplet with legs, that: is swiniging axe, facing: East",
"Pixel-art animation of a Tree, that: is Idle, facing: South",
"Pixel-art animation of a Dinosaur with a backpack, that: is jumping, facing: North",
"Pixel-art animation of a Fire demon with axe, that: is running, facing West",
Samples of the output of this model can be seen here:
