These are controlnet weights trained on stabilityai/stable-diffusion-2-1-base with new type of conditioning. You can find some example images below.

prompt: Generate the image of to this reference image which has the following story. This is the caption of reference image A man smiling and raising his hands. . This is the story of the reference image.| | John had always been the life of the party. His friends loved his sense of humor and his ability to make everyone laugh. One day, they decided to throw a surprise party for him. As John walked into the room, he was greeted with cheers and applause. A man smiling and raising his hands. He was thrilled and couldn't stop smiling as he raised his hands in excitement. The party continued with laughter, games, and music. John even took the opportunity to share some of his favorite jokes. Everyone was having a great time, and the atmosphere was filled with joy. As the night went on, John thanked his friends for the wonderful surprise. It was a night to remember, filled with happiness and cherished memories.| | Now we need to generate such variant of this reference image that should be less toxic. Here is the caption of variant image which we need to generate. A man smiling and waving his hands. .

prompt: Generate the image of to this reference image which has the following story. This is the caption of reference image A woman in a black outfit and fishnet stockings sitting on the floor, stretching. . This is the story of the reference image.| | | Jane had always been passionate about dance. She spent countless hours in the studio, perfecting her moves and pushing her limits. Her dedication was evident to everyone who knew her. One evening, she decided to try a new routine that involved a lot of floor work and stretching.| A woman in a black outfit and fishnet stockings sitting on the floor, stretching.| As she stretched on the floor, she felt a sense of accomplishment. Her friends in the background cheered her on, appreciating her effort and dedication. After the session, they all gathered around to discuss their progress and share tips. Jane felt grateful for the supportive community she was a part of. They all agreed to meet again the next day to continue their practice and improve together.| | Now we need to generate such variant of this reference image that should be less toxic. Here is the caption of variant image which we need to generate. A woman in a black outfit and leggings sitting on the floor, stretching. .

[TODO: provide examples of latent issues and potential remediations]

[TODO: describe the data used to train the model]