This is a component of the VIRES model, as presented in
VIRES: Video Instance Repainting with Sketch and Text Guidance. VIRES is a video instance repainting method with sketch and text guidance, enabling video instance repainting, replacement, generation, and removal. It leverages the generative priors of text-to-video models to maintain temporal consistency and produce visually pleasing results.
1@article{vires,
2 title={VIRES: Video Instance Repainting via Sketch and Text Guided Generation},
3 author={Weng, Shuchen and Zheng, Haojie and Zhang, Peixuan and Hong, Yuchen and Jiang, Han and Li, Si and Shi, Boxin},
4 journal={arXiv preprint arXiv:2411.16199},
5 year={2024}
6}
