Authors
Xinyang Li1,2,
Gen Li2,
Zhihui Lin1,3,
Yichen Qian1,3 †,
Gongxin Yao2,
Weinan Jia1,
Aowen Wang1,
Weihua Chen1,3,
Fan Wang1,3
1Xunguang Team, DAMO Academy, Alibaba Group
2Zhejiang University
3Hupan Lab
1# 1. Create base environment
2conda create -n moda python=3.10 -y
3conda activate moda
4
5# 2. Install requirements
6pip install -r requirements.txt
7
8# 3. Install ffmpeg
9sudo apt-get update
10sudo apt-get install ffmpeg -y
This project is intended for academic research, and we explicitly disclaim any responsibility for user-generated content. Users are solely liable for their actions while using the generative model. The project contributors have no legal affiliation with, nor accountability for, users' behaviors. It is imperative to use the generative model responsibly, adhering to both ethical and legal standards.
We would like to thank the contributors to the
LivePortrait, and
echomimic,
JoyVasa,
Ditto,
Open Facevid2vid,
InsightFace,
X-Pose,
DiffPoseTalk,
Hallo,
wav2vec 2.0,
Chinese Speech Pretrain,
Q-Align,
Syncnet, and
VBench repositories, for their open research and extraordinary work.
If we missed any open-source projects or related articles, we would like to complement the acknowledgement of this specific work immediately.
1@article{li2025moda,
2 title={MoDA: Multi-modal Diffusion Architecture for Talking Head Generation},
3 author={Li, Xinyang and Li, Gen and Lin, Zhihui and Qian, Yichen and Yao, GongXin and Jia, Weinan and Chen, Weihua and Wang, Fan},
4 journal={arXiv preprint arXiv:2507.03256},
5 year={2025}
6}
