You can deploy this model and start earning money today!

smtiitm/
generate_Lipsynced_videos_online

Name: generate_Lipsynced_videos_online
Availability: InStock

Views

No views yet

Lip-Sync Video Generation using gTTS (Google TTS)

NOTE: Please use this if you want to use Google TTS (or any other API but make channges appropriately).

This project generates a lip-synced video based on an original video and translated subtitles.

generate_Lipsync_videos - In this project, we maintained the constant speed of the audio and slowed down the video by interpolating the video frames. This approach ensured proper synchronization between the audio and video, resulting in a video duration longer than the original.

Prerequisites

Conda
Python 3.8

Setup

Clone the repository:

bash
1git clone https://huggingface.co/smtiitm/generate_Lipsynced_videos_online 2cd generate_Lipsynced_videos_online #generate_Lipsync_videos
Create and activate the conda environment:

bash
1conda create -n lipsync_env python=3.8 2conda activate lipsync_env
Install the required packages:

pip install -r requirements.txt
Currently the code uses gTTS APIs for text-to-speech generation. You can use your own TTS API (make sure to use the correct payload given in vtt_to_speech.py file) URL in srt_to_audio_original file.

Usage

Edit the run_script.sh file to assign the paths to your original video and translated subtitles:

bash
1original_video_path="path/to/original_video.mp4" 2translated_srt_path="path/to/translated_subtitles.srt"
Assign the target language code in run_script.sh:

target_language_code="hin" # Example: 'hin' for Hindi
Run the script:

./run_script.sh
Current supported sampling rate is 22.5KHz and .wav format is preferred.