Spark TTS finetuned in genshin charactors voices.

• github code: https://github.com/nonwesjoe/genshin-sparktts
• kaggle notebook: https://www.kaggle.com/code/suziwsz/genshin-sparktts/

Available charactors

• paimon, hutao, furina, kazuha, xiao, mona, ganyu, xiangling, shotgun, citlali, barbara, zhongli, venti, nahida, kaeya, yaoyao, yoimiya, nilou.(each charactor in one full finetuned model)

Usage

• python 3.12 suggested
• git clone https://github.com/nonwesjoe/genshin-sparktts.git && cd genshin-sparktts
• when cuda is availabel, install torch 2.7.1 on cuda pip install torch torchaudio torchvision -i [object Object]
  else, install torch 2.7.1 on cpu pip install torch torchaudio torchvision -i [object Object]
• install other requirements pip install -r requirements.txt
• in terminal set some environment variables

export CHARACTOR=nahida                                         # or other charactors  
export MODEL_PATH=/kaggle/working/genshin/                      # your model path  
export INPUT_TEXT="楼下发荔枝了吗?那我们快去领取！"  # text to be converted  

• download model files: defaultly, download one specific charactor model set in environment variable CHARACTOR. model will be download in ./genshin
  ​
​

• run code to convert text to audio. audio outputs sparktts.wav.
  ​
​

Detail

• this model is trianed on float32 but saved as float16 for less VRAM and Storage usage.

Example

Acknowledgement

• Spark-TTS
• Genshin dataset
• Unsloth