This is an Italian finetune for F5-TTS
Italian only so can't speak english properly
Trained over 73+ hours of "train" split of ylacombe/cml-tts dataset
with 8xRTX4090, still in progress, using gradio finetuning app using following settings:
Data extracted from the datasource has been preprocessed in its transcription.
From my understanding, punctuation is important because it's used to teach to have pauses and proper intonation so it has been preserved.
Original italian "text" field was even containing direct dialogue escapes (long hyphen) that has also be preserved but it contained also
a hypen that was used to split a word in a new line (I don't know which process was used on original dataset to create the text transcription)
and so I removed that hypens merging the two part of the word, otherwise the training was done on artifacts that didn't impacted the speech.
I'm only talking about Italian data on cml-tts, I don't know if other languages are affected by this too.
Current most trained model
model_159600.safetensors (~290 Epoch)
known problems
catastrophic failure (being Italian only, lost english skill). A proper multilanguage dataset should be used instead of single language.
not perfect pronunciation
numbers must be converter in letters to be pronunced in italian
a better dataset with more diverse voices would help improving zero-shot cloning
checkpoints folder
Contains the weight of the checkpoints at specific steps, the higher the number, the further it went into training.
Weights in this folder can be used as starting point to continue training.
Ping me back if you can further finetune it to reach a better result
