yaya-sy/

bimodal-ift

An instruction dataset for speech->text and text->speech. This speech data is tokenized using the SpeechTokenize approach: https://arxiv.org/abs/2308.16692. You can do standard finetuning on this dataset using any LLM!