Whisper finetune for Japanese focused on general/anime domains. For usage instructions follow
openai/whisper-large-v3-turbo. Due to vocab changes ctranslate2>=4.7.1 required for faster-whisper. For inference engines with hardcoded vocab, the token embedding can be padded.
Finetuned from
base with pruned vocab and encoder conv adaption, indices can be found in
mapping.txt. Trained decoder only for 2^20 steps, batch size 64. Using a 45000 hour corpus (largest source is 17000 of filtered reazonspeech-all) with custom mixing ratio and augmentation to maintain long form performance and timestamps.
Benchmarks. Competitive for size on test sets, particually good on JSUT-book. Also trained for lyrics but untested.