import torch
from transformers import pipeline

audio = "path to the audio file to be transcribed"
device = "cuda:0" if torch.cuda.is_available() else "cpu"
modelTags="ARTPARK-IISc/whisper-small-vaani-hindi"
transcribe = pipeline(task="automatic-speech-recognition", model=modelTags, chunk_length_s=30, device=device)
transcribe.model.config.forced_decoder_ids = transcribe.tokenizer.get_decoder_prompt_ids(language="hi", task="transcribe")

print('Transcription: ', transcribe(audio)["text"])

Training and Evaluation

The models has finetuned using folllowing dataset Vaani ,Gramvaani IndicVoices, Fleurs,IndicTTS and Commonvoice

The performance of the model was evaluated using multiple datasets, and the evaluation results are provided below.

Dataset	WER
Gramvaani	32.49
Fleurs	19.08
IndicTTS	11.33
MUCS	28.44
Commonvoice	26.27
Kathbath	18.66
Kathbath Noisy	21.15
Vaani	26.62