How well does your ASR model actually work in the wild?
Vividh-ASR is a complexity-stratified benchmark that tells you exactly where your model succeeds — and where it falls apart.
Most Indic ASR benchmarks evaluate models on clean, studio-recorded speech. Real-world audio is not that. Vividh-ASR organises evaluation by acoustic complexity rather than domain, exposing the studio-bias that plagues models fine-tuned predominantly on read… See the full description on the dataset page:
https://huggingface.co/datasets/adalat-ai/vividh-test-hindi.
