Paper: Do Multilingual VLMs Reason Equally? A Cross-Lingual Visual Reasoning Audit for Indian Languages
This dataset contains ~1,000 visual reasoning questions translated from English into 6 Indian languages:
Hindi (hi), Tamil (ta), Telugu (te), Bengali (bn), Kannada (kn), Marathi (mr).
Source benchmarks: MathVista (testmini), ScienceQA, MMMU
Translation: IndicTrans2 (AI4Bharat), verified against GPT-4o/Gemini… See the full description on the dataset page:
https://huggingface.co/datasets/Swastikr/multilingual-vlm-reasoning.