ViMUL-Bench: A Culturally-diverse Multilingual Multimodal Video Benchmark
Overview
The evaluation toolkit to be used is lmms-eval. This toolkit facilitates the evaluation of models across multiple tasks and languages.
🌍 14 Languages: English, Chinese, Spanish, French, German, Hindi, Arabic, Russian, Bengali, Urdu, Sinhala, Tamil, Swedish, Japanese🎭 15 Categories: Including 8 culturally diverse categories (lifestyles, festivals, foods… See the full description on the dataset page:
https://huggingface.co/datasets/MBZUAI/ViMUL-Bench.