reml-group/

FortisAVQA

FortisAVQA, a novel dataset designed for robustness evaluation, constructed in two stages:

Rephrasing test split questions from the MUSIC-AVQA dataset to increase linguistic diversity. Introducing distribution shifts across question splits to enable a refined robustness evaluation across rare, frequent, and overall question distributions.

Github: https://github.com/reml-group/fortisavqa Arxiv: https://arxiv.org/abs/2504.00487