Question answering on RICO screens: google-research-datasets/screen_qa.
These are the test-only complex questions.
BibTeX:
@misc{baechler2024screenai,
title={ScreenAI: A Vision-Language Model for UI and Infographics Understanding},
author={Gilles Baechler and Srinivas Sunkara and Maria Wang and Fedir Zubach and Hassan Mansoor and Vincent Etter and Victor Cărbune and Jason Lin and Jindong Chen and Abhanshu… See the full description on the dataset page:
https://huggingface.co/datasets/bevaya/RICO-ScreenQA-Complex.