A step-level GUI grounding dataset built on domain-randomized web pages for diagnosing visual and spatial heuristics in VLM agents.
GUI-Perturbed is an evaluation dataset for step-level GUI element localization. It is designed to expose and precisely diagnose the failure modes of vision-language model (VLM) GUI agents to examine whether models rely on rigid visual shortcuts rather… See the full description on the dataset page:
https://huggingface.co/datasets/figai/GUI-Perturbed.