CaptchaArena is a multimodal benchmark for evaluating GUI / computer-use agents on their ability to solve CAPTCHA puzzles. It spans 20 CAPTCHA task families (point-and-click, counting, rotation alignment, drag-to-fit, press-and-hold, connect-the-icons, …), each rendered as one or more screenshot images with an instruction and a machine-checkable ground-truth answer, so agent solutions can be scored automatically. Held-out Val / Test splits give a standardized… See the full description on the dataset page:
https://huggingface.co/datasets/ZHEN-04/CaptchaArena.
