This benchmark was the Web-CogBench mentioned in the paper Web-CogReasoner: Towards Knowledge-Induced Cognitive Reasoning for Web Agents..
The Web-CogBench is used to evaluate Web-CogReasoner, which achieves 84.4 @ Web-CogBench, 86.3 @ VisualWebBench, 30.2% @ WebVoyager, 17.0% and 10.1% @ Online Multimodal-Mind2Web Cross-Tasks and Cross-Webs.
Statistics of the Web-CogBench
Cognition
Task Types
Total Samples
Memorizing
Element… See the full description on the dataset page: https://huggingface.co/datasets/Gnonymous/Web-CogBench.
