Mobile World is a substantially more challenging mobile-use benchmark designed to better reflect real-world mobile usage. It comprises 201 tasks across 20 applications, featuring long-horizon, cross-app tasks, and novel task categories including agent-user interaction and MCP-augmented tasks.
The difficulty of Mobile World is twofold:
Long-horizon, cross-application tasks.… See the full description on the dataset page:
https://huggingface.co/datasets/Tongyi-MAI/MobileWorld.