IDM-Single is part of the IDMBench in AgentStudio for evaluating agent's ability to learn from Internet-scale videos without action labels. Specifically, this dataset requires VLMs to answer the action transition between two screenshots. Please note that this dataset is a test set rather than a training set. Therefore, please do not use it for training. More details are provided in the project page.
