This is the Middle Planning part of VideoGUI benchmark.
We uploaded the full metadata, recording at Google Drive.
"app" (str): The name of the application or system being used.
"subtask_query" (str): The query or input related to the subtask, which may guide the actions taken.
"screenshot_start" (image): The screenshot image representing the state at the beginning of the action.
"screenshot_end" (image): The screenshot image… See the full description on the dataset page:
https://huggingface.co/datasets/VideoGUI/VideoGUI-Mid-Plan.