1499 robot rollout episodes from a hierarchical policy evaluated in simulated RoboCasa
kitchens. A System2 planner watches the video of the step just executed and issues
the next natural-language subgoal; a System1 policy executes that subgoal as
low-level actions and predicts how far through it it is. Each episode here is one video
plus one JSON describing what was being attempted, frame by frame.
Layout… See the full description on the dataset page: https://huggingface.co/datasets/TRI-ML/s1-progact270k-s2-qwen35-4b-full-ep3-11416-v2.
