This dataset contains Isaac Sim observation images for frame-level high-level action selection in robotic task planning.
Each sample includes:
an RGB observation image,
a task instruction,
a frame-level high-level action label,
an action type,
an optional target object.
The dataset is designed for execution-time high-level decision making, where a model selects the next high-level action from the current observation and task instruction.… See the full description on the dataset page:
https://huggingface.co/datasets/Kuoskyler/swiftplan-isaac-sim.