Manipulation episodes from Isaac Lab collected for probing physics understanding in video world models (V-JEPA 2, VideoMAE, DINOv2). Each episode includes dual-camera RGB (384×384), robot state, scripted/RL actions, and per-timestep physics ground truth (contact forces, object kinematics, physics randomization parameters).
Push
1,500
Scripted (random direction, no target — Step… See the full description on the dataset page:
https://huggingface.co/datasets/leesangoh/dynamics-probing.