What this dataset tests
Whether claimed success matches physical outcome
Whether constraints are respected
Whether failure is acknowledged
Why this exists
Robots often narrate successPhysics disagrees
This set forces contact with reality
Data format
Each row contains
initial_state
commanded_action
physical_constraints
observed_outcome
claimed_outcome
Feed the model
initial_state
commanded_action
physical_constraints
observed_outcome
claimed_outcome
