The exact 100 videos that the reported Robometer failure-detection results are
computed on: 81 trajectories across 7 tasks, external and wrist views (43 ext / 57
wrist), labels successful / suboptimal / failure (suboptimal counted as failure
at evaluation time).
Tasks: foldtowel, movebanana, movemouse, pourpebble, pulltissue, putspoon, stirpot.
Reported F1 uses failure as the positive class, and the "Average" row is… See the full description on the dataset page:
https://huggingface.co/datasets/myconnects/robometer_failure_detection.
