This dataset contains human preference judgments for evaluating recovery plans in computer use agent (CUA) harm scenarios introduced in Human-Guided Harm Recovery for Computer Use Agents
The dataset contains 1,130 annotated plan pairs across 226 unique harm scenarios in computer use contexts. Each pair consists of two recovery plans (Plan A and Plan B) that were evaluated by human annotators to determine which plan… See the full description on the dataset page:
https://huggingface.co/datasets/christykl/cua-harm-recovery.