In tackling the challenge of agent out-of-sync, SyncBench is released as a part of our work SyncMind: Measuring Agent Out-of-Sync Recovery In Collaborative Software Engineering
Task: Agent out-of-sync
SyncBench
In our current version, we construct SyncBench based on 21 popular GitHub repositories, while our dataset construction approach allows adaptive upsampling and downsampling for custom needs… See the full description on the dataset page:
https://huggingface.co/datasets/xuehang/SyncBench.
