ToolBench-X is the first benchmark for evaluating tool-using agents under recoverable tool-environment unreliability, which features executable multi-step tool-use tasks, structured reliability hazards, and automatic evaluation of hazard diagnosis and recovery capabilities.
ToolBench-X contains 1,106 tasks, including 378 sequential, 358 parallel, and 370⦠See the full description on the dataset page:
https://huggingface.co/datasets/Foreverskyou/ToolBench-X.