A benchmark for measuring the intrinsic harness-evolving capability of language models.
Overview of the Evo-Bench evaluation pipeline.
608 harness-sensitive tasks from five established benchmarks, spanning
Search, Office, and General agent domains with disjoint validation and
evaluation suites.
Harness-guided benchmark construction selects tasks that respond to
harness improvements… See the full description on the dataset page:
https://huggingface.co/datasets/RUC-AIBOX/Evo-Bench.