A flat, self-contained repackaging of the upstream
PinchBench skill suite (147 tasks,
BENCHMARK_VERSION 2.0.0) for agent-harness consumption. Task content is
unmodified — ids, filenames, prompts, rubrics and graders are byte-identical
to upstream, so scores stay comparable to the
pinchbench.com leaderboard.
Upstream ships tasks as a directory of markdown files plus a separate asset pool
that has to be fetched… See the full description on the dataset page:
https://huggingface.co/datasets/NEAR-AI/pinchbench.