Is this your dataset? Claim it with the Hugging Face account that owns it.

mercor/
APEX-SWE

Name: APEX-SWE
Creator: mercor
License: https://spdx.org/licenses/CC-BY-4.0.html

cc-by-4.0

2601.08806

Views

No views yet

APEX-SWE: Open-Source Evaluation Tasks

A benchmark suite of 50 open-source tasks for evaluating AI coding agents on real-world software engineering challenges. This dataset contains 25 integration tasks and 25 observability tasks.

For the evaluation harness (setup, running evaluations, scoring), see: https://github.com/Mercor-Intelligence/apex-swe For the technical report, see the arxiv paper: https://arxiv.org/pdf/2601.08806 For an accessible overview of APEX-SWE, see the blog:… See the full description on the dataset page: https://huggingface.co/datasets/mercor/APEX-SWE.