EvalRepair-C++ is a benchmark for evaluating C++ program repair performance, derived from HumanEval. It contains 164 single-function repair tasks, each with a buggy implementation and its corresponding fixed version.
Program Repair: Fixing bugs in C++ functions
Code Generation: Generating correct implementations from buggy code
task_id: Unique identifier for the task (same as HumanEval)… See the full description on the dataset page:
https://huggingface.co/datasets/barty/EvalRepair-Cpp.