RepoExec: Evaluate Code Generation with a Repository-Level Executable Benchmark
Dataset Summary
RepoExec is a novel benchmark designed to evaluate code generation at the repository level with a focus on executability and correctness. This benchmark addresses the gaps in existing systems by emphasizing real-world applicability and providing a comprehensive assessment of code functionality. It aims to provide a comprehensive evaluation of code functionality and alignment… See the full description on the dataset page: https://huggingface.co/datasets/Fsoft-AIC/RepoExec.
