The CodeUpdateArena dataset, a benchmark for knowledge editing in the code domain. An instance in our benchmark consists of a synthetic API function update paired with a program synthesis example that uses the updated functionality.
Supported Tasks and Leaderboards
Languages
The programming problems are written in Python and contain English natural text in comments and docstrings.
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/leo-liuzy/CodeUpdateArena.
