RustEvo² is the first benchmark for evaluating LLMs' ability to adapt to evolving Rust APIs, as described in the paper "RustEvo²: An Evolving Benchmark for API Evolution in LLM-based Rust Code Generation".
Our work can be divided into two phases:
Phase I: API Evolution Data Collection - We collect API changes from multiple sources including official Rust repositories and third-party crates. We analyze changelogs, documentation, and… See the full description on the dataset page:
https://huggingface.co/datasets/SYSUSELab/RustEvo2.