CRUST-bench evaluates C-to-safe-Rust repository-level transpilation. This dataset was used for evaluation in the paper Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code. You can find the corresponding evaluation code in the project GitHub repository.

Example Usage

from datasets import load_dataset import json

dataset = load_dataset("eth-sri/CRUST-bench") for instance in dataset["test"]: print(json.dumps(instance, indent=2))… See the full description on the dataset page: https://huggingface.co/datasets/eth-sri/CRUST-bench.