ComputeEval is a benchmark for evaluating LLM-generated CUDA code on correctness and performance. Each problem provides a self-contained programming challenge — spanning kernels, runtime APIs, memory management, parallel algorithms, and GPU libraries — with a held-out test harness for functional validation and optional performance benchmarks for measuring GPU execution time against a baseline.
Homepage: github.com/NVIDIA/compute-eval
For periodic… See the full description on the dataset page:
https://huggingface.co/datasets/nvidia/compute-eval.
