This repository is an updated version of the NASA Code Retrieval Benchmark. It provides a code retrieval benchmark based on code from 7 programming languages sourced from NASA's GitHub repositories.

What's New in v0.1.1?

v0.1.1 introduces a hierarchical structure and official Hugging Face dataset configurations. This allows you to evaluate models specifically by language or by query category without data redundancy in the file system.… See the full description on the dataset page: https://huggingface.co/datasets/nasa-impact/nasa-science-code-benchmark-v0.1.1.