Kaiju is a curated evaluation dataset for assessing AI code-generation models on the task of generating complete libraries from natural-language specifications. The dataset supports multiple programming languages including Python, Java, Go, Rust, TypeScript, JavaScript, C, and C++. Each instance is an open-source repository pinned at specific commits with containerized execution environments and comprehensive test… See the full description on the dataset page: https://huggingface.co/datasets/singhprakhar/kaiju-samples.
