CobolCodeBench is an evaluation dataset of 46 Cobol programming tasks adapted from BigCodeBench-Hard. It's designed to benchmark code completion and code generation capabilities for legacy Cobol systems.

Github

For Source code and results analysis, check out our github.

Purpose

The Dataset has the following purposes:

Benchmarking: To provide a standardized evaluation framework for LLMs on COBOL code generation and completion tasks. Research:… See the full description on the dataset page: https://huggingface.co/datasets/harshini-kumar/CobolCodeBench.