MultiPL-E is a dataset for evaluating large language models for code
generation that supports 22 programming languages. It takes the OpenAI
HumanEval and the Mostly Basic Python Programs (MBPP) benchmarks and uses little compilers to
translate them to other languages. It is easy to add support for new languages
and benchmarks.
The dataset is divided into several configurations named SRCDATA-LANG, where
SRCDATA is… See the full description on the dataset page: https://huggingface.co/datasets/USER-NEURAL/MultiPL-E.
