tohoku-nlp/

JMultiPL-E

	Dataset Card for "JMultiP-E"




	
	Dataset Summary

JMultiPL-E is a dataset for evaluating large language models for code generation that supports 17 programming languages. It takes the OpenAI HumanEval and uses little compilers to translate them to other languages. It is easy to add support for new languages and benchmarks. The dataset is divided into several configurations named SRCDATA-LANG, where SRCDATA is either "humaneval" and LANG is one of the supported languages. We… See the full description on the dataset page: https://huggingface.co/datasets/tohoku-nlp/JMultiPL-E.