m-a-p/

MdEval

	MDEVAL: Massively Multilingual Code Debugging




    

Official repository for our paper "MDEVAL: Massively Multilingual Code Debugging"

🏠 Home Page  •
📊 Benchmark Data  •
🏆 Leaderboard  





	
	Introduction

MDEVAL is a massively multilingual debugging benchmark covering 20 programming languages with 3.9K test samples and three tasks focused on bug fixing. It substantially pushes the limits of code LLMs in multilingual… See the full description on the dataset page: https://huggingface.co/datasets/m-a-p/MdEval.