Evaluation of the correctness of the written code for Python, Java and Go. Correctness means the absent of any errors including SyntaxError, Runtime Error etc. and the successful tests passing as well. The dataset contains 1361 tasks.
Evaluated skills: Instruction Following, Code Perception, Simulation, Error Classification
Contributors: Elena Bruches, Ivan Bondarenko, Daniil Grebenkin, Oleg Sedukhin, Roman Derunets, Georgii Mkrtchyan… See the full description on the dataset page: https://huggingface.co/datasets/MERA-evaluation/CodeCorrectness.
