LLM Code Generation Benchmark for Ukrainian language
Preprint: https://arxiv.org/pdf/2511.05040
Updates
17/10/2025: paper presented at "Informatics. Culture. Technology" conference;
18/09/2025: added data preparation and evaluation notebooks (check notebooks readme first);
17/09/2025: updated result chart; added gpt-5, gpt-oss, and grok-4 evaluations.