LLM Code Generation Benchmark for Ukrainian language
Preprint: https://arxiv.org/pdf/2511.05040
Updates
18/09/2025: added data preparation and evaluation notebooks (check notebooks readme first);
17/09/2025: updated result chart; added gpt-5, gpt-oss, and grok-4 evaluations;
17/09/2025: paper - end of September, stay tuned;