A Culturally Grounded Jailbreak Benchmark for African Languages
TukaBench is a safety benchmark for measuring whether large language models can be jailbroken in African languages — that is, tricked into producing harmful content such as fraud guides, election disinformation, or instructions for violence when the request is written in Amharic, Hausa, Igbo, Chichewa, Kiswahili, isiXhosa, or Yorùbá rather than English. Most existing safety benchmarks evaluate models in… See the full description on the dataset page:
https://huggingface.co/datasets/Victor-Akinode/tukabench.