MasakhaNER-X is an aggregation of MasakhaNER 1.0 and MasakhaNER 2.0 datasets for 20 African languages. The dataset is not in CoNLL format. The input is the original raw text while the output is byte-level span annotations.
Example:
{"example_id": "test-00015916", "language": "pcm", "text": "By Bashir Ibrahim Hassan", "spans": [{"start_byte": 3, "limit_byte": 24, "label": "PER"}], "target": "PER: Bashir Ibrahim Hassan"}
MasakhaNER-X is a named entity dataset consisting of PER, ORG, LOC, and DATE entities annotated by Masakhane for twenty African languages:
- Amharic
- Ghomala
- Bambara
- Ewe
- Hausa
- Igbo
- Kinyarwanda
- Luganda
- Luo
- Mossi
- Chichewa
- Nigerian-Pidgin
- chiShona
- Swahili
- Setswana
- Twi
- Wolof
- Xhosa
- Yoruba
- Zulu
The train/validation/test sets are available for all the twenty languages.
For more details see https://aclanthology.org/2022.emnlp-main.298
