Views
No views yet
The New Standard for African Speech-to-Text
Automatic Speech Recognition — Powering high-accuracy transcription across the continent.Amharic (amh), Arabic (ara), Asante Twi (asanti), Bambara (bam), Baoulé (bau), Bemba (bem), Ewe (ewe), Fanti (fat), Fon (fon), French (fra), Ganda (lug), Hausa (hau), Igbo (ibo), Kabiye (kab), Kinyarwanda (kin), Kongo (kon), Lingala (lin), Luba-Katanga (lub), Luo (luo), Malagasy (mlg), Mossi (mos), Northern Sotho (nso), Nyanja (nya), Oromo (orm), Portuguese (por), Shona (sna), Somali (som), Southern Sotho (sot), Swahili (swa), Swati (ssw), Tigrinya (tir), Tsonga (tso), Tswana (tsn), Twi (twi), Umbundu (umb), Venda (ven), Wolof (wol), Xhosa (xho), Yoruba (yor), Zulu (zul), Tamazight (tzm), Sango (sag), Dinka (din).
| ASR Models | Architecture | #Parameters | 🤗 Hugging Face Model Card | Status |
|---|---|---|---|---|
| 🔥Simba-S🔥 | SeamlessM4T-v2 | 2.3B | 🤗 https://huggingface.co/UBC-NLP/Simba-S | ✅ Released |
| 🔥Simba-W🔥 | Whisper | 1.5B | 🤗 https://huggingface.co/UBC-NLP/Simba-W | ✅ Released |
| 🔥Simba-X🔥 | Wav2Vec2 | 1B | 🤗 https://huggingface.co/UBC-NLP/Simba-X | ✅ Released |
| 🔥Simba-M🔥 | MMS | 1B | 🤗 https://huggingface.co/UBC-NLP/Simba-M | ✅ Released |
| 🔥Simba-H🔥 | HuBERT | 94M | 🤗 https://huggingface.co/UBC-NLP/Simba-H | ✅ Released |
transformers library.1from transformers import pipeline
2
3# Load Simba-S for ASR
4asr_pipeline = pipeline(
5 "automatic-speech-recognition",
6 model="UBC-NLP/Simba-S" #Simba mdoels `UBC-NLP/Simba-S`, `UBC-NLP/Simba-W`, `UBC-NLP/Simba-X`, `UBC-NLP/Simba-H`, `UBC-NLP/Simba-M`
7)
8
9##### Load the multilingual African adapter (Only for `UBC-NLP/Simba-M`)
10asr_pipeline.model.load_adapter("multilingual_african") # Only for `UBC-NLP/Simba-M`
11###########################
12
13# Transcribe audio from file
14result = asr_pipeline("https://africa.dlnlp.ai/simba/audio/afr_Lwazi_afr_test_idx3889.wav")
15print(result["text"])
16
17
18# Transcribe audio from audio array
19result = asr_pipeline({
20 "array": audio_array,
21 "sampling_rate": 16_000
22})
23print(result["text"])
241# Simba-S
2{'text': 'watter verontwaardiging sou daar, in ons binneste gewees het.'}1# Simba-W
2{'text': 'watter veronwaardigingsel daar, in ons binneste gewees het.'}1# Simba-X
2{'text': 'fator fr on ar taamsodr is'}1# Simba-M
2{'text': 'watter veronwaardiging sodaar in ons binniste gewees het'}1# Simba-H
2{'text': 'watter vironwaardiging so daar in ons binneste geweeshet'}1
2@inproceedings{elmadany-etal-2025-voice,
3 title = "Voice of a Continent: Mapping {A}frica{'}s Speech Technology Frontier",
4 author = "Elmadany, AbdelRahim A. and
5 Kwon, Sang Yun and
6 Toyin, Hawau Olamide and
7 Alcoba Inciarte, Alcides and
8 Aldarmaki, Hanan and
9 Abdul-Mageed, Muhammad",
10 editor = "Christodoulopoulos, Christos and
11 Chakraborty, Tanmoy and
12 Rose, Carolyn and
13 Peng, Violet",
14 booktitle = "Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing",
15 month = nov,
16 year = "2025",
17 address = "Suzhou, China",
18 publisher = "Association for Computational Linguistics",
19 url = "https://aclanthology.org/2025.emnlp-main.559/",
20 doi = "10.18653/v1/2025.emnlp-main.559",
21 pages = "11039--11061",
22 ISBN = "979-8-89176-332-6",
23}
24