Property	Value
Model Type	Seq2Seq Translation
Translation Direction	Northern Sotho → English
Base Model	facebook/nllb-200-distilled-600M
Domain	Scientific/Academic texts
Training	Full fine-tuning on AfriScience-MT dataset

Evaluation Results

Performance on the AfriScience-MT test set:

Split	BLEU	chrF	SSA-COMET
Validation	47.19	66.69	67.88
Test	43.04	63.21	66.67

Metrics explanation:

BLEU: Measures n-gram overlap with reference translations (0-100, higher is better)
chrF: Character-level F-score, robust for morphologically rich languages (0-100, higher is better)
SSA-COMET: Neural metric trained for Sub-Saharan African languages, shown as percentage (0-100, higher is better) (McGill-NLP/ssa-comet-stl)

Usage

Quick Start

python

from transformers import AutoModelForSeq2SeqLM, AutoTokenizer

model_id = "dsfsi/nllb_200_distilled_600m-nso-eng"
model = AutoModelForSeq2SeqLM.from_pretrained(model_id)
tokenizer = AutoTokenizer.from_pretrained(model_id)

# Set source language
tokenizer.src_lang = "nso_Latn"

# Translate
text = "The mitochondria is the powerhouse of the cell."
inputs = tokenizer(text, return_tensors="pt", padding=True, truncation=True, max_length=256)

# Generate with target language
forced_bos_token_id = tokenizer.convert_tokens_to_ids("eng_Latn")
outputs = model.generate(**inputs, forced_bos_token_id=forced_bos_token_id, max_length=256, num_beams=5)
translation = tokenizer.batch_decode(outputs, skip_special_tokens=True)[0]
print(translation)

Batch Translation

python

texts = [
    "Climate change affects agricultural productivity.",
    "The study analyzed genetic markers in the population.",
    "Renewable energy sources are essential for sustainable development."
]

inputs = tokenizer(texts, return_tensors="pt", padding=True, truncation=True, max_length=256)
outputs = model.generate(**inputs, forced_bos_token_id=forced_bos_token_id, max_length=256, num_beams=5)
translations = tokenizer.batch_decode(outputs, skip_special_tokens=True)
for src, tgt in zip(texts, translations):
    print(f"{src}\n→ {tgt}\n")

Training Details

Hyperparameters

Parameter	Value
Epochs	10
Batch Size	2
Learning Rate	2e-05

Training Data

Dataset: AfriScience-MT
Domain: Scientific abstracts and papers
Languages: English and 6 African languages (Amharic, Hausa, Luganda, Northern Sotho, Yoruba, isiZulu)

Reproducibility

To reproduce this model:

bash

# Clone the AfriScience-MT repository
git clone https://github.com/afriscience-mt/afriscience-mt.git
cd afriscience-mt

# Install dependencies
pip install -r requirements.txt

# Run training
python -m afriscience_mt.scripts.run_seq2seq_training \
    --data_dir ./data \
    --source_lang nso \
    --target_lang eng \
    --model_name facebook/nllb-200-distilled-600M \
    --model_type nllb \
    --output_dir ./output \
    --num_epochs 10 \
    --batch_size 16 \
    --learning_rate 2e-5

Limitations

Domain Specificity: This model is optimized for scientific/academic texts and may perform poorly on colloquial or informal text.
Language Coverage: Only supports the specific language pair indicated.
Input Length: Maximum input length is 256 tokens; longer texts should be split into segments.

Citation

If you use this model, please cite the AfriScience-MT paper (arXiv:2605.29741):

bibtex

@article{abdulmumin2026afriscience,
  title   = {AfriScience-MT: Towards Decolonizing Science in Africa through Text Translation},
  author  = {Abdulmumin, Idris and Gwadabe, Tajuddeen and Muhammad, Shamsuddeen Hassan and Adelani, David Ifeoluwa and Khalo, Nomonde and Ahmad, Ibrahim Said and Modupe, Abiodun and Mumm, Anina and Biyela, Sibusiso and Rabie, Michelle and Havemann, Johanna and Rei, Marek and Abbott, Jade and Marivate, Vukosi},
  journal = {arXiv preprint arXiv:2605.29741},
  year    = {2026},
  url     = {https://arxiv.org/abs/2605.29741}
}

License

This model is released under the Apache 2.0 License.

Acknowledgments

Built on top of {base_model}
Evaluation using SSA-COMET for African language assessment