Views
No views yet
ibo_Latn as a close proxy during training and inference.1from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
2
3model_id = "luel/nllb-200-distilled-600M-ft-en-efi"
4
5tokenizer = AutoTokenizer.from_pretrained(model_id, use_auth_token=True, src_lang="eng_Latn")
6model = AutoModelForSeq2SeqLM.from_pretrained(model_id, use_auth_token=True)
7
8input_example = "How are you?"
9inputs = tokenizer(input_example, return_tensors="pt")
10
11generated_ids = model.generate(
12 **inputs, forced_bos_token_id = tokenizer.convert_tokens_to_ids("ibo_Latn"), max_length=30
13)
14print(tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0])| Item | Value |
|---|---|
| Base model | facebook/nllb-200-distilled-600M |
| Dataset | Davlan/ibom-mt-en-efi |
| Script | lafand-mt |
| Epochs | 8 |
| Effective batch size | 32 (16 × 2 grad-accum) |
| Learning rate | 3e-5 |
| Mixed precision | bf16 |
| Early stopping | Patience = 3, min_delta (BLEU) = 0.001 |
| Metric | en->efi |
|---|---|
| BLEU | 39.9 |
| chrF | 58.5 |