This model is a quantized version of facebook/nllb-200-distilled-600M, which is released under the CC-BY-NC-4.0 license. The same license applies to this conversion.
Model description
NLLB-200 (No Language Left Behind) is a machine translation model from Meta AI that supports translation across 200 languages. This is the distilled 600M parameter variant, quantized to INT8 with CTranslate2.
Research in machine translation, especially for low-resource languages. Single sentence translation among 200 languages.
Metrics
Evaluated using BLEU, spBLEU, and chrF++ on the Flores-200 dataset.
Evaluation Data
Flores-200 dataset, preprocessed with SentencePiece.
Training Data
Parallel multilingual data from multiple sources and monolingual data from Common Crawl. See Section 5 of the paper for details.
Ethical Considerations
The original NLLB-200 model may produce mistranslations that could have adverse impacts if used for critical decisions (health, safety). Training data mined from public web sources may contain personally identifiable information despite cleaning efforts. This model should not be used for certified translations or domain-specific text (medical, legal).
Caveats and Recommendations
Tested primarily on Wikimedia domain. Input length should not exceed 512 tokens. Language variations may not be fully captured. Users should make appropriate assessments for their use case.
