int8 CTranslate2 serving bundle for ~60 Cameroonian languages (French-pivot MarianMT).
This repository is the quantized (int8) CTranslate2 serving bundle that powers translation for roughly 60 Cameroonian languages. Every model is a MarianMT translation model converted to the CTranslate2 format and quantized to int8.
All language pairs are French-pivot: translation goes either French -> local language (francais-<lang>) or local language -> French (<lang>-francais). To translate between two local languages, pivot through French.
Compared to the original fp32 PyTorch checkpoints, this int8 bundle is roughly 3.8x smaller on disk and runs about 6x faster at inference, which makes it practical to serve many languages from modest hardware.
Repository layout
Each subfolder is exactly one translation direction (one pair), and contains the full CTranslate2 model plus its tokenizer: