Views
No views yet
[!TIP] This model is part of a suite of optimized/quantized ONNX versions of the base model. Other variants in this direction:
- FP32 (Full Precision / Base):
hari31416/indictrans2-en-indic-1B-ONNX(Current)- FP16 (Half Precision):
hari31416/indictrans2-en-indic-1B-ONNX-fp16- INT8 (Dynamic Quantization):
hari31416/indictrans2-en-indic-1B-ONNX-int8- Q4F16 (4-bit Block Quantization):
hari31416/indictrans2-en-indic-1B-ONNX-q4f16
ai4bharat/indictrans2-en-indic-1B
for in-browser and local edge inference.
| Format | Model Size | Exact Match (Token) | Exact Match (Text) | SacreBLEU (Raw) | Latency (Mean) | Speedup vs. FP32 |
|---|---|---|---|---|---|---|
| FP32 | 6.64 GB | 100.00% | 100.00% | 100.00 | 69.5 ms | 1.000x |
| FP16 | 3.32 GB | 99.73% | 99.73% | 100.00 | 74.3 ms | 0.935x |
| INT8 | 1.66 GB | 89.55% | 89.55% | 96.27 | 31.4 ms | 2.125x |
| Q4F16 | 850.5 MB | 82.45% | 82.55% | 91.99 | 58.4 ms | 1.186x |
encoder_model.onnx (and optional .onnx.data weights sidecar)decoder_model.onnx and decoder_with_past_model.onnx (share decoder_shared.onnx.data when present)translate.py — self-contained Python inference helper (see Usage below)tokenizer_src.json, tokenizer_tgt.json, tokenizer_meta.json)config.json, generation_config.json)1# translate.py is included in this repo alongside the ONNX bundle.
2# You can also find it (and read the full source) at:
3# https://github.com/Hari31416/indictrans2-onnx-export/blob/main/src/translate.py
4
5from translate import IndicTransONNX
6
7# Pass a HF repo ID for automatic download, or a local bundle directory path
8model = IndicTransONNX("hari31416/indictrans2-en-indic-1B-ONNX")
9print(model.translate("Who will win the election?", src_lang="eng_Latn", tgt_lang="hin_Deva"))pip install onnxruntime tokenizers huggingface-hub