[!TIP] This model is part of a suite of optimized/quantized ONNX versions of the base model. Other variants in this direction:

FP32 (Full Precision / Base): hari31416/indictrans2-indic-indic-dist-320M-ONNX (Current)

FP16 (Half Precision): hari31416/indictrans2-indic-indic-dist-320M-ONNX-fp16

INT8 (Dynamic Quantization): hari31416/indictrans2-indic-indic-dist-320M-ONNX-int8

Q4F16 (4-bit Block Quantization): hari31416/indictrans2-indic-indic-dist-320M-ONNX-q4f16

ONNX-exported and quantized version of ai4bharat/indictrans2-indic-indic-dist-320M for in-browser and local edge inference.

Precision: FP32 (Full Precision)
Description: Baseline full-precision ONNX export.
Source Pipeline & Details: For pipeline details, benchmarks, and usage instructions, see the indictrans2-onnx-export GitHub repository.

Built for use with Transformers.js and onnxruntime-web in the browser, with fast BPE tokenizer.json files that don't require the SentencePiece WASM runtime.

Performance Visualizations

These charts show overall tradeoffs, language-level parity, and category breakdown.

Performance Tradeoffs & Size Comparison

Compared against the FP32 ONNX oracle on the golden evaluation fixtures.

Format	Model Size	Exact Match (Token)	Exact Match (Text)	SacreBLEU (Raw)	Latency (Mean)	Speedup vs. FP32
FP32	1.87 GB	100.00%	100.00%	100.00	23.0 ms	1.000x
FP16	980.2 MB	99.82%	99.82%	100.00	27.4 ms	0.840x
INT8	497.1 MB	72.18%	72.36%	87.13	16.5 ms	1.475x
Q4F16	711.6 MB	45.91%	46.36%	71.64	28.3 ms	0.829x

Files

encoder_model.onnx (and optional .onnx.data weights sidecar)
decoder_model.onnx and decoder_with_past_model.onnx (share decoder_shared.onnx.data when present)
translate.py — self-contained Python inference helper (see Usage below)
Fast tokenizer config files (tokenizer_src.json, tokenizer_tgt.json, tokenizer_meta.json)
Model configuration configs (config.json, generation_config.json)

Usage Example (Python, onnxruntime)

python

# translate.py is included in this repo alongside the ONNX bundle.
# You can also find it (and read the full source) at:
#   https://github.com/Hari31416/indictrans2-onnx-export/blob/main/src/translate.py

from translate import IndicTransONNX

# Pass a HF repo ID for automatic download, or a local bundle directory path
model = IndicTransONNX("hari31416/indictrans2-indic-indic-dist-320M-ONNX")
print(model.translate("चुनाव कौन जीतेगा?", src_lang="hin_Deva", tgt_lang="tam_Taml"))

Required packages:

pip install onnxruntime tokenizers huggingface-hub

License

MIT (preserved from upstream AI4Bharat).