opus-mt-ml-en-onnx

Export

File layout

./                      fp32 ONNX graphs (encoder_model.onnx, decoder_model.onnx, decoder_with_past_model.onnx) + tokenizer files
./int8/                 int8 dynamic-quantized ONNX graphs

Parity check

• src: ഇത് ഒരു പുസ്തകമാണ്.
  • pytorch greedy: It's a book.
  • onnx fp32 greedy: It's a book. (match)
  • pytorch beam4: It's a book.
  • onnx fp32 beam4: It's a book. (match)
  • onnx int8 greedy: It's a book.
• src: ഞാൻ മലയാളം പഠിക്കുന്നു.
  • pytorch greedy: I study English.
  • onnx fp32 greedy: I study English. (match)
  • pytorch beam4: I study English.
  • onnx fp32 beam4: I study English. (match)
  • onnx int8 greedy: I study English.

Usage