opus-mt-sm-en-onnx

Export

File layout

./                      fp32 ONNX graphs (encoder_model.onnx, decoder_model.onnx, decoder_with_past_model.onnx) + tokenizer files
./int8/                 int8 dynamic-quantized ONNX graphs

Parity check

• src: O se tusi lenei.
  • pytorch greedy: This is a book.
  • onnx fp32 greedy: This is a book. (match)
  • pytorch beam4: This is a book.
  • onnx fp32 beam4: This is a book. (match)
  • onnx int8 greedy: This is a book.
• src: O loʻo ou aʻoaʻoina le gagana Samoa.
  • pytorch greedy: I'm learning English.
  • onnx fp32 greedy: I'm learning English. (match)
  • pytorch beam4: I'm learning English.
  • onnx fp32 beam4: I'm learning English. (match)
  • onnx int8 greedy: I'm learning English.

Usage