opus-mt-st-en-onnx

Export

File layout

./                      fp32 ONNX graphs (encoder_model.onnx, decoder_model.onnx, decoder_with_past_model.onnx) + tokenizer files
./int8/                 int8 dynamic-quantized ONNX graphs

Parity check

• src: Ena ke buka.
  • pytorch greedy: This is a book.
  • onnx fp32 greedy: This is a book. (match)
  • pytorch beam4: This is a book.
  • onnx fp32 beam4: This is a book. (match)
  • onnx int8 greedy: This is a book.
• src: Ke ithuta Sesotho.
  • pytorch greedy: I study English.
  • onnx fp32 greedy: I study English. (match)
  • pytorch beam4: I study English.
  • onnx fp32 beam4: I study English. (match)
  • onnx int8 greedy: I study English.

Usage