opus-mt-pa-en-onnx

Export

File layout

./                      fp32 ONNX graphs (encoder_model.onnx, decoder_model.onnx, decoder_with_past_model.onnx) + tokenizer files
./int8/                 int8 dynamic-quantized ONNX graphs

Parity check

• src: ਇਹ ਇੱਕ ਕਿਤਾਬ ਹੈ।
  • pytorch greedy: This is a book.
  • onnx fp32 greedy: This is a book. (match)
  • pytorch beam4: This is a book.
  • onnx fp32 beam4: This is a book. (match)
  • onnx int8 greedy: This is a book.
• src: ਮੈਂ ਪੰਜਾਬੀ ਸਿੱਖ ਰਿਹਾ ਹਾਂ।
  • pytorch greedy: I am learning English.
  • onnx fp32 greedy: I am learning English. (match)
  • pytorch beam4: I am learning English.
  • onnx fp32 beam4: I am learning English. (match)
  • onnx int8 greedy: I am learning English.

Usage