Model: OPUS-MT
Tested on: Tatoeba
Metric:
bleu(tensorflow),
sacrebleu(github->mjpost),
google_bleu(nltk),
rouge(google-research),
meteor(nltk),
ter(university of Maryland)
Retrieved from: Huggingface metrics
Script used for translation and testing:
https://gitlab.com/hmtkvs/machine_translation/-/tree/production-stable
Info
mtdata-OPUS Tatoeba (length=14178, single reference)
rouge-mid : precision=0.7792… See the full description on the dataset page:
https://huggingface.co/datasets/frtna/es_it_Results-base-OPUS_Tatoeba.