Contains the following datasets downloaded with mtdata after deduplication and basic filtering with quickmt:
Statmt-news_commentary-14-eng-ind
Statmt-news_commentary-15-eng-ind
Statmt-news_commentary-16-eng-ind
Statmt-news_commentary-17-eng-ind
Statmt-news_commentary-18-eng-ind
Statmt-news_commentary-18.1-eng-ind
Statmt-ccaligned-1-eng-ind_ID
Facebook-wikimatrix-1-eng-ind
Neulab-tedtalks_train-1-eng-ind
Neulab-tedtalks_dev-1-eng-ind… See the full description on the dataset page:
https://huggingface.co/datasets/quickmt/quickmt-train.id-en.