Contains the following datasets downloaded with mtdata after deduplication and basic filtering with quickmt:
Statmt-commoncrawl_wmt13-1-deu-eng
Statmt-europarl_wmt13-7-deu-eng
Statmt-news_commentary_wmt18-13-deu-eng
Statmt-europarl-9-deu-eng
Statmt-europarl-7-deu-eng
Statmt-news_commentary-14-deu-eng
Statmt-news_commentary-15-deu-eng
Statmt-news_commentary-16-deu-eng
Statmt-news_commentary-17-deu-eng
Statmt-news_commentary-18-deu-eng… See the full description on the dataset page:
https://huggingface.co/datasets/quickmt/quickmt-train.de-en.
