Contains the following datasets downloaded with mtdata after deduplication and basic filtering with quickmt:
OPUS-ccaligned-v1-ben-eng
OPUS-ccmatrix-v1-ben-eng
OPUS-nllb-v1-ben-eng
OPUS-wikimatrix-v1-ben-eng
Statmt-pmindia-1-eng-ben
JoshuaDec-indian_training-1-ben-eng
JoshuaDec-indian_dev-1-ben-eng
JoshuaDec-indian_test-1-ben-eng
JoshuaDec-indian_devtest-1-ben-eng
JoshuaDec-indian_dict-1-ben-eng
Neulab-tedtalks_train-1-eng-ben… See the full description on the dataset page:
https://huggingface.co/datasets/quickmt/quickmt-train.bn-en.