Frozen, canonical raw bitext consolidated from upstream alvations/mtdata-raw* snapshots (since deleted). This is the read-only source-of-truth for downstream quality-filtering pipelines.

31,663 parquet files (1566.8 GB) 49 language pairs under data// Schema: 5 columns — see below Read-only for downstream pipelines. Do not delete or modify.

Schema

Each parquet has 5 columns:

column type description

source string… See the full description on the dataset page: https://huggingface.co/datasets/natgillin/translations-raw.