aya_dataset_ben_translated is a subset of the aya_dataset, with some modifications. In particular, the original data points in Bengali (indicated by the language or language_code columns) are retained. In addition, the English and Hindi data points are translated into Bengali using Google Cloud Translation API. All columns from the original dataset are retained.
A handful of inaccuracies arising out of translation have been fixed so far. Therefore, the dataset can be a bit noisy. This is… See the full description on the dataset page:
https://huggingface.co/datasets/barunsaha/aya_dataset_ben_translated.
