Echantillon br_clean de allenai/MADLAD-400 que nous avons légèrement nettoyé (supression d'environ 500 lignes identifées comme en français et non en breton).
@misc{kudugunta2023madlad400,
title={MADLAD-400: A Multilingual And Document-Level Large Audited Dataset},
author={Sneha Kudugunta and Isaac Caswell and Biao Zhang and Xavier Garcia and Christopher A. Choquette-Choo and Katherine Lee and Derrick Xin and Aditya Kusupati and Romi… See the full description on the dataset page:
https://huggingface.co/datasets/Bretagne/MADLAD-400_br.