Is this your dataset? Claim it with the Hugging Face account that owns it.

allenai/
MADLAD-400

Name: MADLAD-400
Creator: allenai
License: https://spdx.org/licenses/ODC-By-1.0.html

Views

No views yet

	MADLAD-400




	


	Dataset and Introduction

MADLAD-400 (Multilingual Audited Dataset: Low-resource And Document-level) is a document-level multilingual dataset based on Common Crawl, covering 419 languages in total. This uses all snapshots of CommonCrawl available as of August 1, 2022. The primary advantage of this dataset over similar datasets is that it is more multilingual (419 languages), it is audited and more highly filtered, and it is document-level. The main… See the full description on the dataset page: https://huggingface.co/datasets/allenai/MADLAD-400.