Is this your dataset? Claim it with the Hugging Face account that owns it.

mlfoundations/
MINT-1T-PDF-CC-2024-18

Name: MINT-1T-PDF-CC-2024-18
Creator: mlfoundations
License: https://spdx.org/licenses/CC-BY-4.0.html

Views

No views yet

🍃 MINT-1T:Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens

🍃 MINT-1T is an open-source Multimodal INTerleaved dataset with 1 trillion text tokens and 3.4 billion images, a 10x scale-up from existing open-source datasets. Additionally, we include previously untapped sources such as PDFs and ArXiv papers. 🍃 MINT-1T is designed to facilitate research in multimodal pretraining. 🍃 MINT-1T is created by a team from the University of Washington in… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations/MINT-1T-PDF-CC-2024-18.