lightonai/

multilingual-embeddings-pre-training-curated

📚 Collection | 📝 Multilingual Blog | 📝 English Blog

Contrastive Multilingual Pre-Training

2.16B query–document pairs across eight languages, plus cross-lingual pairs

mDenseOn | mLateOn | DenseOn | LateOn | PyLate | FastPlaid

🎯 TL;DR: The multilingual contrastive pre-training corpus used to train mDenseOn and mLateOn. It extends our curated English data recipe (embeddings-pre-training-curated) to French, German, Italian, Spanish, Portuguese, Swedish, Norwegian, and Arabic… See the full description on the dataset page: https://huggingface.co/datasets/lightonai/multilingual-embeddings-pre-training-curated.