22yuan/

MMedC

💻Github Repo 🖨️arXiv Paper The official pre-training dataset for "Towards Building Multilingual Language Model for Medicine".

We add Arabic and German corpus to MMedC.

This repo contains MMedC, a multilingual medical corpus with 25.5 billion tokens.

Language Family Filtering Content Textbooks Websites Small-scale Dataset TotAmt

English Indo-European 6.56 4.00 0.00 0.00 10.56

Spanish Indo-European 3.98 0.31 0.05 0.02… See the full description on the dataset page: https://huggingface.co/datasets/22yuan/MMedC.