dancinlab/

anima-corpus-5lang-unified

A UNIFIED 5-language training corpus that combines a clean encyclopedic wiki backbone with the persona × SNS roleplay surface, so a single byte-level model is multilingual across ALL surfaces (wiki + SNS + persona) in en / fr / de / es / ko. This closes the CORPUS-domain gap where 5-lang coverage previously lived ONLY in the wiki/chat corpus and the persona/SNS corpus was Korean-only. This corpus feeds a FUTURE 5-lang 7B retrain (separate from the… See the full description on the dataset page: https://huggingface.co/datasets/dancinlab/anima-corpus-5lang-unified.