Preprocessed versions of openly licensed wiki dumps collected by wikiteam and hosted on the Internet Archive.
raw: The original wikitext
v0: Wikitext parsed to plain text with wtf_wikipedia and conversion of math templates to LaTeX.
v1: Removal of some html snippets left behind during parsing.
v2: Removal of documents that basically just transcripts of non-openly licensed things.
v3: Removal of documents that basically… See the full description on the dataset page:
https://huggingface.co/datasets/nkandpa2/wiki-dolma.
