somewheresystems/dataclysm-wikipedia
USE THE NOTEBOOK TO GET STARTED!
https://github.com/somewheresystems/dataclysm
This dataset comprises of 6,458,670 English language Wikipedia articles, with an additional column added for title-embeddings using the bge-small-en-v1.5 embeddings model. The dataset was sourced here:
https://huggingface.co/datasets/wikipedia/viewer/20220301.en
This dataset contains the full text of each Wikipedia article as of the date March 01, 2022. In… See the full description on the dataset page:
https://huggingface.co/datasets/somewheresystems/dataclysm-wikipedia.
