Precomputed host-level graph centrality scores for the WebGraphMix pipeline, from Hubs or Fringes? Pretraining Data Selection via Web Graph Centrality.
Scores are computed on the undirected host graph obtained by intersecting the Common Crawl host-level web graph with hosts present in WebOrganizer/Corpus-200B. They are used to importance-sample central ("hub") vs. peripheral ("fringe") documents for language model pretraining.… See the full description on the dataset page:
https://huggingface.co/datasets/PrincetonPLI/cc-centrality-scores.
