You can deploy this model and start earning money today!

commoncrawl/
host-index-testing-v2

text-generation

10B<n<100B

Views

No views yet

Common Crawl Host Index v2

GitHub: https://github.com/commoncrawl/cc-host-index Each crawl, we generate a Host Index, which aggregates information about each web hosted visited during the crawl. The information is aggregated from the Common Crawl columnar index, web graph, and raw crawler logs.

	Quickstart




	


	Using duckdb:

DuckDB can read directly from Huggingface: $ duckdb D FROM… See the full description on the dataset page: https://huggingface.co/datasets/commoncrawl/host-index-testing-v2.