The April 2016 Internet Archive census
recorded md5 and sha1 for every file of every public IA item —
the only bulk file-hash inventory of the Archive ever published (the
census was not repeated; nothing uploaded after 2016-04-11 appears
here). This dataset is those two dumps joined — they are line-aligned
outputs of one item walk — into single witness rows co-observing both
digests, republished as page-indexed parquet for… See the full description on the dataset page:
https://huggingface.co/datasets/david-ar/ia-census.
