Public transfer staging for the completed MarinFold exp199 ESM contacts-v1
token cache. The cache contains 66,759,922 tokenized documents and
71,450,105,324 token IDs across 1,669 completed shards.
The original 103.375 GB GCS prefix is stored in
25 uncompressed tar bundles under esm-contacts-v1-cache/bundles/. Tar member
paths are relative to the cache root, so extraction beneath… See the full description on the dataset page:
https://huggingface.co/datasets/eczech/marinfold-exp199-token-caches.