Is this your dataset? Claim it with the Hugging Face account that owns it.

HCAI-Lab-GT/
dolma3-6t-sample-100000-docs

Name: dolma3-6t-sample-100000-docs
Creator: HCAI-Lab-GT

Views

No views yet

dolma3-6t-sample-100000-docs

Materialized stratified sample of 100,000 docs per bin (~58k source-shard files, ~186 GB) from the deduplicated 6T Dolma3 corpus. Seed 42, materialized by 128 Modal workers (worker_0000/ through worker_0127/).

Layout

HCAI-Lab/dolma3-6t-sample-100000-docs/ ├── bin_summary.csv ├── sample_contract.json └── worker_NNNN/ └── soc127__phase1_pool_shared__...__shard_NNNNNNNN.jsonl.zst (~450 files per worker)

	Dual-access… See the full description on the dataset page: https://huggingface.co/datasets/HCAI-Lab-GT/dolma3-6t-sample-100000-docs.