Release status: public dataset release.
This repository provides the verified TokV2 token shards, tokenizer, manifests,
checksums, and provenance metadata for BroadBase v0 R1. The token stream is a
lossless mixed-source derivative and is therefore released as license: other.
Tokenisation does not remove upstream licence, attribution, privacy, or usage
obligations.
BroadBase v0 R1 is a deterministic, broad-domain base-pretraining corpus built… See the full description on the dataset page:
https://huggingface.co/datasets/beardymcgee/broadbase-v0-r1-64g-tokv2.
