DO NOT USE. Internal artifact of the Supra2-100M training run, published only
because public storage is free. These are raw uint16 token bins for one specific
tokenizer (supra2-tokenizer.json) and carry the licenses of their upstream sources
(FineWeb-Edu, DCLM, The Stack v3, FineMath, Cosmopedia, Wikipedia). No redistribution
rights are granted or implied. Files may be deleted at any time.
Layout: tokens_XXX.bin (4B tok each), val_000.bin… See the full description on the dataset page:
https://huggingface.co/datasets/GGMLGuy/Supra2-100M-tokens-backup.
