A 30B-token pre-tokenized slice of NVIDIA ClimbMix
(via the shuffled karpathy/climbmix-400b-shuffle),
prepared as pre-training data for the Juniper model series.
Size: 30 billion tokens
Format: ArrayRecord
Tokenizer: o200k_harmony — tiktoken o200k_base plus the gpt-oss special tokens (vocab 201,088)
Shards: 100 ArrayRecord files (group_size:1), exactly 300M tokens each
No BOS token; documents are delimited by EOS only