mkd-ai/

Keural-MoE-14B-stage1-binary-Dataset

Pre-tokenized binary dataset for the Keural MoE Foundation Model. Ready to use directly for training — no tokenization step needed.

	Dataset Overview




	

Property Value

Total Tokens 69.5 billion (69,496,921,399)

Format Binary (.bin) + Index (.idx) + Metadata (.meta)

Total Sequences 15,761,448

Sequence Length 4,096 tokens

Shards 158 shards

Archive Size ~242GB (binary_69B_tokens.tar)

Tokenizer… See the full description on the dataset page: https://huggingface.co/datasets/mkd-ai/Keural-MoE-14B-stage1-binary-Dataset.