Dolci-Think-SFT-7B-q35instruct
Megatron-format tokenization of
allenai/Dolci-Think-SFT-7B
using the Qwen3.5-0.8B-Instruct tokenizer and its chat template.
156 shards, each stored as two aligned Megatron indexed datasets (one document
per conversation, one sequence per document):
train-XXXXX-of-00156.bin / .idx — token ids (int32)
train-XXXXX-of-00156_loss_mask.bin / .idx — per-token loss mask (uint8, 0/1)
624 files total (~113 GB).… See the full description on the dataset page:
https://huggingface.co/datasets/yangwang92/Dolci-Think-SFT-7B-q35instruct.