openeurollm/

dolci-instruct-sft-tokenized

Pre-tokenized version of the allenai/Dolci-Instruct-SFT dataset, ready for training with OLMo-core. See also: openeurollm/dolci-think-sft-tokenized for the thinking variant.

	Dataset Details




	

Property Value

Source dataset allenai/Dolci-Instruct-SFT

Tokenizer allenai/Olmo-3-7B-Instruct-SFT Max sequence length 32,768

Total instances 2,152,111

Total tokens 1.7B

Trainable tokens 789M (46.2%)

Avg tokens per instance 793… See the full description on the dataset page: https://huggingface.co/datasets/openeurollm/dolci-instruct-sft-tokenized.