Is this your dataset? Claim it with the Hugging Face account that owns it.

marin-community/
fineweb-edu-pretokenized-10K

Name: fineweb-edu-pretokenized-10K
Creator: marin-community

Views

No views yet

	Marin/Levanter Subsampled Pretokenized Dataset




	
	Dataset

Train Urls:

gs://marin-us-central2/raw/fineweb-edu-c2beb4/3c452cb/huggingface.co/datasets/HuggingFaceFW/fineweb-edu/resolve/3c452cb

Factsheet

Original cache: gs://marin-us-central2/tokenized/fineweb-edu-24698d Tokenizer: stanford-crfm/marin-tokenizer Seed 42 Number of tokens: 10,390

(This readme is automatically generated by Marin.)

marin-community/fineweb-edu-pretokenized-10K