Is this your dataset? Claim it with the Hugging Face account that owns it.

karpathy/
fineweb-edu-100B-gpt2-token-shards

Name: fineweb-edu-100B-gpt2-token-shards
Creator: karpathy
License: https://spdx.org/licenses/ODC-By-1.0.html

like

0

Views

No views yet

FineWeb Edu 100B dataset tokenized with GPT-2 tokenizer using the code in llm.c repo.

karpathy/fineweb-edu-100B-gpt2-token-shards