Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
prepacked-fineweb-edu-llama2-32K-T2048 – Dataset by KristianS7 | AlphaNeural AI
You can deploy this model and start earning money today!
KristianS7
/
prepacked-fineweb-edu-llama2-32K-T2048
like
0
text-generation
en
odc-by
us
pretokenized
pre-packed
fineweb-edu
llama2
Views
No views yet
Model card
Files and Versions
Community
API
prepacked-fineweb-edu-llama2-32K-T2048
Pre-tokenized and BOS-aligned best-fit packed version of FineWeb-Edu for training with looped nanochat. Tokenized with the Llama 2 tokenizer (32,000 base vocab + 8 special tokens = 32,008).
Stats Train split
Source karpathy/fineweb-edu-100b-shuffle (1,821 shards)
Total tokens 63.26B
Total docs 97.1M
Rows 30,873,598 Shards 2,059 (train-00000 to train-02058)
Rows per shard ~15,000… See the full description on the dataset page:
https://huggingface.co/datasets/KristianS7/prepacked-fineweb-edu-llama2-32K-T2048
.
