Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Pile-OpenWeb_20B – Dataset by firdavsus | AlphaNeural AI
You can deploy this model and start earning money today!
firdavsus
/
Pile-OpenWeb_20B
like
0
text-generation
fill-mask
en
apache-2.0
10B<n<100B
us
pretraining
causal-lm
openwebtext
the-pile
Views
No views yet
Model card
Files and Versions
Community
API
Datasets:
Pile 10B (from NeelNanda/pile-tokenized-10b) OpenWeb 10B (from karpathy nanoGPT)
Tokenizer used:
EleutherAI/gpt-neox-20b
Data type:
new_data_20b.bin (20B tokens) val.bin (4M tokens)
Feel Free to use it as you please!
-just follow the rules of ofiginal datasets :)