Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
fw-bert-tokenized-flattened – Dataset by Hibiki711 | AlphaNeural AI
You can deploy this model and start earning money today!
Hibiki711
/
fw-bert-tokenized-flattened
like
0
fill-mask
text-generation
en
odc-by
1B<n<10B
parquet
datasets
dask
mlcroissant
polars
us
Views
No views yet
Model card
Files and Versions
Community
API
fw-bert-tokenized-flattened
Just a tokenized and flattened version of the 10 billion token sample of
https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu
with the bert-base-uncased tokenizer. Practically a huge array of tokens with each doc sepatated by [SEP].