Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
fineweb2-bagaco2 – Dataset by duarteocarmo | AlphaNeural AI
You can deploy this model and start earning money today!
duarteocarmo
/
fineweb2-bagaco2
like
0
text-classification
language-modeling
topic-classification
text-scoring
uonlp/CulturaX
pt
por
mit
10M<n<100M
parquet
tabular
text
datasets
dask
polars
mlcroissant
us
portuguese
pt-pt
european-portuguese
Views
No views yet
Model card
Files and Versions
Community
API
Bagaço2 🍷🇵🇹
A pretraining dataset for European Portuguese. Methodology:
Takes Portuguese split of CulturaX Uses this classifier to only keep PT-PT docs Adds educational score + content category to each row, by running two additional classifiers
33M documents in 460 parquet shards (~ 37 GB)
Classifiers Statistics & Counts
CulturaX filter using datatrove:
"stats": { "total": 199737979, "dropped": 166679183, "forwarded": 33058796… See the full description on the dataset page:
https://huggingface.co/datasets/duarteocarmo/fineweb2-bagaco2
.
