Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
microbert-indonesian-mxp – AI Model by lgessler | AlphaNeural AI
You can deploy this model and start earning money today!
lgessler
/
microbert-indonesian-mxp
like
0
transformers
pytorch
bert
feature-extraction
ind
text-embeddings-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
This is a
MicroBERT
model for Indonesian.
Its suffix is
-mxp
, which means that it was pretrained using supervision from masked language modeling, XPOS tagging, and UD dependency parsing.
The unlabeled Indonesian data was taken from a June 2022 dump of Indonesian Wikipedia, downsampled to 1,439,772 tokens.
The UD treebank
UD_Indonesian-GSD
, v2.10, totaling 122,021 tokens, was used for labeled data.
Please see
the repository
and
the paper
for more details.
