Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
albert-large-spanish – AI Model by dccuchile | AlphaNeural AI
You can deploy this model and start earning money today!
dccuchile
/
albert-large-spanish
like
0
transformers
pytorch
tf
albert
pretraining
spanish
OpenCENIA
es
large_spanish_corpus
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
ALBERT Large Spanish
This is an
ALBERT
model trained on a
big spanish corpora
. The model was trained on a single TPU v3-8 with the following hyperparameters and steps/time:
LR: 0.000625
Batch Size: 512
Warmup ratio: 0.003125
Warmup steps: 12500
Goal steps: 4000000
Total steps: 1450000
Total training time (aprox): 42 days.
Training loss
https://drive.google.com/uc?export=view&id=10EiI0Yge3U3CnGrqoMs1yJY020pPz_Io
