Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
albert-tiny-spanish – AI Model by dccuchile | AlphaNeural AI
You can deploy this model and start earning money today!
dccuchile
/
albert-tiny-spanish
like
0
transformers
pytorch
tf
albert
pretraining
spanish
OpenCENIA
es
large_spanish_corpus
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
ALBERT Tiny Spanish
This is an
ALBERT
model trained on a
big spanish corpora
. The model was trained on a single TPU v3-8 with the following hyperparameters and steps/time:
LR: 0.00125
Batch Size: 2048
Warmup ratio: 0.0125
Warmup steps: 125000
Goal steps: 10000000
Total steps: 8300000
Total training time (aprox): 58.2 days
Training loss
https://drive.google.com/uc?export=view&id=1KQc8yWZLKvDLjBtu4IOAgpTx0iLcvX_Q
