Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
plantbert-vanilla-cased – Dataset by shius | AlphaNeural AI
You can deploy this model and start earning money today!
shius
/
plantbert-vanilla-cased
like
0
100K<n<1M
parquet
text
datasets
dask
mlcroissant
polars
us
Views
No views yet
Model card
Files and Versions
Community
API
Code availability
shiulab/plantbert
Relevant settings
env:
rand_seed : 20231002
test_size : 0.1
bert_config:
vocab_size : 30_522
max_length : 512
training_arguments:
resume_from_ckpt : False
mlm : True
mlm_prob : 0.2
eval_strategy : 'steps'
overwrite_out : True
num_epochs : 30
train_batch_size : 20
grad_acc_steps : 8
eval_batch_size : 64
logging_strategy : 'steps'
log_steps : 500
save_strategy : 'steps'
save_steps : 500
safetensors : True
load_best_at_end : True
save_total_limit : 5
Model evaluation (loss)
Training: 1.8376
Validation: 1.7476
