Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
mt5-base-medium-poem-generation – AI Model by vikenkd | AlphaNeural AI
You can deploy this model and start earning money today!
vikenkd
/
mt5-base-medium-poem-generation
like
0
transformers
safetensors
mt5
text2text-generation
generated_from_trainer
google/mt5-base
finetune
apache-2.0
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
mt5-base-medium-poem-generation
This model is a fine-tuned version of
google/mt5-base
on an unknown dataset. It achieves the following results on the evaluation set:
Loss: 2.7472
Rouge1: 25.4822
Rouge2: 3.7615
Rougel: 19.5281
Rougelsum: 19.5176
Gen Len: 19.0
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
learning_rate: 4e-05
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
lr_scheduler_warmup_steps: 100
training_steps: 2000
mixed_precision_training: Native AMP
Training results
Training Loss
Epoch
Step
Validation Loss
Rouge1
Rouge2
Rougel
Rougelsum
Gen Len
4.4593
0.1143
1000
2.7944
26.8618
4.2231
20.0761
20.0655
19.0
3.1207
0.2286
2000
2.7472
25.4822
3.7615
19.5281
19.5176
19.0
Framework versions
Transformers 4.45.1
Pytorch 2.4.0
Datasets 3.0.1
Tokenizers 0.20.0
