You can deploy this model and start earning money today!

theojolliffe/
T5-model-1-feedback-0810

Name: T5-model-1-feedback-0810
Availability: InStock

generated_from_trainer

apache-2.0

text-generation-inference

endpoints_compatible

Views

No views yet

T5-model-1-feedback-0810

This model is a fine-tuned version of theojolliffe/T5-model-1-feedback-0510 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.1776
Rouge1: 94.0404
Rouge2: 91.0472
Rougel: 93.8927
Rougelsum: 93.9417
Gen Len: 15.5128

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 2
eval_batch_size: 2
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 4
mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum	Gen Len
No log	1.0	363	0.2000	93.0351	89.425	93.1359	93.2085	15.1538
0.2311	2.0	726	0.1835	93.7371	90.8556	93.7891	93.8622	15.2051
0.191	3.0	1089	0.1792	94.1894	91.4087	94.0525	94.0773	15.5128
0.191	4.0	1452	0.1776	94.0404	91.0472	93.8927	93.9417	15.5128

Framework versions

Transformers 4.22.2
Pytorch 1.12.1+cu113
Datasets 2.5.2
Tokenizers 0.12.1

theojolliffe/T5-model-1-feedback-0810

T5-model-1-feedback-0810

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

theojolliffe/
T5-model-1-feedback-0810