t5-feedback-generator-final – AI Model by nguyennghia0902 | AlphaNeural AI

You can deploy this model and start earning money today!

nguyennghia0902/
t5-feedback-generator-final

like

0

text2text-generation

generated_from_trainer

google/flan-t5-base

text-generation-inference

endpoints_compatible

Views

No views yet

t5-feedback-generator-final

This model is a fine-tuned version of google/flan-t5-base on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 2.6256
Rouge1: 50.0197
Rouge2: 30.1532
Rougel: 40.2203
Rougelsum: 40.264

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.0003
train_batch_size: 16
eval_batch_size: 32
seed: 42
gradient_accumulation_steps: 4
total_train_batch_size: 64
optimizer: Use OptimizerNames.ADAFACTOR and the args are: No additional optimizer arguments
lr_scheduler_type: linear
lr_scheduler_warmup_steps: 200
num_epochs: 5

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum
67.9207	1.0	124	6.5946	12.6715	1.6869	12.0942	12.099
49.8169	2.0	248	4.2355	34.7204	18.3256	29.7743	29.7213
32.6294	3.0	372	2.6306	49.7105	30.1067	40.0865	40.0267
21.9054	4.0	496	1.8128	49.641	30.7987	39.9795	39.9149
17.0548	5.0	620	1.5818	49.9443	30.6155	39.8862	39.8062

Framework versions

Transformers 5.0.0
Pytorch 2.10.0+cu128
Datasets 4.8.3
Tokenizers 0.22.2