flan-t5-base-samsum_nl_split_ep5 – AI Model by yingzwang | AlphaNeural AI

You can deploy this model and start earning money today!

yingzwang/
flan-t5-base-samsum_nl_split_ep5

like

0

text2text-generation

generated_from_trainer

text-generation-inference

endpoints_compatible

Views

No views yet

flan-t5-base-samsum_nl_split

This model is a fine-tuned version of google/flan-t5-base on the None dataset. It achieves the following results on the evaluation set:

Loss: 1.3632
Rouge1: 31.4599
Rouge2: 10.704
Rougel: 26.9038
Rougelsum: 28.3992
Gen Len: 18.7607

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 5

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum	Gen Len
1.7964	1.0	1842	1.5494	30.7493	9.5629	25.9933	27.4434	18.7509
1.5883	2.0	3684	1.4419	30.6164	9.6989	26.2301	27.5887	18.7680
1.4767	3.0	5526	1.3987	30.9685	10.2777	26.6246	28.0667	18.7937
1.4286	4.0	7368	1.3709	31.1626	10.6358	26.7063	28.2072	18.7863
1.4122	5.0	9210	1.3632	31.4599	10.704	26.9038	28.3992	18.7607

Framework versions

Transformers 4.28.1
Pytorch 2.0.0+cu117
Datasets 2.12.0
Tokenizers 0.13.3