flan-t5-base-samsum – AI Model by zakerytclarke | AlphaNeural AI

You can deploy this model and start earning money today!

zakerytclarke/
flan-t5-base-samsum

like

0

text2text-generation

generated_from_trainer

google/flan-t5-base

text-generation-inference

endpoints_compatible

Views

No views yet

flan-t5-base-samsum

This model is a fine-tuned version of google/flan-t5-base on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 1.3717
Rouge1: 47.4483
Rouge2: 23.6821
Rougel: 40.0391
Rougelsum: 43.5912
Gen Len: 17.0745

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 5

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum	Gen Len
1.4543	1.0	1842	1.3866	46.7875	22.9635	39.0803	42.9982	17.5531
1.3399	2.0	3684	1.3731	47.3389	24.0053	39.9638	43.7068	17.3297
1.2788	3.0	5526	1.3717	47.4483	23.6821	40.0391	43.5912	17.0745
1.2239	4.0	7368	1.3752	47.658	24.1589	40.0986	43.9581	17.4676
1.1997	5.0	9210	1.3755	47.3891	23.7333	39.8186	43.563	17.3932

Framework versions

Transformers 4.40.0
Pytorch 2.2.1+cu121
Datasets 2.19.0
Tokenizers 0.19.1