flan-t5-base-samsum – AI Model by WinterShade | AlphaNeural AI

You can deploy this model and start earning money today!

WinterShade/
flan-t5-base-samsum

like

0

text2text-generation

generated_from_trainer

google/flan-t5-base

text-generation-inference

endpoints_compatible

Views

No views yet

flan-t5-base-samsum

This model is a fine-tuned version of google/flan-t5-base on the samsum dataset. It achieves the following results on the evaluation set:

Loss: 1.3728
Rouge1: 47.2368
Rouge2: 23.4056
Rougel: 39.8443
Rougelsum: 43.614
Gen Len: 17.9756

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 5

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum	Gen Len
1.3574	1.0	1842	1.3728	47.2368	23.4056	39.8443	43.614	17.9756
1.269	2.0	3684	1.3746	47.4559	23.7332	39.8739	43.6412	17.8059
1.2043	3.0	5526	1.3802	48.2155	24.3068	40.5794	44.4453	18.0024
1.1677	4.0	7368	1.3825	47.8894	24.0744	40.2636	44.1289	18.0012
1.1459	5.0	9210	1.3865	47.9839	24.4262	40.3524	44.219	18.0256

Framework versions

Transformers 4.51.1
Pytorch 2.2.1+cu121
Datasets 3.5.0
Tokenizers 0.21.1