flan-t5-small-asap_t3_f0_pa – AI Model by salbatarni | AlphaNeural AI

You can deploy this model and start earning money today!

salbatarni/
flan-t5-small-asap_t3_f0_pa

like

0

text2text-generation

generated_from_trainer

google/flan-t5-small

text-generation-inference

endpoints_compatible

Views

No views yet

flan-t5-small-asap_t3_f0_pa

This model is a fine-tuned version of google/flan-t5-small on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.0564
Rouge1: 83.5868
Rouge2: 79.2034
Rougel: 83.6443
Rougelsum: 83.6385
Gen Len: 12.0478

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 5

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum	Gen Len
No log	1.0	259	0.0883	78.5864	72.6388	78.5689	78.5751	12.0072
0.3997	2.0	518	0.0670	82.2729	77.3733	82.2731	82.3003	12.0232
0.3997	3.0	777	0.0580	83.4593	78.9471	83.5089	83.5189	12.0464
0.0732	4.0	1036	0.0570	83.5601	79.1687	83.5758	83.5695	12.0551
0.0732	5.0	1295	0.0564	83.5868	79.2034	83.6443	83.6385	12.0478

Framework versions

Transformers 4.38.2
Pytorch 2.1.0+cu121
Datasets 2.17.1
Tokenizers 0.15.2