You can deploy this model and start earning money today!

OMEGAMAX10/
flan-t5-base-artapolitica

Name: flan-t5-base-artapolitica
Availability: InStock

generated_from_trainer

OMEGAMAX10/flan-t5-base-artapolitica

finetune

apache-2.0

text-generation-inference

endpoints_compatible

Views

No views yet

flan-t5-base-artapolitica

This model is a fine-tuned version of OMEGAMAX10/flan-t5-base-artapolitica on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.5640
Rouge1: 57.3305
Rouge2: 48.0543
Rougel: 57.2599
Rougelsum: 57.1441
Gen Len: 16.7979

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5e-05
train_batch_size: 4
eval_batch_size: 4
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 5

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum	Gen Len
0.6837	0.37	500	0.5680	56.2791	47.2816	56.0867	56.0127	17.0071
0.6734	0.75	1000	0.5640	57.3305	48.0543	57.2599	57.1441	16.7979
0.6871	1.12	1500	0.5796	57.195	48.0373	57.1068	56.9684	16.7943
0.6024	1.5	2000	0.5757	56.7832	47.6809	56.6191	56.5369	16.8759
0.6526	1.87	2500	0.5720	56.6796	47.0988	56.6163	56.5203	16.8511
0.607	2.24	3000	0.5780	57.0497	47.9423	56.9434	56.8005	16.8227
0.5886	2.62	3500	0.5760	56.9706	47.7757	56.7932	56.6967	16.8333
0.5979	2.99	4000	0.5786	56.5049	47.368	56.4206	56.3188	16.7943
0.5617	3.37	4500	0.5826	56.6382	47.568	56.5524	56.418	16.8191
0.5482	3.74	5000	0.5795	56.5271	47.4656	56.3758	56.2517	16.8404
0.5664	4.11	5500	0.5887	56.2546	47.3369	56.1503	56.04	16.8582
0.5496	4.49	6000	0.5823	56.3413	47.2929	56.2431	56.1574	16.8475
0.5365	4.86	6500	0.5811	56.3231	47.3409	56.2346	56.1233	16.8475

Framework versions

Transformers 4.35.2
Pytorch 2.1.0+cu118
Datasets 2.15.0
Tokenizers 0.15.0