t5-small-finetuned-samsun-10epoch-32 – AI Model by dhruviljhala | AlphaNeural AI

You can deploy this model and start earning money today!

dhruviljhala/
t5-small-finetuned-samsun-10epoch-32

like

0

text2text-generation

generated_from_trainer

google-t5/t5-small

text-generation-inference

endpoints_compatible

Views

No views yet

t5-small-finetuned-samsun-10epoch-32

This model is a fine-tuned version of t5-small on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 1.7427
Rouge1: 41.259
Rouge2: 18.6668
Rougel: 34.8705
Rougelsum: 38.2147
Gen Len: 16.6051

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10
mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum	Gen Len
2.2715	1.0	921	1.8796	39.1544	16.6193	32.6399	36.2408	16.3888
2.042	2.0	1842	1.8251	40.2761	17.3143	33.5239	37.3139	16.4218
1.987	3.0	2763	1.7981	40.3499	17.8091	34.0216	37.6063	16.4095
1.9529	4.0	3684	1.7779	40.9741	18.1594	34.3685	37.8782	16.4401
1.9298	5.0	4605	1.7657	41.3166	18.6125	34.8556	38.2854	16.4914
1.9105	6.0	5526	1.7566	41.4267	18.5259	34.7167	38.2684	16.6711
1.8945	7.0	6447	1.7508	41.075	18.4725	34.6262	38.043	16.5037
1.8815	8.0	7368	1.7474	41.4103	18.5046	34.8252	38.2475	16.5513
1.8805	9.0	8289	1.7422	41.4699	18.7027	34.921	38.3892	16.6467
1.8786	10.0	9210	1.7427	41.259	18.6668	34.8705	38.2147	16.6051

Framework versions

Transformers 4.37.2
Pytorch 2.1.0+cu121
Datasets 2.17.1
Tokenizers 0.15.2