t5-small-laShootKP – AI Model by rizvi-rahil786 | AlphaNeural AI

You can deploy this model and start earning money today!

rizvi-rahil786/
t5-small-laShootKP

like

0

text2text-generation

generated_from_trainer

google-t5/t5-small

text-generation-inference

endpoints_compatible

Views

No views yet

t5-small-laShootKP

This model is a fine-tuned version of t5-small on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 1.1739
Rouge1: 49.6859
Rouge2: 37.2276
Rougel: 49.5085
Rougelsum: 49.5531
Gen Len: 6.5138

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5e-05
train_batch_size: 4
eval_batch_size: 4
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 8

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum	Gen Len
1.1796	1.0	6223	1.1739	49.6859	37.2276	49.5085	49.5531	6.5138
1.0232	2.0	12446	1.1820	49.7748	37.0118	49.5941	49.6469	6.8708
0.9315	3.0	18669	1.2301	48.0881	35.58	48.0004	48.0227	6.6295
0.8268	4.0	24892	1.2825	44.9333	32.8997	44.8001	44.8274	6.3620
0.8217	5.0	31115	1.3131	45.5074	32.864	45.3445	45.3414	6.3456
0.7738	6.0	37338	1.3544	44.6476	32.7547	44.4945	44.5461	6.5479
0.7336	7.0	43561	1.3442	45.3053	33.1408	45.155	45.1848	6.5295
0.7086	8.0	49784	1.3590	45.3277	33.0743	45.2083	45.2695	6.5869

Framework versions

Transformers 4.39.3
Pytorch 2.2.1+cu121
Datasets 2.18.0
Tokenizers 0.15.2