t5-base-SQuAD-qag-ep6 – AI Model by Zekunli | AlphaNeural AI

You can deploy this model and start earning money today!

Zekunli/
t5-base-SQuAD-qag-ep6

like

0

text2text-generation

generated_from_trainer

text-generation-inference

endpoints_compatible

Views

No views yet

t5-base-SQuAD-qag-ep6

This model is a fine-tuned version of t5-base on the None dataset. It achieves the following results on the evaluation set:

Loss: 1.0387
Rouge1: 38.3962
Rouge2: 17.2138
Rougel: 35.0757
Rougelsum: 35.0976
F1: 17.4776
Exact Match: 11.8529
Gen Len: 18.4519

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 96
eval_batch_size: 192
seed: 1799
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 6

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum	F1	Exact Match	Gen Len
1.4851	1.02	200	1.1181	37.4066	15.7831	34.003	34.0487	15.55	9.9661	18.4881
1.2194	2.03	400	1.0716	38.1277	16.661	34.6265	34.6546	16.6447	10.9821	18.5283
1.1716	3.05	600	1.0537	37.9106	16.6251	34.5005	34.5213	17.0402	11.1756	18.492
1.1437	4.06	800	1.0441	38.4182	17.1721	35.0109	35.0357	17.482	11.7078	18.4654
1.1329	5.08	1000	1.0387	38.3962	17.2138	35.0757	35.0976	17.4776	11.8529	18.4519

Framework versions

Transformers 4.18.0
Pytorch 1.11.0+cu113
Datasets 2.5.1
Tokenizers 0.12.1