ssr-base-finetuned-samsum-en – AI Model by santiviquez | AlphaNeural AI

You can deploy this model and start earning money today!

santiviquez/
ssr-base-finetuned-samsum-en

like

0

text2text-generation

generated_from_trainer

text-generation-inference

endpoints_compatible

Views

No views yet

ssr-base-finetuned-samsum-en

This model is a fine-tuned version of microsoft/ssr-base on the samsum dataset. It achieves the following results on the evaluation set:

Loss: 1.6231
Rouge1: 46.7505
Rouge2: 22.3968
Rougel: 37.1784
Rougelsum: 42.891

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5.6e-05
train_batch_size: 10
eval_batch_size: 10
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum
1.9682	1.0	300	1.6432	44.2182	20.8486	35.0914	40.9852
1.6475	2.0	600	1.5946	45.3919	21.6955	36.2411	41.8532
1.5121	3.0	900	1.5737	46.1769	22.4178	36.9762	42.6614
1.4112	4.0	1200	1.5774	46.6047	22.8227	37.2457	43.1935
1.323	5.0	1500	1.5825	46.6162	22.485	37.2846	42.9834
1.2613	6.0	1800	1.5883	46.4253	22.1199	37.0491	42.5189
1.2077	7.0	2100	1.5965	46.485	22.3636	37.2677	42.7499
1.1697	8.0	2400	1.6174	46.8654	22.6291	37.4201	43.0875
1.1367	9.0	2700	1.6188	46.707	22.305	37.156	42.9087
1.118	10.0	3000	1.6231	46.7505	22.3968	37.1784	42.891

Framework versions

Transformers 4.19.2
Pytorch 1.11.0+cu113
Datasets 2.2.2
Tokenizers 0.12.1