pegasus-xsum-finetuned-cnn_dailymail – AI Model by CyrexPro | AlphaNeural AI

You can deploy this model and start earning money today!

CyrexPro/
pegasus-xsum-finetuned-cnn_dailymail

like

0

text2text-generation

generated_from_trainer

google/pegasus-xsum

endpoints_compatible

Views

No views yet

pegasus-xsum-finetuned-cnn_dailymail

This model is a fine-tuned version of google/pegasus-xsum on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.8958
Rouge1: 45.7795
Rouge2: 23.3182
Rougel: 32.9241
Rougelsum: 42.3126
Bleu 1: 35.4715
Bleu 2: 24.0726
Bleu 3: 17.9591
Meteor: 32.8897
Lungime rezumat: 43.3773
Lungime original: 48.6937

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5.6e-05
train_batch_size: 4
eval_batch_size: 4
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 4

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum	Bleu 1	Bleu 2	Bleu 3	Meteor	Lungime rezumat	Lungime original
1.1281	1.0	14330	0.9373	44.64	22.2111	32.0228	41.1223	34.4946	23.079	17.0673	31.8685	43.543	48.6937
0.9091	2.0	28660	0.9095	45.0713	22.7428	32.4247	41.554	34.9397	23.5631	17.5094	32.1814	43.3467	48.6937
0.8455	3.0	42990	0.8982	45.5457	23.1315	32.7153	42.0349	35.2659	23.8773	17.8174	32.7185	43.5743	48.6937
0.8076	4.0	57320	0.8958	45.7795	23.3182	32.9241	42.3126	35.4715	24.0726	17.9591	32.8897	43.3773	48.6937

Framework versions

Transformers 4.40.0
Pytorch 2.2.2+cu118
Datasets 2.19.0
Tokenizers 0.19.1