bart-large-cnn_fine_tuned – AI Model by razvanfischer | AlphaNeural AI

You can deploy this model and start earning money today!

razvanfischer/
bart-large-cnn_fine_tuned

like

0

text2text-generation

generated_from_trainer

facebook/bart-large-cnn

endpoints_compatible

Views

No views yet

bart-large-cnn_fine_tuned

This model is a fine-tuned version of facebook/bart-large-cnn on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.3711
Rouge1: 64.5245
Rouge2: 53.1381
Rougel: 47.3234
Rougelsum: 51.2042

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5.6e-06
train_batch_size: 4
eval_batch_size: 4
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 4

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum
0.4228	1.0	389	0.3821	57.8993	45.4774	41.9455	44.9012
0.321	2.0	778	0.3641	61.5071	49.6584	45.5774	48.3601
0.2764	3.0	1167	0.3689	63.7295	52.1907	46.827	50.3726
0.2504	4.0	1556	0.3711	64.5245	53.1381	47.3234	51.2042

Framework versions

Transformers 4.35.2
Pytorch 2.1.0+cu121
Tokenizers 0.15.1