legal-pegasus-finetuned – AI Model by ry29 | AlphaNeural AI

You can deploy this model and start earning money today!

ry29/
legal-pegasus-finetuned

like

0

text2text-generation

generated_from_trainer

nsi319/legal-pegasus

endpoints_compatible

Views

No views yet

legal-pegasus-finetuned

This model is a fine-tuned version of nsi319/legal-pegasus on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 1.8398
Rouge1: 50.3753
Rouge2: 26.0732
Rougel: 34.4429
Rougelsum: 34.4336

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Use adamw_torch_fused with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 3
mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum
2.1848	1.0	791	1.8913	49.8438	25.3784	33.6503	33.6705
2.0197	2.0	1582	1.8517	50.4076	26.1167	34.4954	34.5018
1.976	3.0	2373	1.8398	50.3753	26.0732	34.4429	34.4336

Framework versions

Transformers 4.56.1
Pytorch 2.8.0+cu128
Datasets 4.0.0
Tokenizers 0.22.0