You can deploy this model and start earning money today!

HeshamMamdouh/
mt5-small-v8-sum-fine-tuned

Name: mt5-small-v8-sum-fine-tuned
Availability: InStock

transformers

mbart

text2text-generation

generated_from_keras_callback

apache-2.0

endpoints_compatible

Views

No views yet

mt5-small-v8-sum-fine-tuned

This model is a fine-tuned version of abdalrahmanshahrour/AraBART-summ on an unknown dataset. It achieves the following results on the evaluation set:

Train Loss: 1.6114
Epoch: 29

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}
training_precision: float32

Training results

Train Loss	Epoch
2.4132	0
2.4084	1
2.3948	2
2.3715	3
2.3110	4
2.2797	5
2.2699	6
2.2320	7
2.1178	8
2.1323	9
2.0598	10
2.1086	11
2.0487	12
1.9561	13
2.0067	14
1.8801	15
1.9177	16
1.9594	17
1.8946	18
1.8057	19
1.7603	20
1.7916	21
1.7090	22
1.7502	23
1.7377	24
1.7007	25
1.6427	26
1.6352	27
1.6317	28
1.6114	29

Framework versions

Transformers 4.30.2
TensorFlow 2.13.0
Datasets 2.13.1
Tokenizers 0.13.3

HeshamMamdouh/mt5-small-v8-sum-fine-tuned

mt5-small-v8-sum-fine-tuned

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

HeshamMamdouh/
mt5-small-v8-sum-fine-tuned