BBC – AI Model by Hoax0930 | AlphaNeural AI

You can deploy this model and start earning money today!

Hoax0930/
BBC

like

0

text2text-generation

generated_from_trainer

text-generation-inference

endpoints_compatible

Views

No views yet

BBC

This model is a fine-tuned version of t5-base on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.2824
Rouge1: 18.46
Rouge2: 17.0488
Rougel: 18.3552
Rougelsum: 18.3466

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5.6e-05
train_batch_size: 4
eval_batch_size: 4
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 8

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum
0.7104	1.0	445	0.3218	17.4866	15.2567	17.0429	17.1216
0.3433	2.0	890	0.3039	17.7632	15.8878	17.4551	17.5161
0.3116	3.0	1335	0.2912	18.175	16.4391	17.9597	18.0081
0.2908	4.0	1780	0.2869	18.2832	16.6726	18.1187	18.1205
0.273	5.0	2225	0.2829	18.2807	16.7359	18.1496	18.1621
0.2625	6.0	2670	0.2819	18.3845	16.8793	18.2622	18.2561
0.2482	7.0	3115	0.2801	18.4748	17.0796	18.3792	18.3672
0.2454	8.0	3560	0.2824	18.46	17.0488	18.3552	18.3466

Framework versions

Transformers 4.25.1
Pytorch 1.13.0+cu116
Datasets 2.7.1
Tokenizers 0.13.2