You can deploy this model and start earning money today!

contemmcm/
db1020b67a2da5dbf95757572e7274b5

generated_from_trainer

google/long-t5-tglobal-xl

finetune

apache-2.0

endpoints_compatible

Views

No views yet

db1020b67a2da5dbf95757572e7274b5

This model is a fine-tuned version of google/long-t5-tglobal-xl on the Helsinki-NLP/opus_books [it-ru] dataset. It achieves the following results on the evaluation set:

Loss: 0.8862
Data Size: 1.0
Epoch Runtime: 262.9328
Bleu: 12.5863

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
distributed_type: multi-GPU
num_devices: 4
total_train_batch_size: 32
total_eval_batch_size: 32
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: constant
num_epochs: 50

Training results

Training Loss	Epoch	Step	Validation Loss	Data Size	Epoch Runtime	Bleu
No log	0	0	2.7129	0	18.8115	0.1735
No log	1	447	2.2923	0.0078	21.4956	0.7406
0.0432	2	894	2.0834	0.0156	26.2604	1.3894
0.0553	3	1341	1.9620	0.0312	32.2765	0.9524
0.0865	4	1788	1.8338	0.0625	41.8070	1.4238
0.1473	5	2235	1.6963	0.125	58.7972	2.3192
1.8625	6	2682	1.5436	0.25	87.9583	3.1803
1.592	7	3129	1.3679	0.5	144.7514	4.6704
1.3172	8.0	3576	1.1527	1.0	262.7576	6.4959
1.1637	9.0	4023	1.0329	1.0	260.6613	7.8519
1.0307	10.0	4470	0.9629	1.0	261.6965	8.9914
0.934	11.0	4917	0.9085	1.0	261.6134	9.6975
0.8688	12.0	5364	0.8760	1.0	261.6942	10.3006
0.7792	13.0	5811	0.8555	1.0	262.2055	10.8635
0.7232	14.0	6258	0.8461	1.0	260.3408	11.1665
0.678	15.0	6705	0.8286	1.0	261.0828	11.5097
0.6177	16.0	7152	0.8356	1.0	260.9886	11.7365
0.574	17.0	7599	0.8305	1.0	259.4559	12.0655
0.5306	18.0	8046	0.8270	1.0	261.9602	12.1897
0.4945	19.0	8493	0.8496	1.0	260.2814	12.2705
0.4503	20.0	8940	0.8637	1.0	259.6172	12.4815
0.4242	21.0	9387	0.8771	1.0	260.4173	12.5712
0.37	22.0	9834	0.8862	1.0	262.9328	12.5863

Framework versions

Transformers 4.57.0
Pytorch 2.8.0+cu128
Datasets 4.2.0
Tokenizers 0.22.1

contemmcm/db1020b67a2da5dbf95757572e7274b5

db1020b67a2da5dbf95757572e7274b5

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

contemmcm/
db1020b67a2da5dbf95757572e7274b5