You can deploy this model and start earning money today!

RonTon05/
RevisionQ1_11_03_PhoBert_Lexical_FreezeMetaXLM_52K

Name: RevisionQ1_11_03_PhoBert_Lexical_FreezeMetaXLM_52K
Availability: InStock

Views

No views yet

RevisionQ1_11_03_PhoBert_Lexical_FreezeMetaXLM_52K

This model is a fine-tuned version of phunganhsang/Revision_PhoBert_Lexical_Dataset_52k on an unknown dataset. It achieves the following results on the evaluation set:

More information needed

More information needed

More information needed

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 32
eval_batch_size: 32
seed: 42
optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 5

Training Loss	Epoch	Step	Validation Loss	Accuracy	F1
No log	0.2778	100	0.3339	0.8717	0.8663
No log	0.5556	200	0.3136	0.8665	0.8611
No log	0.8333	300	0.4292	0.7948	0.7926
0.2954	1.1111	400	0.4472	0.7995	0.7970
0.2954	1.3889	500	0.2938	0.8719	0.8666
0.2954	1.6667	600	0.3531	0.8343	0.8300
0.2954	1.9444	700	0.3064	0.8553	0.8503
0.2086	2.2222	800	0.2846	0.8835	0.8737
0.2086	2.5	900	0.3966	0.8320	0.8284
0.2086	2.7778	1000	0.3094	0.8665	0.8612
0.1608	3.0556	1100	0.3154	0.8699	0.8646
0.1608	3.3333	1200	0.3056	0.8748	0.8690
0.1608	3.6111	1300	0.3654	0.8498	0.8453
0.1608	3.8889	1400	0.2846	0.8821	0.8756
0.1184	4.1667	1500	0.3011	0.8712	0.8656
0.1184	4.4444	1600	0.3542	0.8570	0.8522
0.1184	4.7222	1700	0.3361	0.8600	0.8548
0.0897	5.0	1800	0.3449	0.8595	0.8545