learning_rate: 2e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	1.0	4	6.5463	0.0	6.5438	2.5581
No log	2.0	8	3.8922	0.0	3.8905	1.9724
No log	3.0	12	2.2075	0.0970	2.2057	1.4852
No log	4.0	16	1.2137	0.0	1.2123	1.1010
No log	5.0	20	0.9818	0.0037	0.9805	0.9902
No log	6.0	24	1.0238	0.0	1.0224	1.0112
No log	7.0	28	0.7960	0.4012	0.7948	0.8915
No log	8.0	32	0.8893	0.1243	0.8880	0.9424
No log	9.0	36	0.6706	0.4739	0.6694	0.8182
No log	10.0	40	0.7071	0.4335	0.7058	0.8401
No log	11.0	44	0.5842	0.4343	0.5832	0.7637
No log	12.0	48	0.6085	0.5411	0.6073	0.7793
No log	13.0	52	0.6181	0.4243	0.6172	0.7856
No log	14.0	56	1.0551	0.2487	1.0546	1.0269
No log	15.0	60	0.5641	0.5827	0.5632	0.7504
No log	16.0	64	0.7889	0.5133	0.7884	0.8879
No log	17.0	68	0.4530	0.6641	0.4522	0.6725
No log	18.0	72	0.7956	0.5385	0.7952	0.8917
No log	19.0	76	0.4729	0.6456	0.4720	0.6870
No log	20.0	80	0.4602	0.6333	0.4595	0.6779
No log	21.0	84	0.6936	0.5414	0.6926	0.8322
No log	22.0	88	0.4660	0.6117	0.4653	0.6821
No log	23.0	92	0.5755	0.5413	0.5746	0.7580
No log	24.0	96	0.6075	0.4996	0.6068	0.7790
No log	25.0	100	0.7459	0.4483	0.7445	0.8629
No log	26.0	104	0.5227	0.5571	0.5218	0.7223
No log	27.0	108	0.6032	0.5522	0.6021	0.7759
No log	28.0	112	0.5361	0.5480	0.5350	0.7315
No log	29.0	116	0.5309	0.5449	0.5298	0.7279
No log	30.0	120	0.5465	0.5519	0.5456	0.7386
No log	31.0	124	0.5958	0.5199	0.5946	0.7711
No log	32.0	128	0.6270	0.5456	0.6257	0.7910
No log	33.0	132	0.4835	0.6016	0.4826	0.6947
No log	34.0	136	0.6406	0.5427	0.6394	0.7996
No log	35.0	140	0.5750	0.5557	0.5742	0.7578
No log	36.0	144	0.7215	0.4895	0.7201	0.8486
No log	37.0	148	0.6002	0.4980	0.5992	0.7741
No log	38.0	152	0.6616	0.4918	0.6602	0.8125
No log	39.0	156	0.5943	0.5138	0.5932	0.7702
No log	40.0	160	0.5921	0.5125	0.5908	0.7686
No log	41.0	164	0.5615	0.5287	0.5603	0.7485
No log	42.0	168	0.5556	0.5523	0.5544	0.7446
No log	43.0	172	0.6394	0.4898	0.6381	0.7988
No log	44.0	176	0.5920	0.4826	0.5908	0.7686
No log	45.0	180	0.6463	0.4786	0.6449	0.8031
No log	46.0	184	0.5965	0.5422	0.5953	0.7715
No log	47.0	188	0.6266	0.5291	0.6253	0.7907

Framework versions

Transformers 4.51.1
Pytorch 2.5.1+cu124
Datasets 3.5.0
Tokenizers 0.21.0

genki10/BERT_V8_sp10_lw40_ex100_lo00_k5_k5_fold1

BERT_V8_sp10_lw40_ex100_lo00_k5_k5_fold1

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

genki10/
BERT_V8_sp10_lw40_ex100_lo00_k5_k5_fold1