learning_rate: 2e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	1.0	5	7.0961	0.0	7.0961	2.6638
No log	2.0	10	5.0124	0.0115	5.0124	2.2388
No log	3.0	15	2.9549	0.0	2.9549	1.7190
No log	4.0	20	1.4757	0.0316	1.4757	1.2148
No log	5.0	25	1.0463	0.0316	1.0463	1.0229
No log	6.0	30	0.7585	0.4317	0.7585	0.8709
No log	7.0	35	0.9440	0.1916	0.9440	0.9716
No log	8.0	40	0.7177	0.4293	0.7177	0.8472
No log	9.0	45	0.6575	0.3832	0.6575	0.8109
No log	10.0	50	0.6709	0.3074	0.6709	0.8191
No log	11.0	55	0.5741	0.3945	0.5741	0.7577
No log	12.0	60	0.6391	0.3784	0.6391	0.7995
No log	13.0	65	0.8678	0.3939	0.8678	0.9315
No log	14.0	70	1.1440	0.2937	1.1440	1.0696
No log	15.0	75	0.7521	0.4512	0.7521	0.8673
No log	16.0	80	0.6954	0.4486	0.6954	0.8339
No log	17.0	85	0.8799	0.3444	0.8799	0.9380
No log	18.0	90	1.0374	0.3083	1.0374	1.0185
No log	19.0	95	0.7444	0.4250	0.7444	0.8628
No log	20.0	100	0.8535	0.3403	0.8535	0.9238
No log	21.0	105	0.7404	0.3964	0.7404	0.8605
No log	22.0	110	0.8354	0.3530	0.8354	0.9140
No log	23.0	115	0.9789	0.2829	0.9789	0.9894
No log	24.0	120	1.0440	0.3245	1.0440	1.0218
No log	25.0	125	0.8205	0.3820	0.8205	0.9058
No log	26.0	130	0.7940	0.3662	0.7940	0.8911
No log	27.0	135	0.8906	0.3659	0.8906	0.9437
No log	28.0	140	1.0449	0.2977	1.0449	1.0222
No log	29.0	145	0.6992	0.4456	0.6992	0.8362
No log	30.0	150	0.8831	0.3342	0.8831	0.9397
No log	31.0	155	0.9479	0.2944	0.9479	0.9736
No log	32.0	160	0.7147	0.4294	0.7147	0.8454
No log	33.0	165	1.0257	0.3078	1.0257	1.0128
No log	34.0	170	0.7661	0.4092	0.7661	0.8753
No log	35.0	175	0.7805	0.3882	0.7805	0.8834
No log	36.0	180	0.8541	0.4342	0.8541	0.9242
No log	37.0	185	0.8661	0.4007	0.8661	0.9307
No log	38.0	190	0.7509	0.4150	0.7509	0.8666
No log	39.0	195	0.7742	0.4204	0.7742	0.8799
No log	40.0	200	0.8066	0.4128	0.8066	0.8981
No log	41.0	205	0.8497	0.4197	0.8497	0.9218
No log	42.0	210	1.0172	0.3167	1.0172	1.0086
No log	43.0	215	0.7412	0.4158	0.7412	0.8609
No log	44.0	220	0.8425	0.3917	0.8425	0.9179
No log	45.0	225	0.9269	0.3760	0.9269	0.9628

Framework versions

Transformers 4.47.0
Pytorch 2.5.1+cu121
Datasets 3.3.1
Tokenizers 0.21.0

genki10/BERT_V8_sp20_lw10_ex40_lo00_k7_k7_fold0

BERT_V8_sp20_lw10_ex40_lo00_k7_k7_fold0

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

genki10/
BERT_V8_sp20_lw10_ex40_lo00_k7_k7_fold0