learning_rate: 2e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	1.0	4	10.1708	0.0	10.1680	3.1887
No log	2.0	8	7.9246	0.0	7.9221	2.8146
No log	3.0	12	7.4302	0.0	7.4278	2.7254
No log	4.0	16	6.6771	0.0	6.6748	2.5836
No log	5.0	20	4.5003	0.0010	4.4983	2.1209
No log	6.0	24	2.8213	0.0	2.8195	1.6791
No log	7.0	28	1.7402	0.0376	1.7386	1.3186
No log	8.0	32	1.5790	0.0288	1.5774	1.2560
No log	9.0	36	1.2478	0.0	1.2463	1.1164
No log	10.0	40	1.9091	0.0499	1.9072	1.3810
No log	11.0	44	1.3797	0.0130	1.3777	1.1738
No log	12.0	48	1.5845	-0.0455	1.5823	1.2579
No log	13.0	52	1.6978	-0.0512	1.6954	1.3021
No log	14.0	56	1.4561	-0.0331	1.4537	1.2057
No log	15.0	60	1.6245	0.0829	1.6222	1.2737
No log	16.0	64	1.3008	0.1854	1.2990	1.1398
No log	17.0	68	2.0103	0.1044	2.0083	1.4171
No log	18.0	72	1.8543	0.1268	1.8522	1.3610
No log	19.0	76	1.8642	0.1209	1.8622	1.3646
No log	20.0	80	2.2987	0.0417	2.2966	1.5154
No log	21.0	84	2.1126	0.0714	2.1104	1.4527
No log	22.0	88	2.1068	0.1008	2.1045	1.4507
No log	23.0	92	2.0196	0.0755	2.0173	1.4203
No log	24.0	96	2.0014	0.0789	1.9992	1.4139
No log	25.0	100	1.8287	0.1088	1.8267	1.3516
No log	26.0	104	2.2844	0.0571	2.2822	1.5107
No log	27.0	108	2.1561	0.0598	2.1539	1.4676
No log	28.0	112	1.9090	0.0794	1.9070	1.3809
No log	29.0	116	2.1254	0.0481	2.1230	1.4571
No log	30.0	120	1.7659	0.1058	1.7636	1.3280
No log	31.0	124	2.2552	0.0624	2.2528	1.5009
No log	32.0	128	1.8676	0.0895	1.8654	1.3658
No log	33.0	132	2.0090	0.0847	2.0066	1.4165
No log	34.0	136	1.9929	0.1098	1.9906	1.4109
No log	35.0	140	1.7003	0.1081	1.6981	1.3031
No log	36.0	144	2.1623	0.0558	2.1597	1.4696
No log	37.0	148	2.0063	0.0800	2.0038	1.4155
No log	38.0	152	2.3315	0.0488	2.3288	1.5260
No log	39.0	156	2.0439	0.0632	2.0413	1.4288
No log	40.0	160	2.1817	0.0537	2.1793	1.4762
No log	41.0	164	2.0438	0.0745	2.0415	1.4288
No log	42.0	168	1.9384	0.0941	1.9363	1.3915
No log	43.0	172	2.1261	0.0704	2.1240	1.4574
No log	44.0	176	2.0887	0.0716	2.0864	1.4444
No log	45.0	180	2.2252	0.0560	2.2229	1.4909
No log	46.0	184	1.9152	0.0995	1.9130	1.3831

Framework versions

Transformers 4.47.0
Pytorch 2.5.1+cu121
Datasets 3.3.1
Tokenizers 0.21.0

genki10/BERT_V8_sp20_lw10_ex100_lo00_k5_k5_fold1

BERT_V8_sp20_lw10_ex100_lo00_k5_k5_fold1

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

genki10/
BERT_V8_sp20_lw10_ex100_lo00_k5_k5_fold1