learning_rate: 2e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	1.0	4	8.9986	0.0	8.9960	2.9993
No log	2.0	8	5.1789	0.0377	5.1768	2.2753
No log	3.0	12	2.9905	0.0	2.9886	1.7288
No log	4.0	16	1.5633	0.0315	1.5617	1.2497
No log	5.0	20	1.0984	0.0	1.0971	1.0474
No log	6.0	24	0.9208	0.1057	0.9195	0.9589
No log	7.0	28	1.0305	0.0211	1.0292	1.0145
No log	8.0	32	0.8577	0.2212	0.8566	0.9255
No log	9.0	36	1.0010	0.0534	0.9997	0.9999
No log	10.0	40	1.0054	0.1286	1.0041	1.0020
No log	11.0	44	0.8992	0.2021	0.8982	0.9477
No log	12.0	48	1.1315	0.1443	1.1300	1.0630
No log	13.0	52	0.7463	0.3038	0.7453	0.8633
No log	14.0	56	0.9453	0.3315	0.9439	0.9716
No log	15.0	60	0.8932	0.3119	0.8919	0.9444
No log	16.0	64	1.1853	0.2563	1.1836	1.0879
No log	17.0	68	1.0343	0.3065	1.0328	1.0163
No log	18.0	72	1.7708	0.1610	1.7688	1.3300
No log	19.0	76	0.7942	0.3605	0.7933	0.8907
No log	20.0	80	1.1527	0.1834	1.1513	1.0730
No log	21.0	84	0.9173	0.3046	0.9161	0.9571
No log	22.0	88	1.3192	0.2277	1.3175	1.1478
No log	23.0	92	0.9001	0.3452	0.8988	0.9481
No log	24.0	96	1.5189	0.1622	1.5169	1.2316
No log	25.0	100	0.8578	0.3509	0.8566	0.9255
No log	26.0	104	1.7073	0.1139	1.7050	1.3058
No log	27.0	108	0.9130	0.2920	0.9116	0.9548
No log	28.0	112	1.7301	0.1222	1.7278	1.3145
No log	29.0	116	1.1719	0.2193	1.1701	1.0817
No log	30.0	120	1.4679	0.1703	1.4659	1.2107
No log	31.0	124	0.9220	0.3068	0.9205	0.9594
No log	32.0	128	1.4249	0.1801	1.4230	1.1929
No log	33.0	132	1.0759	0.2247	1.0744	1.0365
No log	34.0	136	1.3979	0.1767	1.3960	1.1815
No log	35.0	140	1.1131	0.2140	1.1115	1.0543
No log	36.0	144	1.5218	0.1616	1.5199	1.2328
No log	37.0	148	1.1178	0.2192	1.1162	1.0565
No log	38.0	152	1.0638	0.2223	1.0623	1.0307
No log	39.0	156	1.2162	0.2132	1.2146	1.1021
No log	40.0	160	1.1368	0.2303	1.1352	1.0654
No log	41.0	164	1.3008	0.2034	1.2992	1.1398
No log	42.0	168	1.0873	0.2429	1.0858	1.0420
No log	43.0	172	1.5146	0.1651	1.5128	1.2299
No log	44.0	176	1.0896	0.2361	1.0880	1.0431
No log	45.0	180	1.5212	0.1633	1.5193	1.2326
No log	46.0	184	1.0451	0.2541	1.0436	1.0215
No log	47.0	188	1.5575	0.1355	1.5555	1.2472
No log	48.0	192	0.9752	0.2754	0.9737	0.9868
No log	49.0	196	1.4696	0.1615	1.4678	1.2115

Framework versions

Transformers 4.47.0
Pytorch 2.5.1+cu121
Datasets 3.3.1
Tokenizers 0.21.0

genki10/BERT_V8_sp20_lw10_ex40_lo00_k5_k5_fold1

BERT_V8_sp20_lw10_ex40_lo00_k5_k5_fold1

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

genki10/
BERT_V8_sp20_lw10_ex40_lo00_k5_k5_fold1