learning_rate: 2e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	1.0	3	7.7645	0.0037	7.7645	2.7865
No log	2.0	6	4.7220	0.0233	4.7220	2.1730
No log	3.0	9	2.9866	0.0040	2.9866	1.7282
No log	4.0	12	1.7825	0.0406	1.7825	1.3351
No log	5.0	15	1.1892	0.0316	1.1892	1.0905
No log	6.0	18	0.8764	0.2932	0.8764	0.9362
No log	7.0	21	0.8292	0.0971	0.8292	0.9106
No log	8.0	24	0.7228	0.2903	0.7228	0.8502
No log	9.0	27	0.7085	0.2314	0.7085	0.8417
No log	10.0	30	0.5277	0.5206	0.5277	0.7264
No log	11.0	33	0.4824	0.5607	0.4824	0.6946
No log	12.0	36	0.5539	0.5903	0.5539	0.7442
No log	13.0	39	0.5374	0.5963	0.5374	0.7331
No log	14.0	42	0.5263	0.6241	0.5263	0.7254
No log	15.0	45	0.4982	0.6379	0.4982	0.7058
No log	16.0	48	0.5018	0.6366	0.5018	0.7084
No log	17.0	51	0.5721	0.6061	0.5721	0.7564
No log	18.0	54	0.5478	0.6016	0.5478	0.7401
No log	19.0	57	0.5245	0.6496	0.5245	0.7243
No log	20.0	60	0.5275	0.6626	0.5275	0.7263
No log	21.0	63	0.5887	0.5628	0.5887	0.7673
No log	22.0	66	0.5986	0.6095	0.5986	0.7737
No log	23.0	69	0.5109	0.5685	0.5109	0.7148
No log	24.0	72	0.4844	0.6104	0.4844	0.6960
No log	25.0	75	0.4973	0.6253	0.4973	0.7052
No log	26.0	78	0.5214	0.6143	0.5214	0.7221
No log	27.0	81	0.5775	0.6200	0.5775	0.7600
No log	28.0	84	0.5506	0.5801	0.5506	0.7420
No log	29.0	87	0.5705	0.6086	0.5705	0.7553
No log	30.0	90	0.5301	0.5864	0.5301	0.7281
No log	31.0	93	0.5349	0.5859	0.5349	0.7314
No log	32.0	96	0.5876	0.6289	0.5876	0.7666
No log	33.0	99	0.5771	0.5635	0.5771	0.7597
No log	34.0	102	0.5029	0.6162	0.5029	0.7092
No log	35.0	105	0.5702	0.5865	0.5702	0.7551
No log	36.0	108	0.5712	0.5530	0.5712	0.7558
No log	37.0	111	0.4966	0.6034	0.4966	0.7047
No log	38.0	114	0.5284	0.6101	0.5284	0.7269
No log	39.0	117	0.4917	0.6243	0.4917	0.7012
No log	40.0	120	0.5184	0.6276	0.5184	0.7200
No log	41.0	123	0.4823	0.6491	0.4823	0.6944
No log	42.0	126	0.5439	0.5802	0.5439	0.7375
No log	43.0	129	0.5992	0.6014	0.5992	0.7740
No log	44.0	132	0.7066	0.5715	0.7066	0.8406
No log	45.0	135	0.5104	0.5943	0.5104	0.7144
No log	46.0	138	0.5452	0.5783	0.5452	0.7384
No log	47.0	141	0.5259	0.6158	0.5259	0.7252
No log	48.0	144	0.4985	0.6522	0.4985	0.7061
No log	49.0	147	0.5360	0.5816	0.5360	0.7321
No log	50.0	150	0.4979	0.6485	0.4979	0.7056

Framework versions

Transformers 4.47.0
Pytorch 2.5.1+cu121
Datasets 3.3.1
Tokenizers 0.21.0

genki10/BERT_V8_sp10_lw20_ex200_lo50_k5_k5_fold4

BERT_V8_sp10_lw20_ex200_lo50_k5_k5_fold4

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

genki10/
BERT_V8_sp10_lw20_ex200_lo50_k5_k5_fold4