learning_rate: 2e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	1.0	3	11.4304	0.0238	11.4304	3.3809
No log	2.0	6	8.1499	0.0059	8.1499	2.8548
No log	3.0	9	4.7921	0.0287	4.7921	2.1891
No log	4.0	12	2.9223	0.0115	2.9223	1.7095
No log	5.0	15	1.9044	0.1117	1.9044	1.3800
No log	6.0	18	1.2253	0.0618	1.2253	1.1069
No log	7.0	21	0.9008	0.0406	0.9008	0.9491
No log	8.0	24	0.8202	0.3280	0.8202	0.9056
No log	9.0	27	0.6329	0.3613	0.6329	0.7955
No log	10.0	30	0.7264	0.4775	0.7264	0.8523
No log	11.0	33	0.9821	0.3176	0.9821	0.9910
No log	12.0	36	0.5212	0.4935	0.5212	0.7220
No log	13.0	39	1.0428	0.2753	1.0428	1.0212
No log	14.0	42	0.6159	0.5539	0.6159	0.7848
No log	15.0	45	0.6491	0.5111	0.6491	0.8057
No log	16.0	48	1.3297	0.2738	1.3297	1.1531
No log	17.0	51	0.5740	0.5321	0.5740	0.7576
No log	18.0	54	1.2812	0.2823	1.2812	1.1319
No log	19.0	57	1.0835	0.3220	1.0835	1.0409
No log	20.0	60	0.7136	0.4721	0.7136	0.8448
No log	21.0	63	1.2982	0.2638	1.2982	1.1394
No log	22.0	66	0.7952	0.4044	0.7952	0.8917
No log	23.0	69	1.3023	0.2581	1.3023	1.1412
No log	24.0	72	0.8545	0.3795	0.8545	0.9244
No log	25.0	75	1.3030	0.2554	1.3030	1.1415
No log	26.0	78	0.9428	0.3089	0.9428	0.9710
No log	27.0	81	1.1067	0.2464	1.1067	1.0520
No log	28.0	84	0.8095	0.3891	0.8095	0.8997
No log	29.0	87	1.2132	0.2435	1.2132	1.1015
No log	30.0	90	1.0006	0.3290	1.0006	1.0003
No log	31.0	93	1.1649	0.3091	1.1649	1.0793
No log	32.0	96	1.0991	0.2804	1.0991	1.0484
No log	33.0	99	1.0093	0.2696	1.0093	1.0046
No log	34.0	102	0.8444	0.3694	0.8444	0.9189
No log	35.0	105	1.1408	0.2567	1.1408	1.0681
No log	36.0	108	0.9995	0.3171	0.9995	0.9997
No log	37.0	111	0.9755	0.3177	0.9755	0.9877
No log	38.0	114	1.1244	0.2681	1.1244	1.0604
No log	39.0	117	1.5588	0.2083	1.5588	1.2485
No log	40.0	120	0.8255	0.3504	0.8255	0.9086
No log	41.0	123	1.2328	0.2337	1.2328	1.1103
No log	42.0	126	1.0883	0.2613	1.0883	1.0432
No log	43.0	129	1.0425	0.2755	1.0425	1.0210
No log	44.0	132	1.1430	0.2566	1.1430	1.0691

Framework versions

Transformers 4.47.0
Pytorch 2.5.1+cu121
Datasets 3.3.1
Tokenizers 0.21.0

genki10/BERT_V8_sp10_lw20_ex200_lo100_k5_k5_fold0

BERT_V8_sp10_lw20_ex200_lo100_k5_k5_fold0

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

genki10/
BERT_V8_sp10_lw20_ex200_lo100_k5_k5_fold0