learning_rate: 2e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	1.0	4	9.3200	0.0018	9.3200	3.0529
No log	2.0	8	5.4443	0.0440	5.4443	2.3333
No log	3.0	12	3.0684	0.0040	3.0684	1.7517
No log	4.0	16	1.6222	0.0533	1.6222	1.2737
No log	5.0	20	1.0598	0.0316	1.0598	1.0294
No log	6.0	24	0.8730	0.2653	0.8730	0.9343
No log	7.0	28	1.1325	0.0555	1.1325	1.0642
No log	8.0	32	0.8457	0.3436	0.8457	0.9196
No log	9.0	36	1.2328	0.2265	1.2328	1.1103
No log	10.0	40	0.8298	0.3989	0.8298	0.9109
No log	11.0	44	1.5534	0.2440	1.5534	1.2463
No log	12.0	48	1.4950	0.2646	1.4950	1.2227
No log	13.0	52	0.8201	0.4485	0.8201	0.9056
No log	14.0	56	1.8936	0.1688	1.8936	1.3761
No log	15.0	60	1.1041	0.3442	1.1041	1.0507
No log	16.0	64	1.0786	0.3349	1.0786	1.0386
No log	17.0	68	1.8436	0.1788	1.8436	1.3578
No log	18.0	72	1.3404	0.2522	1.3404	1.1578
No log	19.0	76	1.0569	0.3663	1.0569	1.0280
No log	20.0	80	1.1673	0.3339	1.1673	1.0804
No log	21.0	84	1.4539	0.2528	1.4539	1.2058
No log	22.0	88	1.1758	0.3380	1.1758	1.0844
No log	23.0	92	1.4130	0.2739	1.4130	1.1887
No log	24.0	96	1.3242	0.2931	1.3242	1.1507
No log	25.0	100	1.5893	0.2347	1.5893	1.2607
No log	26.0	104	1.6088	0.2281	1.6088	1.2684
No log	27.0	108	1.2284	0.3175	1.2284	1.1084
No log	28.0	112	1.9626	0.1895	1.9626	1.4009
No log	29.0	116	1.3958	0.2577	1.3958	1.1814
No log	30.0	120	1.4429	0.2497	1.4429	1.2012
No log	31.0	124	1.0080	0.3668	1.0080	1.0040
No log	32.0	128	1.0719	0.3407	1.0719	1.0353
No log	33.0	132	1.1752	0.3115	1.1752	1.0841
No log	34.0	136	1.1945	0.3047	1.1945	1.0929
No log	35.0	140	1.2850	0.2768	1.2850	1.1336
No log	36.0	144	1.3042	0.2731	1.3042	1.1420
No log	37.0	148	1.2559	0.2868	1.2559	1.1207
No log	38.0	152	1.6649	0.2037	1.6649	1.2903
No log	39.0	156	1.3297	0.2339	1.3297	1.1531
No log	40.0	160	1.1931	0.2662	1.1931	1.0923
No log	41.0	164	1.1159	0.3093	1.1159	1.0564
No log	42.0	168	1.6883	0.2136	1.6883	1.2993
No log	43.0	172	1.1705	0.2843	1.1705	1.0819

Framework versions

Transformers 4.51.1
Pytorch 2.5.1+cu124
Datasets 3.5.0
Tokenizers 0.21.0

genki10/BERT_V8_sp10_lw40_ex50_lo00_k5_k5_fold4

BERT_V8_sp10_lw40_ex50_lo00_k5_k5_fold4

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

genki10/
BERT_V8_sp10_lw40_ex50_lo00_k5_k5_fold4