learning_rate: 2e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	1.0	3	9.8951	0.0	9.8952	3.1457
No log	2.0	6	8.9743	0.0	8.9744	2.9957
No log	3.0	9	6.7951	0.0	6.7954	2.6068
No log	4.0	12	4.7039	0.0064	4.7044	2.1690
No log	5.0	15	3.2390	0.0	3.2394	1.7998
No log	6.0	18	2.2315	0.1252	2.2320	1.4940
No log	7.0	21	1.4100	0.0449	1.4104	1.1876
No log	8.0	24	0.9917	0.0107	0.9921	0.9960
No log	9.0	27	0.9168	0.0621	0.9171	0.9577
No log	10.0	30	0.7581	0.3831	0.7584	0.8709
No log	11.0	33	0.6708	0.4356	0.6710	0.8192
No log	12.0	36	0.9303	0.2600	0.9305	0.9646
No log	13.0	39	0.6323	0.4739	0.6324	0.7952
No log	14.0	42	0.6751	0.4328	0.6751	0.8217
No log	15.0	45	0.6577	0.4622	0.6579	0.8111
No log	16.0	48	0.8397	0.4083	0.8396	0.9163
No log	17.0	51	0.6337	0.4869	0.6335	0.7959
No log	18.0	54	0.7886	0.4424	0.7881	0.8878
No log	19.0	57	0.6962	0.4713	0.6958	0.8341
No log	20.0	60	0.7709	0.4300	0.7703	0.8777
No log	21.0	63	0.8300	0.4124	0.8294	0.9107
No log	22.0	66	0.7602	0.4757	0.7597	0.8716
No log	23.0	69	0.9650	0.3753	0.9645	0.9821
No log	24.0	72	0.7595	0.4558	0.7591	0.8713
No log	25.0	75	0.7831	0.4398	0.7826	0.8847
No log	26.0	78	0.8448	0.4063	0.8442	0.9188
No log	27.0	81	0.8921	0.3952	0.8915	0.9442
No log	28.0	84	0.8434	0.4061	0.8429	0.9181
No log	29.0	87	0.8420	0.3935	0.8416	0.9174
No log	30.0	90	0.7584	0.4394	0.7580	0.8706
No log	31.0	93	0.8081	0.4392	0.8075	0.8986
No log	32.0	96	0.8322	0.4274	0.8315	0.9119
No log	33.0	99	0.9887	0.4076	0.9881	0.9940
No log	34.0	102	0.7618	0.4542	0.7613	0.8725
No log	35.0	105	0.7738	0.4294	0.7733	0.8794
No log	36.0	108	0.7527	0.4396	0.7522	0.8673
No log	37.0	111	0.8821	0.3825	0.8816	0.9389
No log	38.0	114	0.7091	0.4508	0.7086	0.8418
No log	39.0	117	0.7601	0.4313	0.7596	0.8716
No log	40.0	120	0.7929	0.4164	0.7924	0.8902
No log	41.0	123	0.7268	0.4304	0.7264	0.8523
No log	42.0	126	0.6924	0.4417	0.6920	0.8319
No log	43.0	129	0.7371	0.4405	0.7368	0.8584
No log	44.0	132	0.6869	0.4491	0.6865	0.8286
No log	45.0	135	0.8758	0.3897	0.8755	0.9357
No log	46.0	138	0.7299	0.4357	0.7295	0.8541
No log	47.0	141	0.7610	0.4145	0.7606	0.8721

Framework versions

Transformers 4.51.1
Pytorch 2.5.1+cu124
Datasets 3.5.0
Tokenizers 0.21.0

genki10/BERT_V8_sp10_lw40_ex10_lo00_k3_k3_fold2

BERT_V8_sp10_lw40_ex10_lo00_k3_k3_fold2

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

genki10/
BERT_V8_sp10_lw40_ex10_lo00_k3_k3_fold2