learning_rate: 2e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	1.0	3	9.6745	0.0018	9.6745	3.1104
No log	2.0	6	8.2045	0.0	8.2045	2.8644
No log	3.0	9	6.4297	0.0003	6.4297	2.5357
No log	4.0	12	4.5710	0.0115	4.5710	2.1380
No log	5.0	15	3.3206	0.0039	3.3206	1.8223
No log	6.0	18	2.2559	0.1189	2.2559	1.5020
No log	7.0	21	1.6236	0.0316	1.6236	1.2742
No log	8.0	24	1.1943	0.0316	1.1943	1.0928
No log	9.0	27	0.8217	0.2731	0.8217	0.9065
No log	10.0	30	0.7466	0.1230	0.7466	0.8641
No log	11.0	33	0.7043	0.2276	0.7043	0.8392
No log	12.0	36	0.6697	0.2217	0.6697	0.8184
No log	13.0	39	0.6158	0.3639	0.6158	0.7847
No log	14.0	42	0.5636	0.3999	0.5636	0.7508
No log	15.0	45	1.0450	0.2765	1.0450	1.0222
No log	16.0	48	0.6933	0.4390	0.6933	0.8326
No log	17.0	51	0.8982	0.3527	0.8982	0.9478
No log	18.0	54	0.6378	0.4841	0.6378	0.7986
No log	19.0	57	0.5146	0.5939	0.5146	0.7174
No log	20.0	60	0.7443	0.4269	0.7443	0.8627
No log	21.0	63	0.5919	0.5468	0.5919	0.7693
No log	22.0	66	0.6602	0.4978	0.6602	0.8125
No log	23.0	69	0.8269	0.4113	0.8269	0.9094
No log	24.0	72	0.6942	0.5142	0.6942	0.8332
No log	25.0	75	0.8611	0.4190	0.8611	0.9280
No log	26.0	78	0.9414	0.3819	0.9414	0.9702
No log	27.0	81	0.7654	0.4303	0.7654	0.8749
No log	28.0	84	0.9652	0.3256	0.9652	0.9824
No log	29.0	87	0.7703	0.3917	0.7703	0.8776
No log	30.0	90	0.5625	0.5626	0.5625	0.7500
No log	31.0	93	0.8046	0.3599	0.8046	0.8970
No log	32.0	96	0.7328	0.4111	0.7328	0.8560
No log	33.0	99	0.8072	0.3715	0.8072	0.8985
No log	34.0	102	0.9480	0.3415	0.9480	0.9736
No log	35.0	105	0.7909	0.4242	0.7909	0.8893
No log	36.0	108	0.8948	0.3740	0.8948	0.9459
No log	37.0	111	0.8331	0.3985	0.8331	0.9127
No log	38.0	114	1.1525	0.3141	1.1525	1.0736
No log	39.0	117	0.8495	0.3805	0.8495	0.9217
No log	40.0	120	1.0125	0.3348	1.0125	1.0062
No log	41.0	123	0.6883	0.4657	0.6883	0.8296
No log	42.0	126	0.9192	0.3430	0.9192	0.9587
No log	43.0	129	0.8602	0.3703	0.8602	0.9275
No log	44.0	132	0.9799	0.3360	0.9799	0.9899
No log	45.0	135	0.9105	0.3497	0.9105	0.9542
No log	46.0	138	0.7505	0.4116	0.7505	0.8663
No log	47.0	141	0.9616	0.3434	0.9616	0.9806
No log	48.0	144	0.7919	0.3867	0.7919	0.8899
No log	49.0	147	0.9452	0.3353	0.9452	0.9722

Framework versions

Transformers 4.47.0
Pytorch 2.5.1+cu121
Datasets 3.3.1
Tokenizers 0.21.0

genki10/BERT_V8_sp10_lw20_ex200_lo50_k5_k5_fold0

BERT_V8_sp10_lw20_ex200_lo50_k5_k5_fold0

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

genki10/
BERT_V8_sp10_lw20_ex200_lo50_k5_k5_fold0