learning_rate: 2e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	1.0	4	7.6431	0.0	7.6429	2.7646
No log	2.0	8	4.2878	0.0039	4.2882	2.0708
No log	3.0	12	2.7667	0.0	2.7671	1.6635
No log	4.0	16	1.6239	0.0280	1.6243	1.2745
No log	5.0	20	1.0761	0.0107	1.0766	1.0376
No log	6.0	24	0.7887	0.4201	0.7890	0.8883
No log	7.0	28	1.0330	0.0356	1.0335	1.0166
No log	8.0	32	0.8632	0.3968	0.8634	0.9292
No log	9.0	36	1.2003	-0.1048	1.2007	1.0958
No log	10.0	40	0.6555	0.3641	0.6558	0.8098
No log	11.0	44	0.5998	0.4262	0.5999	0.7745
No log	12.0	48	0.5914	0.4497	0.5914	0.7690
No log	13.0	52	0.5482	0.4856	0.5480	0.7403
No log	14.0	56	0.5281	0.5035	0.5278	0.7265
No log	15.0	60	0.5779	0.4626	0.5776	0.7600
No log	16.0	64	0.5671	0.5298	0.5667	0.7528
No log	17.0	68	0.5904	0.5971	0.5900	0.7681
No log	18.0	72	0.7289	0.4038	0.7284	0.8535
No log	19.0	76	0.5701	0.5209	0.5698	0.7548
No log	20.0	80	0.5758	0.4898	0.5755	0.7586
No log	21.0	84	0.6214	0.4639	0.6210	0.7880
No log	22.0	88	0.6332	0.4466	0.6328	0.7955
No log	23.0	92	0.5920	0.5649	0.5915	0.7691
No log	24.0	96	0.6844	0.4533	0.6840	0.8271
No log	25.0	100	0.6109	0.5676	0.6104	0.7813
No log	26.0	104	0.6189	0.5012	0.6184	0.7864
No log	27.0	108	0.6380	0.4686	0.6376	0.7985
No log	28.0	112	0.7443	0.3751	0.7440	0.8625
No log	29.0	116	0.6511	0.5456	0.6506	0.8066
No log	30.0	120	0.6399	0.5284	0.6394	0.7996
No log	31.0	124	0.6480	0.4765	0.6476	0.8047
No log	32.0	128	0.6729	0.3924	0.6727	0.8202
No log	33.0	132	0.6328	0.4815	0.6325	0.7953
No log	34.0	136	0.6450	0.5017	0.6447	0.8029
No log	35.0	140	0.7173	0.3949	0.7170	0.8467
No log	36.0	144	0.6540	0.5173	0.6536	0.8084
No log	37.0	148	0.7413	0.4058	0.7408	0.8607
No log	38.0	152	0.6485	0.5492	0.6480	0.8050
No log	39.0	156	0.7423	0.3837	0.7418	0.8613
No log	40.0	160	0.6517	0.5089	0.6513	0.8070
No log	41.0	164	0.8396	0.3008	0.8394	0.9162
No log	42.0	168	0.6656	0.4356	0.6653	0.8157
No log	43.0	172	0.7043	0.4014	0.7040	0.8390
No log	44.0	176	0.6987	0.4017	0.6984	0.8357
No log	45.0	180	0.6210	0.5394	0.6205	0.7877
No log	46.0	184	0.7947	0.3367	0.7945	0.8913
No log	47.0	188	0.6355	0.5076	0.6351	0.7969

Framework versions

Transformers 4.47.0
Pytorch 2.5.1+cu121
Datasets 3.3.1
Tokenizers 0.21.0

genki10/BERT_V8_sp20_lw10_ex30_lo00_k5_k5_fold2

BERT_V8_sp20_lw10_ex30_lo00_k5_k5_fold2

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

genki10/
BERT_V8_sp20_lw10_ex30_lo00_k5_k5_fold2