learning_rate: 2e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	1.0	4	8.0435	0.0	8.0435	2.8361
No log	2.0	8	4.4864	0.0177	4.4864	2.1181
No log	3.0	12	2.7011	0.0187	2.7011	1.6435
No log	4.0	16	1.6229	0.0520	1.6229	1.2739
No log	5.0	20	1.0108	0.0316	1.0108	1.0054
No log	6.0	24	0.8008	0.1558	0.8008	0.8949
No log	7.0	28	0.6562	0.3981	0.6562	0.8100
No log	8.0	32	0.6395	0.3454	0.6395	0.7997
No log	9.0	36	0.6162	0.5181	0.6162	0.7850
No log	10.0	40	0.5071	0.5115	0.5071	0.7121
No log	11.0	44	0.5851	0.4085	0.5851	0.7649
No log	12.0	48	0.7006	0.5051	0.7006	0.8370
No log	13.0	52	0.4946	0.5163	0.4946	0.7033
No log	14.0	56	0.5027	0.5633	0.5027	0.7090
No log	15.0	60	0.8100	0.4682	0.8100	0.9000
No log	16.0	64	0.5788	0.5555	0.5788	0.7608
No log	17.0	68	0.6890	0.4730	0.6890	0.8301
No log	18.0	72	0.7406	0.4801	0.7406	0.8606
No log	19.0	76	0.5402	0.5349	0.5402	0.7350
No log	20.0	80	0.5560	0.5321	0.5560	0.7457
No log	21.0	84	0.5395	0.5099	0.5395	0.7345
No log	22.0	88	0.7463	0.4498	0.7463	0.8639
No log	23.0	92	0.6544	0.4509	0.6544	0.8089
No log	24.0	96	0.6640	0.4549	0.6640	0.8149
No log	25.0	100	0.5603	0.4941	0.5603	0.7485
No log	26.0	104	0.5814	0.4794	0.5814	0.7625
No log	27.0	108	0.6050	0.4609	0.6050	0.7778
No log	28.0	112	0.5998	0.4997	0.5998	0.7744
No log	29.0	116	0.6292	0.4904	0.6292	0.7932
No log	30.0	120	0.6468	0.4931	0.6468	0.8043
No log	31.0	124	0.5126	0.5221	0.5126	0.7160
No log	32.0	128	0.6886	0.4583	0.6886	0.8298
No log	33.0	132	0.5562	0.4808	0.5562	0.7458
No log	34.0	136	0.5336	0.4690	0.5336	0.7305
No log	35.0	140	0.6261	0.4854	0.6261	0.7913
No log	36.0	144	0.6180	0.4700	0.6180	0.7862
No log	37.0	148	0.5966	0.4645	0.5966	0.7724
No log	38.0	152	0.6178	0.4965	0.6178	0.7860
No log	39.0	156	0.5657	0.4892	0.5657	0.7522
No log	40.0	160	0.7102	0.4501	0.7102	0.8427
No log	41.0	164	0.5250	0.5313	0.5250	0.7246
No log	42.0	168	0.7001	0.4617	0.7001	0.8367
No log	43.0	172	0.5485	0.5086	0.5485	0.7406
No log	44.0	176	0.8388	0.4472	0.8388	0.9158

Framework versions

Transformers 4.47.0
Pytorch 2.5.1+cu121
Datasets 3.3.1
Tokenizers 0.21.0

genki10/BERT_V8_sp10_lw20_ex100_lo100_k7_k7_fold0

BERT_V8_sp10_lw20_ex100_lo100_k7_k7_fold0

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

genki10/
BERT_V8_sp10_lw20_ex100_lo100_k7_k7_fold0