learning_rate: 2e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	1.0	4	6.4422	0.0009	6.4398	2.5377
No log	2.0	8	3.5209	0.0	3.5189	1.8759
No log	3.0	12	2.0474	0.0730	2.0457	1.4303
No log	4.0	16	1.2214	0.0	1.2200	1.1045
No log	5.0	20	1.4323	0.0	1.4309	1.1962
No log	6.0	24	1.1247	0.0	1.1233	1.0599
No log	7.0	28	1.0605	0.0145	1.0591	1.0291
No log	8.0	32	1.0931	0.0815	1.0917	1.0448
No log	9.0	36	0.8087	0.3043	0.8074	0.8986
No log	10.0	40	1.1341	0.1925	1.1322	1.0641
No log	11.0	44	0.6196	0.4246	0.6184	0.7864
No log	12.0	48	0.6770	0.3938	0.6759	0.8222
No log	13.0	52	0.5992	0.4402	0.5981	0.7734
No log	14.0	56	0.6340	0.4716	0.6324	0.7953
No log	15.0	60	0.6401	0.4755	0.6389	0.7993
No log	16.0	64	0.9002	0.4021	0.8982	0.9477
No log	17.0	68	0.5362	0.6004	0.5353	0.7316
No log	18.0	72	1.0007	0.3871	0.9985	0.9992
No log	19.0	76	0.8914	0.3216	0.8899	0.9433
No log	20.0	80	1.5024	0.1554	1.4992	1.2244
No log	21.0	84	0.9565	0.3982	0.9555	0.9775
No log	22.0	88	1.0187	0.3310	1.0164	1.0082
No log	23.0	92	0.8946	0.3729	0.8925	0.9447
No log	24.0	96	0.8481	0.3220	0.8464	0.9200
No log	25.0	100	1.0089	0.2702	1.0065	1.0032
No log	26.0	104	0.9176	0.3373	0.9153	0.9567
No log	27.0	108	0.9116	0.3693	0.9094	0.9536
No log	28.0	112	1.1710	0.2740	1.1682	1.0808
No log	29.0	116	0.9673	0.2784	0.9648	0.9822
No log	30.0	120	0.9295	0.3111	0.9272	0.9629
No log	31.0	124	0.9794	0.2639	0.9769	0.9884
No log	32.0	128	0.9849	0.2831	0.9823	0.9911
No log	33.0	132	0.9667	0.3106	0.9643	0.9820
No log	34.0	136	0.8377	0.3898	0.8356	0.9141
No log	35.0	140	0.7923	0.3775	0.7903	0.8890
No log	36.0	144	0.9364	0.3159	0.9341	0.9665
No log	37.0	148	1.0363	0.2860	1.0338	1.0168
No log	38.0	152	0.9731	0.3350	0.9708	0.9853
No log	39.0	156	0.9493	0.3544	0.9471	0.9732
No log	40.0	160	1.1052	0.3015	1.1028	1.0502
No log	41.0	164	0.9024	0.3358	0.9002	0.9488
No log	42.0	168	1.0044	0.3122	1.0020	1.0010
No log	43.0	172	0.9407	0.3355	0.9384	0.9687
No log	44.0	176	0.9211	0.3422	0.9188	0.9585
No log	45.0	180	1.0209	0.3224	1.0185	1.0092
No log	46.0	184	0.7930	0.3775	0.7911	0.8894
No log	47.0	188	1.0943	0.2992	1.0919	1.0449

Framework versions

Transformers 4.47.0
Pytorch 2.5.1+cu121
Datasets 3.3.1
Tokenizers 0.21.0

genki10/BERT_V8_sp20_lw10_ex50_lo00_k5_k5_fold1

BERT_V8_sp20_lw10_ex50_lo00_k5_k5_fold1

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

genki10/
BERT_V8_sp20_lw10_ex50_lo00_k5_k5_fold1