learning_rate: 2e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	1.0	5	6.6909	0.0043	6.6909	2.5867
No log	2.0	10	3.4704	0.0	3.4707	1.8630
No log	3.0	15	1.8688	0.0615	1.8692	1.3672
No log	4.0	20	1.0140	0.0	1.0144	1.0072
No log	5.0	25	0.9573	-0.0019	0.9578	0.9787
No log	6.0	30	0.8218	0.2764	0.8222	0.9067
No log	7.0	35	0.7361	0.4044	0.7364	0.8581
No log	8.0	40	0.7182	0.4218	0.7184	0.8476
No log	9.0	45	0.5333	0.4897	0.5335	0.7304
No log	10.0	50	0.5186	0.4926	0.5186	0.7201
No log	11.0	55	0.5835	0.4857	0.5836	0.7640
No log	12.0	60	0.5051	0.5696	0.5048	0.7105
No log	13.0	65	0.6645	0.4890	0.6644	0.8151
No log	14.0	70	0.4802	0.5969	0.4799	0.6928
No log	15.0	75	0.7350	0.4320	0.7348	0.8572
No log	16.0	80	0.5056	0.5977	0.5052	0.7108
No log	17.0	85	0.8803	0.4112	0.8804	0.9383
No log	18.0	90	0.5243	0.5757	0.5241	0.7240
No log	19.0	95	0.7273	0.4767	0.7274	0.8529
No log	20.0	100	0.6048	0.5239	0.6047	0.7776
No log	21.0	105	0.6773	0.4839	0.6772	0.8229
No log	22.0	110	0.8034	0.4102	0.8033	0.8963
No log	23.0	115	0.5869	0.5250	0.5866	0.7659
No log	24.0	120	0.7887	0.4086	0.7887	0.8881
No log	25.0	125	0.8388	0.4110	0.8387	0.9158
No log	26.0	130	0.6852	0.5213	0.6851	0.8277
No log	27.0	135	0.6590	0.4490	0.6589	0.8117
No log	28.0	140	0.7508	0.4192	0.7509	0.8665
No log	29.0	145	0.6815	0.4843	0.6814	0.8254
No log	30.0	150	0.6962	0.4588	0.6961	0.8343
No log	31.0	155	0.7553	0.4485	0.7554	0.8691
No log	32.0	160	0.6816	0.4739	0.6816	0.8256
No log	33.0	165	0.7176	0.4574	0.7176	0.8471
No log	34.0	170	0.6303	0.5214	0.6301	0.7938
No log	35.0	175	0.9715	0.3553	0.9715	0.9857
No log	36.0	180	0.6352	0.4698	0.6349	0.7968
No log	37.0	185	0.6806	0.4732	0.6804	0.8248
No log	38.0	190	0.8190	0.3847	0.8189	0.9049
No log	39.0	195	0.7308	0.4232	0.7307	0.8548
No log	40.0	200	0.7273	0.4453	0.7272	0.8528
No log	41.0	205	0.6748	0.4736	0.6748	0.8214
No log	42.0	210	0.7152	0.4404	0.7152	0.8457
No log	43.0	215	0.7215	0.4427	0.7215	0.8494
No log	44.0	220	0.7782	0.4139	0.7782	0.8821
No log	45.0	225	0.6545	0.4396	0.6543	0.8089
No log	46.0	230	0.8318	0.3757	0.8318	0.9120

Framework versions

Transformers 4.47.0
Pytorch 2.5.1+cu121
Datasets 3.3.1
Tokenizers 0.21.0

genki10/BERT_V8_sp20_lw10_ex50_lo00_k7_k7_fold2

BERT_V8_sp20_lw10_ex50_lo00_k7_k7_fold2

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

genki10/
BERT_V8_sp20_lw10_ex50_lo00_k7_k7_fold2