learning_rate: 1e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
distributed_type: multi-GPU
num_devices: 8
gradient_accumulation_steps: 8
total_train_batch_size: 512
total_eval_batch_size: 64
optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 1.0

Training Loss	Epoch	Step	Validation Loss
17.9483	0.0904	5000	2.1860
17.4604	0.1808	10000	2.1737
17.2613	0.2712	15000	2.1614
17.3945	0.3616	20000	2.1502
16.9544	0.4520	25000	2.1386
16.8142	0.5424	30000	2.1271
16.7899	0.6329	35000	2.1153
16.9125	0.7233	40000	2.1080
16.954	0.8137	45000	2.1012
16.6773	0.9041	50000	2.0931
16.8028	0.9945	55000	2.0829

CocoRoF/KoModernBERT-chp-05

KoModernBERT-chp-05