learning_rate: 5e-05
train_batch_size: 128
eval_batch_size: 128
seed: 42
gradient_accumulation_steps: 2
total_train_batch_size: 256
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: cosine
lr_scheduler_warmup_ratio: 0.06
num_epochs: 30
mixed_precision_training: Native AMP

Training Loss	Epoch	Step	Validation Loss	Slot P	Slot R	Slot F1	Slot Exact Match	Intent Acc
No log	1.0	45	4.1897	0.0	0.0	0.0	0.4088	0.3478
12.6262	2.0	90	1.3454	0.0090	0.0129	0.0106	0.1943	0.8406
4.1265	3.0	135	1.0228	0.0102	0.0193	0.0134	0.1181	0.8564
1.987	4.0	180	0.9293	0.0100	0.0188	0.0130	0.1313	0.8692
1.382	5.0	225	0.9144	0.0096	0.0205	0.0131	0.0644	0.8706
1.0689	6.0	270	0.9485	0.0090	0.0199	0.0124	0.0418	0.8647

aiface/CafeBERT_massive_v2

CafeBERT_massive_v2