Knowledge Continuity Regularized Network

• lr = 5e-05
• per_device_batch_size = 16
• gradient_accumulation_steps = 1
• weight_decay = 1e-09
• seed = 42

• numerical stability denominator constant = 0.01
• lambda = 0.02
• alpha = 2.0
• beta = 1.0