Knowledge Continuity Regularized Network

• lr = 1e-05
• per_device_batch_size = 8
• gradient_accumulation_steps = 2
• weight_decay = 1e-09
• seed = 42

• numerical stability denominator constant = 0.01
• lambda = 0.001
• alpha = 2.0
• beta = 1.0