anliR3-gpt2 – AI Model by asun17904 | AlphaNeural AI

You can deploy this model and start earning money today!

asun17904/
anliR3-gpt2

like

0

Views

No views yet

Knowledge Continuity Regularized Network

Dataset: ANLI Round: None

Trainer Hyperparameters:

lr = 5e-05
per_device_batch_size = 8
gradient_accumulation_steps = 2
weight_decay = 1e-09
seed = 42

Regularization Hyperparameters

numerical stability denominator constant = 1.0
lambda = 0.0
alpha = 1.0
beta = 1.0

Extended Logs:

eval_loss	eval_accuracy	epoch
1.102	0.429	1.0
1.076	0.451	2.0
1.092	0.443	3.0
1.092	0.441	4.0
1.098	0.438	5.0
1.104	0.437	6.0
1.094	0.443	7.0
1.095	0.448	8.0
1.110	0.434	9.0