learning_rate: 0.0002
train_batch_size: 2
eval_batch_size: 4
seed: 42
gradient_accumulation_steps: 4
total_train_batch_size: 8
optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
lr_scheduler_warmup_steps: 50
num_epochs: 3

Training Loss	Epoch	Step	Validation Loss
0.3157	0.2667	100	0.3160
0.3051	0.5333	200	0.3093
0.3057	0.8	300	0.3051
0.2753	1.0667	400	0.3048
0.2497	1.3333	500	0.3066
0.2456	1.6	600	0.3054
0.2376	1.8667	700	0.3039
0.1865	2.1333	800	0.3304
0.1774	2.4	900	0.3306
0.1778	2.6667	1000	0.3344
0.1801	2.9333	1100	0.3321

EshAhm/Mistral-7B-v0.1-QLoRA-MathReasoning1

Mistral-7B-v0.1-QLoRA-MathReasoning1