You can deploy this model and start earning money today!

smangrul/
peft-lora-starcoderbase3b-personal-copilot-A100-40GB-colab

Name: peft-lora-starcoderbase3b-personal-copilot-A100-40GB-colab
Availability: InStock

Views

No views yet

peft-lora-starcoderbase3b-personal-copilot-A100-40GB-colab

This model is a fine-tuned version of bigcode/starcoderbase-3b on an unknown dataset. It achieves the following results on the evaluation set:

More information needed

More information needed

More information needed

The following bitsandbytes quantization config was used during training:

The following hyperparameters were used during training:

Training Loss	Epoch	Step	Validation Loss
0.8168	0.05	100	0.7807
0.7961	0.1	200	0.7197
0.7837	0.15	300	0.6603
0.7053	0.2	400	0.6371
0.6132	0.25	500	0.6282
0.6584	0.3	600	0.6107
0.621	0.35	700	0.5934
0.6961	0.4	800	0.5877
0.592	0.45	900	0.5833
0.6967	0.5	1000	0.5746
0.6382	0.55	1100	0.5563
0.6815	0.6	1200	0.5436
0.5483	0.65	1300	0.5439
0.7172	0.7	1400	0.5401
0.5479	0.75	1500	0.5390
0.9422	0.8	1600	0.5357
0.5503	0.85	1700	0.5303
0.5928	0.9	1800	0.5322
0.5513	0.95	1900	0.5176
0.6314	1.0	2000	0.5038