You can deploy this model and start earning money today!

hannahbillo/
dpo-llama3-8b-sample-rules

Name: dpo-llama3-8b-sample-rules
Availability: InStock

Views

No views yet

dpo-llama3-8b-sample-rules

This model is a fine-tuned version of meta-llama/Meta-Llama-3.1-8B on the None dataset. It achieves the following results on the evaluation set:

More information needed

More information needed

More information needed

The following hyperparameters were used during training:

Training Loss	Epoch	Step	Validation Loss	Rewards/chosen	Rewards/rejected	Rewards/accuracies	Rewards/margins	Logps/rejected	Logps/chosen	Logits/rejected	Logits/chosen
0.4345	0.4444	50	0.3859	0.2018	-0.5860	1.0	0.7877	-415.8305	-190.8644	-1.3991	-1.2723
0.2288	0.8889	100	0.1915	0.1004	-1.6031	1.0	1.7035	-517.5475	-200.9981	-1.3936	-1.2455