You can deploy this model and start earning money today!

diyali95916/
zephyr-7b-dpo-lora

Name: zephyr-7b-dpo-lora
Availability: InStock

Views

No views yet

zephyr-7b-dpo-lora

This model is a fine-tuned version of HuggingFaceH4/zephyr-7b-beta on the None dataset. It achieves the following results on the evaluation set:

More information needed

More information needed

More information needed

The following hyperparameters were used during training:

Training Loss	Epoch	Step	Validation Loss	Rewards/chosen	Rewards/rejected	Rewards/accuracies	Rewards/margins	Logps/rejected	Logps/chosen	Logits/rejected	Logits/chosen
0.6931	0.55	1	0.6931	0.0	0.0	0.0	0.0	-132.9451	-191.0126	-2.3015	-2.2762
0.6931	1.66	3	0.6928	0.0185	-0.0111	0.5	0.0296	-133.0566	-190.8279	-2.3016	-2.2755
0.6931	2.76	5	0.6843	0.0440	0.0071	0.5	0.0369	-132.8740	-190.5722	-2.2999	-2.2747