You can deploy this model and start earning money today!

xz-huggingface-0/
llama2-7b-dpo-lora-20231129-32

Name: llama2-7b-dpo-lora-20231129-32
Availability: InStock

Views

No views yet

llama2-7b-dpo-lora-20231129-32

This model is a fine-tuned version of meta-llama/Llama-2-7b-hf on the None dataset. It achieves the following results on the evaluation set:

More information needed

More information needed

More information needed

The following hyperparameters were used during training:

Training Loss	Epoch	Step	Validation Loss	Rewards/chosen	Rewards/rejected	Rewards/accuracies	Rewards/margins	Logps/rejected	Logps/chosen	Logits/rejected	Logits/chosen
0.6918	1.0	121	0.6911	0.0118	0.0027	0.5159	0.0091	-288.7652	-360.1456	-0.3204	-0.1740
0.6887	2.0	242	0.6886	0.0182	0.0065	0.5437	0.0118	-288.7276	-360.0812	-0.3203	-0.1741
0.6865	3.0	363	0.6869	0.0290	0.0096	0.5833	0.0193	-288.6959	-359.9739	-0.3197	-0.1734