You can deploy this model and start earning money today!

mnoukhov/
pythia410m-dpo2-tldr

Name: pythia410m-dpo2-tldr
Availability: InStock

Views

No views yet

pythia410m-dpo2-tldr

This model is a fine-tuned version of mnoukhov/pythia410m-sft-tldr on an unknown dataset. It achieves the following results on the evaluation set:

More information needed

More information needed

More information needed

The following hyperparameters were used during training:

Training Loss	Epoch	Step	Validation Loss	Rewards/chosen	Rewards/rejected	Rewards/accuracies	Rewards/margins	Logps/rejected	Logps/chosen	Logps/ref Rejected	Logps/ref Chosen
0.6681	0.1999	335	0.6376	-0.2343	-0.3789	0.6615	0.1446	-70.3464	-70.3464	-59.5615	-65.6594
0.6485	0.3999	670	0.6171	-0.9421	-1.1796	0.6678	0.2375	-84.5023	-84.5023	-59.5615	-65.6594
0.6362	0.5998	1005	0.6095	-1.1035	-1.3785	0.6743	0.2750	-87.7290	-87.7290	-59.5615	-65.6594
0.6342	0.7998	1340	0.6063	-1.2460	-1.5415	0.6768	0.2955	-90.5797	-90.5797	-59.5615	-65.6594
0.6299	0.9997	1675	0.6073	-1.2728	-1.5670	0.6761	0.2942	-91.1163	-91.1163	-59.5615	-65.6594