You can deploy this model and start earning money today!

alvarobartt/
mistral-orpo-mix

Name: mistral-orpo-mix
Availability: InStock

Views

No views yet

ORPO fine-tune of Mistral 7B v0.1 with DPO Mix 7K

Stable Diffusion XL "A capybara, a killer whale, and a robot named Ultra being friends"

⚠️ Note that the code is still experimental, as the ORPOTrainer PR is still not merged, follow its progress at 🤗trl - ORPOTrainer PR.