zephyr-orpo-7b-v0.2 – AI Model by wandb | AlphaNeural AI

You can deploy this model and start earning money today!

wandb/
zephyr-orpo-7b-v0.2

like

0

text-generation

generated_from_trainer

argilla/distilabel-capybara-dpo-7k-binarized

wandb/Mistral-7B-v0.2

autotrain_compatible

text-generation-inference

endpoints_compatible

Views

No views yet

Visualize in Weights & Biases

Mistral 7B Zephyr Orpo

The Zephyr Orpo recipe applied on top of Mistral 7B v0.2 (new recipe with new Mistral base model)

Model description

Recipe

We trained using the alignment handbook recipe and logging to W&B

Visit the W&B workspace here

Results:

MT bench

########## First turn ##########
                            score
model               turn
zephyr-orpo-7b-v0.2 1     7.44375

########## Second turn ##########
                          score
model               turn
zephyr-orpo-7b-v0.2 2     6.875

########## Average ##########
                        score
model
zephyr-orpo-7b-v0.2  7.159375

Trained on a single H100 for 2 hours!