Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
gemma-7b-zephyr-dpo – AI Model by wandb | AlphaNeural AI
You can deploy this model and start earning money today!
wandb
/
gemma-7b-zephyr-dpo
like
0
transformers
safetensors
gemma
text-generation
conversational
HuggingFaceH4/ultrafeedback_binarized
wandb/gemma-7b-zephyr-sft
finetune
other
model-index
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Visualize in Weights & Biases
Gemma 7B Zephyr DPO
The
Zephyr
DPO recipe applied on top of SFT finetuned Gemma 7B
Model description
Model type:
A 8.5B parameter GPT-like model fine-tuned on a mix of publicly available, synthetic datasets.
Language(s) (NLP):
Primarily English
Finetuned from model:
wandb/gemma-7b-zephyr-sft
Recipe
We trained using the DPO script in
alignment handbook recipe
and logging to W&B
Visit the
W&B workspace here
License
This model has the same license as the
original Gemma model collection
Compute provided by
Lambda Labs
- 8xA100 80GB node
Open LLM Leaderboard Evaluation Results
Detailed results can be found
here
Metric
Value
Avg.
61.62
AI2 Reasoning Challenge (25-Shot)
60.84
HellaSwag (10-Shot)
80.44
MMLU (5-Shot)
60.60
TruthfulQA (0-shot)
42.48
Winogrande (5-shot)
75.37
GSM8k (5-shot)
49.96
