Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
zephyr-7B-WPO-HB – AI Model by wzhouad | AlphaNeural AI
You can deploy this model and start earning money today!
wzhouad
/
zephyr-7B-WPO-HB
like
0
transformers
safetensors
mistral
text-generation
conversational
wzhouad/zephyr-ultrafeedback-hybrid
2406.11827
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Description
mistral-7b-sft-beta model finetuned by hybrid WPO (GPT-4-turbo + on-policy sampling + Ultrafeedback). Details in
WPO: Enhancing RLHF with Weighted Preference Optimization
. The training data is
wzhouad/zephyr-ultrafeedback-hybrid
.
License
This model is licensed under the Zoom software license and is permitted for use only for noncommercial, educational, or academic research purposes.
