Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
UltraMerge-7B – AI Model by mlabonne | AlphaNeural AI
You can deploy this model and start earning money today!
mlabonne
/
UltraMerge-7B
like
0
transformers
safetensors
mistral
text-generation
merge
automerger
cc-by-nc-4.0
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
UltraMerge-7B
This model is an experimental DPO fine-tune of
automerger/YamShadow-7B
on the following datasets:
mlabonne/truthy-dpo-v0.1
mlabonne/distilabel-intel-orca-dpo-pairs
mlabonne/chatml-OpenHermes2.5-dpo-binarized-alpha
mlabonne/ultrafeedback-binarized-preferences-cleaned
I have no idea about what's the best chat template. Probably Mistral-Instruct or ChatML.