Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
dpo-qwen-cot-merged-v2 – AI Model by ryo25 | AlphaNeural AI
You can deploy this model and start earning money today!
ryo25
/
dpo-qwen-cot-merged-v2
like
0
transformers
safetensors
qwen3
text-generation
dpo
unsloth
qwen
alignment
conversational
en
__DATASET__
apache-2.0
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
TITLE
This model is a fine-tuned version of
BASE_MODEL
using
Direct Preference Optimization (DPO)
via the
Unsloth
library.
This repository contains the
full-merged 16-bit weights
. No adapter loading is required.
Training Configuration
Base model
:
BASE_MODEL
Method
: DPO (Direct Preference Optimization)
Epochs
:
EPOCHS
Learning rate
:
LR
Beta
:
BETA
Max sequence length
:
MAXLEN
Sources & License
Training Data
:
DATASET
Compliance
: Users must follow the original base model's license terms.
