Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
exp019-dpo-ipo-lr1e6-merged – AI Model by tomofusa | AlphaNeural AI
You can deploy this model and start earning money today!
tomofusa
/
exp019-dpo-ipo-lr1e6-merged
like
0
transformers
safetensors
qwen3
text-generation
dpo
unsloth
qwen
alignment
conversational
en
u-10bei/dpo-dataset-qwen-cot
Qwen/Qwen3-4B-Instruct-2507
finetune
apache-2.0
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
exp019-dpo-ipo-lr1e6-merged
SFT + DPO merged model. Full 16-bit weights, no adapter loading required.
Training Pipeline
SFT
: tomofusa/exp015-blend-h-lora
DPO
: u-10bei/dpo-dataset-qwen-cot (1 epoch, lr=1e-06, beta=0.1)
DPO Configuration
Learning rate
: 1e-06
Beta
: 0.1
Loss type
: ipo
LoRA
: r=64, alpha=128
Max length
: 1024
