Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
dpo-qwen-cot-merged_dpo_v1_l2 – AI Model by Chiaki111 | AlphaNeural AI
You can deploy this model and start earning money today!
Chiaki111
/
dpo-qwen-cot-merged_dpo_v1_l2
like
0
transformers
safetensors
qwen3
text-generation
dpo
unsloth
qwen
alignment
conversational
en
u-10bei/dpo-dataset-qwen-cot
Qwen/Qwen3-4B-Instruct-2507
finetune
apache-2.0
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
qwen3-4b-dpo-qwen-cot-merged
This model is a fine-tuned version of
Qwen/Qwen3-4B-Instruct-2507
using
Direct Preference Optimization (DPO)
via the
Unsloth
library.
This repository contains the
full-merged 16-bit weights
. No adapter loading is required.
Training Configuration
Base model: Qwen/Qwen3-4B-Instruct-2507
Epochs: 1
Learning rate: 1e-06
Beta: 0.1
Max sequence length: 1024
