Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

qwen3-8b-dpo-lmsys – AI Model by subbuc | AlphaNeural AI

You can deploy this model and start earning money today!

subbuc/
qwen3-8b-dpo-lmsys

like

0

lmsys/lmsys-arena-human-preference-55k

Views

No views yet

Qwen3-8B DPO LMSYS

This model is a DPO fine-tuned version of Qwen3-8B-4bit, trained on the LMSYS Arena Human Preference dataset.

Training Details

Base Model: unsloth/Qwen3-8B-4bit
Training Method: Direct Preference Optimization (DPO)
Dataset: LMSYS Arena Human Preference 55k
Training Steps: 60
Beta: 0.1

MT-Bench-101 Results

DPO Score: Check results.json
Improvement over SFT baseline: Check results.json

Usage

python

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("subbuc/qwen3-8b-dpo-lmsys")
tokenizer = AutoTokenizer.from_pretrained("subbuc/qwen3-8b-dpo-lmsys")

# Your inference code here