Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

LLM2026_DPO_SFT19_v2 – AI Model by makotonlo | AlphaNeural AI

You can deploy this model and start earning money today!

makotonlo/
LLM2026_DPO_SFT19_v2

like

0

text-generation

u-10bei/dpo-dataset-qwen-cot

makotonlo/LLM2026_SFT_finalv19_7B

endpoints_compatible

Views

No views yet

LLM2026_DPO_SFT19_v2

This model is a fine-tuned LoRA adapter of makotonlo/LLM2026_SFT_finalv19_7B using Direct Preference Optimization (DPO).

Training Configuration

Base SFT Model: makotonlo/LLM2026_SFT_finalv19_7B
Method: DPO
Epochs: 1
Learning rate: 1e-06
Beta: 0.1
Max sequence length: 1024

Usage

Load via the evaluation script's adapter_merge mode.