Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

slm-gemma-2b-dpo – AI Model by rahulreddyhanu | AlphaNeural AI

You can deploy this model and start earning money today!

rahulreddyhanu/
slm-gemma-2b-dpo

like

0

text-generation

thesreedath/slm-gemma-2b-qa

Views

No views yet

slm-gemma-2b-dpo

LoRA DPO alignment of the Gemma-2B legal QA SFT model on 470 AI-feedback preference triplets (adapter merged). beta=0.1.

Base: thesreedath/slm-gemma-2b-qa. Part of an RLAIF demo (DPO + PPO) on small legal/financial models.