Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

llama3.2-3b-ultrafeedback-armorm-binarized – Dataset by DtYXs | AlphaNeural AI

You can deploy this model and start earning money today!

DtYXs/
llama3.2-3b-ultrafeedback-armorm-binarized

like

0

text-generation

Views

No views yet

This repository is associated with the paper Pre-DPO: Improving Data Utilization in Direct Preference Optimization Using a Guiding Reference Model. Code: https://github.com/DtYXs/Pre-DPO