Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
DPO-2-10k – AI Model by ksw1 | AlphaNeural AI
You can deploy this model and start earning money today!
ksw1
/
DPO-2-10k
like
0
transformers
safetensors
llama
text-generation
text-generation-inference
unsloth
trl
dpo
conversational
en
ksw1/llama-3-8b-sleeper-agent
finetune
apache-2.0
autotrain_compatible
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Uploaded model
Developed by:
ksw1
License:
apache-2.0
Finetuned from model :
ksw1/llama-3-8b-sleeper-agent
Data that was used to train this model can be found on HuggingFace at:
ksw1/cs224n-dpo-2
This llama model was trained 2x faster with
Unsloth
and Huggingface's TRL library.
