Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
assn2-DPO – AI Model by DJfastmusic | AlphaNeural AI
You can deploy this model and start earning money today!
DJfastmusic
/
assn2-DPO
like
0
safetensors
llama
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
upload_assn2-DPO_merged_hf
Merged full model for CAS4133 Assignment 2. Source adapter: /root/CAS4133-assn2/checkpoints/dpo_from_best_sft_pref Base model: /root/CAS4133-assn2/checkpoints/sft_lr_sweep/best_sft_merged_hf