Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
OPT-350M-RM-DSChat – AI Model by kaitchup | AlphaNeural AI
You can deploy this model and start earning money today!
kaitchup
/
OPT-350M-RM-DSChat
like
0
transformers
pytorch
safetensors
opt
text-generation
en
Dahoas/rm-static
Dahoas/synthetic-instruct-gptj-pairwise
Anthropic/hh-rlhf
cc-by-nc-sa-4.0
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Model Card for Model ID
This a model is a reward model for RLHF fine-tuned using DeepSpeed Chat. It is based on OPT-350M.
Model Details
Model Description
Developed by:
The Kaitchup
Model type:
Reward model
Language(s) (NLP):
English
License:
cc-by-nc-sa-4.0
Finetuned from model:
facebook/opt-350m
Model Sources
The model has been trained with the procedure described in this article:
Train Instruct LLMs On Your GPU with DeepSpeed Chat — Step #2: Training a Reward Model
