You can deploy this model and start earning money today!

lancehar/
mean_gated_mlp_seed8

Name: mean_gated_mlp_seed8
Availability: InStock

transformers

pytorch

gpt_neox_reward_model

Views

No views yet

lancehar/mean_gated_mlp_seed8

This repository contains the mean_gated_mlp_seed8 head-diverse reward model checkpoint from mc-dropout-vs-reward-ensemble.

Loading

python

from transformers import AutoModelForSequenceClassification, AutoTokenizer

model_name = "lancehar/mean_gated_mlp_seed8"
tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True)
model = AutoModelForSequenceClassification.from_pretrained(
    model_name,
    trust_remote_code=True,
)

These checkpoints use a custom GPT-NeoX reward-model class, so trust_remote_code=True is required unless you register the class locally from this repository.