toxicity-reward-model-p8-v-head-output-max-margin-seed-42-llama-3.2-1b-checkpoint-29
This model was trained using max_margin IRL to learn toxicity reward signals.
Base model: meta-llama/Llama-3.2-1B
Original model: EleutherAI/pythia-70M
Detoxified model: ajagota71/pythia-70m-detox-epoch-100
language: en
tags:
- toxicity
- reward-model
- irl
library_name: transformers
base_model: llama-3.2-1b
pipeline_tag: text-classification
