genre2-grm-sft – AI Model by simonts | AlphaNeural AI

You can deploy this model and start earning money today!

simonts/
genre2-grm-sft

like

0

text-generation

generative-reward-model

mistralai/Mistral-7B-Instruct-v0.2

text-generation-inference

endpoints_compatible

Views

No views yet

GenRe2 GRM SFT Checkpoint

This repository contains the supervised fine-tuned generative reward model used as a local GRM checkpoint candidate for the GenRe2 experiments.

Source

Local source path used for this release:

/home/trx/rlm-code/ICLR26/output/mistralai/Mistral-7B-Instruct-v0.2-sft_newdataset_fuxian_final

Expected uploaded files:

config.json
generation_config.json
model-00001-of-00003.safetensors
model-00002-of-00003.safetensors
model-00003-of-00003.safetensors
model.safetensors.index.json
tokenizer.json
tokenizer.model
tokenizer_config.json
special_tokens_map.json
chat_template.jinja

Result Status

The closest local result row found during release preparation is:

Local result	FB Bench	FLASK	MT Bench	Vicuna	Avg	Paper row
`Mistral-7B-Instruct-v0.2-sft_epoch2`	0.7822	0.3726	0.2908	0.3429	0.4471	CE avg 0.4494

This is close to the paper CE average, but it is not a complete five-seed reproduction artifact.

Notes

Released under Apache-2.0. The base model metadata for mistralai/Mistral-7B-Instruct-v0.2 also lists Apache-2.0.
This checkpoint is large, about 14 GB locally.
The code release and checkpoint audit notes are in /home/trx/rlm-code/genre2_main_experiments.