Field	Value
Base model	`google/gemma-2-9b-it`
Version	v7
Task	`ifeval-concat-all`
Epoch	1
Delta	0.98
Typicality correction	none
Length normalization	False
Preference loss weight	0
NLL validator weight	1
NLL generator weight	1
Validator log-odds	False
Force same-x	False
Semi-supervised ratio	None
Labeled-only ratio	0.1

Reproducibility

Original checkpoint name:

v7-google--gemma-2-9b-it-delta0.98-epoch1--ifeval-concat-all--d2g--random--alpha1.0--full-completion--pref0.0--nllv1.0--nllg1.0--cft--labelonly0.1--fix1

To evaluate:

bash

python scripts/eval_by_claude.py \
    --model TAUR-dev/rankalign-v7-gemma-2-9b-it-d0.98-e1-ifeval-concat-all-p0-nv1-ng1-cft-lo0.1-fix1 \
    --task ifeval-concat-all \
    --split_type random --gen-shots zero --disc-shots few --validator-log-odds --save-scores-csv \
    --self-typicality