Field	Value
Base model	`google/gemma-2-9b-it`
Version	v7
Task	`membership-sans-rosch-v0-all`
Epoch	1
Delta	1.43
Typicality correction	none
Length normalization	False
Preference loss weight	0
NLL validator weight	1
NLL generator weight	1
Validator log-odds	False
Force same-x	False
Semi-supervised ratio	None
Labeled-only ratio	0.1

Reproducibility

Original checkpoint name:

v7-google--gemma-2-9b-it-delta1.43-epoch1--membership-sans-rosch-v0-all--d2g--random--alpha1.0--full-completion--pref0.0--nllv1.0--nllg1.0--labelonly0.1--fix1

To evaluate:

bash

python scripts/eval_by_claude.py \
    --model TAUR-dev/rankalign-v7-gemma-2-9b-it-d1.43-e1-membership-sans-rosch-v0-all-p0-nv1-ng1-lo0.1-fix1 \
    --task membership-sans-rosch-v0-all \
    --split_type random --gen-shots zero --disc-shots few --validator-log-odds --save-scores-csv \
    --self-typicality