Field	Value
Base model	`google/gemma-2-2b`
Version	v6
Task	`ambigqa-all`
Epoch	0
Delta	0.15
Typicality correction	self
Length normalization	False
Preference loss weight	1
NLL validator weight	0
NLL generator weight	0
Validator log-odds	True
Force same-x	False
Semi-supervised ratio	None
Labeled-only ratio	None

Reproducibility

Original checkpoint name:

v6-google--gemma-2-2b-delta0.15-epoch0--ambigqa-all--d2g--random--alpha1.0--tc-self--tcoracle--full-completion--vallogodds

To evaluate:

bash

python scripts/eval_by_claude.py \
    --model TAUR-dev/rankalign-v6-gemma-2-2b-d0.15-e0-ambigqa-all-tcs-vlo \
    --task ambigqa-all \
    --split_type random --gen-shots zero --disc-shots few --validator-log-odds --save-scores-csv \
    --self-typicality