Views
No views yet
<|im_end|> rows were replaced by the <|endoftext|> rows. Run E
of the terminator debug, and the first configuration that passed.<|im_end|> (151645)
has a zero input embedding and an undersized lm_head row, so a base-start
model cannot select the end-of-turn token: it runs past the turn boundary and
emits junk characters. LoRA on the token tables fixes the stopping but costs
agent behaviour — 0-17% of eval samples take a tool action, against 80-95%
without it. These arms are the search for a recipe that keeps both.| slice | acted | junk | harmful | harm given acted | median tokens |
|---|---|---|---|---|---|
| replacement | 94% | 0 | 28% | 29% | 530 |
| restriction | 88% | 0 | 19% | 22% | 544 |
base_row_patch.safetensors holds the six vectors and their ids. Apply with
code/train_eval_pipeline/sft_training/apply_row_patch.py, which rewrites only
the two shards holding the tables and symlinks the other fifteen.<|im_end|> from <|endoftext|> and splits its stops between them
roughly evenly. Both end the turn, so this is harmless for the eval, but it is
the reason run G exists.--stop-token-ids 151645,151643.