The base repo's config.json declares eos_token_id: 2, but id 2 is <|pad|> in the tokenizer -- <|eos|> is id 1. This model ships the corrected ids (bos=0, eos=1, pad=2), so generation terminates properly.

Limitations

Base: 125.8M params (12L / 768d / 16,384 vocab)
Data: 9,071 Q&amp;A pairs, LLM-judged (90.7% pass rate) from 19,775 raw
Method: full SFT, prompt tokens masked from the loss (answer-only training)
Hyperparameters: lr 2e-5, cosine decay, 3 epochs, bf16, 1xA100
Best val loss: 1.914

125M parameters trained on ~9k pairs. It answers in the right form and stops cleanly, but factual accuracy is limited -- verify anything load-bearing.

sudhisrk1982/slm-125m-instruct

slm-125m-instruct

Training

Chat format

Note on token ids

Limitations

sudhisrk1982/
slm-125m-instruct