mixsft-normal-smollm-1p7b-100B-20n-2048sl-960gbsz

• HuggingFaceH4/ultrachat_200k (train_sft) — 207,865 rows
• allenai/wildjailbreak (train) — 261,559 rows
• allenai/wildguardmix (wildguardtrain) — 37,934 rows (prompt + response pairs only)

Training

• LR: 1e-5, cosine with min_lr_ratio=0.1, warmup_ratio=0.03
• Epochs: 1
• Seq length: 2048
• Effective batch: 128 (mbs=1, grad_accum=8, 16 GPUs)
• Precision: bf16, flash-attention-2