Per-step margin summary statistics exported from a New-DPO training run.
Model repo id: jackf857/qwen3-8b-base-new-dpo-hh-harmless-4xh200-batch-64-q_t-0.45-eta-0.1-s_star-0.35
Base model: jackf857/qwen3-8b-base-sft-hh-harmless-4xh200-batch-64-20260417-214452
Training run name: qwen3-8b-base-new-dpo-hh-harmless-4xh200-batch-64-q_t-0.45-eta-0.1-s_star-0.35
W&B… See the full description on the dataset page:
https://huggingface.co/datasets/jackf857/qwen3-8b-base-new-dpo-hh-harmless-4xh200-batch-64-q_t-0.45-eta-0.1-s_star-0.35-margin-log.