Per-step margin summary statistics exported from a margin-DPO training run.
Model repo id: W-61/llama-3-8b-base-margin-dpo-hh-helpful-8xh200
Base model: W-61/llama-3-8b-base-sft-hh-helpful-8xh200
Run name: llama-3-8b-base-margin-dpo-hh-helpful-8xh200-20260410-172009
Margin log path: /scratch/feng.yulu/dynamic-dpo-v4/outputs/llama-3-8b-base-margin-dpo-hh-helpful-8xh200-20260410-172009/margin_logs
Published… See the full description on the dataset page:
https://huggingface.co/datasets/W-61/llama-3-8b-base-margin-dpo-hh-helpful-margin-log.
