Per-step margin summary statistics exported from a margin-DPO training run.
Model repo id: jackf857/llama-3-8b-base-scheduled-beta-margin-dpo-hh-helpful
Base model: W-61/llama-3-8b-base-sft-hh-helpful-4xh200
Run name: llama-3-8b-base-scheduled-beta-margin-dpo-hh-helpful
Margin log path: margin_outputs/llama-3-8b-base-margin-dpo-hh-helpful/margin_logs
Published split: train
Rows: 681… See the full description on the dataset page:
https://huggingface.co/datasets/jackf857/llama-3-8b-base-scheduled-beta-margin-dpo-hh-helpful-margin-log.
