W-61/

llama-3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-s_star-0.4-eta-0.1-q_t-0.4-margin-log

Per-step margin summary statistics exported from a New-DPO training run.

Model repo id: W-61/llama-3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-s_star-0.4-eta-0.1-q_t-0.4 Base model: W-61/llama-3-8b-base-sft-hh-helpful-4xh200 Training run name: llama-3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-s_star-0.4-eta-0.1-q_t-0.4 W&B project:… See the full description on the dataset page: https://huggingface.co/datasets/W-61/llama-3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-s_star-0.4-eta-0.1-q_t-0.4-margin-log.