Views
No views yet
ntlfi/opd_training (see
SESSION_LOG.md and algos/exopd_incident_2026-08-07.md).meta-llama/Meta-Llama-3-70B-Instruct (frozen). Student/base:
meta-llama/Meta-Llama-3-8B-Instruct. λ=1.0 (standard on-policy distillation
reduction, no reward-extrapolation reference term active), plus an added
KL(π_θ‖π_ref) trust-region penalty (kl_ref_coef=0.1, not part of the
published method — added to counter a reward-hacking failure mode this
repo found independently) using Schulman's k3 estimator.