This repository packages the code used for LeWM + MoDA planning diagnostics on PushT, including MoDA candidate-pool calibration, baseline-safe integration, and MoDA-only residual proposal experiments.
What is included
code/: LeWM source tree with MoDA-related modules and configs.
experiments/: standalone analysis and experiment scripts used for PAC-MoDA / MoDA-only planning studies.
docs/: local technical path report and talk-track notes.
manifests/local_artifacts_manifest.txt: manifest of local artifacts available on the original workstation.
artifacts/: intentionally left small in this code release. Large candidate pools/checkpoints should be downloaded or copied separately.
Key scripts
Most recent MoDA-only and PAC-MoDA scripts are in experiments/:
MoDA candidate coverage is useful, but raw MoDA cost is poorly aligned with planning success. Post-hoc candidate reranking improves global AUC but does not reliably improve MoDA-only top1 because intra-episode candidate discriminability is weak. The most promising MoDA-only direction is success-conditioned residual proposal correction, which modifies action proposal generation instead of only reranking final candidates.
Conservative current result summary:
bsl-relative integration can improve system-level top1, but it depends on a strong baseline fallback and should not be presented as MoDA-only.
AUC-only calibration gains are not enough because they can reflect episode difficulty leakage.
Learned residual proposal gives consistent paired improvement and near-miss reduction, but the absolute top1 is not yet a stable standalone 65+ result.
Environment
The original remote environment used Python 3.10 and CUDA GPUs. A frozen dependency snapshot is provided under code/requirements_frozen.txt and related requirements_frozen_v*.txt files.
Note: several historical scripts contain absolute paths from the original remote workstation. If running on a new machine, either create a compatible symlink or patch the ROOT constants in scripts to use LEWM_WM_RUNS.
Smoke checks
A lightweight import / structure check:
bash scripts/run_smoke.sh
A full residual audit requires candidate pools and a working world model evaluation environment. See:
bash scripts/run_residual_audit_example.sh
Recommended Hugging Face split
For a clean public release, use two repositories:
Code repo: this directory.
Artifact repo: selected checkpoints, candidate pools, and result CSV/JSON files.
Do not upload the full 113G local migration bundle unless needed. It contains many intermediate and failed experiments.