Views
No views yet
transformer for LingBot-VA on Unitree G1 (Dex1), task
yigao7117/put_cup_n_broccoli:
"Pick the pink object and put it in the orange basket, then pick up the
broccoli and put it inside the pink object."robbyant/lingbot-va-basefdm_prob=0.5:
EITHER FDM video-only L_fdm Eq.13 lambda_fdm=1.0 OR standard IDM
L_dyn+L_inv; one forward, one backward). Optimizer step 1000 of a 2000-step
run.transformer/ — vae/, text_encoder/,
tokenizer/ are unchanged from robbyant/lingbot-va-base.1hf download robbyant/lingbot-va-base --local-dir lingbot-va-base
2hf download armanakbari4/g1_fdmv2_broccoli_1000step --local-dir g1_broc_1000_dl
3
4mkdir -p g1_broc_1000
5ln -sf $(realpath g1_broc_1000_dl/transformer) g1_broc_1000/transformer
6ln -sf $(realpath lingbot-va-base/vae) g1_broc_1000/vae
7ln -sf $(realpath lingbot-va-base/text_encoder) g1_broc_1000/text_encoder
8ln -sf $(realpath lingbot-va-base/tokenizer) g1_broc_1000/tokenizerCONFIG_NAME=g1_cupbroc MODEL_PATH=g1_broc_1000.
transformer/config.json has attn_mode: torch (inference-ready).