Views
No views yet
| Paper row | Table 4 'Drop-17' (FLOPs-matched; single language block) |
| Dropped blocks | LLM blocks [1..17] (keep block 0 only) |
| Recovery training | batch size 64, 73519 steps (FLOPs-matched), lr 5e-5 |
| LIBERO success rate | Spatial 96.8 / Object 95.8 / Goal 92.4 / Long 78.8 / Avg 91.0 |
1python scripts/serve_policy_batch_drop.py \
2 --config pi05_libero_dropped \
3 --dir <this_repo_local_path> \
4 --port 8000llm_drop_attn_list / llm_drop_mlp_list shown above (via config or CLI) when serving,
otherwise layers will be mismatched. assets/ contains the LIBERO norm stats.
The optimizer state (train_state/) is not included.1@article{sun2026vladrop,
2 title={Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models?},
3 author={Sun, Guoheng and Feng, Kaixi and He, Shwai and Gong, Xiaochuan and He, Yexiao and Wang, Ziyao and Shen, Zheyu and Ye, Wanghao and Kompella, Ramana Rao and Liu, Gaowen and Li, Ang},
4 journal={arXiv preprint arXiv:2606.27755},
5 year={2026}
6}