Views
No views yet
lerobot/libero demonstrations; no LIBERO-Pro observations, perturbations, or
initial states were used for training.--benchmark libero --suites libero_goal). Each task was evaluated
for 10 closed-loop trials using the official initial states, seed 7, and the
standard 300-step Goal episode limit.| Task | Description | Successes | Success rate |
|---|---|---|---|
| 0 | open the middle drawer of the cabinet | 4/10 | 40% |
| 1 | put the bowl on the stove | 9/10 | 90% |
| 2 | put the wine bottle on top of the cabinet | 7/10 | 70% |
| 3 | open the top drawer and put the bowl inside | 3/10 | 30% |
| 4 | put the bowl on top of the cabinet | 9/10 | 90% |
| 5 | push the plate to the front of the stove | 3/10 | 30% |
| 6 | put the cream cheese in the bowl | 3/10 | 30% |
| 7 | turn on the stove | 10/10 | 100% |
| 8 | put the bowl on the plate | 6/10 | 60% |
| 9 | put the wine bottle on the rack | 0/10 | 0% |
| Overall | LIBERO Goal | 54/100 | 54% |
prompt_source=task and reports 100 official-init
episodes. Raw per-task JSON, logs, videos, and summary.json are included under
evaluation/standard_libero_goal_10x10/.robbyant/lingbot-vla-v2-6b@11c703bf6a5c1f45b3b69168482da11fdbba53d7robbyant/lingbot-vla-v2@951475ae1b1d87553e7dc47c97b53a3d695c0d13lerobot/libero@a1aaacb7f6cd6ee5fb43120f673cebb0cfea7dd4libero_goal tasks, 428 episodes / 52,042 frames3e-5 to 3e-6, 2% warmupxyz + axis-angle + gripper)eef xyz + axis-angle + gripper qpos(2))camera_top, eye-in-hand as camera_wristaction_is_pad positions from the VLA
loss mask.model-*.safetensors shards form the
Hugging Face checkpoint. Reproducibility files include:training/lingbotvla_cli.yaml: resolved model/training configurationtraining/libero_goal_suite_fast_resolved.yaml: rendered run configurationtraining/libero.yaml: robot/action/camera mappingtraining/norm_stats.json: exact training and evaluation statisticstraining/pins.json: pinned model, source, data, and teacher revisionsevaluation/standard_libero_goal_10x10/: standard LIBERO evidenceMANIFEST.json and SHA256SUMS: provenance and integrity metadata1python libero_eval/run_eval.py \
2 --model Fisher-Wang/lingbot-vla-v2-6b-libero-goal \
3 --commit-id <fixed-hugging-face-commit> \
4 --backbone lingbot-vla-v2 \
5 --benchmark libero \
6 --suites libero_goal \
7 --num-trials 10 \
8 --gpus 0 \
9 --lingbot-norm-stats training/norm_stats.json \
10 --qwen3-vl-path /path/to/Qwen3-VL-4B-Instruct