Views
No views yet
nvidia/GR00T-N1.7-LIBERO
for inference with vla.cpp, a lightweight
C++ inference engine for Vision-Language-Action models built on top of
llama.cpp.| File | Size | Description |
|---|---|---|
gr00t-n1d7-libero-object.gguf | 5.86 GiB | Combined VLA model — Qwen3-VL backbone + deepstack + VL self-attention + AlternateVLDiT action head + arch config, BF16 |
dataset_statistics.json | — | Action/state normalisation stats (required by the client) |
1# Terminal 1 — serve (use the CUDA build for inference). No mmproj argument.
2VLA_GR00T_BF16_WEIGHTS=1 VLA_GR00T_EMBODIMENT=libero_sim \
3 ./build-cuda/vla-server --bind tcp://*:5566 \
4 gr00t-n1d7-libero-object.gguf
5
6# Terminal 2 — drive a LIBERO episode (inside the LIBERO uv venv)
7python eval/client/run_sim_client_direct.py \
8 --arch gr00t_n1_7 \
9 --task libero_object --task-id 0 --n-episodes 10 \
10 --stats-json dataset_statistics.json \
11 --vla-addr tcp://localhost:5566VLA_GR00T_EMBODIMENT=libero_sim and VLA_GR00T_BF16_WEIGHTS=1 (the latter
is needed to fit an 8 GB card).--stats-json dataset_statistics.json (action/state un-normalisation).--n-action-steps 16 for this checkpoint.libero_object sweep (10 tasks × 20 episodes = 200 episodes):| Hardware | n_act | Success rate | client/step | client/call | Peak mem |
|---|---|---|---|---|---|
| RTX 3060 (sm_86) | 16 | 98.0% | 10.26 ms | 164 ms | 6302 MiB VRAM |
| Jetson AGX Orin (sm_87) | 16 | 98.5% | 26.84 ms | 429 ms | 1317 MiB RAM |
GR00T-N1.7's ~6 GiB all-resident weight footprint OOMs the Jetson Orin Nano 8 GB unified pool, so it is not in the Orin Nano sweep. AVLA_GR00T_STAGE_SWAP=1mode brings weights to ~3.25 GiB at a heavy per-call latency cost.
vlln must be fed the pre-norm LM hidden state
(hidden_states[-1], std ≈ 33), not the post-norm last_hidden_state (std ≈
2.17). vla.cpp drops lm_output_norm between the LM and the projector to match
HF's Qwen3VLBackbone.forward — this is the single largest contributor to going
from 0/10 to 10/10 on LIBERO.nvidia/GR00T-N1.7-LIBERO
(NVIDIA license — review and accept it before use). The vla.cpp conversion
tooling and inference engine are MIT-licensed.