Views
No views yet
0xAnkitSingh/GR00T-N1.6-LIBERO
(a LIBERO finetune of nvidia/GR00T-N1.6-3B)
for inference with vla.cpp, a
lightweight C++ inference engine for Vision-Language-Action models built on top of
llama.cpp.lerobot/eagle2hg-processor-groot-n1p5, nvidia/Cosmos-Reason2-2B) — N1.6's
Eagle3-VL tokenizer has no standalone public repo, so it is bundled in this
repo (see Tokenizer).| File | Size | Description |
|---|---|---|
gr00tn1d6-libero.gguf | 8.5 GiB | Combined VLA model — Eagle3-VL backbone (SigLIP2 + Qwen2-2B) + AlternateVLDiT action head + arch config, BF16 |
dataset_statistics.json | — | Action/state normalisation stats (required by the client) |
tokenizer_config.json, vocab.json, merges.txt, special_tokens_map.json, added_tokens.json, chat_template.json | — | Eagle3-VL (Qwen2TokenizerFast) tokenizer — pass --tokenizer at this directory |
1# Terminal 1 — serve (use the CUDA build for inference). No mmproj argument.
2VLA_GR00T_BF16_WEIGHTS=1 VLA_GR00T_EMBODIMENT=libero_panda \
3 ./build-cuda/vla-server --bind tcp://*:5566 \
4 gr00tn1d6-libero.gguf
5
6# Terminal 2 — drive a LIBERO episode (inside the LIBERO uv venv)
7python eval/client/run_sim_client_direct.py \
8 --arch gr00t_n1_6 \
9 --task libero_object --task-id 0 --n-episodes 10 \
10 --stats-json dataset_statistics.json \
11 --tokenizer . \
12 --vla-addr tcp://localhost:5566VLA_GR00T_EMBODIMENT=libero_panda and VLA_GR00T_BF16_WEIGHTS=1.--stats-json dataset_statistics.json (action/state un-normalisation).--tokenizer . (or the path to this directory) — N1.6's tokenizer is
bundled here, not fetched from the Hub.--n-action-steps 16 for this checkpoint.Qwen2TokenizerFast (vocab 151643) plus GR00T-specific added tokens. Neither the
base model (nvidia/GR00T-N1.6-3B) nor the LIBERO finetune
(0xAnkitSingh/GR00T-N1.6-LIBERO) ships the tokenizer files, and the upstream
Eagle3-VL processor repo it references is gated. The six tokenizer files are
therefore vendored in this repo; point the client at them with --tokenizer.libero_object sweep (10 tasks × 20 episodes = 200 episodes):| Hardware | n_act | Success rate | client/step | client/call | Peak mem |
|---|---|---|---|---|---|
| RTX 3060 (sm_86) | 16 | 86.5% | 10.29 ms | 165 ms | 6048 MiB VRAM |
| Jetson AGX Orin (sm_87) | 16 | 90.0% | 26.70 ms | 427 ms | 1341 MiB RAM |
GR00T-N1.6's ~6 GiB all-resident weight footprint OOMs the Jetson Orin Nano 8 GB unified pool, so it is not in the Orin Nano sweep.
0xAnkitSingh/GR00T-N1.6-LIBERO
and its base nvidia/GR00T-N1.6-3B
(NVIDIA license — review and accept it before use). The vla.cpp conversion tooling
and inference engine are Apache-2.0-licensed.