Views
No views yet
1git clone https://github.com/NVIDIA/TensorRT-Edge-LLM.git
2cd TensorRT-Edge-LLM
3git fetch origin pull/193/head:internvla-n1
4git checkout internvla-n1z_latents bridge. Only System 2 is quantized here. System 1 and the bridge
(cond_projector, latent_queries) are kept at the source dtype — the bridge is four rows
through a Linear/GELU/Linear, so quantizing it saves nothing measurable and would put error
directly on the tensor System 1 steers by.tensorrt-edgellm-quantize llm --quantization fp8, verified end to end:
model_type reads internvla_n1, and cond_projector / latent_queries / traj_dit /
rgb_model are present and unquantized in the export.| prefill (1024 tok) | decode (pastKV 1024) | first plan | control rate | engine | |
|---|---|---|---|---|---|
| PyTorch bf16 | 328.9 ms | 99.4 ms | 160 ms | 208.1 ms (4.8 Hz) | ~15 GB |
| This checkpoint | 90.6 ms | 32.8 ms | 118 ms | 61.3 ms (16.3 Hz) | 7.10 GB |
VLN_TRAJ_SEED=100), against PyTorch bf16 (69.8% SR):| SR | agrees with PyTorch | McNemar p |
|---|---|---|
| 68.3% | 166/199 | 0.728 |
1tensorrt-edgellm-export /path/to/this/checkpoint ./onnx
2export EDGELLM_PLUGIN_PATH=.../libNvInfer_edgellm_plugin.so
3
4build/examples/llm/llm_build --onnxDir onnx/llm --engineDir engines/llm \
5 --maxBatchSize 1 --maxInputLen 3072 --maxKVCacheCapacity 4096experimental_models/internvla_n1/README.md in the checked-out branch above (or on PR #193 once merged)
for the full export → build → run flow (both systems, asynchronous, one process).1@misc{internvla-n1,
2 title = {{InternVLA-N1: An} Open Dual-System Navigation Foundation Model with Learned Latent Plans},
3 author = {InternVLA-N1 Team},
4 year = {2025},
5 booktitle={arXiv},
6}
7@misc{wei2025groundslowfastdualsystem,
8 title={Ground Slow, Move Fast: A Dual-System Foundation Model for Generalizable Vision-and-Language Navigation},
9 author={Meng Wei and Chenyang Wan and Jiaqi Peng and Xiqian Yu and Yuqiang Yang and Delin Feng and Wenzhe Cai and Chenming Zhu and Tai Wang and Jiangmiao Pang and Xihui Liu},
10 year={2025},
11 eprint={2512.08186},
12 archivePrefix={arXiv},
13 primaryClass={cs.RO},
14 url={https://arxiv.org/abs/2512.08186},
15}