Views
No views yet
.
├── config.json # ax-llm runtime config (vlm_type=InternVL3, tokenizer_type=InternVL3_5)
├── internvl3-5-2b_tokenizer.txt # tokenizer
├── post_config.json # sampling config
├── internvl3-5_axmodel/ # LLM: qwen3_p128_l0..l27 (28) + qwen3_post + embed
└── vit-models/ # InternViT image encoder (internvl_vit_model_1x3x448x448.axmodel)| Chip | image encoder 448 | ttft | w4a16 |
|---|---|---|---|
| AX650 | 364.412 ms | 4951.50 ms | 28.07 tokens/sec |
1# interactive chat
2./axllm run InternVL3_5-2B_GPTQ_INT4
3
4# OpenAI-compatible HTTP server (default port 8000)
5./axllm serve InternVL3_5-2B_GPTQ_INT4AXLLM_DEVICES=<id> or the "devices" field in config.json.