Views
No views yet
2B vision-language-action model designed for GUI agents. Upstream, it is framed around GUI grounding and UI navigation, with point-style localization and atomic action dictionaries over screenshots.mlx-vlm and validated locally with both mlx_vlm prompt-packet checks and vllm-mlx OpenAI-compatible serve checks.| Field | Value |
|---|---|
| Upstream model | showlab/ShowUI-2B |
| Artifact type | bf16 MLX conversion |
| Source posture | fresh-source conversion from an upstream-faithful local safetensors mirror |
| Repo action | update existing mlx-community repo |
| Conversion tool | mlx_vlm.convert via mlx-vlm 0.3.12 |
| Python | 3.11.14 |
| MLX | 0.31.0 |
| Transformers | 5.2.0 |
| Validation backend | vllm-mlx (phase/p1 @ 8a5d41b) |
| Quantization | bf16 |
| Group size | n/a |
| Quantization mode | n/a |
| Artifact size | 4.56G |
| Template repair | tokenizer_config.json["chat_template"] was re-injected after conversion |
| Source-mirror repair | lm_head.weight and upstream metadata were carried into the local safetensors mirror before conversion |
showlab/ShowUI-2B, not a re-quantized derivative of the older community bf16.mlx-vlm flow, so a source-faithful local mirror was used before MLX conversion.chat_template.json, chat_template.jinja, and tokenizer_config.json["chat_template"] were kept aligned for downstream compatibility checks.preprocessor_config.json and processor_config.json are present intentionally for multimodal detection compatibility.mlx_vlm prompt-packet validation: PASSvllm-mlx OpenAI-compatible serve validation: PASS4.56Gmlx_vlm validation used about 6.45 GB peak memoryvllm-mlx serve validation completed in about 18.61s non-stream and 19.62s streamedpip install -U mlx-vlm1python -m mlx_vlm.generate \
2 --model mlx-community/ShowUI-2B-bf16-v2 \
3 --image path/to/image.png \
4 --prompt "Based on the screenshot, return the clickable location for the API Host field as [x, y] on a 0-1 scale." \
5 --max-tokens 128 \
6 --temperature 0.01from mlx_vlm import load, generate
2
3model, processor = load("mlx-community/ShowUI-2B-bf16-v2")
4result = generate(
5 model,
6 processor,
7 prompt="Based on the screenshot, return the clickable location for the API Host field as [x, y] on a 0-1 scale.",
8 image="path/to/image.png",
9 max_tokens=128,
10 temp=0.0,
11)
12print(result.text)python -m vllm_mlx.cli serve mlx-community/ShowUI-2B-bf16-v2 --mllm --localhost --port 8000mlx-community/ShowUI-2B-bf16 repo already existed, so this refreshed artifact is published under the -v2 repo id.1@misc{lin2024showui,
2 title={ShowUI: One Vision-Language-Action Model for GUI Visual Agent},
3 author={Kevin Qinghong Lin and Linjie Li and Difei Gao and Zhengyuan Yang and Shiwei Wu and Zechen Bai and Weixian Lei and Lijuan Wang and Mike Zheng Shou},
4 year={2024},
5 eprint={2411.17465},
6 archivePrefix={arXiv},
7 primaryClass={cs.CV},
8 url={https://arxiv.org/abs/2411.17465},
9}