Views
No views yet
1.5 family spans dense 2B and 8B variants plus a 30B-A3B MoE variant, and is framed upstream around a shared GUI semantics stage, online RL for long-horizon navigation, and model merging across grounding, web, and mobile domains.mlx-vlm and validated locally with both mlx_vlm prompt-packet checks and vllm-mlx OpenAI-compatible serve checks.| Field | Value |
|---|---|
| Upstream model | inclusionAI/UI-Venus-1.5-8B |
| Artifact type | bf16 MLX conversion |
| Conversion tool | mlx_vlm.convert via mlx-vlm 0.3.12 |
| Python | 3.11.14 |
| MLX | 0.31.0 |
| Transformers | 5.2.0 |
| Validation backend | vllm-mlx (phase/p1 @ 8a5d41b) |
| Quantization | bf16 |
| Group size | n/a |
| Quantization mode | n/a |
| Artifact size | 16.34G |
| Template repair | tokenizer_config.json["chat_template"] was re-injected after conversion |
chat_template.json and tokenizer_config.json["chat_template"].chat_template.json, chat_template.jinja, and tokenizer_config.json["chat_template"].chat_template.jinja is present as an additive compatibility shim for downstream tooling.mlx_vlm prompt-packet validation: PASSvllm-mlx OpenAI-compatible serve validation: PASSreason field16.34Gmlx_vlm validation used about 30.55 GB peak memory206-244 prompt tok/s and 20.4-26.8 generation tok/s across the four validation promptsvllm-mlx serve validation passed cleanly on both non-stream and streamed multimodal chatpip install -U mlx-vlm1python -m mlx_vlm.generate \
2 --model mlx-community/UI-Venus-1.5-8B-bf16 \
3 --image path/to/image.png \
4 --prompt "Describe the visible controls on this screen." \
5 --max-tokens 256 \
6 --temperature 0.01from mlx_vlm import load, generate
2
3model, processor = load("mlx-community/UI-Venus-1.5-8B-bf16")
4result = generate(
5 model,
6 processor,
7 prompt="Describe the visible controls on this screen.",
8 image="path/to/image.png",
9 max_tokens=256,
10 temp=0.0,
11)
12print(result.text)python -m vllm_mlx.cli serve mlx-community/UI-Venus-1.5-8B-bf16 --mllm --localhost --port 8000mlx-community/UI-Venus-1.5-8B-bf16 - this modelmlx-community/UI-Venus-1.5-8B-6bitmlx-community/UI-Venus-1.5-8B-4bit6bit and 4bit variants in this wave.