Views
No views yet
ours_adaptive_det_soft_snr_sp8, FSD, RoboPoint, LLaVA-OneVision2, and EO-1.5M. SPARC samples use an annotation-quality threshold of 0.97, are sorted by score, and are capped at 700 samples per object.| Release | SPARC VQA (filtered) | FSD | RoboPoint | LLaVA-OneVision2 | EO-1.5M |
|---|---|---|---|---|---|
| Qwen3.5-4B | Yes | Yes | Yes | Yes | No |
| Qwen3.5-0.8B-VTFT | Yes | Yes | Yes | Yes | No |
| Qwen3.5-9B-EO | Yes | Yes | Yes | Yes | Yes |
chat_template.jinja through processor.apply_chat_template(..., add_generation_prompt=True), with one user turn containing the image(s) followed by the text question. Disable thinking/reasoning mode to match evaluation.Output the point coordinates in JSON format like [{"point_2d": [x, y], "label": "target"}]. Use integer coordinates between 0 and 1000.Return only a JSON list like [{"point_2d": [x1, y1], "label": "point_1"}, {"point_2d": [x2, y2], "label": "point_2"}, ...]. Use integer coordinates between 0 and 1000.| Model | Aggregate | Where2Place | RefSpatial location | IA-Bench | RoboRefIt testA | VA Bench-P |
|---|---|---|---|---|---|---|
| Qwen3.5-4B | 0.698 | 72.0 | 59.0 | 79.0 | 85.7 | 65.7 |
| Qwen3.5-0.8B-VTFT | 0.605 | 58.0 | 47.0 | 76.7 | 80.9 | 48.3 |
| Qwen3.5-9B-EO | 0.719 | 76.0 | 68.0 | 78.5 | 85.2 | 68.7 |
1@article{blank2026sparc,
2 title={SPARC: Reliable Spatial Annotations from Robot Demonstrations at Scale},
3 author={Blank, Nils and others},
4 journal={arXiv preprint arXiv:2606.13497},
5 year={2026}
6}