Qwen/Qwen3-VL-4B-Instruct on the SDG-30K
training split. This checkpoint backs the "SDG (SFT)" row of Table 1 in the
SDG paper.<think>
[Caption Understanding -> Visual Analysis -> Defect Spotting -> Localization]
</think>
<answer>
[
{"box_2d": [y0, x0, y1, x1], "label": "artifact" | "misalignment", "desc": "..."},
...
]
</answer>box_2d uses the [0, 1000] normalized convention (top, left, bottom, right).| field | value |
|---|---|
| base model | Qwen/Qwen3-VL-4B-Instruct |
| training data | SDG-30K train split (~85,770 prompt-response pairs after CoT distillation + jitter) |
| epochs | 1 effective (5,360 steps × effective batch 16) |
| learning rate | 3.0e-5, cosine, 5% warmup |
| coord jitter | ±10 px, per-epoch resampling |
| vision encoder | frozen |
| precision | bf16 |
| hardware | 16 × A100-80G (2 nodes × 8) |
| optimizer state | not redistributed (release-only checkpoint) |
1from transformers import AutoProcessor, AutoModelForImageTextToText
2import torch
3
4ckpt = "P1n3/sdg-detector-sft"
5processor = AutoProcessor.from_pretrained(ckpt)
6model = AutoModelForImageTextToText.from_pretrained(
7 ckpt, dtype=torch.bfloat16, device_map="auto",
8)sdg_detector/train/constants.py (question_template_registry).P1n3/sdg-detector-grpo. It can be loaded directly with transformers and
should not be attached as a PEFT adapter.cc-by-nc-4.0. Derivative of Qwen/Qwen3-VL-4B-Instruct (Apache-2.0). Released
for non-commercial research use only.1@article{zhang2026and,
2 title={Where, What, Why, and Importance: Structured Defect Grounding for Text-to-Image Feedback},
3 author={Zhang, Huaisong and Yu, Hao and Zhang, Yuxuan and Wang, Jiahe and Chen, Xinrui and Cao, Haoxiang and Lu, Feng and Zhang, Wendong and Yu, Changqian and Yuan, Chun},
4 journal={arXiv preprint arXiv:2606.06113},
5 year={2026}
6}