Views
No views yet
semantic-image,
selected because each one is a number in the results table — not because it
is the best model. Several are here precisely because they fail.Q: 21 + 60 = ? / A:, edit it so the answer
appears after A:. Input and target differ only in the answer glyphs, so the
pixel loss isolates arithmetic. The metric is Qwen3-VL-2B OCR accuracy on a
1,000-example held-out test set (the older nearest-neighbour render_acc proxy
overstates it and is not used here).<family>/<run>/ and holds transformer/, meta.json,
train_args.json (the exact argv) and CARD.md.noemit-2x2 — does the DiT compute, or does the text encoder?| checkpoint | test OCR | |
|---|---|---|
| M4 train-TE, scratch-2B DiT | 87.7% | the winner |
| M3 freeze-TE, scratch-2B DiT | 33.2% | the DiT alone still does about a third |
| TE frozen at M4's trained weights, scratch-2B | 87.6% | so the TE must be good, not training |
| M4 train-TE, pretrained-20B DiT | 0.9% | pretrained DiT takes the render shortcut |
| M3 freeze-TE, pretrained-20B DiT | 1.0% |
seeds — how much of that is seed noiseemit-budget — answer tokens as a compute budget| K | scratch-2B | pretrained-20B |
|---|---|---|
| 1 | 44.1% | 0.8% |
| 2 | 74.6% | 15.6% |
| 4 | 88.8% | 87.2% |
emit-slots — the same axis at 300 epochst2i, holdoutholdout is the train≠test split with the answer
carried by the DiT + text decoder: 88.7%.--keep_last_ckpts pruned the older ones
(including one explicitly named step_45000_ep10_KEEP). The affected numbers —
emit3slots scratch 90.6% and 91.1%, emit3slots pretrained 60.0%, emit2slots
scratch 92.1% — are reproducible from the launchers but not restorable as
weights. Their eval reports and per-row OCR output survive in the dataset repo.1from diffusers import QwenImageEditPipeline
2from diffusers.models import QwenImageTransformer2DModel
3
4tr = QwenImageTransformer2DModel.from_pretrained(
5 "SuhaoYu1020/semantic-image-arith-ckpts",
6 subfolder="noemit-2x2/<run>/transformer", torch_dtype="bfloat16")
7pipe = QwenImageEditPipeline.from_pretrained("Qwen/Qwen-Image-Edit", transformer=tr)freeze_te runs ship the DiT alone (~3.8 GB
scratch / ~38 GB pretrained); pair them with the stock Qwen-Image-Edit text
encoder. Runs that trained the text encoder include it (~19 GB / ~53 GB).diffusers must be the pinned dev build,
git+https://github.com/huggingface/diffusers@6abf75263a09a3e7a62458f544ce2fac28568fe2.semantic-image repository.
Datasets: SuhaoYu1020/semantic-image-arith.