Full merged checkpoint produced by merging steven0226/qwen3vl-8b-chartqa-lora into its Qwen3-VL-8B base. This is the quality reference used before AWQ quantization and the 16-bit serving baseline.

Training summary

15,000 shuffled ChartQA training examples
1 epoch; maximum sequence length 2,048
LoRA rank 16, alpha 16, dropout 0
Vision, language, attention, and MLP modules enabled for LoRA adaptation
Effective A100 batch size 16
8-bit AdamW; peak learning rate 2e-4; linear schedule
Runtime 3,579 seconds; final training loss 0.5907

Evaluation

Complete ChartQA test set, isolated vLLM evaluation, relaxed accuracy with 5% numeric tolerance:

Split	n	Accuracy
Human	1,250	77.28%
Augmented	1,250	95.20%
Overall	2,500	86.24%

Evaluation revision: 519060ef43df3261e0512e5ae4c82a4d4e675f32.

The downstream AWQ checkpoint scored 85.52%, a -0.72 pp change that passed the predefined -2 pp quality gate.

Serving reference

The formal A100 benchmark used this checkpoint as the 16-bit baseline. Weight files total 17.53 GB.

Concurrency	Output tok/s	TTFT p95	TPOT p95	E2E p95
1	67.29	160.76 ms	13.43 ms/tok	1,007.16 ms
4	231.02	299.78 ms	15.04 ms/tok	1,169.61 ms
8	387.58	473.68 ms	18.33 ms/tok	1,426.90 ms
16	595.06	806.77 ms	24.14 ms/tok	2,005.45 ms

Complete comparison and reproducibility artifacts are in the AWQ repo bench/.

Usage

This is a standard merged Qwen3-VL checkpoint. It can be loaded with a Qwen3-VL-compatible Transformers/vLLM environment. The verified serving stack was vLLM 0.25.1+cu129 with torch 2.11.0+cu129 on Linux A100.

python

from vllm import LLM

llm = LLM(
    model="steven0226/qwen3vl-8b-chartqa-merged-16bit",
    revision="519060ef43df3261e0512e5ae4c82a4d4e675f32",
    max_model_len=4096,
    limit_mm_per_prompt={"image": 1, "video": 0},
)

For a complete image/chat example, use the AWQ model card and replace the model ID/revision.

Limitations

Evaluated primarily on English ChartQA short answers.
Not validated for general OCR documents, out-of-domain charts, or safety-critical use.
This checkpoint is the larger quality reference; the AWQ checkpoint is recommended for serving when its -0.72 pp quality tradeoff is acceptable.

中文摘要

這是將 ChartQA LoRA adapter 合併回 Qwen3-VL-8B 後的 16-bit 完整模型，也是 AWQ 量化前的品質與 serving baseline。完整 2,500 題 vLLM 評估為 86.24%；權重檔 17.53 GB。若部署可接受 0.72 個百分點的下降，建議改用 7.55 GB 的 AWQ 版本。

Source repository

程式碼、訓練與評估流程、測試與完整證據都在 GitHub：https://github.com/kuotunyu/qwen3-vl-chartqa。GitHub kuotunyu 與 Hugging Face steven0226 為同一人。

Source code, the training/evaluation pipeline, tests and the full evidence trail live at https://github.com/kuotunyu/qwen3-vl-chartqa. GitHub kuotunyu and Hugging Face steven0226 are the same author.