AWQ (W4A16 asymmetric, group size 128) quantization of ATH-MaaS/OvisOCR2 — a 0.8B end-to-end document parsing / OCR model built on Qwen3.5-0.8B.

Made with llm-compressor: AWQModifier applied to all Linear layers of the language model. The vision tower and lm_head are kept in BF16.

Prompt for full-page OCR (same as base model):

Use temperature 0.0 for OCR tasks.

Quantized entirely with open tooling; see the base model card for benchmarks, capabilities and limitations of the underlying model. Weight-only 4-bit quantization may introduce a small accuracy loss versus BF16 on dense documents.