OmniParse-v1 is a powerful Vision-Language Model (VLM) customized for Intelligent Document Processing (IDP). It is designed to understand complex document layouts, such as dense mark sheets, invoices, and unstructured PDFs, and natively extract beautifully structured Markdown.
This model is intended to be used with the OmniParse Python/Gradio pipeline.
1from transformers import AutoModelForCausalLM, AutoProcessor
2import torch
3
4model_id = "ManvithReddy/OmniParse-v1"
5
6# Load the processor and model
7processor = AutoProcessor.from_pretrained(model_id, trust_remote_code=True)
8model = AutoModelForCausalLM.from_pretrained(
9 model_id,
10 trust_remote_code=True,
11 torch_dtype=torch.bfloat16
12).eval()
This model is derived from the PaddleOCR-VL architecture and customized for local, offline document extraction tasks.