jlli/

HuDocVQA-manual

54 images from Common Crawl annotated by humans with questions and answers in Hungarian, as featured in our paper "Synthetic Document Question Answering in Hungarian". Performance of recent VLMs on this dataset are as follows:

Model Accuracy

gpt4o-2024-11-20 0.667

claude_37_sonnet_20250219 0.630

Qwen2.5-VL-72B-Instruct 0.611

Llama-3.2-90B-Vision-Instruct 0.481

See the other datasets from the paper:

HuDocVQA… See the full description on the dataset page: https://huggingface.co/datasets/jlli/HuDocVQA-manual.