I processed the jsonl file downloaded from DUE Benchmark using the code below.For the images, I used images provided by DocDownstream.
import json
from datasets import Dataset, DatasetDict
from tqdm import tqdm
from huggingface_hub import login; login(token="YOUR_TOKEN")
with open(jsonl_file, "r", encoding="utf-8") as f:
for line in tqdm(f):
record = json.loads(line)
img_path =… See the full description on the dataset page:
https://huggingface.co/datasets/Ryoo72/DocVQA.
