Forked from opendatalab/OmniDocBench.
We have added a simple Python tool for filtering and performing stratified sampling on OmniDocBench data.
Filter JSON entries based on custom criteria
Perform stratified sampling based on multiple categories
Handle nested JSON fields
Installation
Local Development Install (Recommended)
git clone
https://huggingface.co/Quivr/OmniDocBench.git
cd OmniDocBench
pip install -r requirements.txt #… See the full description on the dataset page:
https://huggingface.co/datasets/Quivr/OmniDocBench.