ssaitokenny90/

diffusion-retriever

	loader.py




	


	Dataset Summary

A document ocr dataset with sensor fusion modality, stored in npy sharded format.

Preprocessing: minimal Augmentation: randaugment

Split strategy: random 90 10 Sampling: random

Quality filtering: strict Labeling: pseudo label

loader.py — main artifact of this repository

See the… See the full description on the dataset page: https://huggingface.co/datasets/ssaitokenny90/diffusion-retriever.