pbevan11/

image_gen_ocr_evaluation_data

Author: Peter J. Bevan Date: 15/12/23 github: https://github.com/pbevan1/image-gen-spelling-eval

Table 1: Normalised Levenshtein similarity scores between instructed text and text present in image (as identified by OCR)

Model object signage natural long Overall

DALLE3 0.62 0.62 0.62 0.58 0.61

DeepFloydIF 0.57 0.56 0.66 0.39 0.54

DALLE2 0.44 0.35 0.42 0.22 0.36

SDXL 0.3 0.33 0.4 0.21 0.31

SD 0.28 0.26 0.32 0.22 0.27

PlayGroundV2 0.19 0.23 0.17… See the full description on the dataset page: https://huggingface.co/datasets/pbevan11/image_gen_ocr_evaluation_data.