A benchmark for evaluating the adversarial robustness of zero-shot image classifiers across six fine-grained / domain-specific datasets and a range of threat models.
A small stratified sample (2 images per class) is also available for quick inspection: 👉
https://huggingface.co/datasets/legolasflagstaff/RobustGenBench-samplecaltech101_processed.tar.zst
fgvc-aircraft-2013b_processed.tar.zst
flowers-102_processed.tar.zst… See the full description on the dataset page:
https://huggingface.co/datasets/legolasflagstaff/RobustGenBench.
