Official dataset of the ECCV24 paper, "Dissecting Dissonance: Benchmarking Large Multimodal Models Against Self-Contradictory Instructions".
Website:
https://selfcontradiction.github.io
Github:
https://github.com/shiyegao/Self-Contradictory-Instructions-SCI
In the paper, “SCI-Core (1%), SCI-Base (10%), and SCI-All (100%)” denote the small, medium, and full splits of the Hugging Face dataset, respectively.