To systematically evaluate multimodal knowledge updating in LMMs, we introduce MMKU-Bench, a comprehensive benchmark that covers both updated knowledge and previously unknown knowledge. MMKU-Bench contains over 25k knowledge instances paired with more than 49k images, spanning 331 fine-grained types (including 156 updated types and 175 unknown types) across diverse visual knowledge domains.
For detailed usage and instructions, please refer to the GitHub page.
You… See the full description on the dataset page:
https://huggingface.co/datasets/baochenfu/MMKU-Bench.
