[06/13/2024] ๐ We release our MMDU benchmark and MMDU-45k instruct tunning data to huggingface.
To evaluate the multi-image multi-turn dialogue capabilities of existing models, we have developed the MMDU Benchmark. Our benchmark comprises 110 high-quality multi-image multi-turn dialogues with more than 1600 questions, each accompanied by detailed long-form answers. Previous benchmarks typically involved only single images or a small number ofโฆ See the full description on the dataset page:
https://huggingface.co/datasets/laolao77/MMDU.