FreedomIntelligence/

MileBench

	MileBench




	
	Introduction

We introduce MileBench, a pioneering benchmark designed to test the MultImodal Long-contExt capabilities of MLLMs. This benchmark comprises not only multimodal long contexts, but also multiple tasks requiring both comprehension and generation. We establish two distinct evaluation sets, diagnostic and realistic, to systematically assess MLLMs’ long-context adaptation capacity and their ability to completetasks in long-context scenarios

To… See the full description on the dataset page: https://huggingface.co/datasets/FreedomIntelligence/MileBench.