You can deploy this model and start earning money today!

facebook/
Common-O

Views

No views yet

Common-O

measuring multimodal reasoning across scenes

Common-O, inspired by cognitive tests for humans, probes multimodal LLMs' ability to reason across scenes by asking "what’s in common?"

Common-O is comprised of household objects:

We have two subsets: Common-O (3 - 8 objects) and Common-O Complex (8 - 16 objects).

	Multimodal LLMs excel at single image perception, but struggle with multi-scene reasoning





	
	Evaluating a Multimodal LLM on Common-O

import… See the full description on the dataset page: https://huggingface.co/datasets/facebook/Common-O.