PhoStream is a mobile-centric streaming benchmark for evaluating omnimodal assistants in real-world mobile scenarios. It contains 5,572 open-ended QA pairs from 578 videos across 4 scenarios and 10 capabilities, covering video, audio, and temporal reasoning.
This dataset is associated with our ICML 2026 paper:
PhoStream: Benchmarking Real-World Streaming for Omnimodal Assistants in Mobile Scenarios