OmniPro

OmniPro A comprehensive benchmark for evaluating proactive video understanding capabilities of omni multimodal large language models (MLLMs). Unlike traditional reactive QA benchmarks where models respond to explicit questions after watching a video, OmniPro evaluates whether models can proactively monitor video streams and respond at the right moment when specific conditions are met. OmniPro is designed around three core capabilities that define a good omni-proactive model:… See the full description on the dataset page:

Source: Hugging Face Hub (RuixiangZhao/OmniPro). Metadata imported from the dataset’s Hub tags.