Datasets
634 results
MultimodalTextVideo
Vript_Chinese
🎬 Vript: Refine Video Captioning into Video Scripting Github Repo We construct a fine-grained video-text dataset with 44.7K…
100K–1M·JSON
ImageMultimodalText
VideoThinkBench
CVPR 2026 Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigm 🎊 News 2026.02 🔥🔥Our work…
1K–10K·MIT·Parquet
MultimodalTabularText
CG-Bench
CG-Bench Project Website: Repository: (includes running code) Summary We introduce CG-Bench, a groundbreaking benchmark for clue-grounded question…
10K–100K·MIT·JSON
Video
stream-data
Streaming Video Dataset Description A consolidated collection of video datasets for streaming video understanding research, including temporal…
100K–1M·CC-BY
MultimodalTextVideo
UrbanVideo-Bench
ACL'25 Oral UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spaces This repository contains…
1K–10K·MIT·Parquet
MultimodalTextVideo
heico-focus-vqa
HeiCo-FOCUS (Beta release) A clinically grounded dataset for long-context video understanding in minimally invasive surgery. 📄 Paper • …
10K–100K·CC-BY-NC-SA·Parquet
Video
LLaVA-Video-large-swift
Dataset Card LLaVA-Video-medium-swift A subset of LLaVA-Video-178K for educational purposes to learn how to fine-tune video models.
<1K·Apache-2.0
ImageMultimodalVideo
MindCraft
MindCraft Benchmark for spatio-temporal reasoning during vision-and-language navigation, used with LASAR. Layout mindcraft/ 000001/ data.npz 1.mp4…
1K–10K·Apache-2.0·Images (folder)
ImageMultimodalText
ANAKIN: manipulated videos and mask annotations
ANAKIN: manipulated videos and mask annotations
1K–10K·CC-BY
AudioMultimodalVideo
MRSDrama
ISDrama: Immersive Spatial Drama Generation through Multimodal Prompting Yu Zhang , Wenxiang Guo , Changhao Pan , Zhiyuan…
<1K·CC-BY-NC-SA
MultimodalTabularText
Talker-T2AV-Data
Talker-T2AV-Data Joint Talking Audio-Video Generation with Autoregressive Diffusion Modeling Paper (arXiv 2604.23586) · Code (GitHub) · Model ·…
100K–1M·Apache-2.0·CSV