MMMU_Pro

MMMU-Pro (A More Robust Multi-discipline Multimodal Understanding Benchmark) 🌐 Homepage 🏆 Leaderboard 🤗 Dataset 🤗 Paper 📖 arXiv GitHub 🔔News 🛠️ 2026-07-10 Fixed incorrect ground-truth answer labels. (validation Design 15; validation Art Theory 4) 🛠️ 2026-05-30 Fixed the option augmentation issue in Vision and Standard (10 options) settings. (validation Diagnostics and Laboratory Medicine 17) 🛠️ 2025-03-08 Fixed mismatch between inner image… See the full description on the dataset page: Pro.

Source: Hugging Face Hub (MMMU/MMMU_Pro). Metadata imported from the dataset’s Hub tags.