MuirBench

MuirBench: A Comprehensive Benchmark for Robust Multi-image Understanding 🌐 Homepage 📖 Paper 💻 Evaluation Intro MuirBench is a benchmark containing 11,264 images and 2,600 multiple-choice questions, providing robust evaluation on 12 multi-image understanding tasks. MuirBench evaluates on a comprehensive range of 12 multi-image understanding abilities, e.g. geographic understanding, diagram understanding, visual retrieval, …, etc, while prior benchmarks… See the full description on the dataset page:

Source: Hugging Face Hub (MUIRBENCH/MUIRBENCH). Metadata imported from the dataset’s Hub tags.