JMMMU

JMMMU: A Japanese Massive Multi-discipline Multimodal Understanding Benchmark 🌐 Homepage 🤗 Dataset 🏆 HF Leaderboard 📖 arXiv 💻 Code Introduction We introduce JMMMU (Japanese MMMU), a multimodal benchmark that can truly evaluate LMM performance in Japanese. To create JMMMU, we first carefully analyzed the existing MMMU benchmark and examined its cultural dependencies. Then, for questions in culture-agnostic subjects, we employed native Japanese speakers who… See the full description on the dataset page:

Source: Hugging Face Hub (JMMMU/JMMMU). Metadata imported from the dataset’s Hub tags.