HalluCompass

HalluCompass A direction-aware diagnostic benchmark and protocol for vision-language model (VLM) hallucination evaluation NeurIPS 2026 Datasets & Benchmarks Track Unified release: 2,200 images across MS-COCO + AMBER + NoCaps + VizWiz, 10,000 queries, two-pass annotation (GPT-4o-mini 1st-pass + 5-human verification, Fleiss’ κ = 0.72 inter-annotator agreement on a stratified 250-image validation subset, substantial agreement per Landis & Koch 1977). A balanced POPE-compatible… See the full description on the dataset page:

Source: Hugging Face Hub (anonymous80934/HalluCompass). Metadata imported from the dataset’s Hub tags.