Abstract
Despite growing interest in hallucination in Multimodal Large LanguageModels, existing studies primarily focus on single-image settings, leavinghallucination in multi-image scenarios largely unexplored. To address this gap,we conduct the first systematic study of hallucinations in multi-image MLLMsand propose MIHBench, a benchmark specifically tailored for evaluatingobject-related hallucinations across multiple images. MIHBench comprises threecore tasks: Multi-Image Object Existence Hallucination, Multi-Image ObjectCount Hallucination, and Object Identity Consistency Hallucination, targetingsemantic understanding across object existence, quantity reasoning, andcross-view identity consistency. Through extensive evaluation, we identify keyfactors associated with the occurrence of multi-image hallucinations,including: a progressive relationship between the number of image inputs andthe likelihood of hallucination occurrences; a strong correlation betweensingle-image hallucination tendencies and those observed in multi-imagecontexts; and the influence of same-object image ratios and the positionalplacement of negative samples within image sequences on the occurrence ofobject identity consistency hallucination. To address these challenges, wepropose a Dynamic Attention Balancing mechanism that adjusts inter-imageattention distributions while preserving the overall visual attentionproportion. Experiments across multiple state-of-the-art MLLMs demonstrate thatour method effectively reduces hallucination occurrences and enhances semanticintegration and reasoning stability in multi-image scenarios.