Abstract
Metaphorical comprehension in images remains a critical challenge for AIsystems, as existing models struggle to grasp the nuanced cultural, emotional,and contextual implications embedded in visual content. While multimodal largelanguage models (MLLMs) excel in basic Visual Question Answer (VQA) tasks, theystruggle with a fundamental limitation on image implication tasks: contextualgaps that obscure the relationships between different visual elements and theirabstract meanings. Inspired by the human cognitive process, we propose LetAndroids Dream (LAD), a novel framework for image implication understanding andreasoning. LAD addresses contextual missing through the three-stage framework:(1) Perception: converting visual information into rich and multi-level textualrepresentations, (2) Search: iteratively searching and integrating cross-domainknowledge to resolve ambiguity, and (3) Reasoning: generating context-alignmentimage implication via explicit reasoning. Our framework with the lightweightGPT-4o-mini model achieves SOTA performance compared to 15+ MLLMs on Englishimage implication benchmark and a huge improvement on Chinese benchmark,performing comparable with the GPT-4o model on Multiple-Choice Question (MCQ)and outperforms 36.7% on Open-Style Question (OSQ). Additionally, our workprovides new insights into how AI can more effectively interpret imageimplications, advancing the field of vision-language reasoning and human-AIinteraction. Our project is publicly available athttps://github.com/MING-ZCH/Let-Androids-Dream-of-Electric-Sheep.