Abstract
Aerial Visual Object Search (AVOS) tasks in urban environments requireUnmanned Aerial Vehicles (UAVs) to autonomously search for and identify targetobjects using visual and textual cues without external guidance. Existingapproaches struggle in complex urban environments due to redundant semanticprocessing, similar object distinction, and the exploration-exploitationdilemma. To bridge this gap and support the AVOS task, we introduce CityAVOS,the first benchmark dataset for autonomous search of common urban objects. Thisdataset comprises 2,420 tasks across six object categories with varyingdifficulty levels, enabling comprehensive evaluation of UAV agents' searchcapabilities. To solve the AVOS tasks, we also propose PRPSearcher(Perception-Reasoning-Planning Searcher), a novel agentic method powered bymulti-modal large language models (MLLMs) that mimics human three-tiercognition. Specifically, PRPSearcher constructs three specialized maps: anobject-centric dynamic semantic map enhancing spatial perception, a 3Dcognitive map based on semantic attraction values for target reasoning, and a3D uncertainty map for balanced exploration-exploitation search. Also, ourapproach incorporates a denoising mechanism to mitigate interference fromsimilar objects and utilizes an Inspiration Promote Thought (IPT) promptingmechanism for adaptive action planning. Experimental results on CityAVOSdemonstrate that PRPSearcher surpasses existing baselines in both success rateand search efficiency (on average: +37.69% SR, +28.96% SPL, -30.69% MSS, and-46.40% NE). While promising, the performance gap compared to humans highlightsthe need for better semantic reasoning and spatial exploration capabilities inAVOS tasks. This work establishes a foundation for future advances in embodiedtarget search. Dataset and source code are available athttps://anonymous.4open.science/r/CityAVOS-3DF8.