Abstract
User queries in information retrieval are often ambiguous, making itchallenging for systems to identify a user's target from a single query. Whilerecent dialogue-based interactive retrieval systems can clarify user intent,they are inefficient as they often lack an explicit strategy to ask the mostinformative questions. To address this limitation, we propose SherlockLLM, adialogue-driven retrieval framework that learns an optimal questioning strategyvia Reinforcement Learning (RL) and avoids the need for large-scale annotateddialogue data. In our framework, an agent is trained to generate a sequence ofbinary questions to efficiently narrow down the search space. To validate ourapproach, we introduce a benchmark with both structured and unstructured tasks.Experimental results show that SherlockLLM is a robust and efficient solution.On the structured tasks, its performance matches strong baselines andapproaches the theoretical optimal defined by binary search. On the challengingunstructured task, our agent significantly outperforms these baselines,showcasing its ability to learn a highly effective information-seeking dialoguepolicy.