Where to Search: Measure the Prior-Structured Search Space of LLM Agents

  • 2025-11-03 10:52:10
  • Zhuo-Yang Song
  • 0

Abstract

The generate-filter-refine (iterative paradigm) based on large languagemodels (LLMs) has achieved progress in reasoning, programming, and programdiscovery in AI+Science. However, the effectiveness of search depends on whereto search, namely, how to encode the domain prior into an operationallystructured hypothesis space. To this end, this paper proposes a compact formaltheory that describes and measures LLM-assisted iterative search guided bydomain priors. We represent an agent as a fuzzy relation operator on inputs andoutputs to capture feasible transitions; the agent is thereby constrained by afixed safety envelope. To describe multi-step reasoning/search, we weight allreachable paths by a single continuation parameter and sum them to obtain acoverage generating function; this induces a measure of reachabilitydifficulty; and it provides a geometric interpretation of search on the graphinduced by the safety envelope. We further provide the simplest testableinferences and validate them via two instantiation. This theory offers aworkable language and operational tools to measure agents and their searchspaces, proposing a systematic formal description of iterative searchconstructed by LLMs.

 

Quick Read (beta)

loading the full paper ...