Abstract
Foundation models, including large language models (LLMs) and vision-languagemodels (VLMs), have recently enabled novel approaches to robot autonomy andhuman-robot interfaces. In parallel, vision-language-action models (VLAs) orlarge behavior models (LBMs) are increasing the dexterity and capabilities ofrobotic systems. This survey paper focuses on those works advancing towardsagentic applications and architectures. This includes initial efforts exploringGPT-style interfaces to tooling, as well as more complex system where AI agentsare coordinators, planners, perception actors, or generalist interfaces. Suchagentic architectures allow robots to reason over natural languageinstructions, invoke APIs, plan task sequences, or assist in operations anddiagnostics. In addition to peer-reviewed research, due to the fast-evolvingnature of the field, we highlight and include community-driven projects, ROSpackages, and industrial frameworks that show emerging trends. We propose ataxonomy for classifying model integration approaches and present a comparativeanalysis of the role that agents play in different solutions in today'sliterature.