Abstract
Recent efforts have incorporated large language models (LLMs) with externalresources (e.g., the Internet) or internal control flows (e.g., promptchaining) for tasks requiring grounding or reasoning. However, these effortshave largely been piecemeal, lacking a systematic framework for constructing afully-fledged language agent. To address this challenge, we draw on the richhistory of agent design in symbolic artificial intelligence to develop ablueprint for a new wave of cognitive language agents. We first show that LLMshave many of the same properties as production systems, and recent efforts toimprove their grounding or reasoning mirror the development of cognitivearchitectures built around production systems. We then propose CognitiveArchitectures for Language Agents (CoALA), a conceptual framework tosystematize diverse methods for LLM-based reasoning, grounding, learning, anddecision making as instantiations of language agents in the framework. Finally,we use the CoALA framework to highlight gaps and propose actionable directionstoward more capable language agents in the future.