Abstract
The AI community has been exploring a pathway to artificial generalintelligence (AGI) by developing "language agents", which are complex largelanguage models (LLMs) pipelines involving both prompting techniques and toolusage methods. While language agents have demonstrated impressive capabilitiesfor many real-world tasks, a fundamental limitation of current language agentsresearch is that they are model-centric, or engineering-centric. That's to say,the progress on prompts, tools, and pipelines of language agents requiressubstantial manual engineering efforts from human experts rather thanautomatically learning from data. We believe the transition from model-centric,or engineering-centric, to data-centric, i.e., the ability of language agentsto autonomously learn and evolve in environments, is the key for them topossibly achieve AGI. In this work, we introduce agent symbolic learning, a systematic frameworkthat enables language agents to optimize themselves on their own in adata-centric way using symbolic optimizers. Specifically, we consider agents assymbolic networks where learnable weights are defined by prompts, tools, andthe way they are stacked together. Agent symbolic learning is designed tooptimize the symbolic network within language agents by mimicking twofundamental algorithms in connectionist learning: back-propagation and gradientdescent. Instead of dealing with numeric weights, agent symbolic learning workswith natural language simulacrums of weights, loss, and gradients. We conductproof-of-concept experiments on both standard benchmarks and complex real-worldtasks and show that agent symbolic learning enables language agents to updatethemselves after being created and deployed in the wild, resulting in"self-evolving agents".