Abstract
The emergence of Large Language Models (LLMs) like ChatGPT has inspired thedevelopment of LLM-based agents capable of addressing complex, real-worldtasks. However, these agents often struggle during task execution due tomethodological constraints, such as error propagation and limited adaptability.To address this issue, we propose a multi-agent framework based on dynamic TaskDecomposition and Agent Generation (TDAG). This framework dynamicallydecomposes complex tasks into smaller subtasks and assigns each to aspecifically generated subagent, thereby enhancing adaptability in diverse andunpredictable real-world tasks. Simultaneously, existing benchmarks often lackthe granularity needed to evaluate incremental progress in complex, multi-steptasks. In response, we introduce ItineraryBench in the context of travelplanning, featuring interconnected, progressively complex tasks with afine-grained evaluation system. ItineraryBench is designed to assess agents'abilities in memory, planning, and tool usage across tasks of varyingcomplexity. Our experimental results reveal that TDAG significantly outperformsestablished baselines, showcasing its superior adaptability and contextawareness in complex task scenarios.