Abstract
This paper studies close-loop task planning, which refers to the process ofgenerating a sequence of skills (a plan) to accomplish a specific goal whileadapting the plan based on real-time observations. Recently, prompting LargeLanguage Models (LLMs) to generate actions iteratively has become a prevalentparadigm due to its superior performance and user-friendliness. However, thisparadigm is plagued by two inefficiencies: high token consumption and redundanterror correction, both of which hinder its scalability for large-scale testingand applications. To address these issues, we propose Tree-Planner, whichreframes task planning with LLMs into three distinct phases: plan sampling,action tree construction, and grounded deciding. Tree-Planner starts by usingan LLM to sample a set of potential plans before execution, followed by theaggregation of them to form an action tree. Finally, the LLM performs atop-down decision-making process on the tree, taking into account real-timeenvironmental information. Experiments show that Tree-Planner achievesstate-of-the-art performance while maintaining high efficiency. By decomposingLLM queries into a single plan-sampling call and multiple grounded-decidingcalls, a considerable part of the prompt are less likely to be repeatedlyconsumed. As a result, token consumption is reduced by 92.2% compared to thepreviously best-performing model. Additionally, by enabling backtracking on theaction tree as needed, the correction process becomes more flexible, leading toa 40.5% decrease in error corrections. Project page:https://tree-planner.github.io/