Abstract
Tool use, planning, and feedback learning are currently three prominentparadigms for developing Large Language Model (LLM)-based agents across varioustasks. Although numerous frameworks have been devised for each paradigm, theirintricate workflows and inconsistent taxonomy create challenges inunderstanding and reviewing the frameworks across different paradigms. Thissurvey introduces a unified taxonomy to systematically review and discuss theseframeworks. Specifically, 1) the taxonomy defines environments/tasks, commonLLM-profiled roles (policy models, evaluators, and dynamic models), anduniversally applicable workflows found in prior work, and 2) it enables acomparison of key perspectives on LMPR implementations and workflow usageacross different agent paradigms.