Abstract
Large Language Model (LLM) empowered agents have recently emerged as advancedparadigms that exhibit impressive capabilities in a wide range of domains andtasks. Despite their potential, current LLM agents often adopt aone-size-fits-all approach, lacking the flexibility to respond to users'varying needs and preferences. This limitation motivates us to developPersonaAgent, the first personalized LLM agent framework designed to addressversatile personalization tasks. Specifically, PersonaAgent integrates twocomplementary components - a personalized memory module that includes episodicand semantic memory mechanisms; a personalized action module that enables theagent to perform tool actions tailored to the user. At the core, the persona(defined as unique system prompt for each user) functions as an intermediary:it leverages insights from personalized memory to control agent actions, whilethe outcomes of these actions in turn refine the memory. Based on theframework, we propose a test-time user-preference alignment strategy thatsimulate the latest n interactions to optimize the persona prompt, ensuringreal-time user preference alignment through textual loss feedback betweensimulated and ground-truth responses. Experimental evaluations demonstrate thatPersonaAgent significantly outperforms other baseline methods by not onlypersonalizing the action space effectively but also scaling during test-timereal-world applications. These results underscore the feasibility and potentialof our approach in delivering tailored, dynamic user experiences.