Abstract
Autonomy is a double-edged sword for AI agents, simultaneously unlockingtransformative possibilities and serious risks. How can agent developerscalibrate the appropriate levels of autonomy at which their agents shouldoperate? We argue that an agent's level of autonomy can be treated as adeliberate design decision, separate from its capability and operationalenvironment. In this work, we define five levels of escalating agent autonomy,characterized by the roles a user can take when interacting with an agent:operator, collaborator, consultant, approver, and observer. Within each level,we describe the ways by which a user can exert control over the agent and openquestions for how to design the nature of user-agent interaction. We thenhighlight a potential application of our framework towards AI autonomycertificates to govern agent behavior in single- and multi-agent systems. Weconclude by proposing early ideas for evaluating agents' autonomy. Our workaims to contribute meaningful, practical steps towards responsibly deployed anduseful AI agents in the real world.