Abstract
AI programming tools enable powerful code generation, and recent prototypesattempt to reduce user effort with proactive AI agents, but their impact onprogramming workflows remains unexplored. We introduce and evaluateCodellaborator, a design probe LLM agent that initiates programming assistancebased on editor activities and task context. We explored three interfacevariants to assess trade-offs between increasingly salient AI support:prompt-only, proactive agent, and proactive agent with presence and context(Codellaborator). In a within-subject study (N=18), we find that proactiveagents increase efficiency compared to prompt-only paradigm, but also incurworkflow disruptions. However, presence indicators and interaction contextsupport alleviated disruptions and improved users' awareness of AI processes.We underscore trade-offs of Codellaborator on user control, ownership, and codeunderstanding, emphasizing the need to adapt proactivity to programmingprocesses. Our research contributes to the design exploration and evaluation ofproactive AI systems, presenting design implications on AI-integratedprogramming workflow.