Abstract
Research on human-AI collaboration often prioritizes objective performance.However, understanding human subjective preferences is essential to improvinghuman-AI complementarity and human experiences. We investigate humanpreferences for controllability in a shared workspace task with AI partnersusing Behavior Shaping (BS), a reinforcement learning algorithm that allowshumans explicit control over AI behavior. In one experiment, we validate the robustness of BS in producing effective AIpolicies relative to self-play policies, when controls are hidden. In anotherexperiment, we enable human control, showing that participants perceive AIpartners as more effective and enjoyable when they can directly dictate AIbehavior. Our findings highlight the need to design AI that prioritizes bothtask performance and subjective human preferences. By aligning AI behavior withhuman preferences, we demonstrate how human-AI complementarity can extendbeyond objective outcomes to include subjective preferences.