Abstract
Reinforcement learning (RL) offers a general approach for modeling andtraining AI agents, including human-AI interaction scenarios. In this paper, wepropose SHARPIE (Shared Human-AI Reinforcement Learning Platform forInteractive Experiments) to address the need for a generic framework to supportexperiments with RL agents and humans. Its modular design consists of aversatile wrapper for RL environments and algorithm libraries, aparticipant-facing web interface, logging utilities, deployment on popularcloud and participant recruitment platforms. It empowers researchers to study awide variety of research questions related to the interaction between humansand RL agents, including those related to interactive reward specification andlearning, learning from human feedback, action delegation, preferenceelicitation, user-modeling, and human-AI teaming. The platform is based on ageneric interface for human-RL interactions that aims to standardize the fieldof study on RL in human contexts.