Abstract
Human-centered AI considers human experiences with AI performance. Whileabundant research has been helping AI achieve superhuman performance either byfully automatic or weak supervision learning, fewer endeavors are experimentingwith how AI can tailor to humans' preferred skill level given fine-grainedinput. In this work, we guide the curriculum reinforcement learning resultstowards a preferred performance level that is neither too hard nor too easy vialearning from the human decision process. To achieve this, we developed aportable, interactive platform that enables the user to interact with agentsonline via manipulating the task difficulty, observing performance, andproviding curriculum feedback. Our system is highly parallelizable, making itpossible for a human to train large-scale reinforcement learning applicationsthat require millions of samples without a server. The result demonstrates theeffectiveness of an interactive curriculum for reinforcement learning involvinghuman-in-the-loop. It shows reinforcement learning performance can successfullyadjust in sync with the human desired difficulty level. We believe thisresearch will open new doors for achieving flow and personalized adaptivedifficulties.