Abstract
Providing reinforcement learning agents with informationally rich humanknowledge can dramatically improve various aspects of learning. Prior work hasdeveloped different kinds of shaping methods that enable agents to learnefficiently in complex environments. All these methods, however, tailor humanguidance to agents in specialized shaping procedures, thus embodying variouscharacteristics and advantages in different domains. In this paper, weinvestigate the interplay between different shaping methods for more robustlearning performance. We propose an adaptive shaping algorithm which is capableof learning the most suitable shaping method in an on-line manner. Results intwo classic domains verify its effectiveness from both simulated and real humanstudies, shedding some light on the role and impact of human factors inhuman-robot collaborative learning.