Abstract
We introduce a novel method to train agents of reinforcement learning (RL) bysharing knowledge in a way similar to the concept of using a book. The recordedinformation in the form of a book is the main means by which humans learnknowledge. Nevertheless, the conventional deep RL methods have mainly focusedeither on experiential learning where the agent learns through interactionswith the environment from the start or on imitation learning that tries tomimic the teacher. Contrary to these, our proposed book learning shares keyinformation among different agents in a book-like manner by delving into thefollowing two characteristic features: (1) By defining the linguistic function,input states can be clustered semantically into a relatively small number ofcore clusters, which are forwarded to other RL agents in a prescribed manner.(2) By defining state priorities and the contents for recording, coreexperiences can be selected and stored in a small container. We call thiscontainer as `BOOK'. Our method learns hundreds to thousand times faster thanthe conventional methods by learning only a handful of core clusterinformation, which shows that deep RL agents can effectively learn through theshared knowledge from other agents.