This article surveys reinforcement learning approaches in social robotics.Reinforcement learning is a framework for decision-making problems in which anagent interacts through trial-and-error with its environment to discover anoptimal behavior. Since interaction is a key component in both reinforcementlearning and social robotics, it can be a well-suited approach for real-worldinteractions with physically embodied social robots. The scope of the paper isfocused particularly on studies that include social physical robots andreal-world human-robot interactions with users. We present a thorough analysisof reinforcement learning approaches in social robotics. In addition to asurvey, we categorize existent reinforcement learning approaches based on theused method and the design of the reward mechanisms. Moreover, sincecommunication capability is a prominent feature of social robots, we discussand group the papers based on the communication medium used for rewardformulation. Considering the importance of designing the reward function, wealso provide a categorization of the papers based on the nature of the reward.This categorization includes three major themes: interactive reinforcementlearning, intrinsically motivated methods, and task performance-driven methods.The benefits and challenges of reinforcement learning in social robotics,evaluation methods of the papers regarding whether or not they use subjectiveand algorithmic measures, a discussion in the view of real-world reinforcementlearning challenges and proposed solutions, the points that remain to beexplored, including the approaches that have thus far received less attentionis also given in the paper. Thus, this paper aims to become a starting pointfor researchers interested in using and applying reinforcement learning methodsin this particular research field.