Abstract
Safe reinforcement learning deals with mitigating or avoiding unsafesituations by reinforcement learning (RL) agents. Safe RL approaches are basedon specific risk representations for particular problems or domains. In orderto analyze agent behaviors, compare safe RL approaches, and effectivelytransfer techniques between application domains, it is necessary to understandthe types of risk specific to safe RL problems. We performed a systematicliterature mapping with the objective to characterize risk in safe RL. Based onthe obtained results, we present definitions, characteristics, and types ofrisk that hold on multiple application domains. Our literature mapping coversliterature from the last 5 years (2017-2022), from a variety of knowledge areas(AI, finance, engineering, medicine) where RL approaches emphasize riskrepresentation and management. Our mapping covers 72 papers filteredsystematically from over thousands of papers on the topic. Our proposed notionof risk covers a variety of representations, disciplinary differences, commontraining exercises, and types of techniques. We encourage researchers toinclude explicit and detailed accounts of risk in future safe RL researchreports, using this mapping as a starting point. With this information,researchers and practitioners could draw stronger conclusions on theeffectiveness of techniques on different problems.