Abstract
Reinforcement learning (RL) is a versatile framework for optimizing long-termgoals. Although many real-world problems can be formalized with RL, learningand deploying a performant RL policy requires a system designed to addressseveral important challenges, including the exploration-exploitation dilemma,partial observability, dynamic action spaces, and safety concerns. While theimportance of these challenges has been well recognized, existing open-sourceRL libraries do not explicitly address them. This paper introduces Pearl, aProduction-Ready RL software package designed to embrace these challenges in amodular way. In addition to presenting benchmarking results, we also highlightexamples of Pearl's ongoing industry adoption to demonstrate its advantages forproduction use cases. Pearl is open sourced on GitHub atgithub.com/facebookresearch/pearl and its official website ispearlagent.github.io.