Abstract
The inclusion of physical information in machine learning frameworks hasrevolutionized many application areas. This involves enhancing the learningprocess by incorporating physical constraints and adhering to physical laws. Inthis work we explore their utility for reinforcement learning applications. Wepresent a thorough review of the literature on incorporating physicsinformation, as known as physics priors, in reinforcement learning approaches,commonly referred to as physics-informed reinforcement learning (PIRL). Weintroduce a novel taxonomy with the reinforcement learning pipeline as thebackbone to classify existing works, compare and contrast them, and derivecrucial insights. Existing works are analyzed with regard to therepresentation/ form of the governing physics modeled for integration, theirspecific contribution to the typical reinforcement learning architecture, andtheir connection to the underlying reinforcement learning pipeline stages. Wealso identify core learning architectures and physics incorporation biases(i.e., observational, inductive and learning) of existing PIRL approaches anduse them to further categorize the works for better understanding andadaptation. By providing a comprehensive perspective on the implementation ofthe physics-informed capability, the taxonomy presents a cohesive approach toPIRL. It identifies the areas where this approach has been applied, as well asthe gaps and opportunities that exist. Additionally, the taxonomy sheds lighton unresolved issues and challenges, which can guide future research. Thisnascent field holds great potential for enhancing reinforcement learningalgorithms by increasing their physical plausibility, precision, dataefficiency, and applicability in real-world scenarios.