Abstract
Markov games (MGs) and multi-agent reinforcement learning (MARL) are studiedto model decision making in multi-agent systems. Traditionally, the objectivein MG and MARL has been risk-neutral, i.e., agents are assumed to optimize aperformance metric such as expected return, without taking into accountsubjective or cognitive preferences of themselves or of other agents. However,ignoring such preferences leads to inaccurate models of decision making in manyreal-world scenarios in finance, operations research, and behavioral economics.Therefore, when these preferences are present, it is necessary to incorporate asuitable measure of risk into the optimization objective of agents, which opensthe door to risk-sensitive MG and MARL. In this paper, we systemically reviewthe literature on risk sensitivity in MG and MARL that has been growing inrecent years alongside other areas of reinforcement learning and game theory.We define and mathematically describe different risk measures used in MG andMARL and individually for each measure, discuss articles that incorporate it.Finally, we identify recent trends in theoretical and applied works in thefield and discuss possible directions of future research.