Abstract
Analysis of invasive sports such as soccer is challenging because the gamesituation changes continuously in time and space, and multiple agentsindividually recognize the game situation and make decisions. Previous studiesusing deep reinforcement learning have often considered teams as a single agentand valued the teams and players who hold the ball in each discrete event. Thenit was challenging to value the actions of multiple players, including playersfar from the ball, in a spatiotemporally continuous state space. In this paper,we propose a method of valuing possible actions for on- and off-ball soccerplayers in a single holistic framework based on multi-agent deep reinforcementlearning. We consider a discrete action space in a continuous state space thatmimics that of Google research football and leverages supervised learning foractions in reinforcement learning. In the experiment, we analyzed therelationships with conventional indicators, season goals, and game ratings byexperts, and showed the effectiveness of the proposed method. Our approach canassess how multiple players move continuously throughout the game, which isdifficult to be discretized or labeled but vital for teamwork, scouting, andfan engagement.