Deep reinforcement learning for large-scale epidemic control

  • 2020-03-30 17:57:09
  • Pieter Libin, Arno Moonens, Timothy Verstraeten, Fabian Perez-Sanjines, Niel Hens, Philippe Lemey, Ann Nowé
  • 2

Abstract

Epidemics of infectious diseases are an important threat to public health andglobal economies. Yet, the development of prevention strategies remains achallenging process, as epidemics are non-linear and complex processes. Forthis reason, we investigate a deep reinforcement learning approach toautomatically learn prevention strategies in the context of pandemic influenza.Firstly, we construct a new epidemiological meta-population model, with 379patches (one for each administrative district in Great Britain), thatadequately captures the infection process of pandemic influenza. Our modelbalances complexity and computational efficiency such that the use ofreinforcement learning techniques becomes attainable. Secondly, we set up aground truth such that we can evaluate the performance of the 'Proximal PolicyOptimization' algorithm to learn in a single district of this epidemiologicalmodel. Finally, we consider a large-scale problem, by conducting an experimentwhere we aim to learn a joint policy to control the districts in a community of11 tightly coupled districts, for which no ground truth can be established.This experiment shows that deep reinforcement learning can be used to learnmitigation policies in complex epidemiological models with a large state space.Moreover, through this experiment, we demonstrate that there can be anadvantage to consider collaboration between districts when designing preventionstrategies.

 

Quick Read (beta)

loading the full paper ...