Learning to Discretize: Solving 1D Scalar Conservation Laws via Deep Reinforcement Learning

  • 2019-06-11 15:06:32
  • Yufei Wang, Ziju Shen, Zichao Long, Bin Dong
  • 0

Abstract

Conservation laws are considered to be fundamental laws of nature. It hasbroad application in many fields including physics, chemistry, biology,geology, and engineering. Solving the differential equations associated withconservation laws is a major branch in computational mathematics. Recentsuccess of machine learning, especially deep learning, in areas such ascomputer vision and natural language processing, has attracted a lot ofattention from the community of computational mathematics and inspired manyintriguing works in combining machine learning with traditional methods. Inthis paper, we are the first to explore the possibility and benefit of solvingnonlinear conservation laws using deep reinforcement learning. As a proof ofconcept, we focus on 1-dimensional scalar conservation laws. We deploy themachinery of deep reinforcement learning to train a policy network that candecide on how the numerical solutions should be approximated in a sequentialand spatial-temporal adaptive manner. We will show that the problem of solvingconservation laws can be naturally viewed as a sequential decision makingprocess and the numerical schemes learned in such a way can easily enforcelong-term accuracy. Furthermore, the learned policy network can determine agood local discrete approximation based on the current state of the solution,which essentially makes the proposed method a meta-learning approach. In otherwords, the proposed method is capable of learning how to discretize for a givensituation mimicking human experts. Finally, we will provide details on how thepolicy network is trained, how well it performs compared with somestate-of-the-art numerical solvers such as WENO schemes, and how well itgeneralizes.

 

Quick Read (beta)

loading the full paper ...