Model-based Reinforcement Learning for Semi-Markov Decision Processes with Neural ODEs

  • 2020-06-29 17:21:43
  • Jianzhun Du, Joseph Futoma, Finale Doshi-Velez
  • 0

Abstract

We present two elegant solutions for modeling continuous-time dynamics, in anovel model-based reinforcement learning (RL) framework for semi-Markovdecision processes (SMDPs), using neural ordinary differential equations(ODEs). Our models accurately characterize continuous-time dynamics and enableus to develop high-performing policies using a small amount of data. We alsodevelop a model-based approach for optimizing time schedules to reduceinteraction rates with the environment while maintaining the near-optimalperformance, which is not possible for model-free methods. We experimentallydemonstrate the efficacy of our methods across various continuous-time domains.

 

Quick Read (beta)

loading the full paper ...