Statistical Inference in Reinforcement Learning: A Selective Survey

  • 2025-04-18 00:15:48
  • Chengchun Shi
  • 0

Abstract

Reinforcement learning (RL) is concerned with how intelligence agents takeactions in a given environment to maximize the cumulative reward they receive.In healthcare, applying RL algorithms could assist patients in improving theirhealth status. In ride-sharing platforms, applying RL algorithms could increasedrivers' income and customer satisfaction. For large language models, applyingRL algorithms could align their outputs with human preferences. Over the pastdecade, RL has been arguably one of the most vibrant research frontiers inmachine learning. Nevertheless, statistics as a field, as opposed to computerscience, has only recently begun to engage with RL both in depth and inbreadth. This chapter presents a selective review of statistical inferentialtools for RL, covering both hypothesis testing and confidence intervalconstruction. Our goal is to highlight the value of statistical inference in RLfor both the statistics and machine learning communities, and to promote thebroader application of classical statistical inference tools in this vibrantarea of research.

 

Quick Read (beta)

loading the full paper ...