Statistical Inference with Limited Memory: A Survey

  • 2024-10-13 13:26:39
  • Tomer Berg, Or Ordentlich, Ofer Shayevitz
  • 0

Abstract

The problem of statistical inference in its various forms has been thesubject of decades-long extensive research. Most of the effort has been focusedon characterizing the behavior as a function of the number of availablesamples, with far less attention given to the effect of memory limitations onperformance. Recently, this latter topic has drawn much interest in theengineering and computer science literature. In this survey paper, we attemptto review the state-of-the-art of statistical inference under memoryconstraints in several canonical problems, including hypothesis testing,parameter estimation, and distribution property testing/estimation. We discussthe main results in this developing field, and by identifying recurrent themes,we extract some fundamental building blocks for algorithmic construction, aswell as useful techniques for lower bound derivations.

 

Quick Read (beta)

loading the full paper ...