From Predictive to Prescriptive Analytics

  • 2018-07-19 15:36:29
  • Dimitris Bertsimas, Nathan Kallus
  • 0

Abstract

In this paper, we combine ideas from machine learning (ML) and operationsresearch and management science (OR/MS) in developing a framework, along withspecific methods, for using data to prescribe optimal decisions in OR/MSproblems. In a departure from other work on data-driven optimization andreflecting our practical experience with the data available in applications ofOR/MS, we consider data consisting, not only of observations of quantities withdirect effect on costs/revenues, such as demand or returns, but predominantlyof observations of associated auxiliary quantities. The main problem ofinterest is a conditional stochastic optimization problem, given imperfectobservations, where the joint probability distributions that specify theproblem are unknown. We demonstrate that our proposed solution methods, whichare inspired by ML methods such as local regression, CART, and random forests,are generally applicable to a wide range of decision problems. We prove thatthey are tractable and asymptotically optimal even when data is not iid and maybe censored. We extend this to the case where decision variables may directlyaffect uncertainty in unknown ways, such as pricing's effect on demand. As ananalogue to R^2, we develop a metric P termed the coefficient ofprescriptiveness to measure the prescriptive content of data and the efficacyof a policy from an operations perspective. To demonstrate the power of ourapproach in a real-world setting we study an inventory management problem facedby the distribution arm of an international media conglomerate, which ships anaverage of 1bil units per year. We leverage internal data and public onlinedata harvested from IMDb, Rotten Tomatoes, and Google to prescribe operationaldecisions that outperform baseline measures. Specifically, the data we collect,leveraged by our methods, accounts for an 88\% improvement as measured by ourP.

 

Quick Read (beta)

loading the full paper ...