Abstract
Incorporating side observations in decision making can reduce uncertainty andboost performance, but it also requires we tackle a potentially complexpredictive relationship. While one may use off-the-shelf machine learningmethods to separately learn a predictive model and plug it in, a variety ofrecent methods instead integrate estimation and optimization by fitting themodel to directly optimize downstream decision performance. Surprisingly, inthe case of contextual linear optimization, we show that the naive plug-inapproach actually achieves regret convergence rates that are significantlyfaster than methods that directly optimize downstream decision performance. Weshow this by leveraging the fact that specific problem instances do not havearbitrarily bad near-dual-degeneracy. While there are other pros and cons toconsider as we discuss and illustrate numerically, our results highlight anuanced landscape for the enterprise to integrate estimation and optimization.Our results are overall positive for practice: predictive models are easy andfast to train using existing tools, simple to interpret, and, as we show, leadto decisions that perform very well.