Abstract
The goal of policy learning is to train a policy function that recommends atreatment given covariates to maximize population welfare. There are two majorapproaches in policy learning: the empirical welfare maximization (EWM)approach and the plug-in approach. The EWM approach is analogous to aclassification problem, where one first builds an estimator of the populationwelfare, which is a functional of policy functions, and then trains a policy bymaximizing the estimated welfare. In contrast, the plug-in approach is based onregression, where one first estimates the conditional average treatment effect(CATE) and then recommends the treatment with the highest estimated outcome.This study bridges the gap between the two approaches by showing that both arebased on essentially the same optimization problem. In particular, we prove anexact equivalence between EWM and least squares over a reparameterization ofthe policy class. As a consequence, the two approaches are interchangeable inseveral respects and share the same theoretical guarantees under commonconditions. Leveraging this equivalence, we propose a regularization method forpolicy learning. The reduction to least squares yields a smooth surrogate thatis typically easier to optimize in practice. At the same time, for many naturalpolicy classes the inherent combinatorial hardness of exact EWM generallyremains, so the reduction should be viewed as an optimization aid rather than auniversal bypass of NP-hardness.