Abstract
There are various applications, where companies need to decide to whichindividuals they should best allocate treatment. To support such decisions,uplift models are applied to predict treatment effects on an individual level.Based on the predicted treatment effects, individuals can be ranked andtreatment allocation can be prioritized according to this ranking. An implicitassumption, which has not been doubted in the previous uplift modelingliterature, is that this treatment prioritization approach tends to bringindividuals with high treatment effects to the top and individuals with lowtreatment effects to the bottom of the ranking. In our research, we show thatheteroskedastictity in the training data can cause a bias of the uplift modelranking: individuals with the highest treatment effects can get accumulated inlarge numbers at the bottom of the ranking. We explain theoretically howheteroskedasticity can bias the ranking of uplift models and show this processin a simulation and on real-world data. We argue that this problem of rankingbias due to heteroskedasticity might occur in many real-world applications andrequires modification of the treatment prioritization to achieve an efficienttreatment allocation.