Abstract
We study the robustness of conformal prediction, a powerful tool foruncertainty quantification, to label noise. Our analysis tackles bothregression and classification problems, characterizing when and how it ispossible to construct uncertainty sets that correctly cover the unobservednoiseless ground truth labels. Through stylized theoretical examples andpractical experiments, we argue that naive conformal prediction covers thenoiseless ground truth label unless the noise distribution is adversariallydesigned. This leads us to believe that correcting for label noise isunnecessary except for pathological data distributions or noise sources. Insuch cases, we can also correct for noise of bounded size in the conformalprediction algorithm in order to ensure correct coverage of the ground truthlabels without score or data regularity.