Abstract
Out-of-distribution (OOD) detection is essential for ensuring the reliabilityand safety of machine learning systems. In recent years, it has receivedincreasing attention, particularly through post-hoc detection andtraining-based methods. In this paper, we focus on post-hoc OOD detection,which enables identifying OOD samples without altering the model's trainingprocedure or objective. Our primary goal is to investigate the relationshipbetween model capacity and its OOD detection performance. Specifically, we aimto answer the following question: Does the Double Descent phenomenon manifestin post-hoc OOD detection? This question is crucial, as it can reveal whetheroverparameterization, which is already known to benefit generalization, canalso enhance OOD detection. Despite the growing interest in these topics by theclassic supervised machine learning community, this intersection remainsunexplored for OOD detection. We empirically demonstrate that the DoubleDescent effect does indeed appear in post-hoc OOD detection. Furthermore, weprovide theoretical insights to explain why this phenomenon emerges in suchsetting. Finally, we show that the overparameterized regime does not yieldsuperior results consistently, and we propose a method to identify the optimalregime for OOD detection based on our observations.