Deep Neural Network Calibration by Reducing Classifier Shift with Stochastic Masking

  • 2025-08-12 17:50:23
  • Jiani Ni, He Zhao, Yibo Yang, Dandan Guo
  • 0

Abstract

In recent years, deep neural networks (DNNs) have shown competitive resultsin many fields. Despite this success, they often suffer from poor calibration,especially in safety-critical scenarios such as autonomous driving andhealthcare, where unreliable confidence estimates can lead to seriousconsequences. Recent studies have focused on improving calibration by modifyingthe classifier, yet such efforts remain limited. Moreover, most existingapproaches overlook calibration errors caused by underconfidence, which can beequally detrimental. To address these challenges, we propose MaC-Cal, a novelmask-based classifier calibration method that leverages stochastic sparsity toenhance the alignment between confidence and accuracy. MaC-Cal adopts atwo-stage training scheme with adaptive sparsity, dynamically adjusting maskretention rates based on the deviation between confidence and accuracy.Extensive experiments show that MaC-Cal achieves superior calibrationperformance and robustness under data corruption, offering a practical andeffective solution for reliable confidence estimation in DNNs.

 

Quick Read (beta)

loading the full paper ...