Abstract
This paper tackles the problem of the worst-class error rate, instead of thestandard error rate averaged over all classes. For example, a three-classclassification task with class-wise error rates of 10%, 10%, and 40% has aworst-class error rate of 40%, whereas the average is 20% under theclass-balanced condition. The worst-class error is important in manyapplications. For example, in a medical image classification task, it would notbe acceptable for the malignant tumor class to have a 40% error rate, while thebenign and healthy classes have a 10% error rates. To avoid overfitting inworst-class error minimization using Deep Neural Networks (DNNs), we design aproblem formulation for bounding the worst-class error instead of achievingzero worst-class error. Moreover, to correctly bound the worst-class error, wepropose a boosting approach which ensembles DNNs. We give training andgeneralization worst-class-error bound. Experimental results show that thealgorithm lowers worst-class test error rates while avoiding overfitting to thetraining set. This code is available athttps://github.com/saito-yuya/Bounding-the-Worst-class-error-A-Boosting-Approach.