Abstract
Much of the recent progress made in image classification research can becredited to training procedure refinements, such as changes in dataaugmentations and optimization methods. In the literature, however, mostrefinements are either briefly mentioned as implementation details or onlyvisible in source code. In this paper, we will examine a collection of suchrefinements and empirically evaluate their impact on the final model accuracythrough ablation study. We will show that, by combining these refinementstogether, we are able to improve various CNN models significantly. For example,we raise ResNet-50's top-1 validation accuracy from 75.3% to 79.29% onImageNet. We will also demonstrate that improvement on image classificationaccuracy leads to better transfer learning performance in other applicationdomains such as object detection and semantic segmentation.