Abstract
Recent advances in deep neural networks have been developed via architecturesearch for stronger representational power. In this work, we focus on theeffect of attention in general deep neural networks. We propose a simple andeffective attention module, named Bottleneck Attention Module (BAM), that canbe integrated with any feed-forward convolutional neural networks. Our moduleinfers an attention map along two separate pathways, channel and spatial. Weplace our module at each bottleneck of models where the downsampling of featuremaps occurs. Our module constructs a hierarchical attention at bottlenecks witha number of parameters and it is trainable in an end-to-end manner jointly withany feed-forward models. We validate our BAM through extensive experiments onCIFAR-100, ImageNet-1K, VOC 2007 and MS COCO benchmarks. Our experiments showconsistent improvement in classification and detection performances withvarious models, demonstrating the wide applicability of BAM. The code andmodels will be publicly available.