Abstract
In this paper, we propose a general framework for image classification usingthe attention mechanism and global context, which could incorporate withvarious network architectures to improve their performance. To investigate thecapability of the global context, we compare four mathematical models andobserve the global context encoded in the category disentangled conditionalgenerative model could give more guidance as "know what is task irrelevant willalso know what is relevant". Based on this observation, we define a novelCategory Disentangled Global Context (CDGC) and devise a deep network to obtainit. By attending CDGC, the baseline networks could identify the objects ofinterest more accurately, thus improving the performance. We apply theframework to many different network architectures and compare with thestate-of-the-art on four publicly available datasets. Extensive resultsvalidate the effectiveness and superiority of our approach. Code will be madepublic upon paper acceptance.