SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentation

  • 2022-09-18 15:33:49
  • Meng-Hao Guo, Cheng-Ze Lu, Qibin Hou, Zhengning Liu, Ming-Ming Cheng, Shi-Min Hu
  • 28

Abstract

We present SegNeXt, a simple convolutional network architecture for semanticsegmentation. Recent transformer-based models have dominated the field ofsemantic segmentation due to the efficiency of self-attention in encodingspatial information. In this paper, we show that convolutional attention is amore efficient and effective way to encode contextual information than theself-attention mechanism in transformers. By re-examining the characteristicsowned by successful segmentation models, we discover several key componentsleading to the performance improvement of segmentation models. This motivatesus to design a novel convolutional attention network that uses cheapconvolutional operations. Without bells and whistles, our SegNeXt significantlyimproves the performance of previous state-of-the-art methods on popularbenchmarks, including ADE20K, Cityscapes, COCO-Stuff, Pascal VOC, PascalContext, and iSAID. Notably, SegNeXt outperforms EfficientNet-L2 w/ NAS-FPN andachieves 90.6% mIoU on the Pascal VOC 2012 test leaderboard using only 1/10parameters of it. On average, SegNeXt achieves about 2.0% mIoU improvementscompared to the state-of-the-art methods on the ADE20K datasets with the sameor fewer computations. Code is available at https://github.com/uyzhang/JSeg(Jittor) and https://github.com/Visual-Attention-Network/SegNeXt (Pytorch).

 

Quick Read (beta)

loading the full paper ...