Abstract
Convolutional neural networks (CNNs) have shown remarkable results over thelast several years for a wide range of computer vision tasks. A newarchitecture recently introduced by Sabour et al., referred to as a capsulenetworks with dynamic routing, has shown great initial results for digitrecognition and small image classification. The success of capsule networkslies in their ability to preserve more information about the input by replacingmax-pooling layers with convolutional strides and dynamic routing, allowing forpreservation of part-whole relationships in the data. This preservation of theinput is demonstrated by reconstructing the input from the output capsulevectors. Our work expands the use of capsule networks to the task of objectsegmentation for the first time in the literature. We extend the idea ofconvolutional capsules with locally-connected routing and propose the conceptof deconvolutional capsules. Further, we extend the masked reconstruction toreconstruct the positive input class. The proposedconvolutional-deconvolutional capsule network, called SegCaps, shows strongresults for the task of object segmentation with substantial decrease inparameter space. As an example application, we applied the proposed SegCaps tosegment pathological lungs from low dose CT scans and compared its accuracy andefficiency with other U-Net-based architectures. SegCaps is able to handlelarge image sizes (512 x 512) as opposed to baseline capsules (typically lessthan 32 x 32). The proposed SegCaps reduced the number of parameters of U-Netarchitecture by 95.4% while still providing a better segmentation accuracy.