Abstract
We present a simple, fully-convolutional model for real-time instancesegmentation that achieves 29.8 mAP on MS COCO at 33 fps evaluated on a singleTitan Xp, which is significantly faster than any previous competitive approach.Moreover, we obtain this result after training on only one GPU. We accomplishthis by breaking instance segmentation into two parallel subtasks: (1)generating a set of prototype masks and (2) predicting per-instance maskcoefficients. Then we produce instance masks by linearly combining theprototypes with the mask coefficients. We find that because this processdoesn't depend on repooling, this approach produces very high-quality masks andexhibits temporal stability for free. Furthermore, we analyze the emergentbehavior of our prototypes and show they learn to localize instances on theirown in a translation variant manner, despite being fully-convolutional.Finally, we also propose Fast NMS, a drop-in 12 ms faster replacement forstandard NMS that only has a marginal performance penalty.