Abstract
Unsupervised panoptic segmentation aims to partition an image intosemantically meaningful regions and distinct object instances without trainingon manually annotated data. In contrast to prior work on unsupervised panopticscene understanding, we eliminate the need for object-centric training data,enabling the unsupervised understanding of complex scenes. To that end, wepresent the first unsupervised panoptic method that directly trains onscene-centric imagery. In particular, we propose an approach to obtainhigh-resolution panoptic pseudo labels on complex scene-centric data, combiningvisual representations, depth, and motion cues. Utilizing both pseudo-labeltraining and a panoptic self-training strategy yields a novel approach thataccurately predicts panoptic segmentation of complex scenes without requiringany human annotations. Our approach significantly improves panoptic quality,e.g., surpassing the recent state of the art in unsupervised panopticsegmentation on Cityscapes by 9.4% points in PQ.