Abstract
With the increasing availability of large databases of 3D CAD models,depth-based recognition methods can be trained on an uncountable number ofsynthetically rendered images. However, discrepancies with the real dataacquired from various depth sensors still noticeably impede progress. Previousworks adopted unsupervised approaches to generate more realistic depth data,but they all require real scans for training, even if unlabeled. This stillrepresents a strong requirement, especially when consideringreal-life/industrial settings where real training images are hard or impossibleto acquire, but texture-less 3D models are available. We thus propose a novelapproach leveraging only CAD models to bridge the realism gap. Purely trainedon synthetic data, playing against an extensive augmentation pipeline in anunsupervised manner, our generative adversarial network learns to effectivelysegment depth images and recover the clean synthetic-looking depth informationeven from partial occlusions. As our solution is not only fully decoupled fromthe real domains but also from the task-specific analytics, the pre-processedscans can be handed to any kind and number of recognition methods also trainedon synthetic data. Through various experiments, we demonstrate how thissimplifies their training and consistently enhances their performance, withresults on par with the same methods trained on real data, and better thanusual approaches doing the reverse mapping.