Abstract
Performance on benchmark datasets has drastically improved with advances indeep learning. Still, cross- dataset generalization performance remainsrelatively low due to the domain shift that can occur between two differentdatasets. This domain shift is especially exaggerated between synthetic andreal datasets. Significant research has been done to reduce this gap,specifically via modeling variation in the spatial layout of a scene, such asocclusions, and scene environmental factors, such as time of day and weathereffects. However, few works have addressed modeling the variation in the sensordomain as a means of reducing the synthetic to real domain gap. The camera orsensor used to capture a dataset introduces artifacts into the image data thatare unique to the sensor model, suggesting that sensor effects may alsocontribute to domain shift. To address this, we propose a learned augmentationnetwork composed of physically-based augmentation functions. Our proposedaugmentation pipeline transfers specific effects of the sensor model--chromatic aberration, blur, exposure, noise, and color temperature-- from areal dataset to a synthetic dataset. We provide experiments that demonstratethat augmenting synthetic training datasets with the proposed learnedaugmentation framework reduces the domain gap between synthetic and realdomains for object detection in urban driving scenes.