Modeling Camera Effects to Improve Visual Learning from Synthetic Data

  • 2018-09-17 15:28:40
  • Alexandra Carlson, Katherine A. Skinner, Ram Vasudevan, Matthew Johnson-Roberson
  • 0

Abstract

Recent work has focused on generating synthetic imagery to increase the sizeand variability of training data for learning visual tasks in urban scenes.This includes increasing the occurrence of occlusions or varying environmentaland weather effects. However, few have addressed modeling variation in thesensor domain. Sensor effects can degrade real images, limitinggeneralizability of network performance on visual tasks trained on syntheticdata and tested in real environments. This paper proposes an efficient,automatic, physically-based augmentation pipeline to vary sensor effects--chromatic aberration, blur, exposure, noise, and color cast-- for syntheticimagery. In particular, this paper illustrates that augmenting synthetictraining datasets with the proposed pipeline reduces the domain gap betweensynthetic and real domains for the task of object detection in urban drivingscenes.

 

Quick Read (beta)

loading the full paper ...