Abstract
We present a system for training deep neural networks for object detectionusing synthetic images. To handle the variability in real-world data, thesystem relies upon the technique of domain randomization, in which theparameters of the simulator$-$such as lighting, pose, object textures,etc.$-$are randomized in non-realistic ways to force the neural network tolearn the essential features of the object of interest. We explore theimportance of these parameters, showing that it is possible to produce anetwork with compelling performance using only non-artistically-generatedsynthetic data. With additional fine-tuning on real data, the network yieldsbetter performance than using real data alone. This result opens up thepossibility of using inexpensive synthetic data for training neural networkswhile avoiding the need to collect large amounts of hand-annotated real-worlddata or to generate high-fidelity synthetic worlds$-$both of which remainbottlenecks for many applications. The approach is evaluated on bounding boxdetection of cars on the KITTI dataset.