Abstract
Simulation is a useful tool in situations where training data for machinelearning models is costly to annotate or even hard to acquire. In this work, wepropose a reinforcement learning-based method for automatically adjusting theparameters of any (non-differentiable) simulator, thereby controlling thedistribution of synthesized data in order to maximize the accuracy of a modeltrained on that data. In contrast to prior art that hand-crafts thesesimulation parameters or adjusts only parts of the available parameters, ourapproach fully controls the simulator with the actual underlying goal ofmaximizing accuracy, rather than mimicking the real data distribution orrandomly generating a large volume of data. We find that our approach (i)quickly converges to the optimal simulation parameters in controlledexperiments and (ii) can indeed discover good sets of parameters for an imagerendering simulator in actual computer vision applications.