Abstract
Deep generative models have shown promising results in generating realisticimages, but it is still non-trivial to generate images with complicatedstructures. The main reason is that most of the current generative models failto explore the structures in the images including spatial layout and semanticrelations between objects. To address this issue, we propose a novel deepstructured generative model which boosts generative adversarial networks (GANs)with the aid of structure information. In particular, the layout or structureof the scene is encoded by a stochastic and-or graph (sAOG), in which theterminal nodes represent single objects and edges represent relations betweenobjects. With the sAOG appropriately harnessed, our model can successfullycapture the intrinsic structure in the scenes and generate images ofcomplicated scenes accordingly. Furthermore, a detection network is introducedto infer scene structures from a image. Experimental results demonstrate theeffectiveness of our proposed method on both modeling the intrinsic structures,and generating realistic images.