Abstract
Recently, there has been growing interest in developing learning-basedmethods to detect and utilize salient semi-global or global structures, such asjunctions, lines, planes, cuboids, smooth surfaces, and all types ofsymmetries, for 3D scene modeling and understanding. However, the ground truthannotations are often obtained via human labor, which is particularlychallenging and inefficient for such tasks due to the large number of 3Dstructure instances (e.g., line segments) and other factors such as viewpointsand occlusions. In this paper, we present a new synthetic dataset,Structured3D, with the aim to providing large-scale photo-realistic images withrich 3D structure annotations for a wide spectrum of structured 3D modelingtasks. We take advantage of the availability of millions of professionalinterior designs and automatically extract 3D structures from them. We generatehigh-quality images with an industry-leading rendering engine. We use oursynthetic dataset in combination with real images to train deep neural networksfor room layout estimation and demonstrate improved performance on benchmarkdatasets.