Abstract

Deep neural networks (DNNs) have shown remarkable performance improvements onvision-related tasks such as object detection or image segmentation. Despitetheir success, they generally lack the understanding of 3D objects which formthe image, as it is not always possible to collect 3D information about thescene or to easily annotate it. Differentiable rendering is a novel field whichallows the gradients of 3D objects to be calculated and propagated throughimages. It also reduces the requirement of 3D data collection and annotation,while enabling higher success rate in various applications. This paper reviewsexisting literature and discusses the current state of differentiablerendering, its applications and open research problems.

 

Quick Read (beta)