GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering

  • 2020-10-09 14:21:43
  • Alex Trevithick, Bo Yang
  • 38

Abstract

We present a simple yet powerful implicit neural function that can representand render arbitrarily complex 3D scenes in a single network only from 2Dobservations. The function models 3D scenes as a general radiance field, whichtakes a set of posed 2D images as input, constructs an internal representationfor each 3D point of the scene, and renders the corresponding appearance andgeometry of any 3D point viewing from an arbitrary angle. The key to ourapproach is to explicitly integrate the principle of multi-view geometry toobtain the internal representations from observed 2D views, guaranteeing thelearned implicit representations meaningful and multi-view consistent. Inaddition, we introduce an effective neural module to learn general features foreach pixel in 2D images, allowing the constructed internal 3D representationsto be remarkably general as well. Extensive experiments demonstrate thesuperiority of our approach.

 

Quick Read (beta)

loading the full paper ...