Volume Feature Rendering for Fast Neural Radiance Field Reconstruction

  • 2023-05-31 08:03:11
  • Kang Han, Wei Xiang, Lu Yu
  • 0

Abstract

Neural radiance fields (NeRFs) are able to synthesize realistic novel viewsfrom multi-view images captured from distinct positions and perspectives. InNeRF's rendering pipeline, neural networks are used to represent a sceneindependently or transform queried learnable feature vector of a point to theexpected color or density. With the aid of geometry guides either in occupancygrids or proposal networks, the number of neural network evaluations can bereduced from hundreds to dozens in the standard volume rendering framework.Instead of rendering yielded color after neural network evaluation, we proposeto render the queried feature vectors of a ray first and then transform therendered feature vector to the final pixel color by a neural network. Thisfundamental change to the standard volume rendering framework requires only onesingle neural network evaluation to render a pixel, which substantially lowersthe high computational complexity of the rendering framework attributed to alarge number of neural network evaluations. Consequently, we can use acomparably larger neural network to achieve a better rendering quality whilemaintaining the same training and rendering time costs. Our model achieves thestate-of-the-art rendering quality on both synthetic and real-world datasetswhile requiring a training time of several minutes.

 

Quick Read (beta)

loading the full paper ...