Abstract
Neural radiance fields (NeRF) methods have demonstrated impressive novel viewsynthesis performance. The core approach is to render individual rays byquerying a neural network at points sampled along the ray to obtain the densityand colour of the sampled points, and integrating this information using therendering equation. Since dense sampling is computationally prohibitive, acommon solution is to perform coarse-to-fine sampling. In this work we address a clear limitation of the vanilla coarse-to-fineapproach -- that it is based on a heuristic and not trained end-to-end for thetask at hand. We introduce a differentiable module that learns to proposesamples and their importance for the fine network, and consider and comparemultiple alternatives for its neural architecture. Training the proposal modulefrom scratch can be unstable due to lack of supervision, so an effectivepre-training strategy is also put forward. The approach, named `NeRF in detail'(NeRF-ID), achieves superior view synthesis quality over NeRF and thestate-of-the-art on the synthetic Blender benchmark and on par or betterperformance on the real LLFF-NeRF scenes. Furthermore, by leveraging thepredicted sample importance, a 25% saving in computation can be achievedwithout significantly sacrificing the rendering quality.