Abstract
Neural radiance fields (NeRFs) produce state-of-the-art view synthesisresults. However, they are slow to render, requiring hundreds of networkevaluations per pixel to approximate a volume rendering integral. Baking NeRFsinto explicit data structures enables efficient rendering, but results in alarge increase in memory footprint and, in many cases, a quality reduction. Inthis paper, we propose a novel neural light field representation that, incontrast, is compact and directly predicts integrated radiance along rays. Ourmethod supports rendering with a single network evaluation per pixel for smallbaseline light field datasets and can also be applied to larger baselines withonly a few evaluations per pixel. At the core of our approach is a ray-spaceembedding network that maps the 4D ray-space manifold into an intermediate,interpolable latent space. Our method achieves state-of-the-art quality ondense forward-facing datasets such as the Stanford Light Field dataset. Inaddition, for forward-facing scenes with sparser inputs we achieve results thatare competitive with NeRF-based approaches in terms of quality while providinga better speed/quality/memory trade-off with far fewer network evaluations.