Abstract
Neural Radiance Fields (NeRFs) have shown remarkable novel view synthesiscapabilities even in large-scale, unbounded scenes, albeit requiring hundredsof views or introducing artifacts in sparser settings. Their optimizationsuffers from shape-radiance ambiguities wherever only a small visual overlap isavailable. This leads to erroneous scene geometry and artifacts. In this paper,we propose Re-Nerfing, a simple and general multi-stage data augmentationapproach that leverages NeRF's own view synthesis ability to address theselimitations. With Re-Nerfing, we enhance the geometric consistency of novelviews as follows: First, we train a NeRF with the available views. Then, we usethe optimized NeRF to synthesize pseudo-views around the original ones with aview selection strategy to improve coverage and preserve view quality. Finally,we train a second NeRF with both the original images and the pseudo viewsmasking out uncertain regions. Extensive experiments applying Re-Nerfing onvarious pipelines on the mip-NeRF 360 dataset, including Gaussian Splatting,provide valuable insights into the improvements achievable without externaldata or supervision, on denser and sparser input scenarios. Project page:https://renerfing.github.io