Abstract
This paper tackles the problem of novel view synthesis (NVS) from 2D imageswithout known camera poses and intrinsics. Among various NVS techniques, NeuralRadiance Field (NeRF) has recently gained popularity due to its remarkablesynthesis quality. Existing NeRF-based approaches assume that the cameraparameters associated with each input image are either directly accessible attraining, or can be accurately estimated with conventional techniques based oncorrespondences, such as Structure-from-Motion. In this work, we propose anend-to-end framework, termed NeRF--, for training NeRF models given only RGBimages, without pre-computed camera parameters. Specifically, we show that thecamera parameters, including both intrinsics and extrinsics, can beautomatically discovered via joint optimisation during the training of the NeRFmodel. On the standard LLFF benchmark, our model achieves comparable novel viewsynthesis results compared to the baseline trained with COLMAP pre-computedcamera parameters. We also conduct extensive analyses to understand the modelbehaviour under different camera trajectories, and show that in scenarios whereCOLMAP fails, our model still produces robust results.