Abstract
The view synthesis problem--generating novel views of a scene from knownimagery--has garnered recent attention due in part to compelling applicationsin virtual and augmented reality. In this paper, we explore an intriguingscenario for view synthesis: extrapolating views from imagery captured bynarrow-baseline stereo cameras, including VR cameras and now-widespreaddual-lens camera phones. We call this problem stereo magnification, and proposea learning framework that leverages a new layered representation that we callmultiplane images (MPIs). Our method also uses a massive new data source forlearning view extrapolation: online videos on YouTube. Using data mined fromsuch videos, we train a deep network that predicts an MPI from an input stereoimage pair. This inferred MPI can then be used to synthesize a range of novelviews of the scene, including views that extrapolate significantly beyond theinput baseline. We show that our method compares favorably with several recentview synthesis methods, and demonstrate applications in magnifyingnarrow-baseline stereo images.