Abstract
We propose a novel video inpainting algorithm that simultaneouslyhallucinates missing appearance and motion (optical flow) information, buildingupon the recent 'Deep Image Prior' (DIP) that exploits convolutional networkarchitectures to enforce plausible texture in static images. In extending DIPto video we make two important contributions. First, we show that coherentvideo inpainting is possible without a priori training. We take a generativeapproach to inpainting based on internal (within-video) learning withoutreliance upon an external corpus of visual data to train a one-size-fits-allmodel for the large space of general videos. Second, we show that such aframework can jointly generate both appearance and flow, whilst exploitingthese complementary modalities to ensure mutual consistency. We show thatleveraging appearance statistics specific to each video achieves visuallyplausible results whilst handling the challenging problem of long-termconsistency.