Abstract
In the evolving landscape of video enhancement and editing methodologies, amajority of deep learning techniques often rely on extensive datasets ofobserved input and ground truth sequence pairs for optimal performance. Suchreliance often falters when acquiring data becomes challenging, especially intasks like video dehazing and relighting, where replicating identical motionsand camera angles in both corrupted and ground truth sequences is complicated.Moreover, these conventional methodologies perform best when the testdistribution closely mirrors the training distribution. Recognizing thesechallenges, this paper introduces a novel video decomposition prior `VDP'framework which derives inspiration from professional video editing practices.Our methodology does not mandate task-specific external data corpus collection,instead pivots to utilizing the motion and appearance of the input video. VDPframework decomposes a video sequence into a set of multiple RGB layers andassociated opacity levels. These set of layers are then manipulatedindividually to obtain the desired results. We addresses tasks such as videoobject segmentation, dehazing, and relighting. Moreover, we introduce a novellogarithmic video decomposition formulation for video relighting tasks, settinga new benchmark over the existing methodologies. We observe the property ofrelighting emerge as we optimize for our novel relighting decompositionformulation. We evaluate our approach on standard video datasets like DAVIS,REVIDE, & SDSD and show qualitative results on a diverse array of internetvideos. Project Page -https://www.cs.umd.edu/~gauravsh/video_decomposition/index.html for videoresults.