Abstract
Motion blurry images challenge many computer vision algorithms, e.g, featuredetection, motion estimation, or object recognition. Deep convolutional neuralnetworks are state-of-the-art for image deblurring. However, obtaining trainingdata with corresponding sharp and blurry image pairs can be difficult. In thispaper, we present a differentiable reblur model for self-supervised motiondeblurring, which enables the network to learn from real-world blurry imagesequences without relying on sharp images for supervision. Our key insight isthat motion cues obtained from consecutive images yield sufficient informationto inform the deblurring task. We therefore formulate deblurring as an inverserendering problem, taking into account the physical image formation process: wefirst predict two deblurred images from which we estimate the correspondingoptical flow. Using these predictions, we re-render the blurred images andminimize the difference with respect to the original blurry inputs. We use bothsynthetic and real dataset for experimental evaluations. Our experimentsdemonstrate that self-supervised single image deblurring is really feasible andleads to visually compelling results.