Abstract
In many robotics and VR/AR applications, fast camera motions cause a highlevel of motion blur, causing existing camera pose estimation methods to fail.In this work, we propose a novel framework that leverages motion blur as a richcue for motion estimation rather than treating it as an unwanted artifact. Ourapproach works by predicting a dense motion flow field and a monocular depthmap directly from a single motion-blurred image. We then recover theinstantaneous camera velocity by solving a linear least squares problem underthe small motion assumption. In essence, our method produces an IMU-likemeasurement that robustly captures fast and aggressive camera movements. Totrain our model, we construct a large-scale dataset with realistic syntheticmotion blur derived from ScanNet++v2 and further refine our model by trainingend-to-end on real data using our fully differentiable pipeline. Extensiveevaluations on real-world benchmarks demonstrate that our method achievesstate-of-the-art angular and translational velocity estimates, outperformingcurrent methods like MASt3R and COLMAP.