Abstract
Video motion magnification techniques allow us to see small motionspreviously invisible to the naked eyes, such as those of vibrating airplanewings, or swaying buildings under the influence of the wind. Because the motionis small, the magnification results are prone to noise or excessive blurring.The state of the art relies on hand-designed filters to extract representationsthat may not be optimal. In this paper, we seek to learn the filters directlyfrom examples using deep convolutional neural networks. To make trainingtractable, we carefully design a synthetic dataset that captures small motionwell, and use two-frame input for training. We show that the learned filtersachieve high-quality results on real videos, with less ringing artifacts andbetter noise characteristics than previous methods. While our model is nottrained with temporal filters, we found that the temporal filters can be usedwith our extracted representations up to a moderate magnification, enabling afrequency-based motion selection. Finally, we analyze the learned filters andshow that they behave similarly to the derivative filters used in previousworks. Our code, trained model, and datasets will be available online.