Abstract

Traditional approaches for color propagation in videos rely on some form ofmatching between consecutive video frames. Using appearance descriptors, colorsare then propagated both spatially and temporally. These methods, however, arecomputationally expensive and do not take advantage of semantic information ofthe scene. In this work we propose a deep learning framework for colorpropagation that combines a local strategy, to propagate colors frame-by-frameensuring temporal stability, and a global strategy, using semantics for colorpropagation within a longer range. Our evaluation shows the superiority of ourstrategy over existing video and image color propagation methods as well asneural photo-realistic style transfer approaches.

 

Quick Read (beta)