A Closed-form Solution to Photorealistic Image Stylization

  • 2018-02-22 17:38:42
  • Yijun Li, Ming-Yu Liu, Xueting Li, Ming-Hsuan Yang, Jan Kautz
  • 1

Abstract

Photorealistic image style transfer algorithms aim at stylizing a contentphoto using the style of a reference photo with the constraint that thestylized photo should remains photorealistic. While several methods exist forthis task, they tend to generate spatially inconsistent stylizations withnoticeable artifacts. In addition, these methods are computationally expensive,requiring several minutes to stylize a VGA photo. In this paper, we present anovel algorithm to address the limitations. The proposed algorithm consists ofa stylization step and a smoothing step. While the stylization step transfersthe style of the reference photo to the content photo, the smoothing stepencourages spatially consistent stylizations. Unlike existing algorithms thatrequire iterative optimization, both steps in our algorithm have closed-formsolutions. Experimental results show that the stylized photos generated by ouralgorithm are twice more preferred by human subjects in average. Moreover, ourmethod runs 60 times faster than the state-of-the-art approach. Code andadditional results are available at https://github.com/NVIDIA/FastPhotoStyle .

 

Quick Read (beta)

loading the full paper ...