High-Resolution Deep Image Matting

  • 2020-09-14 17:53:15
  • Haichao Yu, Ning Xu, Zilong Huang, Yuqian Zhou, Humphrey Shi
  • 21

Abstract

Image matting is a key technique for image and video editing and composition.Conventionally, deep learning approaches take the whole input image and anassociated trimap to infer the alpha matte using convolutional neural networks.Such approaches set state-of-the-arts in image matting; however, they may failin real-world matting applications due to hardware limitations, sincereal-world input images for matting are mostly of very high resolution. In thispaper, we propose HDMatt, a first deep learning based image matting approachfor high-resolution inputs. More concretely, HDMatt runs matting in apatch-based crop-and-stitch manner for high-resolution inputs with a novelmodule design to address the contextual dependency and consistency issuesbetween different patches. Compared with vanilla patch-based inference whichcomputes each patch independently, we explicitly model the cross-patchcontextual dependency with a newly-proposed Cross-Patch Contextual module (CPC)guided by the given trimap. Extensive experiments demonstrate the effectivenessof the proposed method and its necessity for high-resolution inputs. Our HDMattapproach also sets new state-of-the-art performance on Adobe Image Matting andAlphaMatting benchmarks and produce impressive visual results on morereal-world high-resolution images.

 

Quick Read (beta)

loading the full paper ...