WSSL: Weighted Self-supervised Learning Framework For Image-inpainting

  • 2023-08-24 20:28:08
  • Shubham Gupta, Rahul Kunigal Ravishankar, Madhoolika Gangaraju, Poojasree Dwarkanath, Natarajan Subramanyam
  • 0

Abstract

Image inpainting is the process of regenerating lost parts of the image.Supervised algorithm-based methods have shown excellent results but have twosignificant drawbacks. They do not perform well when tested with unseen data.They fail to capture the global context of the image, resulting in a visuallyunappealing result. We propose a novel self-supervised learning framework forimage-inpainting: Weighted Self-Supervised Learning (WSSL) to tackle theseproblems. We designed WSSL to learn features from multiple weighted pretexttasks. These features are then utilized for the downstream task,image-inpainting. To improve the performance of our framework and produce morevisually appealing images, we also present a novel loss function for imageinpainting. The loss function takes advantage of both reconstruction loss andperceptual loss functions to regenerate the image. Our experimentation showsWSSL outperforms previous methods, and our loss function helps produce betterresults.

 

Quick Read (beta)

loading the full paper ...