Fully Convolutional Network with Multi-Step Reinforcement Learning for Image Processing

  • 2018-11-13 15:58:01
  • Ryosuke Furuta, Naoto Inoue, Toshihiko Yamasaki
  • 0

Abstract

This paper tackles a new problem setting: reinforcement learning withpixel-wise rewards (pixelRL) for image processing. After the introduction ofthe deep Q-network, deep RL has been achieving great success. However, theapplications of deep RL for image processing are still limited. Therefore, weextend deep RL to pixelRL for various image processing applications. InpixelRL, each pixel has an agent, and the agent changes the pixel value bytaking an action. We also propose an effective learning method for pixelRL thatsignificantly improves the performance by considering not only the futurestates of the own pixel but also those of the neighbor pixels. The proposedmethod can be applied to some image processing tasks that require pixel-wisemanipulations, where deep RL has never been applied. We apply the proposedmethod to three image processing tasks: image denoising, image restoration, andlocal color enhancement. Our experimental results demonstrate that the proposedmethod achieves comparable or better performance, compared with thestate-of-the-art methods based on supervised learning.

 

Quick Read (beta)

loading the full paper ...