Infrared and Visible Image Fusion using a Deep Learning Framework

  • 2018-04-19 04:30:08
  • Hui Li, Xiao-Jun Wu, Josef Kittler
  • 30

Abstract

In recent years, deep learning has become a very active research tool whichis used in many image processing fields. In this paper, we propose an effectiveimage fusion method using a deep learning framework to generate a single imagewhich contains all the features from infrared and visible images. First, thesource images are decomposed into base parts and detail content. Then the baseparts are fused by weighted-averaging. For the detail content, we use a deeplearning network to extract multi-layer features. Using these features, we usel_1-norm and weighted-average strategy to generate several candidates of thefused detail content. Once we get these candidates, the max selection strategyis used to get final fused detail content. Finally, the fused image will bereconstructed by combining the fused base part and detail content. Theexperimental results demonstrate that our proposed method achievesstate-of-the-art performance in both objective assessment and visual quality.The Code of our fusion method is available athttps://github.com/exceptionLi/imagefusion_deeplearning.

 

Quick Read (beta)

loading the full paper ...