机构:[1]Faculty of Information Engineering and Automation and the Yunnan Provincial Key Laboratory of Artificial Intelligence, Kunming University of Science and Technology, Kunming 650500, China[2]Department of Anesthesiology, Affiliated Hospital of Kunming University of Science and Technology, Kunming 650031, China
Recently, infrared & x2013;visible image fusion has attracted more and more attention, and numerous excellent methods in this field have emerged. However, when the low-resolution images are being fused, most fusion results are of low resolution, limiting the practical application of the fusion results. Although some methods can simultaneously realize the fusion and super-resolution of low-resolution images, the improvement of fusion performance is limited due to the lack of guidance of high-resolution fusion results. To address this issue, we propose a heterogeneous knowledge distillation network (HKDnet) with multilayer attention embedding to jointly implement the fusion and super-resolution of infrared and visible images. Precisely, the proposed method consists of a high-resolution image fusion network (teacher network) and a low-resolution image fusion and super-resolution network (student network). The teacher network mainly fuses the high-resolution input images and guides the student network to obtain the ability of joint implementation of fusion and super-resolution. In order to make the student network pay more attention to the texture details of the visible input image, we designed a corner embedding attention mechanism. The mechanism integrates channel attention, position attention, and corner attention to highlight the visible image & x2019;s edge, texture, and structure. For the input infrared image, the dual-frequency attention (DFA) is constructed by mining the relationship of interlayer features to highlight the role of salient targets of the infrared image in the fusion result. The experimental results show that compared with the existing methods, the proposed method preserves the image information of both visible and infrared modalities, achieves sound visual effects, and displays accurate and natural texture details. The code of the proposed method can be available at <uri>https://github.com/firewaterfire/HKDnet</uri>.
基金:
National Natural Science Foundation of ChinaNational Natural Science Foundation of China (NSFC) [62161015]
第一作者机构:[1]Faculty of Information Engineering and Automation and the Yunnan Provincial Key Laboratory of Artificial Intelligence, Kunming University of Science and Technology, Kunming 650500, China
共同第一作者:
通讯作者:
推荐引用方式(GB/T 7714):
Xiao Wanxin,Zhang Yafei,Wang Hongbin,et al.Heterogeneous Knowledge Distillation for Simultaneous Infrared-Visible Image Fusion and Super-Resolution[J].IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT.2022,71:doi:10.1109/TIM.2022.3149101.
APA:
Xiao, Wanxin,Zhang, Yafei,Wang, Hongbin,Li, Fan&Jin, Hua.(2022).Heterogeneous Knowledge Distillation for Simultaneous Infrared-Visible Image Fusion and Super-Resolution.IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT,71,
MLA:
Xiao, Wanxin,et al."Heterogeneous Knowledge Distillation for Simultaneous Infrared-Visible Image Fusion and Super-Resolution".IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT 71.(2022)