高级检索
当前位置: 首页 > 详情页

Heterogeneous Knowledge Distillation for Simultaneous Infrared-Visible Image Fusion and Super-Resolution

文献详情

资源类型:
WOS体系:

收录情况: ◇ SCIE

机构: [1]Faculty of Information Engineering and Automation and the Yunnan Provincial Key Laboratory of Artificial Intelligence, Kunming University of Science and Technology, Kunming 650500, China [2]Department of Anesthesiology, Affiliated Hospital of Kunming University of Science and Technology, Kunming 650031, China
出处:
ISSN:

关键词: Image fusion Superresolution Knowledge engineering Feature extraction Training Task analysis Image edge detection Attention mechanism image fusion infrared and visible images knowledge distillation super-resolution

摘要:
Recently, infrared & x2013;visible image fusion has attracted more and more attention, and numerous excellent methods in this field have emerged. However, when the low-resolution images are being fused, most fusion results are of low resolution, limiting the practical application of the fusion results. Although some methods can simultaneously realize the fusion and super-resolution of low-resolution images, the improvement of fusion performance is limited due to the lack of guidance of high-resolution fusion results. To address this issue, we propose a heterogeneous knowledge distillation network (HKDnet) with multilayer attention embedding to jointly implement the fusion and super-resolution of infrared and visible images. Precisely, the proposed method consists of a high-resolution image fusion network (teacher network) and a low-resolution image fusion and super-resolution network (student network). The teacher network mainly fuses the high-resolution input images and guides the student network to obtain the ability of joint implementation of fusion and super-resolution. In order to make the student network pay more attention to the texture details of the visible input image, we designed a corner embedding attention mechanism. The mechanism integrates channel attention, position attention, and corner attention to highlight the visible image & x2019;s edge, texture, and structure. For the input infrared image, the dual-frequency attention (DFA) is constructed by mining the relationship of interlayer features to highlight the role of salient targets of the infrared image in the fusion result. The experimental results show that compared with the existing methods, the proposed method preserves the image information of both visible and infrared modalities, achieves sound visual effects, and displays accurate and natural texture details. The code of the proposed method can be available at <uri>https://github.com/firewaterfire/HKDnet</uri>.

基金:
语种:
被引次数:
WOS:
中科院(CAS)分区:
出版当年[2022]版:
大类 | 2 区 工程技术
小类 | 2 区 工程:电子与电气 2 区 仪器仪表
最新[2025]版:
大类 | 2 区 工程技术
小类 | 2 区 工程:电子与电气 2 区 仪器仪表
JCR分区:
出版当年[2021]版:
Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Q1 INSTRUMENTS & INSTRUMENTATION
最新[2023]版:
Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Q1 INSTRUMENTS & INSTRUMENTATION

影响因子: 最新[2023版] 最新五年平均 出版当年[2021版] 出版当年五年平均 出版前一年[2020版] 出版后一年[2022版]

第一作者:
第一作者机构: [1]Faculty of Information Engineering and Automation and the Yunnan Provincial Key Laboratory of Artificial Intelligence, Kunming University of Science and Technology, Kunming 650500, China
共同第一作者:
通讯作者:
推荐引用方式(GB/T 7714):
APA:
MLA:

资源点击量:87236 今日访问量:0 总访问量:717 更新日期:2025-04-01 建议使用谷歌、火狐浏览器 常见问题

版权所有©2020 云南省第一人民医院 技术支持:重庆聚合科技有限公司 地址:云南省昆明市西山区金碧路157号