一种全天候道路场景下的红外和可见光图像融合方法

A Fusion Method for Infrared and Visible Images in All-Weather Road Scenes

  • 摘要: 结合红外图像的高亮目标信息与可见光图像丰富的纹理细节,可以生成同时包含丰富纹理和显著目标的融合图像,但受限于光照条件和恶劣天气,现有的红外和可见光图像融合方法在全天候道路应用场景中难以得到理想的效果。针对此问题,提出了一种适用于全天候道路场景的红外和可见光图像融合网络。首先,通过光照损失函数设计指导融合网络自适应地保持背景纹理细节和显著目标的强度分布;然后,在纹理损失函数中引入Scharr梯度算子提高梯度计算精度,从而约束融合图像,保留更细腻的纹理细节;最后,基于Resblock结构设计了二阶梯度残差块,以增强融合网络提取图像强弱纹理特征的能力。在公开数据集MFNet、RoadScene和TNO上对该方法进行了对比实验和泛化实验,结果表明,所提方法在主观视觉效果和客观指标评价上均优于其他先进方法,得到的融合图像纹理清晰且红外目标显著。因此,所提出的3种优化设计可以提高可见光和红外图像的融合效果。

     

    Abstract:
    Objectives The objective of infrared and visible image fusion in the all-weather road scenes is to generate fusion images that contain rich textures and significant goals. However, due to the influence of light conditions and harsh weather factors, the existing infrared and visible image fusion algorithm is difficult to achieve the ideal effect.
    Methods In response to this issue, an infrared and visible image fusion network suitable for all -weather road scenes was proposed. First, we designed an illumination loss function that can guide the intensity distribution of the background texture and the intensity of significant goals in the adaptive network. Second, the introduction of the Scharr gradient to improve the calculation accuracy of the gradient of texture loss, and restrict the fusion image to retain more delicate texture details. Finally, we designed the second order residual block based on the Resblock structure to enhance the ability to integrate network extraction of strong and weak texture features of images.
    Results Comparison and generalization experiments on MFNet, RoadScene, and TNO data sets show that the proposed method is better than other advanced methods in subjective visual effects and objective indicators.
    Conclusions Therefore, the three optimized designs the proposed can improve the fusion effect of visible and infrared images.

     

/

返回文章
返回