• 结合暗光增强与密集卷积的双模态视觉图像融合

    Dual-modal visual image fusion combining low-light enhancement and dense convolution

    • 针对夜间及低照度场景下多模态图像融合易出现的视觉退化问题,本文构建了一种融合自适应光照补偿网络与跨模态特征交互模块的双路径对抗生成框架。首先,设计亮度感知的可见光图像校正单元,通过光照强度量化生成区域增强权重,优化暗区视觉特征。其次,在特征提取阶段引入交叉注意力机制与残差密集块,通过通道级特征重标定实现红外目标结构特征与可见光高频纹理的协同表达。最后,构建双路径判别网络,分别建模红外对比度特征与可见光细节分布,以缓解单判别器导致的模态特征偏移问题。在LLVIP数据集上的测试结果表明,该方法在信息熵、相关系数与视觉信息保真度三个客观评价指标上均有较优表现。

       

      Abstract: To address the issue of visual degradation in multi-modal image fusion under nighttime or low-light conditions, this paper proposes a dual-path adversarial generation framework that integrates an adaptive illumination compensation network and a cross-modal feature interaction module. First, a luminance-aware visible image correction unit is designed, which generates region enhancement weights by quantifying illumination intensity, thereby enhancing visual features in dark areas. Second, during the feature extraction stage, a cross-attention mechanism and residual dense blocks are introduced to strengthen the collaborative representation of infrared target structural features and visible high-frequency textures through channel-level feature recalibration. Finally, a dual-path discriminative network is constructed to separately model infrared contrast features and visible detail distributions, mitigating the modal feature bias caused by a single discriminator. Experiments conducted on the LLVIP dataset demonstrate that the proposed method achieves competitive performance in three objective metrics: information entropy, correlation coefficient, and visual information fidelity.

       

    /

    返回文章
    返回