• 基于交叉推理的单图像去雨方法

    Single image rain removal method based on cross inference

    • 图像去雨任务的核心挑战在于能够干净地去除雨纹,同时完好地保留背景图像的纹理细节。随着网络深度的增加,大多数深度CNN会出现性能饱和、学习能力下降等问题,传统的去雨方法由于网络深度的增加导致背景图像的细节信息丢失。通过实验发现,高层特征虽然丢失了清晰背景,但是雨痕也较少;低层特征虽然保留有雨痕,但是背景清晰。另外,由于Transformer拥有良好的捕获全局信息以及信息融合的能力,提出一种基于交叉推理的图像去雨方法,采用Transformer的网络结构,利用无雨图像的高层特征,给予低层特征的背景以更高的注意力,增强背景修复能力。同时,利用低层的雨痕特征,给予高层特征中的雨痕以更高的注意力,以增强去雨能力。实证结果表明,提出的算法和主流算法相比在几个去雨任务中取得了良好的效果。

       

      Abstract: The core challenge of the image rain removal task is to be able to remove the rain streak cleanly while preserving the texture details of the background image. With the increase of network depth, most deep CNNS will have problems such as performance saturation and learning decline, and the traditional method of rain removal will cause the loss of background image details due to the increase of network depth. Through the experiment, it is found that although the high level features lost the clear background, but also less rain marks. The lower level features retain rain marks, but the background is clear. In addition, Transformer has a good ability to capture global information and information fusion. In this paper, an image rain removal method based on cross-reasoning is proposed. Transformer adopts the network structure and takes advantage of the high level features of rainless images to pay more attention to the background of low level features and enhance the background repair ability. At the same time, the rain marks of the lower layer are used to give higher attention to the rain marks of the upper layer to enhance the rain removal ability. The empirical results show that the proposed algorithm achieves good results in several rain removal tasks compared with the mainstream algorithms.

       

    /

    返回文章
    返回