• 基于像素级对比的自监督小目标检测算法研究

    Self-supervised small object detection based on pixel-level contrast

    • 深度学习目标检测算法对小目标的检测精度显著落后于中型和大型目标。为了解决这一问题,将自监督学习和小目标检测任务相结合,提出了一种基于自监督的小目标检测方法。首先通过自监督对比学习算法预训练一个分类网络,再迁移到小目标检测模型中。与传统的有监督预训练相比,自监督预训练能从海量无标签数据中提取通用的特征表示,显著降低数据标注的成本,增强模型在下游任务中的泛化能力。其次,从提升模型对小目标特征提取能力的角度出发,采用基于像素级分类的对比学习方法。相较于经典的图像级对比学习而言,像素级对比更能关注到图像中的细节信息,主干网络具有更强的特征表达能力,迁移到小目标检测任务中能够取得更优秀的性能。同时,优化和改进检测网络结构,采用基于并行式更新的批量归一化层,确保输入数据的分布不会因为参数更新而产生偏移。最后,探讨了基于全微调和部分微调的模型训练方法,在冻结主干网络不同层的情况下进行实验。结果表明,该方法在小目标检测任务上的性能超越了传统的有监督预训练和经典的自监督方法,在SODA数据集上的平均检测精度分别提升了1.3%和1.6%。

       

      Abstract: The detection accuracy of the state-of-the-art deep learning object detection algorithms for small objects is notably lower than that of medium and large objects. In order to solve this problem, we propose a self-supervised small object detection method by combining self-supervised learning and the task of small object detection. Firstly, a classification network is pre-trained by a self-supervised contrastive learning algorithm and then transferred to the small object detection model. Compared with the traditional supervised pre-training, the self-supervised pre-training can extract universal feature representations from massive unlabeled data, significantly reduce the cost of data annotation, and enhance the generalization ability of the model in downstream tasks. Secondly, in order to improve the ability of the model to extract small object features, we adopt a contrast learning method based on pixel-level classification. Compared to the classic image-level contrastive learning, pixel-level contrast pays more attention to the details in the image, the backbone network has stronger feature representation ability that achieves better performance when transferred to small object detection tasks. Meanwhile, we optimize and improve the structure of the detection network by adding synchronized batch normalization layer to ensure that the distribution of input data does not deviate due to parameter updating. Finally, we discuss the model training methods based on full fine-tuning and partial fine-tuning, conducting experiments under conditions where different layers of the backbone network are frozen. The results show that our method outperforms traditional supervised pre-training and classic self-supervised methods on small object detection tasks, and the average detection precision on SODA datasets is improved by 1.3% and 1.6%, respectively.

       

    /

    返回文章
    返回