• UMT-HPLA:半监督雾天跨域目标检测模型

    UMT-HPLA: Semi-supervised cross-domain object detection model in foggy conditions

    • 针对雾天场景下的跨域目标检测模型存在输入图像域差异显著、检测对象模糊、目标被遮挡,以及伪标签质量不高等问题,提出了一种基于无偏均值教师(Unbiased Mean Teacher, UMT)的半监督跨域目标检测模型UMT-HPLA (UMT-Harmony Pseudo Label Assigner),该模型由非成对图像生成器、YOLOv5检测器和伪标签处理模块组成,分别从域适应、检测性能优化以及伪标签质量提升等方面进行改进。非成对图像生成器通过对比学习生成风格一致的伪图像,有效缓解域差异问题;在YOLOv5检测器中引入变焦损失(Varifocal Loss, VFL),提升对遮挡目标的鲁棒性;伪标签处理模块包括伪标签筛选器和伪标签分配器,伪标签筛选器将定位和置信度共同作为主导因素来选择样本以提供高质量的伪标签,并通过新设计的伪标签分配方法针对不同类型伪标签采用差异化损失计算策略。在公开的数据集Cityscapes和Foggy Cityscapes的实验结果表明,相比较以YOLO为检测器的UMT方法,该模型的mAP提高了3.7%,达到了58.1%。

       

      Abstract: In response to the problems of significant domain difference in input images, blurred detection objects, target occlusion, low number of target samples, and poor quality pseudo labels in foggy scene target detection models, an unsupervised cross-domain target detection model called UMT-HPLA (UMT-Harmony Pseudo Label Assigner) based on Unbiased Mean Teacher (UMT) is proposed. The model consists of a non-paired image generator, a YOLOv5 detector, and a pseudo label processing module, which are improved from the perspectives of domain adaptation, detection performance optimization, and pseudo label quality enhancement. The non-paired image generator generates style-consistent pseudo images by contrastive learning to effectively alleviate the domain difference problem. The YOLOv5 detector introduces the Varifocal Loss (VFL) to enhance the robustness to occluded targets. The pseudo label processing module includes a pseudo label selector and a pseudo label assigner. The pseudo label selector selects samples by combining the location and confidence as the dominant factors to provide high-quality pseudo labels, and the new designed pseudo label assignment method adopts a differentiated loss calculation strategy for different types of pseudo labels.The experimental results on the public datasets Cityscapes and Foggy Cityscapes show that compared with the UMT method with YOLO as the detector, the mAP of the proposed model is increased by 3.7%, reaching 58.1%.

       

    /

    返回文章
    返回