• PFTransCNN:基于CNN-Transformer双分支融合的病理图像分割

    PFTransCNN: A dual-branch fusion pathological image segmentation based on CNN-Transformer

    • 针对临床诊断中病理图像结构复杂、病变区域与正常组织边界模糊且对比度低所导致的分割精度受限问题,提出了一种基于卷积神经网络(CNN)与Transformer的双分支融合模型PFTransCNN(Parallel Fusion Transformer and CNN)。该模型旨在充分利用病理图像中空间和通道之间的相关性,实现对边界模糊且平滑的癌变组织的精准分割。具体而言,模型以ResNet34作为CNN分支的骨干网络,并结合Transformer模块提取多层次特征,捕获局部相关性与远程依赖信息。通过Fusion模块对两分支特征进行交互融合,增强了语义依赖关系,有效避免了边界特征的丢失。此外,采用上采样特征调制模块UFM(Upsample Feature Modulator)处理上采样分支中的特征信息,成功捕获低层次空间特征与高层次语义信息,从而实现了精准的分割结果。在GlaS、SEED和MoNuSeg数据集上的实验结果表明:该模型的Dice系数分别达到了91.61%、90.32%和81.37%,显著优于现有方法,验证了其在复杂病理图像分割任务中的有效性与泛化能力。

       

      Abstract: To address the issue of limited segmentation accuracy caused by the complex structure of pathological images, the blurred boundaries between lesion areas and normal tissues, as well as the low contrast, a dual-branch fusion model PFTransCNN (Parallel Fusion Transformer and CNN) based on convolutional neural networks (CNN) and Transformer is proposed. This model aims to fully utilize the spatial and channel correlations in pathological images to achieve precise segmentation of cancerous tissues with blurred and smooth boundaries. Specifically, the model uses ResNet34 as the backbone network for the CNN branch and combines the Transformer module to extract multi-level features, capturing local correlations and remote dependency information. Through the Fusion module, the features of the two branches are interactively fused, enhancing semantic dependency relationships and effectively avoiding the loss of boundary features. Additionally, the Upsample Feature Modulator (UFM) is used to process the feature information in the upsampled branch, successfully capturing low-level spatial features and high-level semantic information, thereby achieving precise segmentation results. Experimental results on the GlaS, SEED, and MoNuSeg datasets show that the Dice coefficient of the proposed model reaches 91.61%, 90.32%, and 81.37% respectively, significantly outperforming existing methods, verifying its effectiveness and generalization ability in complex pathological image segmentation tasks.

       

    /

    返回文章
    返回