• 部分卷积融合自注意力的轻量级遥感场景分类方法

    Partial convolution fusion with self-attention for lightweight remote sensing scene classification

    • 遥感图像的场景类别多且类间相似度高,现有的卷积神经网络分类方法参数量较大,并且在相似特征区分和关键特征聚焦方面存在困难,因此提出了一种轻量级卷积神经网络(Convolutional Neural Network, CNN)和Transformer的混合模型。CNN模块使用部分卷积来高效提取空间特征,并结合坐标注意力机制来减小计算开销并获取更广泛信息。同时采用随机通道混洗以增强不同通道信息交流和特征多样性。在Transformer模块中,通过引入MobileVIT block,确保训练稳定性,防止过度拟合低级特征。CNN处理低层特征,Transformer则处理高级特征,形成互补以提升整体分类性能。在公开数据集NWPU-RESISC45和VGoogle上的对比实验结果表明,该模型的参数量和计算量仅在1.29 MB和269.81 MB的情况下,取得了95.69%和97.56%的分类精度,进一步印证了其有效性。

       

      Abstract: Remote sensing images exhibit diverse scene categories with high inter-class similarity. Existing Convolutional Neural Network (CNN) classification methods often entail large parameter counts and encounter challenges in distinguishing similar features and focusing on key features. Therefore, a hybrid model combining a lightweight CNN and Transformer architecture is proposed. The CNN module employs partial convolutions to efficiently extract spatial features and integrates a coordinate attention mechanism to reduce computational overhead while capturing broader information., and utilizes random channel shuffling to enhance inter-channel information exchange and feature diversity. Within the Transformer module, stability during training is ensured by introducing the MobileVIT block, guarding against overfitting on low-level features. CNN handles low-level features, while the Transformer manages high-level features, creating a complementary synergy that enhances overall classification performance. Comparative experimental results on the publicly available datasets NWPU-RESISC45 and VGoogle demonstrate that the model achieved classification accuracies of 95.69% and 97.56%, respectively, with parameter and computational complexities of only 1.29 MB and 269.81 MB. This further validates its effectiveness.

       

    /

    返回文章
    返回