• 基于自适应空间混合的大规模点云语义分割

    Semantic segmentation of large-scale point clouds based on adaptive spatial mixing

    • 针对点云语义分割在保持分割精度的同时提升大规模点云场景实时性的需求,提出了一种基于自适应空间混合的点云语义分割算法。首先,在嵌入层融合点特征和领域特征,增强原始点数据并捕获局部几何信息。随后,通过空间和通道混合层对嵌入点特征进行迭代更新。在空间混合阶段,利用稀疏矩阵投影点云,引入轴感知特征混合模块捕获跨维度上下文信息,并实现本地特征与查询特征的自适应融合,融合后与嵌入特征残差连接后输入通道混合阶段。在通道混合阶段,设计一种低参数量的低秩近似MLP模块替代传统MLP,对特征进行高效处理。经多次交替混合后,利用卷积对更新后的特征进行分类。在SemanticKITTI和SemanticPOSS数据集上的实验结果表明:所提方法在效率与精度之间取得良好平衡,验证集平均交并比分别达到64.0%与52.2%。

       

      Abstract: To address the demand for maintaining the segmentation accuracy while enhancing the real-time performance of large-scale point cloud scenes in point cloud semantic segmentation, a point cloud semantic segmentation algorithm based on adaptive spatial mixing is proposed. Firstly, the point features and domain features are fused in the embedding layer to enhance the original point data and capture local geometric information. Subsequently, the embedded point features are iteratively updated through the spatial and channel mixing layers. In the spatial mixing stage, the point cloud is projected using a sparse matrix, an axis-aware feature mixing module is introduced to capture cross-dimensional context information, and adaptive fusion of local features and query features is achieved. The fused features are then connected with the residual of the embedded features and input into the channel mixing stage. In the channel mixing stage, a low-parameter low-rank approximation Multi-Layer Perceptron (MLP) module is designed to replace the traditional MLP, for efficient processing of the features. After multiple alternating mixings, the updated features are classified using convolution. Experimental results on the SemanticKITTI and SemanticPOSS datasets show that the proposed method achieves a good balance between efficiency and accuracy, with the mean intersection over union (mIoU) scores on the validation set reaching 64.0% and 52.2%, respectively.

       

    /

    返回文章
    返回