• 融合注意力机制的双分支人体姿态与形状估计

    Human pose and shape reconstruction integrating attention mechanisms and dual-branch features

    • 针对三维人体姿态与形状估计中难以同时兼顾遮挡鲁棒性与像素对齐精度的问题,提出一种融合注意力机制的双分支人体姿态与形状估计方法。该方法由分割引导分支与姿态构建分支组成。其中,分割引导分支采用人体部位分割策略,生成不同部位的分割结果并将其转化为注意力权重,以引导特征学习;姿态构建分支则基于输入特征图,结合注意力权重进行人体模型参数回归,实现对三维人体姿态与形状的精确估计。与现有最先进方法相比,该方法在Human3.6M数据集上的MPJPE和PA-MPJPE指标分别降低5.4 mm和1.9 mm,在3DPW数据集上的MPJPE和PVE指标分别降低0.2 mm和3.2 mm。实验结果表明,该方法不仅显著提升了重建网格与输入图像之间的对齐精度,同时在复杂场景下展现出更强的遮挡鲁棒性。

       

      Abstract: To address the challenge of balancing occlusion robustness and pixel alignment accuracy in 3D human pose and shape estimation, a dual-branch estimation method integrating attention mechanisms is proposed. The proposed method consists of a segmentation-guided branch and a pose construction branch. The segmentation-guided branch adopts a human body part segmentation strategy, generating segmentation results for different body parts and converting them into attention weights to guide feature learning. The pose construction branch performs human model parameter regression based on the input feature maps combined with the attention weights, achieving accurate 3D human pose and shape estimation. Compared with state-of-the-art methods, the proposed method achieves improvements on the Human3.6M dataset, reducing MPJPE and PA-MPJPE by 5.4 mm and 1.9 mm, respectively, and on the 3DPW dataset, reducing MPJPE and PVE by 0.2 mm and 3.2 mm, respectively. Experimental results demonstrate that the proposed method not only significantly improves the alignment accuracy between the reconstructed mesh and the input image but also exhibits enhanced occlusion robustness in complex scenes.

       

    /

    返回文章
    返回