• MDC-Stereo:一种基于深度与颜色一致性的立体匹配方法

    MDC-stereo: A stereo matching method based on depth and color consistency

    • 双目立体匹配在自动驾驶与机器人导航等领域具有重要应用。针对有监督方法依赖大量标注数据且在弱纹理区域表现受限的问题,本文提出一种基于单目深度一致性的无监督双目立体匹配方法。首先,利用单目深度估计获取场景初始深度,并引入全局结构先验以增强低纹理区域的深度表征能力;其次,构建深度估计一致性模块,通过点云刚体变换实现左右视图在三维空间中的对齐,联合Chamfer距离与颜色一致性约束优化深度估计结果;最后,提出基于点云最近邻搜索的视差重建算法,将视差估计问题转化为三维空间中的点云匹配问题,利用最近邻搜索在三维点云中建立精确对应关系,相较于传统方法显著降低计算复杂度并提升配准精度。实验结果表明,本方法在KITTI 2012、KITTI 2015及Virtual KITTI 2数据集上的性能优于DispNet等经典无监督方法,且接近AANet、GwcNet等有监督方法的水平,验证了其在弱纹理区域重建精度与泛化能力方面的优势。

       

      Abstract: Binocular stereo matching plays a vital role in applications such as autonomous driving and robotic navigation. To address the limitations of supervised methods, which rely heavily on large amounts of annotated data and perform poorly in texture-less regions, this paper proposes an unsupervised binocular stereo matching method based on monocular depth consistency. Firstly, monocular depth estimation is utilized to obtain an initial depth map of the scene, introducing global structural priors to enhance depth representation in low-texture areas. Secondly, a depth estimation consistency module is constructed to align the left and right views in 3D space through point cloud rigid body transformations, optimizing the depth results using Chamfer distance and color consistency constraints. Finally, a disparity reconstruction algorithm based on point cloud nearest neighbor search is proposed, which transforms the disparity estimation problem into a point cloud matching task in 3D space. By leveraging nearest neighbor search to establish precise correspondences within the 3D point cloud, this approach significantly reduces computational complexity and improves registration accuracy compared to traditional methods. Experimental results on the KITTI 2012, KITTI 2015, and Virtual KITTI 2 datasets demonstrate that the proposed method outperforms classical unsupervised methods such as DispNet and achieves performance close to that of supervised methods like AANet and GwcNet, validating its advantages in reconstruction accuracy for texture-less regions and generalization capability.

       

    /

    返回文章
    返回