• 一种由部件隐向量驱动的隐式三维重建方法

    An implicit 3D reconstruction method driven by latent vectors of the components

    • 神经隐式表征是一种新兴的形状表示范式,但多数传统隐式表示方法如DeepSDF等未考虑整体形状的局部特征信息,存在拓扑细节精度不足的问题。为解决上述问题,提出了一种由部件隐向量驱动的隐式三维重建方法,即构建部件的隐式场以最小化模型预测的整体形状目标点有符号距离值LGI-RIF(Reconstruction of Implicit Fields with Local and Global Integration),能从观测数据中重建几何形状。该方法在一个低维的潜在编码空间中训练神经网络并在解码器框架中联合优化,设计EFP、EFCS和R3DS这3个模块,在EFP模块中由设计的变分自编码器学习部件的特征向量分布,在EFCS模块中构建自动解码器学习整体形状的SDF隐式表达,在R3DS模块中重建整体三维形状。实验结果表明:LGI-RIF在ShapeNet和ModelNet 10数据集上的重建精度得到了进一步提升,在可视化重构中具有良好的视觉效果。

       

      Abstract: Neural implicit representation is an emerging shape representation paradigm, but most traditional implicit representation methods such as DeepSDF do not consider the local feature information of the overall shape, which has the problem of insufficient accuracy of topological details. In order to solve the above problems, an implicit 3D reconstruction method driven by latent vectors of the components is proposed, that is, the implicit field of the construction component reduces the signed distance value of the overall shape target point predicted by the model. LGI-RIF (Reconstruction of Implicit Fields with Local and Global Integration), predicted by the implicit field of the component, which can reconstruct the geometry from the observed data. This method trains the neural network in a low-dimensional latent encoding space and jointly optimizes in the decoder framework, designing three modules, EFP, EFCS and R3DS. The EFP module learns the latent vector distribution of the designed variational autoencoder, constructs the automatic decoder to learn the SDF implicit expression of the overall shape in the EFCS module, and reconstructs the overall 3D shape in the R3DS module. The experimental results show that the reconstruction accuracy of LGI-RIF on the ShapeNet and ModelNet 10 datasets has been further improved, and it has a good visual effect in the visualization reconstruction.

       

    /

    返回文章
    返回