• 基于自适应频率控制的3D高斯溅射质量优化方法

    Adaptive frequency-controlled 3D gaussian splatting: A quality-optimized rendering framework

    • 针对现有3D高斯溅射(3D Gaussian Splatting, 3DGS)技术在复杂场景重建中存在的锯齿效应、混叠伪影及细节缺失等问题,提出了一种基于几何特征的自适应频率滤波方法,以动态优化高斯基元的频率响应,有效平衡高频细节保留与低频噪声抑制。通过分析场景局部几何复杂度、颜色梯度及邻近基元密度等特征,设计轻量级可学习映射函数,将多模态特征动态关联至高斯核滤波强度参数,实现频率自适应的三维重建。具体实现上,首先提取每个高斯基元的法线变化强度、投影区域颜色梯度及邻域分布密度作为输入特征,通过多层感知机(Multilayer Perceptron, MLP)预测各向同性平滑系数,并将其融入协方差矩阵以调整滤波范围;其次,设计两阶段端到端优化策略,联合优化基元属性与滤波参数,结合RGB重建损失、结构相似性损失及正则化约束,确保训练稳定性。在Mip-NeRF360数据集上的实验结果证明:所提方法在建图精度与视觉质量上方面均优于现有主流方法,验证了其有效性和先进性。

       

      Abstract: To address the issues of jagged edges, aliasing artifacts, and detail loss in complex scene reconstruction with existing 3D Gaussian Splatting (3DGS) techniques, an adaptive frequency filtering method based on geometric features is proposed. This method dynamically optimizes the frequency response of Gaussian primitives to balance high-frequency detail preservation and low-frequency noise suppression. By analyzing the local geometric complexity, color gradients, and neighboring primitive density of the scene, a lightweight learnable mapping function was designed to dynamically associate multimodal features with the filtering strength parameters of Gaussian kernels, achieving frequency-adaptive 3D reconstruction. Specifically, we first extract three input features for each Gaussian primitive: the intensity of normal variation, color gradients in projected regions, and local neighborhood density. These features are fed into a Multilayer Perceptron (MLP) to predict isotropic smoothing coefficients, which are then integrated into the covariance matrix to adjust the filtering range. Additionally, a two-stage end-to-end optimization strategy is proposed to jointly optimize the attributes of Gaussian primitives and filtering parameters, combining RGB reconstruction loss, structural similarity loss, and regularization constraints to ensure training stability. To validate the effectiveness of our approach, comprehensive experiments are conducted on the Mip-NeRF360 dataset. The results demonstrate that the improved algorithm significantly outperforms existing methods in both reconstruction accuracy and visual quality.

       

    /

    返回文章
    返回