• 基于监控指标关联性的微服务异常检测

    Microservices anomaly detection based on the correlation of monitoring metrics

    • 微服务架构虽具备灵活性、可扩展性及高内聚低耦合等优势,但其监控指标数量庞大且层级间粒度和数量分布不均,导致异常检测面临数据处理困难与高计算开销的双重挑战。同时,现有方法多聚焦于关键性能指标(Key Performance Indicators, KPIs),忽视跨层级监控指标间的潜在关联,限制了检测精度的进一步提升。为此,提出了一种基于监控指标关联性的双编码微服务异常检测方法(Metric Correlation-Based dual coding - Microservice Anomaly Detection, CDC-MAD)。首先,采用动态时间规整(Dynamic Time Warping, DTW)算法衡量监控指标相关性,并基于此构建K-近邻网络结构。其次,通过层次化社团聚类方法识别对异常状态敏感的重要指标,构建精简有效的关联特征空间,降低计算开销。然后,使用一维卷积神经网络(1D Convolutional Neural Network, 1D-CNN)对原始数据进行特征提取和统一维度,通过双路编码器将原始特征空间和关联特征空间进行特征融合以捕获更多异常特征信息。最后,使用变分自编码器(Variational Auto-Encoders, VAE)重参数化技术对潜在空间随机采用增加模型的鲁棒性。相比于同类异常检测方法VAE、OmniAnomaly和SDFVAE,精确率平均提高了2.99%、39.06%和1.92%。

       

      Abstract: The microservice architecture is increasingly adopted as the preferred approach for enterprises to build complex application systems due to its flexibility, scalability, and high cohesion with low coupling. However, massive microservice monitoring indicators are generated with significant variations in quantity and granularity across different system layers, resulting in high computational costs being incurred during data processing and anomaly detection. Moreover, existing research primarily relies on key performance indicators (KPIs) while neglecting potential correlations between cross-layer monitoring metrics, which limits the comprehensiveness and precision of system state perception and anomaly detection.To address these challenges, we propose Metric Correlation-Based Dual Coding - Microservice Anomaly Detection (CDC-MAD), a dual-encoder model that integrates raw and structurally correlated monitoring features to improve anomaly detection under complex microservice environments. Firstly, the dynamic time warping (DTW) algorithm is employed to measure inter-indicator correlations, based on which a K-nearest neighbor network structure is constructed. Subsequently, hierarchical community clustering is implemented to identify critical indicators sensitive to abnormal states, thereby building a streamlined yet effective correlated feature space that reduces computational overhead. Then, one-dimensional convolutional neural networks (1D-CNN) are utilized to extract features and unify dimensions from raw data. Dual-path encoders are designed to fuse features from both raw and correlated spaces, enabling enhanced capture of abnormal characteristics. Finally, the reparameterization technique of variational autoencoders (VAE) is applied to strengthen feature representation robustness. Experimental results demonstrate that compared to similar anomaly detection methods such as VAE, OmniAnomaly, and SDFVAE, the proposed approach achieves average precision improvements of 2.99%, 39.06%, and 1.92% respectively. Comprehensive experiments across multiple datasets validate the effectiveness of the CDC-MAD method.

       

    /

    返回文章
    返回