融合环境语义的时空图网络行人轨迹预测模型
Fusion of environmental semantics in spatio-temporal graph networks for pedestrian trajectory prediction
-
针对行人轨迹预测中动态交互建模复杂及环境语义信息融合不足的难题,提出了一种融合环境语义的时空图网络预测模型——环境语义感知时空图网络(Environmental Semantics-aware Spatio-Temporal Graph Network, ES-STGNet)。该模型构建了一个端到端框架,旨在深度融合行人间动态的社会交互与场景中静态的物理环境约束。通过为每个场景即时构建时空图,利用图卷积网络(Graph Convolutional Network, GCN)显式地捕捉行人间的时空依赖关系。同时,提出一种信息要素空间定位算法,将高清地图中的车道拓扑、交通状态等异构语义信息动态地融入交互编码器,以增强预测轨迹的物理合理性。该模型末端采用拉普拉斯混合密度网络(Laplacian Mixture Density Network, LMDN)作为解码器,生成多模态的概率性轨迹预测,有效处理行人运动的不确定性。在公开数据集ETH和UCY上的实验结果表明:所提模型在平均位移误差(Average Displacement Error, ADE)和最终位移误差(Final Displacement Error, FDE)两项指标上均表现出优异性能。研究证实,将环境语义信息与动态交互模型相结合能够有效提升轨迹预测的准确性与物理一致性,为复杂城市场景下的自动驾驶和智能监控系统提供了一种精准且符合实际约束的轨迹预测技术方案。Abstract: To address the complex modeling of dynamic interactions and the insufficient fusion of environmental semantic information in pedestrian trajectory prediction, a model named Environmental Semantics-aware Spatio-Temporal Graph Network (ES-STGNet) is proposed. This model constructs an end-to-end framework to deeply integrate dynamic social interactions among pedestrians with static physical constraints from the environment. Methodologically, a spatio-temporal graph is constructed for each scene in real-time. A Graph Convolutional Network is then utilized to explicitly capture the spatio-temporal dependencies among pedestrians. An information element spatial localization algorithm is also proposed. This algorithm dynamically integrates heterogeneous semantic information from high-definition maps, such as lane topology and traffic status, into the interaction encoder to enhance the physical plausibility of the predicted trajectories. The model employs a Laplacian Mixture Density Network as a decoder to generate multi-modal probabilistic trajectory predictions, effectively handling the uncertainty of pedestrian movement. Experimental results on the public ETH and UCY datasets show that the proposed model achieves superior performance on bothaverage displacement error(ADE) and final displacement error(FDE) metrics. This research confirms the effectiveness of combining environmental semantic information with a dynamic interaction model. It provides a more accurate and physically plausible trajectory prediction solution for autonomous driving and intelligent surveillance systems in complex urban scenarios.
下载: