• 基于图变换型神经网络的知识图谱补全研究

    Research on knowledge graph completion based on graph transformation neural networks

    • 图神经网络(Graph Neural Networks, GNN)作为一种强大的图表示方法,广泛应用在图表示学习中,并在知识图谱补全中取得良好的效果完成知识图谱。但是,对于包含多种类型节点与关系的异构图知识图谱,大多数同质图神经网络没能很好地考虑到知识图谱的异构性和丰富的节点信息交互聚合问题,给异构图神经网络的设计带来了很大的困难。针对以上问题,提出了一种图变换型神经网络(Graph Transformation Neural Networks, GTN)模型。它将多种类型的节点和关系共同嵌入到关系图中,生成新的图结构,能够学习不同元路径的重要性,解决图的异构性问题;再聚合通过知识图谱嵌入的方法形成实体节点-关系边类型间的复合信息,表示新图结构上的节点特征来生成有效链接,补全原始图中未连接节点之间的可用链接,完成知识图谱补全的链接预测任务。GTN能学习节点与其基于元路径邻居之间的重要性,表明图结构中节点间链接是可生成的。为了缓解实验中模型泛化能力弱和过拟合现象,GTN在训练过程中添加了R-Drop结构,能很好地应对此问题。在FB15k-237和WN18RR两个常用的链接预测任务的数据集中,GTN做了对比实验和消融实验,结果证明了该方法的有效性。

       

      Abstract: Graph Neural Networks (GNN), as a powerful graph representation method, have been widely used in graph representation learning, and have achieved a good result in knowledge graph completion. However, for knowledge graph with various types of nodes and links, most homogeneous graph neural networks fail to consider the heterogeneity of knowledge graph and the interaction and aggregation of rich node information, which brings great difficulties to the design of heterogeneous graph neural networks. To solve the above problems, a Graph Transformation Neural Networks (GTN) model is proposed, which embeds multiple types of nodes and relation into the graph to generate a new graph structure, learn the importance of different meta-paths, and solve the problem of heterogeneity of the graph. The composite information between entity node-relation edge types formed by the knowledge graph embedding method is then aggregated to represent the node features on the new graph structure to generate effective links, complete the available links between unconnected nodes in the original graph, and complete the link prediction task of knowledge graph completion. GTN can learn the importance between nodes and their meta-path based on neighbors, which shows that links between nodes in the graph structure can be generated. In order to alleviate the over-fitting phenomenon caused by the weak generalization ability of the model in the experiment, GTN added the R-Drop structure in the training process. Based on the datasets of the two commonly used link prediction tasks, FB15k-237 and WN18RR, comparative experiments and ablation experiments are conducted on GTN, and the results prove the effectiveness of this method.

       

    /

    返回文章
    返回