Knowledge graph completion method and system based on multi-scale dispersed dynamic routing

A knowledge map and multi-scale technology, applied in the field of knowledge map, can solve the problems of prediction vector error summation, knowledge map completion field not being applied, convolutional neural network coding efficiency and other problems, and achieve the effect of improving performance

Pending Publication Date: 2022-07-12
QILU UNIV OF TECH
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] 1) MCapsE improves CapsE by making multi-scale convolution kernels in the convolutional layer, which improves the semantic features of the model to extract triples, but only expanding the capsule network model cannot effectively capture the potential dependencies between entities; 2) While R-MeN, although it can well extract the potential dependencies between entities in different semantic spaces, is limited by the disadvantages of low coding efficiency of convolutional neural networks; 3) and because the dynamic routing part in the capsule network uses The Softmax function will lead to wrong summation of the prediction vectors, which will affect the final result of the prediction. The DE-CapsNet model uses the decentralized dynamic routing with the Sigmoid function to improve the capsule network. In the field of image classification, the data sets CIFAR-10 and F -MNIST shows very good performance, but it has not been applied in the field of knowledge map completion

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Knowledge graph completion method and system based on multi-scale dispersed dynamic routing
  • Knowledge graph completion method and system based on multi-scale dispersed dynamic routing
  • Knowledge graph completion method and system based on multi-scale dispersed dynamic routing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0043] Embodiments of the invention and features of the embodiments may be combined with each other without conflict.

[0044] The general idea proposed by the present invention:

[0045]The multi-head attention mechanism is introduced into the multi-scale capsule network, and the triple memory matrix is ​​used as the input of the optimized capsule network to better encode the dependencies between entities and capture the spatial structure information of the triple; while the dynamic routing of the capsule network part, using decentralized dynamic routing to replace the dynamic routing used in traditional capsule networks, assigning larger coupling coefficients to real features, transferring real features that are actually relevant to the class to the next capsule layer, while assigning erroneous features relatively Smaller coupling coefficients improve model performance.

Embodiment 1

[0047] This embodiment discloses a knowledge graph completion method based on multi-scale decentralized dynamic routing;

[0048] like figure 1 As shown, a knowledge graph completion method based on multi-scale decentralized dynamic routing, including:

[0049] S1: Use the multi-head attention mechanism to cyclically interact with the memory matrix for the acquired triples to be completed, encode the potential dependencies between entities and relationships, and generate triplet encoding vectors;

[0050] S2: Input the triplet encoding vector into the trained capsule network, extract global features, assign different coupling coefficients to the global features, predict the missing triples according to the global features, and complete the knowledge map.

[0051] The S1 step, which consists of a multilayer perceptron and memory gating, encodes the information of latent dependencies and important parts between entities and relations and forms an encoded embedding vector.

[0...

Embodiment 2

[0086] This embodiment discloses a knowledge graph completion system based on multi-scale decentralized dynamic routing;

[0087] like figure 2 As shown, a knowledge graph completion system based on multi-scale decentralized dynamic routing, including relational memory module and capsule network module;

[0088] The relationship memory module is used to cyclically interact with the memory matrix using the multi-head attention mechanism for the acquired triples to be completed, encode the potential dependencies between entities and relationships, and generate triplet encoding vectors;

[0089] The capsule network module is used to input the triplet encoding vector into the trained capsule network, extract global features, assign different coupling coefficients to the global features, predict the missing triples according to the global features, and complete the knowledge Completion of the map.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a knowledge graph completion method and system based on multi-scale dispersion dynamic routing, and the method comprises the steps: enabling an obtained to-be-completed triple to circularly interact with a memory matrix through employing a multi-head attention mechanism, coding a potential dependence relation between an entity and a relation, and generating a triple coding vector; the triple coding vectors are input into the trained capsule network, global features are extracted, different coupling coefficients are distributed to the global features, missing triads are predicted according to the global features, and completion of the knowledge graph is completed; according to the method, the potential dependency relationship between the entities is effectively modeled during knowledge graph prediction, the deviation caused by dynamic routing during prediction is reduced as much as possible, and the characteristics of different abstract levels are captured, so that the completion prediction precision of the knowledge graph and the effect of triple classification are improved.

Description

technical field [0001] The invention belongs to the technical field of knowledge graphs, and in particular relates to a knowledge graph completion method and system based on multi-scale decentralized dynamic routing. Background technique [0002] The statements in this section merely provide background information related to the present invention and do not necessarily constitute prior art. [0003] Knowledge Graph (KG) was proposed by Google in 2012 and is usually expressed as a multi-relational graph, which is a collection of three elements of facts. There are a large number of facts in the world that can be simply represented as entities and their relationships. YAGO, Freebase and DBpedia are usually KGs representing relationships between entities in the form of facts (head entity, relation, tail entity), represented as (h; r; t), e.g. ("Beijing", "belongs to", " China”); knowledge graphs can be used to describe ternary relationships in the fields of recommender systems,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/36G06N5/02G06K9/62G06N3/04G06N3/08
CPCG06F16/367G06N5/02G06N3/08G06N3/047G06N3/048G06F18/241G06F18/2415Y02D10/00
Inventor 尉秀梅马浩翔姜雪松柴慧慧陈珺陈佃迎
Owner QILU UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products