Knowledge graph long-tail relation completion method based on attention mechanism

A knowledge graph and attention technology, applied in the field of knowledge graph, can solve the problems of the scarcity of long-tail relationships and the over-fitting of long-tail relationship prediction, and achieve the effects of rich representation features, improved generalization ability, and improved accuracy.

Active Publication Date: 2020-06-16
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF11 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to solve the above-mentioned problems in the prior art, that is, in order to solve the problem of over-fitting the long-tail relationship prediction in the traditional relationship completion model due to the scarcity of long-tail relationship numbers, the first aspect of the present invention proposes an attention-based The knowledge map long-tail relationship completion method of the force mechanism, the method includes:

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Knowledge graph long-tail relation completion method based on attention mechanism
  • Knowledge graph long-tail relation completion method based on attention mechanism
  • Knowledge graph long-tail relation completion method based on attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

example 3

[0072] In this embodiment, entities in the task knowledge graph are vectorized based on the entity vector representation of the fusion neighborhood information in the background knowledge graph. Then, for each relationship type in the task knowledge graph, randomly select an instance triplet of the relationship type, and combine the vector representations of the head entity h and tail entity t of the triplet together as an instance triplet of the relationship type feature, and use the combined vector as the support set S.

[0073] For the above relationship types, obtain the remaining triples, and combine the vector representations of the head entity and the tail entity in each remaining triple to form a query set Q.

[0074] Step S400, calculate the matching degree between the query set and each entity pair in the support set through the preset long-tail relationship prediction method of various network types; based on the matching degree, obtain the relationship between each...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the field of knowledge maps, particularly relates to a knowledge map long-tail relation completion method, system and equipment based on an attention mechanism, and aims at solving the problem that a traditional relation completion model generates overfitting on long-tail relation prediction due to the fact that the number of long-tail relations is small. The method of thesystem comprises the steps of obtaining a knowledge graph to be completed, constructing the knowledge graph to be completed into a first knowledge graph and a second knowledge graph according to a relationship type between entities of the knowledge graph, obtaining entity vector representation fusing neighborhood information in the first knowledge graph to serve as first representation, performing vectorization representation on each entity in the second knowledge graph according to the first representation, constructing a support set and a query set, obtaining the relationship type label ofeach entity pair in the query set through a preset long-tail relationship prediction method of multiple network types, and complementing the relationship between the entities. According to the method,the neighborhood information of each entity in the knowledge graph is fused, so that the problem of overfitting during long-tail relation prediction is avoided.

Description

technical field [0001] The invention belongs to the field of knowledge graphs, and in particular relates to a method, system, and device for completing long-tail relations in knowledge graphs based on an attention mechanism. Background technique [0002] Knowledge graphs are key resources for artificial intelligence and natural language processing, and play an important role in the fields of question answering systems, intelligent retrieval, and sentiment analysis. Therefore, to complete incomplete knowledge graphs, that is, to complement missing relationships in knowledge graphs Completeness is the basic task of knowledge graphs, and the quality of knowledge completion directly affects the performance of knowledge graphs in downstream tasks. [0003] The translation-based embedding model is the current knowledge graph completion method. This type of method is based on the distributed vector representation of entities and relationships, and the relationship in each triple in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/28G06F16/36G06N3/04G06N3/08
CPCG06F16/288G06F16/367G06N3/08G06N3/048G06N3/045Y02D10/00
Inventor 周玉孙建宗成庆
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products