Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Entity linking method based on RoBERTa and heuristic algorithm

A heuristic algorithm and entity technology, applied in the field of knowledge base question answering, can solve problems such as many n-gram word combinations, limit the performance of entity linking methods, and query knowledge bases for a long time. The effect of enriching prior information

Active Publication Date: 2020-05-08
SOUTH CHINA UNIV OF TECH
View PDF2 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method has the following disadvantages: (1) There are many n-gram word combinations in the question, resulting in too much time-consuming query knowledge base; (2) Too many irrelevant entities are introduced in the candidate entities
Most of the current entity linking models based on sequence annotations model the problem on the basis of word-embedding, which also limits the performance of current entity linking methods to a certain extent.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Entity linking method based on RoBERTa and heuristic algorithm
  • Entity linking method based on RoBERTa and heuristic algorithm
  • Entity linking method based on RoBERTa and heuristic algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The present invention will be further described in detail below in conjunction with the embodiments and the accompanying drawings, but the embodiments of the present invention are not limited thereto.

[0022] An entity linking method based on RoBERTa and a heuristic algorithm. There are two main ideas for improving the model. One is to use the sequence tagging model based on the pre-trained language model RoBERTa to tag questions. The RoBERTa model stacks 12 layers of transformer structures to Obtain multi-level grammatical and semantic information in the question, and through the multi-head attention mechanism in the transformer, it can effectively obtain the context-based dynamic representation of each word in the question, and more accurately obtain the entity mention range in the question; the second is to obtain the entity After mentioning the range, use a heuristic algorithm to directly match the entity mention with the knowledge base entity, avoiding time-consumi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an entity linking method based on RoBERTa and a heuristic algorithm. The method comprises the following steps that a sequence labeling model based on a pre-trained language model RoBERTa is used for labeling a problem, and the RoBERTa model stacks 12 layers of transcriber structures to obtain multi-level grammatical semantic information in the problem; dynamic representation of each word in the question based on context is obtained through a multi-head attention mechanism in transformator, and then the entity mention range in the question is obtained; and after the entity mention range is obtained, directly matching the entity mention with the knowledge base entity by using a heuristic algorithm to complete entity linking. The method can be applied to various knowledge base questioning and answering scenes, and provides underlying basic services for many advanced applications.

Description

technical field [0001] The invention relates to the field of knowledge base questions and answers, in particular to an entity linking method based on RoBERTa and a heuristic algorithm. Background technique [0002] Entity linking is a subtask of knowledge base question answering, which aims to extract knowledge base entity texts that appear in questions and link them to entity objects in knowledge base, so as to obtain candidate answers for knowledge base question answering tasks. In recent years, with the continuous development of large-scale knowledge bases such as YAGO, Freebase, and Dbpedia, knowledge base question answering tasks have also begun to attract people's attention, and how to establish a connection between natural language questions and structured knowledge base entities is A burning problem that is also the goal of entity linking tasks. [0003] For this task, the early research mainly used the n-gram method to traverse the phrases in the question, and then...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/36G06F40/295
CPCG06F16/367
Inventor 苏锦钿罗达毛冠文
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products