Unlock instant, AI-driven research and patent intelligence for your innovation.

Remote supervision relation extraction method based on multilayer attention mechanism

A remote supervision and relationship extraction technology, applied in the fields of artificial intelligence and natural language processing, can solve problems such as poor extraction effect, ignoring sentence package noise processing, etc.

Active Publication Date: 2021-07-06
BEIJING INSTITUTE OF TECHNOLOGYGY
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to solve the technical problems such as the poor extraction effect of the existing remote supervision relation extraction method in the noise environment, ignoring the noise processing of the sentence package, and the repeated occurrence of entities in the sentence, and creatively propose a multi-layer attention-based Mechanism-based Distant Supervised Relation Extraction Method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Remote supervision relation extraction method based on multilayer attention mechanism
  • Remote supervision relation extraction method based on multilayer attention mechanism
  • Remote supervision relation extraction method based on multilayer attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The method of the present invention will be described in further detail below in conjunction with the accompanying drawings and embodiments. This embodiment describes in detail the method and effect of this method when it is implemented in the mainstream data set of relation extraction.

[0029] Such as figure 1 As shown, a method of distant supervision relation extraction based on multi-layer attention mechanism, including the following steps:

[0030] Step 1: Obtain the knowledge base and divide the sentences in the knowledge data set into packages.

[0031] Specifically, the sentences in the knowledge dataset are divided into packages according to the corresponding entity pairs, so that the sentences in the packages have the same entity pairs, and the relationship corresponding to the entity pairs is assigned to each sentence.

[0032] Step 2: Obtain the matrix representation of the sentence.

[0033] details as follows:

[0034] First, let the i-th package in th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a remote supervision relation extraction method based on a multilayer attention mechanism, and belongs to the technical field of artificial intelligence and natural language processing. In order to solve the technical problems that an existing remote supervision relation extraction method is poor in extraction effect in a noise environment, noise processing on sentence packages is ignored, entities in sentences appear repeatedly and the like, a relative position feature attention is designed for the situation that entity pairs in the sentences appear repeatedly, and position information of the entity pairs is fully utilized. For the sentence packet noise problem, the confidence coefficient of each sentence packet is calculated, and the sentence packets with large noise and the sentence packets with small noise, which have the same relationship, are combined into packet groups according to the confidence coefficient, so that the noise between the packet groups is relatively balanced, and the relationship extraction effect in the noise environment is improved.

Description

technical field [0001] The invention relates to a method for extracting remote supervision relations, in particular to a method for extracting remote supervision relations based on a multi-layer attention mechanism, and belongs to the technical fields of artificial intelligence and natural language processing. Background technique [0002] Information Extraction is a basic task in natural language processing, which extracts structured information by processing unstructured text as input for subsequent natural language processing tasks. In the era of knowledge explosion, people need to face massive data every day, so it is extremely important to use the information extraction system to efficiently process text and extract useful information. [0003] As an extremely important part of natural language processing, information extraction itself is also composed of a series of subtasks, such as named entity recognition, relationship extraction and event extraction. Among them, R...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/31G06F40/30G06N5/02G06N3/04G06N3/08
CPCG06F16/313G06F40/30G06N5/022G06N3/084G06F2216/03G06N3/042G06N3/048G06N3/045
Inventor 刘琼昕王佳升
Owner BEIJING INSTITUTE OF TECHNOLOGYGY