Fine-grained entity classification method based on diversified semantic attention model

A technology of attention model and classification method, which is applied in the field of fine-grained entity classification based on diversified semantic attention model, and can solve the problem of low accuracy of fine-grained entity classification

Pending Publication Date: 2021-02-26
中国科学院电子学研究所苏州研究院
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to propose a fine-grained entity classification method based on a

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fine-grained entity classification method based on diversified semantic attention model
  • Fine-grained entity classification method based on diversified semantic attention model
  • Fine-grained entity classification method based on diversified semantic attention model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0109] In order to verify the effectiveness of the solution of the present invention, the following simulation experiments are carried out.

[0110] Step 1: Generate attention segments. For example, the input sentence is: Skeptics wonder whether mega-resorts such as the Mirage will be able to squeeze a profit from their cashflow. According to the segmentation length and segmentation step size set in step 1, the input sentence can be segmented into: Skeptics wonder whether mega-resorts such as, wonder whether mega-resorts such as the Mirage will be able to squeeze a profit, the Mirage will be able to squeeze a profit from their cash flow and other sentences.

[0111] Step 2: Perform contextualized word vector encoding on the multiple sentences segmented in step 1. The example sentence in step 1 is used for illustration. The word vector encoding of the sentence is [-0.13128 -0.452 0.043399 -0.99798 -0.21053 -0.95868 -0.24609 0.48413 0.18178 0.475 -0.22305 0.30064 0.43496 -0.36...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a fine-grained entity classification method based on a diversified semantic attention model, and the method comprises the steps of obtaining a diversified attention segment sequence of a sentence based on a segmentation length and a step length; constructing a diversified semantic attention model, wherein the diversified semantic attention model comprises an attention graphprediction model and an attention feature integration model; constructing diversity constraints including attention graph constraints and attention fragment constraints, and determining a final loss function in combination with classification loss for training a diversified semantic attention model; and determining an attention graph corresponding to the diversified attention fragment sequence byusing the trained diversified semantic attention model, predicting a classification result of each time step for each fine-grained entity category in combination with a softmax network, and comprehensively obtaining a prediction result of the entities in the input sentence. According to the invention, the problem of low classification precision of fine-grained entities is solved.

Description

technical field [0001] The invention relates to the field of natural language processing, and relates to a fine-grained entity classification method based on a diversified semantic attention model. Background technique [0002] With the development of natural language processing (NLP), methods for fine-grained entity classification have gradually attracted more and more attention in natural language processing (NLP) applications. Fine-grained entity classification refers to assigning specific types to entities in sentences. Due to the ambiguity of entities, how to utilize fine-grained entity classification methods is a very challenging problem. Not only that, in order to better capture the key differences, the attention mechanism has been applied to automatically select the discriminative features of sentences, which greatly improves the performance of the algorithm. In the prior art, most existing attention methods usually extract salient features from entities and contex...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F40/30G06F40/216G06F16/35G06N3/04G06N3/08
CPCG06F40/30G06F40/216G06F16/35G06N3/049G06N3/08G06N3/047G06N3/045
Inventor 向镐鹏胡岩峰乔雪姜添潘宇顺彭晨李熙雨罗晋
Owner 中国科学院电子学研究所苏州研究院
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products