Text understanding method based on external knowledge embedding

A technology of external knowledge and text, which is applied in the field of text understanding based on external knowledge embedding, can solve the problems of uneven data triples and inaccurate knowledge relationships, etc., to improve knowledge accuracy, high intelligence level, and improve The effect of drawing ability

Pending Publication Date: 2021-03-16
苏州元启创人工智能科技有限公司
View PDF0 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] Although knowledge graphs have been widely used at present, not only in terms of data volume but also in the accuracy of data triplets, there are still several problems: one is the number of data triplets in different The knowledge map is uneven. With the continuous

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text understanding method based on external knowledge embedding
  • Text understanding method based on external knowledge embedding
  • Text understanding method based on external knowledge embedding

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0049] In order to better understand the present application scheme, the technical solutions in the present application will be described in conjunction with the drawings in the present application embodiments. The invention includes, but is not limited to the following examples.

[0050] Embodiments of the present invention provide a method based on external knowledge embedded, including knowledge representation and text understanding of two major modules, such as figure 1 As shown, the specific implementation steps of this embodiment are as follows:

[0051] figure 2 For the knowledge representation of the present invention, the module network configuration, including steps 1 to 4;

[0052] Step 1: Divide the entity in the data set by clustering algorithm, and add a negative quarter group in the data set by random sampling splicing.

[0053] The knowledge map data sets used in this example are Wn11 and FB13, which contain 125,734,345,873 three-component groups, all of which a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a text understanding method based on external knowledge embedding. The method comprises the following steps: dividing entities in a data set through a clustering algorithm, andadding a negative triad in the data set through random sampling splicing; then, building a BERT network under a Keras deep learning framework, and coding entity relations in the knowledge graph to obtain a corresponding representation vector; extracting low-level features of different dimensions by using multi-granularity convolution so as to further improve the feature extraction capability of the model; mining the deep relationship between entities through the capsule neural network so as to complement the knowledge graph and improve the knowledge accuracy; fusing the code of the entity relationship serves as external knowledge with text entity information; and finally, interacting the knowledge vector with the text context by using a self-attention mechanism, and acquiring an answer through a multi-layer perceptron. Therefore, the method can enable a machine to well understand the meanings of the preceding and following texts, and enables the intelligent level of the network to behigher, and closer to the cognitive thinking of human beings.

Description

technical field [0001] The invention belongs to the technical fields of natural language processing, knowledge representation and machine reading comprehension, and in particular relates to a text comprehension method based on external knowledge embedding. Background technique [0002] The knowledge graph was officially proposed by Google in 2012. Its original intention is to optimize the search results and enhance the user's search quality and experience. The knowledge map provides a more effective way to represent, organize, manage and utilize massive, heterogeneous and dynamic big data on the Internet, making the network more intelligent and closer to human cognitive thinking. It is usually denoted as triplet G(E h ,R,E t ), where E is the entity set in the knowledge graph, E h and E t Respectively represent the head entity and the tail entity, and R represents the relationship between entities. [0003] It is very effective to use the pre-trained language model to s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/28G06F40/211G06N3/04
CPCG06F16/288G06F16/285G06F40/211G06N3/045
Inventor 何慧华
Owner 苏州元启创人工智能科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap