A method and device for intelligent semantic matching based on deep layered coding

A technology of hierarchical coding and intelligent semantics, applied in semantic analysis, neural learning methods, natural language data processing, etc., can solve the problems of not considering the hierarchical relationship of sentences, ignoring sequence information, losing intermediate coding information, etc., to improve the comprehensiveness and accuracy, improve accuracy, and enhance the effectiveness of interaction mechanisms

Active Publication Date: 2021-06-18
南方电网互联网服务有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Through analysis and research, it is not difficult to find that most of the existing technologies are based on convolutional neural network models or cyclic neural network models, and the characteristics and limitations of these two models make it impossible to completely solve this problem
Among them, although the convolutional neural network is good at capturing and representing local features with different kernel functions, it ignores the sequence information in the text and is not suitable for processing sequence information tasks; although the recurrent neural network can process sequence information, most of them only Generate the final vector representation without considering the hierarchical relationship of the sentence, which may lose some important intermediate encoding information
For the semantic matching task of sentences, the order of words in the sentence and the hierarchical information of the sentence are crucial, therefore, it is almost impossible to obtain satisfactory results by simply using the method based on the convolutional neural network model or the recurrent neural network model.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and device for intelligent semantic matching based on deep layered coding
  • A method and device for intelligent semantic matching based on deep layered coding
  • A method and device for intelligent semantic matching based on deep layered coding

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0095] as attached Figure 9 As shown, the intelligent semantic matching method based on deep layered coding of the present invention is realized by constructing and training a sentence matching model consisting of an embedding layer, a deep layered coding representation layer, a layered feature interactive matching layer and a prediction layer For the deep layered coding representation of sentences, more semantic context information and interactive information between sentences are obtained, and at the same time, a new layered feature interactive matching mechanism is implemented to achieve the goal of intelligent semantic matching of sentences; the details are as follows :

[0096] (1), the embedding layer performs an embedding operation on the input sentence, and passes the result to the depth layered coding representation layer;

[0097] (2), the deep layered encoding representation layer performs an encoding operation on the result obtained by the embedding operation, an...

Embodiment 2

[0101] as attached figure 1 As shown, the intelligent semantic matching method based on depth layered coding of the present invention, the specific steps are as follows:

[0102] S1. Construct sentence matching knowledge base, as attached figure 2 As shown, the specific steps are as follows:

[0103] S101. Use a crawler to obtain original data: write a crawler program, crawl the question set on the online public question-and-answer platform, and obtain the original similar sentence knowledge base; or use the sentence matching data set published on the Internet as the original similar sentence knowledge base.

[0104] The public question-and-answer sharing platform on the Internet has a large amount of question-and-answer data and recommendations for similar questions, which are open to the public. Therefore, we can design a corresponding crawler program according to the characteristics of the question-answering platform to obtain a set of semantically similar questions, the...

Embodiment 3

[0178] as attached Figure 6 As shown, based on the intelligent semantic matching device based on depth layered coding of embodiment 2, the device includes,

[0179] The sentence matching knowledge base construction unit is used to use the crawler program to crawl the question set on the online public question and answer platform to obtain the original similar sentence knowledge base, and then perform word break or word segmentation preprocessing on the original similar sentence knowledge base, so as to construct a The sentence matching knowledge base for model training; the sentence matching knowledge base construction unit includes,

[0180] The data crawling sub-unit is used to crawl the question set on the online public question-and-answer platform and build the original similar sentence knowledge base;

[0181] The crawling data processing subunit is used to perform hyphenation processing or word segmentation processing on the sentences in the original similar sentence k...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an intelligent semantic matching method and device based on deep layered coding, which belongs to the technical field of artificial intelligence and natural language processing. The technical problem to be solved by the invention is how to capture more semantic context information and the interaction between sentences Information, in order to realize the intelligent semantic matching of sentences, the technical scheme adopted is as follows: the method is to realize the The deep layered coding representation of the sentence, so as to obtain more semantic context information and interactive information between sentences, and realize the interactive matching mechanism of layered features, so as to achieve the goal of intelligent semantic matching of sentences. The device includes a sentence matching knowledge base construction unit, a training data set generation unit, a sentence matching model construction unit and a sentence matching model training unit.

Description

technical field [0001] The invention relates to the technical fields of artificial intelligence and natural language processing, in particular to an intelligent semantic matching method and device based on deep layered coding. Background technique [0002] In recent years, semantic matching methods for sentences have received more and more attention in the field of natural language processing. The reason is that many natural language processing tasks are based on the semantic matching of sentences, which can be regarded as an extension of sentence semantic matching tasks to a certain extent. For example, the task of "automatic question answering" can be processed by calculating the matching degree of "question" and "candidate answer"; the task of "information retrieval" can be regarded as calculating the matching degree of "query sentence" and "matching document". Because of this, semantic matching of sentences plays a crucial role in the field of natural language processin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F40/289G06F40/30G06N3/04G06N3/08
CPCG06N3/08G06N3/045
Inventor 鹿文鹏于瑞张旭乔新晓成金勇王灿
Owner 南方电网互联网服务有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products