Intelligent semantic matching method and device based on deep hierarchical coding

A technology of hierarchical coding and intelligent semantics, applied in semantic analysis, neural learning methods, natural language data processing, etc., can solve the problems of ignoring sequence information, not considering the hierarchical relationship of sentences, and not suitable for processing sequence information tasks.

Active Publication Date: 2020-06-23
南方电网互联网服务有限公司
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Through analysis and research, it is not difficult to find that most of the existing technologies are based on convolutional neural network models or cyclic neural network models, and the characteristics and limitations of these two models make it impossible to completely solve this problem
Among them, although the convolutional neural network is good at capturing and representing local features with different kernel functions, it ignores the sequence information in the text and is not suitable for processing sequence information tasks; although the recu

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent semantic matching method and device based on deep hierarchical coding
  • Intelligent semantic matching method and device based on deep hierarchical coding
  • Intelligent semantic matching method and device based on deep hierarchical coding

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0095] as attached Figure 9 As shown, the intelligent semantic matching method based on deep layered coding of the present invention is realized by constructing and training a sentence matching model consisting of an embedding layer, a deep layered coding representation layer, a layered feature interactive matching layer and a prediction layer For the deep layered coding representation of sentences, more semantic context information and interactive information between sentences are obtained, and at the same time, a new layered feature interactive matching mechanism is implemented to achieve the goal of intelligent semantic matching of sentences; the details are as follows :

[0096] (1), the embedding layer performs an embedding operation on the input sentence, and passes the result to the depth layered coding representation layer;

[0097] (2), the deep layered encoding representation layer performs an encoding operation on the result obtained by the embedding operation, an...

Embodiment 2

[0101] as attached figure 1 As shown, the intelligent semantic matching method based on depth layered coding of the present invention, the specific steps are as follows:

[0102] S1. Construct sentence matching knowledge base, as attached figure 2 As shown, the specific steps are as follows:

[0103] S101. Use a crawler to obtain original data: write a crawler program, crawl the question set on the online public question-and-answer platform, and obtain the original similar sentence knowledge base; or use the sentence matching data set published on the Internet as the original similar sentence knowledge base.

[0104] The public question-and-answer sharing platform on the Internet has a large amount of question-and-answer data and recommendations for similar questions, which are open to the public. Therefore, we can design a corresponding crawler program according to the characteristics of the question-answering platform to obtain a set of semantically similar questions, the...

Embodiment 3

[0178] as attached Image 6 As shown, based on the intelligent semantic matching device based on depth layered coding of embodiment 2, the device includes,

[0179] The sentence matching knowledge base construction unit is used to use the crawler program to crawl the question set on the online public question and answer platform to obtain the original similar sentence knowledge base, and then perform word break or word segmentation preprocessing on the original similar sentence knowledge base, so as to construct a The sentence matching knowledge base for model training; the sentence matching knowledge base construction unit includes,

[0180] The data crawling sub-unit is used to crawl the question set on the online public question-and-answer platform and build the original similar sentence knowledge base;

[0181] The crawling data processing subunit is used to perform hyphenation processing or word segmentation processing on the sentences in the original similar sentence kn...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an intelligent semantic matching method and device based on deep hierarchical coding, andd belongs to the technical field of artificial intelligence and natural language processing. The technical problem to be solved by the invention is how to capture more semantic context information and interaction information between sentences to achieve Intelligent semantic matching ofsentences; the adopted technical scheme is as follows: the method comprises the following steps: constructing and training a sentence matching model consisting of an embedding layer, a deep hierarchical coding representation layer, a hierarchical feature interaction matching layer and a prediction layer; according to the method, deep hierarchical coding representation of the sentences is realized,so that more semantic context information and interaction information between the sentences are obtained, and a hierarchical feature interaction matching mechanism is realized to achieve the purposeof intelligent semantic matching of the sentences. The device comprises a sentence matching knowledge base construction unit, a training data set generation unit, a sentence matching model construction unit and a sentence matching model training unit.

Description

technical field [0001] The invention relates to the technical fields of artificial intelligence and natural language processing, in particular to an intelligent semantic matching method and device based on deep layered coding. Background technique [0002] In recent years, semantic matching methods for sentences have received more and more attention in the field of natural language processing. The reason is that many natural language processing tasks are based on the semantic matching of sentences, which can be regarded as an extension of sentence semantic matching tasks to a certain extent. For example, the task of "automatic question answering" can be processed by calculating the matching degree of "question" and "candidate answer"; the task of "information retrieval" can be regarded as calculating the matching degree of "query sentence" and "matching document". Because of this, semantic matching of sentences plays a crucial role in the field of natural language processin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F40/289G06F40/30G06N3/04G06N3/08
CPCG06N3/08G06N3/045
Inventor 鹿文鹏于瑞张旭乔新晓成金勇王灿
Owner 南方电网互联网服务有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap