Query intention recognition method based on bert + bolstm + crf and fused with sentence pattern analysis

A technology for query intent and sentence pattern analysis, applied in the fields of natural language processing and artificial intelligence, which can solve the problems of model recognition rate dependence on training data and uninterpretable recognition results, achieving high recognition rate and improved accuracy

Pending Publication Date: 2021-06-25
TONGFANG KNOWLEDGE NETWORK TECH CO LTD (BEIJING) +2
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The intent recognition model based on deep learning has a high intent recognition rate, but the recognition resul

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Query intention recognition method based on bert + bolstm + crf and fused with sentence pattern analysis
  • Query intention recognition method based on bert + bolstm + crf and fused with sentence pattern analysis

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015] In order to make the objectives, technical solutions, and advantages of the present invention, the present invention will be described in more detail below with reference to the embodiments and drawings.

[0016] Query the intention to identify the task, that is, enter the problem Q, the output problem belongs to classify INTENT, and the wording name Slot and the corresponding slot value Value information.

[0017] Such as figure 1 with figure 2 As shown, based on BERT + BILSTM + CRF and integrated identification method of sentence pattern analysis, including the following steps:

[0018] Step 1: Targeting the build data set, defines the field intent, clear intent classification, intent errors, build a varicker set, namely the word value collection, collecting problem set, labeling problem intention classification and gallographic information;

[0019] The construct of the gathered value collection helps to further accurately determine the intent classification, identify th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a query intention recognition method based on bert + bolstm + crf and fused with sentence pattern analysis. The method comprises the steps that a data set is marked and constructed, domain intentions are defined, intention classification and intention word grooves are clarified, a domain term set corresponding to the word grooves is constructed, a question set is collected, and question intention classification and word groove information are marked. According to the marked question and the corresponding intention information, a sentence pattern for matching verification in an intention recognition model reasoning stage is generated; and a query intention recognition model is constructed based on bert+bilstm+crf. According to the method, slot dictionary matching, sentence pattern analysis, slot entity recognition based on bert+bilstm+crf and intention classification based on bert are fused, the problem that the model is wrongly recognized when the model training data and the model prediction data are inconsistent in distribution is well solved, and the accuracy of recognizing the user input port linguistic content intention by the model is improved.

Description

Technical field [0001] The present invention relates to natural language processing, artificial intelligence technology, and more particularly to a query intent recognition method based on Bert + BilSTM + CRF and fusion sentence pattern analysis. Background technique [0002] The existing so-called intention is actually the natural language understanding (NLU), is one of the important tasks in natural language. Natural language understanding is to hope that the machine is like people, with the normal human language understanding, through the intention of accurate identification, clarify the user's demand, thereby providing to the user accurate service. [0003] With the development of deep learning, the neural network model based on deep learning algorithms such as CNN, RNN, LSTM, and attention mechanism is widely used in text classification, intended to identify the field, and continuously obtain SOTA effects. The intent identification model of deep learning is high, but the ide...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/35G06F40/30G06F40/295G06F40/216G06F40/242G06F40/211
CPCG06F16/35G06F40/211G06F40/216G06F40/242G06F40/295G06F40/30
Inventor 朱江程燕张振海
Owner TONGFANG KNOWLEDGE NETWORK TECH CO LTD (BEIJING)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap