Intention recognition method and intention recognition device

A recognition method and recognition device technology, which are applied in the fields of natural language processing and neural networks, and can solve problems such as intention recognition performance limitations

Pending Publication Date: 2020-06-02
UBTECH ROBOTICS CORP LTD
View PDF3 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] Embodiments of the present invention provide an intent recognition method, an intent recognition device, and a computer-readable storage medium to solve the problem of limited performance of existing intent recognition and improve the accuracy of sentence intent recognition

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intention recognition method and intention recognition device
  • Intention recognition method and intention recognition device
  • Intention recognition method and intention recognition device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0067] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0068] The intent recognition method in this embodiment is based on the Bert model. In order to facilitate the understanding of the embodiments of the present invention, here are some introductions to the Bert model. The Bert model is based on the encoder structure in the encoder (encoder) of the Transformer model. Specifically, as figure 1 As shown, the Transformer model includes an encoder (encoder) and a decoder (decoder), but since the decoder is no...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an intention recognition method and an intention recognition device. The method comprises the following steps: acquiring a sentence to be recognized; converting the sentence tobe recognized into a first vector, a second vector and a third vector through an embedding layer; respectively performing linear mapping on the first vector and the second vector to obtain a first mapping vector and a second mapping vector; obtaining a first attention vector according to the first mapping vector, and obtaining a second attention vector according to the second mapping vector; obtaining a first sentence vector according to the first attention vector, and obtaining a second sentence vector according to the second attention vector; obtaining a target sentence vector according tothe first sentence vector and the second sentence vector; and inputting the target sentence vector into a linear layer of a Bert model for intention recognition, and obtaining an intention recognitionresult.

Description

technical field [0001] The present invention relates to the technical fields of natural language processing and neural network, in particular to an intention recognition method and an intention recognition device. Background technique [0002] The Transformer model is a natural language processing model (Natural Language Processing, referred to as NLP) developed by Google, and it is an important innovation in the development of NLP. The Bert model (BidirectionalEncoder Representations from Transformers) is based on the encoder structure of the Transformer model. The encoder includes multiple encoding layers, and one encoding layer includes a self-attention (self-attention) layer, addition & normalization layer and a fully connected feed-forward neural network layer, and the self-attention layer is formed by stacking N Scaled Dot Product Attention (SDPA) components, that is, SDPA is a component of the Bert model, and the Bert model uses an embedding layer to input sentences ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F40/30G06N3/04
CPCG06N3/044
Inventor 黄日星熊友军
Owner UBTECH ROBOTICS CORP LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products