An Adversarial Multi-Task Training Method for Spoken Language Understanding

A technology of oral comprehension and training methods, applied in the field of confrontational multi-task training of oral comprehension, which can solve the problems of time-consuming and difficult to obtain marked data in the domain, and achieve the effect of reducing cost and avoiding heavy dependence
CN108491380BActive Publication Date: 2021-11-23AISPEECH CO LTD
11 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
AISPEECH CO LTD
Publication Date
2021-11-23

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses an adversarial multi-task training method for spoken language comprehension, including sampling from unlabeled data and labeled data to train and update a language model and a shared space, and labeling the first public feature obtained in the shared space as a language model The task is to train and update the task discriminator and the shared space; take samples from the labeled data to train and update the spoken language understanding model and the shared space, and mark the second public feature obtained by the shared space as a spoken language understanding model task to train and update the described Task discriminator and the shared space. The adversarial multi-task training method for spoken language understanding in the embodiment of the present invention can train the spoken language understanding model based on unlabeled data and labeled data at the same time, thereby avoiding the heavy dependence of the traditional method for training the spoken language understanding model on labeled data , reducing the cost overhead caused by a large number of labeled data.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to the technical field of artificial intelligence, in particular to an adversarial multi-task training method for spoken language comprehension. Background technique

[0002] The spoken language understanding (SLU, spoken language understanding) module is a key component of the target-oriented spoken language dialogue system (SDS, spoken dialogue system), which parses the user's utterance into corresponding semantic concepts. For example, the sentence "show me flights from Boston to New York" could be parsed as (departure city=Boston, arrival city=New York). Generally, it is considered as a slot filling task, assigning each word in an utterance a predefined semantic slot label.

[0003] Recent research on statistical slot filling in SLU has focused on recurrent neural networks (RNNs) and their extensions, such as long and short memory networks (LSTMs), codec models, etc. These traditional methods require a large amount of labele...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More