Voice endpoint detection model training method and device, and voice endpoint detection model using method and device

A technology of endpoint detection and model training, applied in speech analysis, speech recognition, instruments, etc., can solve problems such as hard to get data, inability to distinguish speech from non-speech, and the number is not so large

Inactive Publication Date: 2020-10-23
AISPEECH CO LTD
View PDF7 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The main defect of the related technology is that it cannot distinguish between speech and non-speech in a noisy environment.
Some noise-adaptive technical methods r

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Voice endpoint detection model training method and device, and voice endpoint detection model using method and device
  • Voice endpoint detection model training method and device, and voice endpoint detection model using method and device
  • Voice endpoint detection model training method and device, and voice endpoint detection model using method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0116] As an implementation manner, the above-mentioned electronic equipment is applied to a speech endpoint detection model training device, including:

[0117] at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions are executed by the at least one processor so that the at least one processor can:

[0118] Input the training audio into the generalized speech endpoint detection model;

[0119] Detecting a plurality of audio events present in the training audio via the generalized speech endpoint detection model, wherein the plurality of audio events include human speaking events, silence events, and at least one noise event;

[0120] Acquiring the distinction result of speech and non-speech of the plurality of audio events output by the speech endpoint detection model in the broad sense;

[0121] A loss function is calculated based on the au...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a voice endpoint detection model training method and device, and a voice endpoint detection model using method and device. The training method comprises the steps: inputting atraining audio into a generalized voice endpoint detection model; detecting a plurality of audio events existing in the training audio through the generalized voice endpoint detection model, wherein the plurality of audio events include a human speaking event, a mute event and at least one noise event; obtaining a voice and non-voice distinguishing result of the plurality of audio events output bythe generalized voice endpoint detection model; calculating a loss function based on the audio event label of the training audio and the output of the generalized voice endpoint detection model; andoptimizing the generalized voice endpoint detection model by controlling the loss function. According to the scheme of the embodiment of the invention, different types in the non-voice part can be distinguished, the classification accuracy can be improved, and the noise is not easy to misjudge as the voice part.

Description

technical field [0001] The invention belongs to the field of language models, in particular to a method and device for training and using a speech endpoint detection model. Background technique [0002] In related technologies, there are various types of speech endpoint detection models, including speech endpoint detection models that use thresholds such as short-term energy and zero-crossing rate as speech and non-speech discrimination standards, and speech endpoints that use discriminative models such as neural networks to train Detector. [0003] On the one hand, the threshold discrimination method mainly uses indicators such as short-term energy and zero-crossing rate as the threshold. After extracting the acoustic features from the audio, these indicators are calculated for each frame or each segment, and then the audio is distinguished by whether it reaches the threshold. Speech and non-speech parts. [0004] On the other hand, the model discrimination method mainly ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10L25/78G10L25/87G10L15/06G10L15/16G10L25/30
CPCG10L25/78G10L25/87G10L25/30G10L15/063G10L15/16
Inventor 吴梦玥陈烨斐丁翰林俞凯
Owner AISPEECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products