Speech synthesis method and device, readable storage medium and electronic equipment

A technology for speech synthesis and audio information, applied in the computer field, can solve the problems of low training efficiency and model real-time rate, complex internal structure of vocoder, and long training time.

Pending Publication Date: 2020-09-11
BEIJING BYTEDANCE NETWORK TECH CO LTD
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, with the popularity of neural network applications, neural network vocoders can be obtained based on neural network training. In order to ensure the accuracy of speech synthesis, neural network vocoders need to have complex network structures. However, on the o

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Speech synthesis method and device, readable storage medium and electronic equipment
  • Speech synthesis method and device, readable storage medium and electronic equipment
  • Speech synthesis method and device, readable storage medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

preparation example Construction

[0028] figure 1 is a flowchart of a speech synthesis method provided according to an implementation manner of the present disclosure. Such as figure 1 As shown, the method may include the following steps.

[0029] In step 11, the acoustic feature information corresponding to the text to be synthesized is determined.

[0030] For example, the acoustic feature information corresponding to the text to be synthesized may be determined based on a commonly used end-to-end speech synthesis model (for example, Tacotron2). The end-to-end speech synthesis model includes an acoustic model, which is used to obtain the acoustic feature information of the text to be synthesized. Among them, the acoustic model includes an encoder, an attention model, and a decoder. The encoder performs feature extraction of the text, that is, according to the text to be synthesized, the corresponding representation sequence is obtained. After that, the attention model and the decoder are obtained based on...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a voice synthesis method and device, a readable storage medium and electronic equipment. The method comprises the steps of determining acoustic feature information corresponding to a to-be-synthesized text; obtaining audio information corresponding to the to-be-synthesized text through a first vocoder according to the acoustic characteristic information, wherein the firstvocoder is obtained by carrying out knowledge distillation on a second vocoder, the first vocoder and the second vocoder are vocoders based on a neural network model, and the model complexity of the first vocoder is lower than that of the second vocoder. Thus, the first vocoder learns the excellent data processing capability of the second vocoder, has a simple model structure, and has two advantages of accuracy and speed. Thus, speech synthesis is performed on the to-be-synthesized text based on the first vocoder, and a speech synthesis result can be quickly obtained on the basis of ensuring speech synthesis accuracy.

Description

technical field [0001] The present disclosure relates to the field of computer technology, and in particular, to a speech synthesis method, device, readable storage medium and electronic equipment. Background technique [0002] A vocoder constructs a speech waveform based on acoustic characteristics (eg, fundamental frequency, frequency spectrum, etc.) to form synthesized audio. It can be seen that the vocoder is a very important part of speech synthesis technology. The accuracy and speed of speech synthesis are important indicators to measure the performance of the vocoder. At present, with the popularity of neural network applications, neural network vocoders can be obtained based on neural network training. In order to ensure the accuracy of speech synthesis, neural network vocoders need to have complex network structures. However, on the one hand, complex structures The vocoder needs to spend a lot of training time in the early training, and the training efficiency and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10L13/02G10L13/04G10L13/08G10L19/16G10L25/30
CPCG10L13/02G10L13/08G10L19/16G10L25/30
Inventor 顾宇
Owner BEIJING BYTEDANCE NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products