Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Speech synthesis model training method, speech synthesis method and device

A technology for speech synthesis and model training, applied in the computer field, can solve the problems of complex training process, unsatisfactory effect of synthesized speech, and dull sound quality, so as to ensure the accuracy rate, reduce pronunciation errors, and improve the accuracy.

Active Publication Date: 2021-08-13
BEIJING XINTANG SICHUANG EDUCATIONAL TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] It can be seen that the above method requires the design and training of multiple models, so the training process is very complicated, and the effect of the synthesized speech obtained is not ideal, and the sound quality is flat

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Speech synthesis model training method, speech synthesis method and device
  • Speech synthesis model training method, speech synthesis method and device
  • Speech synthesis model training method, speech synthesis method and device

Examples

Experimental program
Comparison scheme
Effect test

preparation example Construction

[0114] As shown in the figure, the speech synthesis method provided by the embodiment of the present invention includes:

[0115] Step S30: Obtain the third word vector sequence of the Chinese character sentence to be speech synthesized.

[0116] The specific content of step S30 can refer to figure 1 Step S10, which will not be repeated here.

[0117]Step S31: Encoding the third character vector sequence by using the trained encoding module to obtain a third linguistic encoding feature.

[0118] After obtaining the third character vector sequence, use the trained encoding module to encode it, so as to obtain triphonetic encoding features.

[0119] The specific content of step S31 can refer to figure 1 Step S11, which will not be repeated here.

[0120] Step S32: Using the trained speech feature decoding module to decode the third linguistic coding feature to obtain a third speech feature.

[0121] After obtaining the third linguistic coding feature, use the trained speech...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the present invention provides a speech synthesis model training method, speech synthesis method and device, the speech synthesis model training method includes: obtaining the first word vector sequence corresponding to the Chinese character sentence of encoding training; using the encoding module to encode the first word vector The sequence is encoded to obtain the first linguistic coding feature; the linguistic feature decoding module is used to decode the linguistic feature of the first linguistic coding feature to obtain the linguistic decoding feature; according to the relationship between the linguistic decoding feature and the reference linguistic decoding feature The linguistic feature loss of the speech synthesis model is adjusted by adjusting the model parameters of the coding module of the speech synthesis model until the linguistic feature loss meets the linguistic feature loss threshold, and the trained coding module of the speech synthesis model is obtained. The speech synthesis model training method, speech synthesis method and related devices provided by the embodiments of the present invention can reduce the complexity of speech synthesis, improve the training accuracy of the encoder, and ensure the effect of synthesized speech.

Description

technical field [0001] The embodiments of the present invention relate to the field of computers, and in particular to a speech synthesis model training method, device, device and storage medium, and a speech synthesis method, device, device and storage medium. Background technique [0002] With the development of artificial intelligence technology, people pay more and more attention to speech synthesis technology. Using speech synthesis technology and speech recognition technology, on the one hand, computers and other equipment can generate spoken language that people can understand; Human-machine voice communication can be realized. [0003] In order to realize speech synthesis, the traditional parametric speech synthesis method can be used, which is divided into multiple parts such as linguistic feature prediction, duration prediction, and acoustic feature prediction. It is necessary to build and train models for each part to realize speech synthesis. [0004] It can be ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G10L13/02G10L25/03G10L25/30
CPCG10L13/02G10L25/03G10L25/30
Inventor 智鹏鹏杨嵩杨非刘子韬
Owner BEIJING XINTANG SICHUANG EDUCATIONAL TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products