Personalized speech synthesis model creation, speech synthesis and test method and device thereof

A speech synthesis and model technology, applied in the field of artificial intelligence, can solve the problems of time-consuming, cumbersome process, high cost of training data, etc., and achieve the effect of improving user experience and good robustness

Pending Publication Date: 2021-06-01
ALIBABA GRP HLDG LTD
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] For the business demand scenario of personalized speech synthesis, in order to synthesize the specific style of speech of a personalized speaker, it is necessary to further analyze the characteristics of the personalized speaker on the basis of the above-mentioned multi-speaker Neural TTS model. Learning, in order to ensure the learning effect, requires a large amount of training data for the personalized speaker, but the acquisition of training data requires high cost investment, not only the process is cumbersome, but also takes a long time, which will seriously affect the user experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Personalized speech synthesis model creation, speech synthesis and test method and device thereof
  • Personalized speech synthesis model creation, speech synthesis and test method and device thereof
  • Personalized speech synthesis model creation, speech synthesis and test method and device thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0102] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0103] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough underst...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a personalized speech synthesis model creation method, a speech synthesis method and a device thereof. The method comprises the following steps: selecting similar speakers belonging to the same category as a user from a plurality of speakers of a multi-speaker speech synthesis model; and training the multi-speaker speech synthesis model according to the training data of the user and the selected similar speakers to obtain a personalized speech synthesis model of the user. The voice of the specific speaking style of the target speaker can be synthesized, and the user experience is improved.

Description

technical field [0001] The invention relates to the technical field of artificial intelligence, in particular to a creation method of a personalized speech synthesis model, a speech synthesis and testing method and device. Background technique [0002] Voice interaction scenarios in artificial intelligence technology require personalized voice synthesis. Personalized speech synthesis is a strong demand in business, and it is also one of the future trends in the field of speech synthesis. [0003] In traditional speech synthesis technology, using hundreds of hours of training data from hundreds of speakers, a multi-speaker speech synthesis system based on massive data can be constructed. Specifically, a multi-speaker speech synthesis model can be used, for example, based on neural The text-to-speech Neural TTS (Text-To-Speech) model of the network. In the training data of this model, the amount of speech data of a single speaker often ranges from several hours to dozens of h...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L13/02G10L13/047G10L13/10G10L15/05
CPCG10L13/02G10L13/047G10L13/10G10L15/05
Inventor 黄智颖霍媛圆雷鸣
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap