Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Voice synthesis method and device and electronic equipment

A technology of speech synthesis and speech library, applied in speech synthesis, speech analysis, instruments, etc., can solve the problems of strong machine sense of sound quality, poor stability outside the set, loss of details of sound quality and tone, etc., to improve the effect and improve the effect. Effect

Active Publication Date: 2019-07-23
BEIJING SINOVOICE TECH CO LTD
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The two have their own advantages and disadvantages, and they cannot completely replace each other: voice selection and splicing synthesis have realistic sound quality and real sound length, but the splicing flaws are obvious and the stability outside the set is poor; the statistical parameter synthesis is stable and the synergistic pronunciation is smooth, but the sound quality is strong and machine-like. Length averaging
After all, the reason why parametric synthesis can better balance the fit inside and outside the set and the softness of synergistic pronunciation is at the cost of "melting and flattening" the individuality of the samples in the set, and the details of sound quality and tone will be lost

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Voice synthesis method and device and electronic equipment
  • Voice synthesis method and device and electronic equipment
  • Voice synthesis method and device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0057] figure 1 It is a flowchart of steps of a speech synthesis method provided by an embodiment of the present invention.

[0058] refer to figure 1 As shown, the speech synthesis method provided in this embodiment is applied to electronic devices such as electronic computers or speech synthesis equipment, and specifically includes the following steps:

[0059] S1. Perform text analysis on the input text.

[0060] When the user directly inputs or other electronic equipment inputs the corresponding text, text analysis is performed on the input text, and the target primitive sequence and corresponding context information are obtained therefrom. The target primitive sequence here includes multiple target primitives.

[0061] S2. Using the traditional model decision tree to determine the subcategory numbers to which the contextual information respectively belongs in the voice selection target model of the speech library.

[0062] The voice selection target model here include...

Embodiment 2

[0151] figure 2 It is a structural block diagram of a speech synthesis device provided by an embodiment of the present invention.

[0152] refer to figure 2 As shown, the speech synthesis device provided by this embodiment is applied to electronic equipment such as electronic computers or speech synthesis equipment, and specifically includes a text analysis module 10, a first calculation module 20, a distance calculation module 30, a grid construction module 40, a second The calculation module 50 , the third calculation module 60 , the fourth calculation module 70 , the path selection module 80 and the splicing output module 90 .

[0153] The text analysis module is used to perform text analysis on the input text.

[0154] When the user directly inputs or other electronic equipment inputs the corresponding text, text analysis is performed on the input text, and the target primitive sequence and corresponding context information are obtained therefrom. The target primitive...

Embodiment 3

[0198] This embodiment provides an electronic device, such as a speech synthesis device, an electronic computer, or a mobile terminal, which is provided with the speech synthesis device provided in the previous embodiment. The device is used for text analysis of the input text to obtain the target primitive sequence and corresponding context information; for the context information, the traditional model decision tree is used to determine the subcategories of the context information in the statistical model of the speech library number and the corresponding Gaussian distribution model to obtain the corresponding pre-selection results; use the pre-selection results to form a column for each target primitive in turn, and finally make the sequence of target primitives form a set of candidate grids; input the context information into the deep learning model, Get the acoustic parameter envelope, primitive duration, and boundary frame acoustic parameters of each target primitive in t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a voice synthesis method and device and electronic equipment. According to the technical scheme, on a voice selection splicing synthesis path, a depth learningtechnology is moderately introduced, but a traditional statistical learning technology is not thoroughly abandoned, and thus the advantages of both parties are taken; the key innovation is that a depth learning model is adopted for generating simulation data to conduct back feeding on training of a traditional statistical learning model, the effect of traditional learning is improved from two aspects of algorithms and data, and thus the effect of voice synthesis is improved.

Description

technical field [0001] The invention relates to the technical field of speech synthesis, in particular to a speech synthesis method, device and electronic equipment. Background technique [0002] In recent years, as the wave of deep learning has swept across the related fields of machine learning, the field of speech synthesis has also been surging. From acoustic parameter modeling, speech enhancement, vocoder, to prosody analysis and other text preprocessing links, they have tried to apply State-of-the-art deep learning techniques, or even attempts to model "end-to-end" directly from text to waveforms, have achieved impressive results. [0003] In the past ten years of development in the field of speech synthesis, the contention between the two routes of statistical parameter synthesis and voice selection splicing synthesis has been maintained. The two have their own strengths and weaknesses, and they cannot completely replace each other: voice selection and splicing synth...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G10L13/08G10L25/30
CPCG10L13/08G10L25/30
Inventor 王愈李健张连毅武卫东
Owner BEIJING SINOVOICE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com