Chinese speech synthesis method based on phonemes and rhythm structures

A technology of speech synthesis and prosody, applied in speech synthesis, speech analysis, instruments, etc., can solve problems such as strong mechanical sense, unnatural sound, and slow synthesis speed, so as to improve synthesis speed, sound quality and synthesis efficiency, Phoneme Set Simple Effects

Active Publication Date: 2019-12-03
XI AN JIAOTONG UNIV
View PDF10 Cites 84 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] In order to solve the problems existing in the prior art, the present invention provides a Chinese speech synthesis method based on phoneme and prosodic structure, which is used to solve the problems that the synthesized voice is not natural enough, the mechanical sense is strong and the synthesis speed is slow

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Chinese speech synthesis method based on phonemes and rhythm structures
  • Chinese speech synthesis method based on phonemes and rhythm structures
  • Chinese speech synthesis method based on phonemes and rhythm structures

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The exemplary embodiments will be described in detail below in conjunction with the accompanying drawings:

[0033] Such as figure 1 As shown, the Chinese speech synthesis method based on phoneme and prosodic structure is divided into training phase and synthesis phase. During the training phase, the steps are as follows:

[0034] Step 1. Extract prosodic structural features from the prosodic labeling information of the text to be processed

[0035] Prosodic labeling information includes four pause levels of "#1", "#2", "#3", and "#4". The three levels of intonation phrase (IPH) and intonation phrase (IPH) have a certain inclusion relationship. The prosodic word boundary contains the prosodic phrase boundary, and the prosodic phrase boundary contains the prosodic intonation phrase boundary. Any position where a pause occurs in a sentence is a prosodic word boundary. The position where "#2", "#3" or "#4" appears is a prosodic phrase boundary, and the position where "#...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a Chinese speech synthesis method based on phonemes and rhythm structures. The method is divided into a training stage and a synthesis stage, and comprises the steps of extracting therhythm structure features from the rhythm labeling information in a to-be-processed text according to the linguistic knowledge, and training a rhythm model based on the rhythm structure features; preprocessing the to-be-processed text and an audio to obtain a pinyin sequence containing the rhythm information and the corresponding acoustic features, then training an acoustic model, and deploying the trained rhythm model and acoustic model to a background; obtaining a text containing the rhythm information corresponding to the input text according to the rhythm model; converting into a pinyin sequence with rhythm information, and inputting into the acoustic model to obtain a linear frequency spectrum; and converting the linear frequency spectrum into the audio. According to the Chinesespeech synthesis method, the synthesized voice can be more natural, and especially for the longer clauses, the pause position can be determined. In addition, the model is deployed to the background at the synthesis stage, and the model loading time is saved, so that the voice synthesis speed can be increased.

Description

technical field [0001] The invention belongs to the field of artificial intelligence, and in particular relates to a Chinese speech synthesis method based on phoneme and prosodic structure. Background technique [0002] Speech synthesis, also known as Text to Speech, or TTS for short, is an AI technology that converts text into sound, and plays a vital role in human-computer interaction. Whether it is application software such as voice assistants, map navigation, entertainment and education, or hardware devices such as air conditioners, speakers, and TVs, you can see the shadow of speech synthesis. With more and more scenarios where people interact with people, such as smart homes, autonomous driving, and smart medical care, users have put forward new requirements for the experience of human-computer interaction—synthesized voices are more natural and more like real people. This makes speech synthesis technology an increasingly hot research direction. [0003] Traditional ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L13/10G10L13/08G10L25/24G10L25/30
CPCG10L13/10G10L13/08G10L25/24G10L25/30
Inventor 张春霞谢壮壮
Owner XI AN JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap