Speech synthesis method and speech synthesis device

Abstract

The invention discloses a speech synthesis method. The method comprises the steps that the language type of statement text information to be synthesized is determined, wherein the language type comprises a first language type and a second language type; a first base model corresponding to the first language type and a second base model corresponding to the second language type are determined; a target tone is determined; according to the target tone, self-adaptive transforming is carried out on the first base model and the second base model; according to first and second base models after self-adaptive transforming, the statement text information to be synthesized is trained to generate corresponding spectrum parameters and fundamental frequency parameters; according to the target tone, the fundamental frequency parameters of the first language type and the second language type are adjusted; and according to the spectrum parameter of the first language type, the spectrum parameter of the second language type and the adjusted fundamental frequency parameters of the first language type and the second language type, target speech is synthesized.

Description

technical field [0001] The invention relates to the technical field of speech synthesis, in particular to a speech synthesis method and a speech synthesis device. Background technique [0002] With the development of speech synthesis technology and popularization of applications, speech synthesis services are being accepted and used by more and more users. Among users of speech synthesis services, a large part are bilingual or multilingual users, and speech synthesis is increasingly applied to multilingual content occasions. Therefore, there is a demand for multilingual speech synthesis, among which the mixed reading of Chinese and English is the most common. Users generally require intelligibility for multilingual speech synthesis, followed by accurate, natural and uniform timbre. Under the condition that the current speech synthesis technology has basically solved the intelligibility, how to synthesize natural, accurate and uniform multilingual speech has become a techni...

AI Technical Summary

Problems solved by technology

[0004] However, the current problems are: (1) the method of using data of different native speakers for different languages ​​will cause the problem of inconsistent synthesized timbres, which will affect the naturalness and user experience of speech synthesis; (2) the use of multilingual In the method of speaker data, most of the speakers are not idiomatic in languages ​​other than their native language, and have an accent, which is quite different from that of native speakers, which reduces user experience. Pronunciation is not standard enough, and the speakers who are standard in multiple languages ​​are usually professionals, and the cost of data collection is high

Images