A method of cloning accent and rhyme based on speech training

Abstract

A method for cloning accents and rhymes based on speech training, which discloses the use of typical classified texts representing different intonations in training texts, and obtains units containing accents and rhymes under the same phonetic symbol of the user in several different intonations after training, from which phonemes and phonemes are extracted The segment unit is the content of the sound library, which fully retains the accent and rhyme characteristics of the user's personalized voice. When cloning the simulated voice, the corresponding phoneme group is obtained according to the intonation represented by the text features and the training experience. Align and correct synthesized speech to achieve fidelity cloning of accents and tones.

Description

technical field [0001] The invention relates to the technical field of voice cloning, in particular to a method for cloning accents and tones based on voice training. Background technique [0002] Voice technology is now one of the hottest and most cutting-edge technical fields in scientific and technological research. Voice technology is also a subject of vigorous research by many international technology companies such as Google and Xunfei. There is a LYREBIRD (Lyrebird) website platform abroad that provides voice cloning services. , the user only needs to read aloud through the text of about 30 sentences on the website platform, and the user can get the reading voice of the input text content, and the sound quality of the voice obtained is similar to the user's voice. Now it has become a hot topic, and many users are in major The video website platform releases this voice cloning video, but the LYREBIRD (Lyrebird) website platform is the same as other existing voice mode ...

AI Technical Summary

Problems solved by technology

[0002] Voice technology is now one of the hottest and most cutting-edge technical fields in scientific and technological research. Voice technology is also a subject of vigorous research by many international technology companies such as Google and Xunfei. There is a LYREBIRD (Lyrebird) website platform abroad that provides voice cloning services. , the user only needs to read aloud through the text of about 30 sentences on the website platform, and the user can get the reading voice of the input text content, and the sound quality of the voice obtained is similar to the user's voice. Now it has become a hot topic, and many users are in major The video website platform releases this voice cloning video, but the LYREBIRD (Lyrebird) website platform is the same as other existing voice mode cloning technologies. Although the sound quality is very close to the user's voice, it is a great breakthrough, but the released The human voice is still a mechanical electronic sound, and acoustic engineers all over the world have been working on making the machine "speak human", but most of the results are still far from the real human voice, which is blunt and unnatural. It is a common problem; at its root, the existing voice simulation cloning technology is basically based on the mandatory consistency of sound quality and pitch, and there is no cloning to simulate the voice content of the user's intonation, rhythm, accent, etc. that can represent the user's personalized characteristics

Images