The present invention is applicable to the field of audio
processing, and discloses a method for voice conversion of real-time speech, a terminal device, and a storage medium. The method for voice conversion of real-time speech includes: generating original speech data according to real-time conversation audio, and determining a conditional feature, a diversity feature, and a padding data
mask according to the original speech data; determining a first
tensor information according to the conditional feature, the diversity feature, and the padding data
mask, and determining a speaker embedding vector according to the original speech data; determining a second
tensor information according to the first
tensor information, the speaker embedding vector, and the padding data
mask; generating a target
timbre audio according to the second tensor information, the speaker embedding vector, and the
pitch frequency of the original speech data. The present invention significantly improves the reconstruction accuracy of the original
timbre features in the voice conversion process, enables the generated speech to reach the level of a real person in
perception dimensions such as
timbre similarity and intonation naturalness, and improves the authenticity of voice conversion of real-time speech.