Audio synthesis method and device, electronic equipment and computer readable storage medium

Abstract

The invention discloses an audio synthesis method and device, electronic equipment and a computer readable storage medium, and the method comprises the steps: obtaining a target dry sound audio, and generating phoneme information corresponding to the target dry sound audio; extracting audio features from the target dry sound audio; wherein the audio features comprise any one or a combination of several of fundamental frequency features, energy features and perception linear prediction features; and inputting the target dry sound audio, the phoneme information and the audio features into the trained neural network model to obtain a synthesized dry sound audio. Therefore, according to the audio synthesis method provided by the invention, the audio features are embedded into the synthesis process of the neural network model, so that the efficiency and accuracy of synthesizing the dry sound audio by the neural network model are improved, and the depicting ability of the neural network model on the target dry sound audio can be enhanced; therefore, the trained neural network model can generate the synthetic dry sound audio with better tone quality and richer sound details, and the tonequality of the final synthetic song is improved.

Description

technical field [0001] The present application relates to the technical field of sound synthesis, and more specifically, to an audio synthesis method, device, electronic equipment, and computer-readable storage medium. Background technique [0002] With the development of deep learning technology and audio signal processing technology, artificially synthesized singing voices have gradually become possible. People can use technology to generate dry voices, that is, pure human voices without music. These synthesized dry sounds are accompanied by an accompaniment to obtain a song. [0003] In the related art, a method based on parameter synthesis is used to synthesize dry sound, which can achieve accurate pronunciation time and controllable rhythm under the condition of accurate parameters, but the sound quality is generally poor, which in turn leads to poor sound quality of the synthesized audio. It can be seen that during the process of implementing the present invention, th...

AI Technical Summary

Problems solved by technology

[0003] In the related art, a method based on parameter synthesis is used to synthesize dry sound, which can achieve the effect of accurate pronunciation time and controllable rhythm under the condition of accurate parameters, but the sound quality is generally poor, which leads to poor sound quality of synthesized audio

It can be seen that in the process of realizing the present invention, the inventors have found that there are at least the following problems in the related art: the sound quality of the synthesized audio is relatively poor

Images