Audio optimization method, related device, electronic equipment and storage medium

Abstract

The invention discloses an audio optimization method, a related device, electronic equipment and a storage medium. The audio optimization method comprises the steps: extracting a first audio representation of a collected audio, and extracting a second audio representation of a reference audio; based on the first audio representation and the second audio representation, respectively extracting a first echo representation, a first voice representation and a first noise representation; performing interaction processing on the first voice representation, the first echo representation and the first noise representation to obtain a second voice representation, a second echo representation and a second noise representation, wherein the interactive processing comprises echo suppression, noise suppression and speech enhancement; and acquiring an optimized target audio based on at least one of the second speech representation, the second echo representation and the second noise representation. According to the method, the audio optimization effect can be improved.

Description

technical field [0001] The present application relates to the technical field of audio processing, in particular to an audio optimization method and related devices, electronic equipment, and storage media. Background technique [0002] In real scenarios, due to the coupling between the speaker and the microphone in electronic devices such as mobile phones, smart speakers, and TVs, the microphone will collect the signal from the speaker to form an echo system, and there is inevitably noise in the environment, and the audio quality will be reduced. be greatly affected. [0003] Taking the communication field as an example, if the sound of the near-end speaker and the far-end speaker played by the loudspeaker are transmitted to the far end at the same time, there will be a delay through network transmission, and the far-end speaker will hear his own echo and environmental noise, which will seriously affect call experience, and even cause communication barriers; or, taking the...

AI Technical Summary

Problems solved by technology

[0003] Taking the communication field as an example, if the sound of the near-end speaker and the far-end speaker played by the loudspeaker are transmitted to the far end at the same time, there will be a delay through network transmission, and the far-end speaker will hear his own echo and environmental noise, which will seriously affect call experience, and even cause communication barriers; or, taking the field of smart hardware as an example, when interactively controlling electronic devices such as smart TVs and smart speakers that have playback and interaction functions at the same time, the source of sound playback is Usually much closer to the microphone, affecting interaction recognition

Although several audio optimization algorithms have been proposed, the optimization results are not satisfactory.

Images