Microphone array voice reinforcing system and microphone array voice reinforcing method with combination of audio information and video information

Abstract

The invention discloses a microphone array voice reinforcing system and a microphone array voice reinforcing method with combination of audio information and video information. The system comprises a video acquisition module, a microphone array receiving module, an audio-and-video incoming wave direction combined-estimation module, a microphone array voice reinforcing module and an audio-and-video combined voice reinforcing module. The video acquisition module is used for acquiring a video signal of a speaker in an application scene. The microphone array receiving module is used for receiving an audio signal of a speaker. The audio-and-video incoming wave direction combined-estimation module performs combined estimation for the audio incoming wave direction of the speaker by means of audio information and video information. The microphone array voice reinforcing module utilizes the audio signal which is received by the microphone array receiving module for reinforcing a voice signal. The audio-and-video combined voice reinforcing module performs secondary reinforcing on the voice by means of combination of the audio signal and the video signal. According to the microphone array voice reinforcing system and the microphone array voice reinforcing method, the performance of the microphone array voice reinforcing system can be remarkably improved. The microphone array voice reinforcing system and the microphone array voice reinforcing method can be widely used for occasions of a video conference, an on-vehicle telephone, a mobile video communication terminal, etc.

Description

technical field [0001] The invention relates to the field of speech signal processing, in particular to a microphone array speech enhancement system for fusion of audio and video information. Background technique [0002] In the actual use environment, the communication equipment is susceptible to interference such as background noise and reverberation, which affects the quality and intelligibility of the voice signal. Therefore, in many communication applications, effective voice enhancement processing is required to suppress noise and improve voice. Clarity, intelligibility and comfort. [0003] At present, the commonly used speech enhancement methods mainly include two categories. One is the speech enhancement method based on a single microphone, including spectral subtraction, Wiener filter, MMSE, Kalman filter, wavelet transform, etc. This type of method uses a single microphone to receive speech signals. The noise is suppressed by filtering and processing in the time ...

AI Technical Summary

Problems solved by technology

However, the existing microphone array speech enhancement technologies are all based on air-conduction speech sensors, which have the following deficiencies in practical applications: (1) when the environmental noise is strong, the output speech quality is not high; (2) when the environment is used When there are multiple sound sources in the environment,

Images