Multi-microphone audio mixing method and device

Abstract

The present invention relates to the field of audio information processing. Disclosed are a method and apparatus for the audio mixing of multiple microphones. The method comprises: making a statistic analysis of the signal strength of each input channel during the current period, choosing on the basis of this at least two input channels with higher signal strength for audio testing, identifying the tested input channel with audio as the audio input channel; when there are at least two audio input channels, identifying the signal similarity between the signals of each audio input channel, then controlling the strobe of the audio input channel on the basis of this, and making the signal of the strobe audio input channel for weighted audio mixing output. The method and apparatus in the present invention are capable of reducing the erroneous judgment rate of input channel strobe and improving the audio quality after audio mixing.

Description

technical field [0001] The invention relates to the field of audio information processing, in particular to a multi-microphone sound mixing method and device. Background technique [0002] In the video conferencing system, it is necessary to use a microphone to collect the voice of the local speaker. The voice is encoded and transmitted to the remote end. After being decoded in the remote system, it is output to the speaker through a power amplifier for playback. In order to reduce the influence of room reverberation and background noise, a directional microphone is generally used to collect sound (ie pick up sound) in a video conferencing system. Since the directional microphone has the best sound pickup effect in the direction directly facing the microphone, in order to ensure good sound pickup effect when speakers from different directions speak, generally multiple directional microphones are needed to collect the voices of speakers from different directions. The pickup ...

AI Technical Summary

Problems solved by technology

This method can alleviate channel switching when speakers in different positions speak at the same time, but its disadvantage is that because only the signal strength information is used, two or more physically adjacent channels will be opened when a single person speaks, resulting in signal loss. Reduced noise ratio, increased reverberation and slurred speech

[0008] The above audio mixing method judges the channel gating based entirely on the signal strength. In many application scenarios, the performance is low and misjudgment is prone to occur:

[0009] 1) In a typical array microphone application, such as figure 2 , when a speaker who is far away from the array microphone speaks, the difference in signal strength collected by each microphone in the array microphone device is very small, which leads to misjudgment when mixing

[0010] 2) Even in the application where the microphones are scattered, due to the reflection of the desktop, whiteboard, wall, etc., such as Figure 4 As shown, it is a schematic diagram of a distributed sound pickup method with reflectors. The discrimination method based on signal strength is also prone to misjudgment, resulting in the channel with a large reflection / reverberation being wrongly selected, which seriously affects the voice after mixing. sound quality

[0011] In a stereo / multi-channel system, in addition to considering the energy mixing of different channels when mixing, it is also required that the mixed signal can still maintain the orientation (position) information of the original sound source. Microphones in different positions often correspond to different positions of the sound source. False gating can cause sudden shifts in the sound image position, causing greater disturbance to far-end listeners

Images