Audio signal processing equipment and method as well as electronic equipment

Abstract

The invention discloses audio signal processing equipment and an audio signal processing method as well as electronic equipment. The audio signal processing equipment comprises a microphone array, an audio localization device, a camera, an image localization device and a sound source classifier, wherein the microphone array comprises a plurality of directional microphones having different sound pickup areas; the audio localization device is used for identifying a first group of sound sources and for determining position of each sound source in an audio coordinate system; the camera is used for capturing scene images of a current scene, wherein the current scene at least covers the sound pickup areas of the plurality of directional microphones; the image localization device is used for identifying a second group of sound sources and for determining position of each sound source in an image coordinate system; and the sound source classifier is used for classifying each sound source in the first and second groups of sound sources in accordance with a registration relation between audio and the image coordinate system, the position of each sound source in the audio coordinate system as well as the position of each sound source in the image coordinate system. Therefore, the precise classification of the sound sources can be achieved on the basis of double localization of the directional microphones and the camera.

Description

technical field [0001] The present application relates to the field of audio technology, and more specifically, relates to an audio signal processing device, an audio signal processing method, an electronic device, a computer program product, and a computer-readable storage medium. Background technique [0002] Whether it is an intelligent speech recognition system (for example, smart home appliances, robots, etc.), or a traditional voice communication system (for example, a conference system, a voice over Internet protocol VoIP system, etc.), the problem of noise cancellation will be encountered. [0003] Current existing noise cancellation techniques are based on a combination of omnidirectional microphone arrays and beamforming algorithms. Omnidirectional microphones have omnidirectional pickup response, that is, they respond equally to sound from all directions. Multiple omnidirectional microphones can be configured in an array to create a directional response to enhanc...

AI Technical Summary

Problems solved by technology

[0004] However, the omnidirectional microphone array has the following limitations in noise reduction processing, that is, it is impossible to distinguish the type of sound source. Simply using the spatial domain algorithm to eliminate noise, enhance one sound source angle and weaken the other sound source angles, it is easy to Focus on signal damage

Images