Sound localization method and device and electronic equipment

Abstract

The invention discloses a sound localization method and device and electronic equipment. The method comprises the steps: obtaining a first image of a sound source at the first position through a camera; determining a first pixel size of an extension direction size scale of a reference portion of the sound source in the first image, wherein the extension direction size scale is a true size scale of the reference portion in the extension direction; obtaining a first camera distance between the first position and the reference position of the camera; determining a location mapping relationship according to the first pixel size and the first camera distance, wherein the location mapping relationship is applied to determining a second camera distance between a second position and the reference position of the camera according to a second pixel size of the extension direction size scale in a second image after the second image of the sound source at the second position is obtained through the camera. Therefore, the sound source can be accurately and completely located.

Description

technical field [0001] The present application relates to the field of audio technology, and more specifically, to a sound source localization method, device, electronic equipment, computer program product, and computer-readable storage medium. Background technique [0002] In the voice experience function of smart devices, if the device can accurately determine the direction and distance of sound sources such as users, there will be many applications that can be implemented, such as multimedia virtual surround experience, panoramic sound, four-dimensional (4D) Movies, intelligent human-computer interaction, intelligent device interaction, entertainment system, etc. [0003] Most of the existing sound source localization systems and methods are implemented based on microphone arrays. When the microphone array is applied to the far-field sound source localization, due to the particularity of the far-field sound field model, the existing sound source localization technology b...

AI Technical Summary

Problems solved by technology

When the microphone array is applied to the far-field sound source localization, due to the particularity of the far-field sound field model, the existing sound source localization technology based on the microphone array cannot simultaneously determine the near-field sound source as in the near-field application direction and distance, but can only locate the direction of the far-field sound source, resulting in the defect that accurate and complete far-field sound source positioning cannot be achieved

[0004] Therefore, the existing sound source localization technology is ineffective and the user experience is poor

Images