A method and apparatus for improving sound source localization accuracy for binaural hearing aids

Abstract

The application provides a method and device for improving sound source positioning accuracy of a binaural hearing aid, which is applied to the binaural hearing aid, and the method comprises the following steps: acquiring a first frequency signal and a second frequency signal, and recording intensity information and respective acquisition time stamps of the first frequency signal and the second frequency signal, wherein the first frequency signal and the second frequency signal are the same specific frequency signal with different acquisition positions; if the acquisition time stamp of the first frequency signal is synchronous or earlier than that of the second frequency signal, when the binaural hearing aid is affected by a head shadow effect, the intensity information difference between the first frequency signal and the second frequency signal and the time difference of the acquisition time stamps are calculated, the analog distance of the specific frequency signal affected by the head shadow effect on a propagation path is deduced, the intensity information of the analog frequency signal and the analog acquisition time stamp are calculated through the difference of sound wave propagation speeds in different media, and available frequency information can be generated.

Description

Technical Field

[0001] This invention patent relates to the field of hearing aid technology, specifically to a method and apparatus for improving the sound source localization accuracy of binaural hearing aids. Background Technology

[0002] Binaural hearing aids are devices used to improve the hearing of people with hearing loss. They capture sound through a built-in microphone, enhance specific frequencies of sound through digital signal processing technology, and reduce unwanted noise. Finally, the processed sound is transmitted to the user's ear through a speaker. Binaural hearing aids are especially suitable for people with hearing loss in both ears because they can improve the accuracy of sound source localization, improve speech resolution in noise, enhance the binaural summation effect, and reduce hearing loss in the non-wearing ear. Chinese Patent Publication No. CN112235705B discloses a binaural hearing aid, comprising: a first and a second hearing aid wirelessly connected and clock-synchronized, each hearing aid having a pickup module for acquiring audio data, and each generating a count value representing a clock count corresponding to the audio data acquired by its respective pickup module; the first hearing aid sends the count value to the second hearing aid, and the second hearing aid, based on the count value representing the audio data acquired by the first and second hearing aids, generates a clock count value corresponding to the audio data acquired by its respective pickup module; the first hearing aid sends the count value to the second hearing aid, and the second hearing aid generates a clock count value corresponding to the audio data acquired by the first and second hearing aids, and generates a clock count value corresponding to the audio data acquired by its respective pickup module. The two hearing aids adjust themselves based on the difference in clock count values ​​corresponding to the audio data collected by their respective pickup modules, in order to synchronize with the audio sampling of the first hearing aid. The clocks of the first and second hearing aids are synchronized. The second hearing aid adjusts itself based on the first and second count values ​​to achieve synchronization with the first hearing aid. The audio sampling of the hearing aid is synchronized, which avoids the problem of large time delay in binaural hearing aids affecting the user's hearing experience; The aforementioned technology determines the location of a sound source using traditional sound source localization techniques. However, since the microphones are located on both sides of the head, at least one audio data point is affected by the head shadow effect, resulting in significant differences in the information between the two sets of audio data and causing misjudgment of the sound source location. Therefore, this invention provides a method and apparatus for improving the sound source localization accuracy of binaural hearing aids to solve the above problems.

[0003] Invention Patent Content In view of the deficiencies in the prior art, this invention provides a method and apparatus for improving the sound source localization accuracy of binaural hearing aids, so as to solve the defects existing in the sound source localization technology of binaural hearing aids.

[0004] According to a first aspect of the present disclosure, a preferred embodiment of the present invention provides a method for improving the sound source localization accuracy of a binaural hearing aid, applied to a binaural hearing aid, the method comprising: Acquire a first frequency signal and a second frequency signal, and record the intensity information of the first frequency signal and the second frequency signal and their respective acquisition timestamps, wherein the first frequency signal and the second frequency signal are the same specific frequency signal acquired at different locations; If the first frequency signal is synchronized with or earlier than the acquisition timestamp of the second frequency signal, the strength information of the first frequency signal and the acquisition timestamp of the first frequency signal are integrated into usable frequency information. If the first frequency signal is acquired later than the second frequency signal's acquisition timestamp, then the intensity information of the simulated frequency signal after the specific frequency signal attenuates through the simulated distance and the simulated acquisition timestamp are calculated, and the intensity information of the simulated frequency signal and the simulated acquisition timestamp are integrated into usable frequency information, wherein the simulated distance is the length of the specific frequency signal affected by the head shadow effect on the propagation path.

[0005] In one embodiment, if the first frequency signal is acquired later than the second frequency signal's acquisition timestamp, then the intensity information of the simulated frequency signal after the specific frequency signal attenuates over a simulated distance and the simulated acquisition timestamp are calculated, and the intensity information of the simulated frequency signal and the simulated acquisition timestamp are integrated into usable frequency information, wherein the simulated distance is the length of the specific frequency signal affected by the head shadow effect along its propagation path, including: Calculate the attenuation value of the intensity information of the first frequency signal relative to the intensity information of the second frequency signal; The azimuth information of the acquisition position of the second frequency signal relative to the acquisition position of the first frequency signal is matched according to the attenuation value, wherein the azimuth information is the angle between the maximum distance between the acquisition positions of the first frequency signal and the acquisition positions of the second frequency signal and the length of the specific frequency signal affected by the head shadow effect on the propagation path. Calculate the product of the azimuth information and the maximum distance between the acquisition location of the first frequency signal and the acquisition location of the second frequency signal; this data is used as the simulated distance. The product of the simulated distance and the first unit attenuation value is calculated and the sum of the intensity information of the first frequency signal is used as the intensity information of the initial simulated frequency signal, wherein the first unit attenuation value is the attenuation intensity per unit length of the sound wave when affected by the head shadow effect. The difference between the intensity information of the initial signal at the simulated frequency and the product of the simulated distance and the second unit attenuation value is calculated. This data is used as the intensity information of the simulated frequency signal, where the second unit attenuation value is the attenuation intensity of the sound wave per unit length in the air.

[0006] Calculate the difference between the acquisition timestamp of the first frequency signal and the quotient of the analog distance and the first unit attenuation value. The sum of this difference and the quotient of the analog distance and the second unit attenuation value is used as the analog acquisition timestamp of the analog frequency signal.

[0007] In one embodiment, the available frequency information is the raw parameter data of the binaural hearing aid sound source localization system.

[0008] According to a second aspect of the present disclosure, this invention provides a device for improving the sound source localization accuracy of a binaural hearing aid, applied to a binaural hearing aid, the device comprising: The acquisition module is used to acquire a first frequency signal and a second frequency signal, and record the intensity information of the first frequency signal and the second frequency signal and their respective acquisition timestamps, wherein the first frequency signal and the second frequency signal are the same specific frequency signal acquired at different locations; The first generation module is used to integrate the intensity information of the first frequency signal and the acquisition timestamp of the first frequency signal into usable frequency information if the first frequency signal is synchronized with or earlier than the acquisition timestamp of the second frequency signal. The second generation module is used to calculate the intensity information of the simulated frequency signal after the specific frequency signal is attenuated by the simulated distance and the simulated acquisition timestamp if the first frequency signal is acquired later than the second frequency signal. The intensity information of the simulated frequency signal and the simulated acquisition timestamp are then integrated into usable frequency information. The simulated distance is the length of the specific frequency signal affected by the head shadow effect on the propagation path.

[0009] In one embodiment, the second generation module includes: The first calculation module is used to calculate the attenuation value of the intensity information of the first frequency signal relative to the intensity information of the second frequency signal. The matching module is used to match the azimuth information of the acquisition position of the second frequency signal relative to the acquisition position of the first frequency signal according to the attenuation value, wherein the azimuth information is the angle between the maximum distance between the acquisition positions of the first frequency signal and the acquisition positions of the second frequency signal and the length of the specific frequency signal affected by the head shadow effect on the propagation path. The second calculation module is used to calculate the product of the azimuth information and the maximum distance between the acquisition location of the first frequency signal and the acquisition location of the second frequency signal, and this data is used as the simulated distance. The third calculation module is used to calculate the sum of the product of the simulated distance and the first unit attenuation value and the intensity information of the first frequency signal. This data serves as the intensity information of the initial simulated frequency signal, wherein the first unit attenuation value is the attenuation intensity per unit length of the sound wave when affected by the head shadow effect. The fourth calculation module is used to calculate the difference between the intensity information of the initial analog frequency signal and the product of the analog distance and the second unit attenuation value. This data serves as the intensity information of the analog frequency signal, wherein the second unit attenuation value is the attenuation intensity of the sound wave per unit length in the air.

[0010] The fifth calculation module is used to calculate the difference between the acquisition timestamp of the first frequency signal and the quotient of the analog distance and the first unit attenuation value. The sum of this difference and the quotient of the analog distance and the second unit attenuation value is used as the analog acquisition timestamp of the analog frequency signal.

[0011] In one embodiment, the available frequency information is the raw parameter data of the binaural hearing aid sound source localization system.

[0012] According to a third aspect of the present disclosure, the present invention provides an apparatus for improving the sound source localization accuracy of binaural hearing aids, comprising: processor; Memory used to store the processor's executable instructions; The processor is configured to perform the steps of the above method.

[0013] According to a fourth aspect of the present disclosure, the present invention provides a computer-readable storage medium having a computer program stored thereon, the computer program being executed by a processor of the steps of the above-described method.

[0014] As can be seen from the above technical solution, the method and device provided by this invention for improving the sound source localization accuracy of binaural hearing aids can, when binaural hearing aids are affected by the head shadow effect, calculate the intensity difference between the first frequency signal and the second frequency signal and the time difference of the timestamp acquisition. This allows for the derivation of the simulated distance of a specific frequency signal affected by the head shadow effect along its propagation path. Furthermore, by using the difference in the propagation speed of sound waves in different media, the intensity information of the simulated frequency signal and the simulated acquisition timestamp can be calculated, generating usable frequency information. When using the usable frequency information for sound source localization calculation, the influence of the head shadow effect is avoided, improving the accuracy of sound source localization and resulting in better gain of the hearing aid.

[0015] It should be understood that the above general description and the following detailed description are merely exemplary and do not limit this disclosure. Attached Figure Description

[0016] To more clearly illustrate the specific embodiments of this invention, the accompanying drawings used in the description of the specific embodiments or prior art will be briefly introduced below. In all the drawings, the elements or parts are not necessarily drawn to scale.

[0017] Figure 1A flowchart of a method for improving the sound source localization accuracy of binaural hearing aids provided by this invention patent; Figure 2 A flowchart of step S30 in a method for improving the sound source localization accuracy of a binaural hearing aid provided by this invention patent; Figure 3 A block diagram of a device for improving the sound source localization accuracy of binaural hearing aids, provided for this invention patent; Figure 4 A block diagram of another device for improving the sound source localization accuracy of binaural hearing aids provided by this invention patent. Detailed Implementation

[0018] The embodiments of the technical solution of this invention will now be described in detail with reference to the accompanying drawings. These embodiments are merely illustrative of the technical solution of this invention and are therefore intended to limit the scope of protection of this invention.

[0019] Figure 1 This invention provides a flowchart of a method for improving the sound source localization accuracy of binaural hearing aids. This method is applied to a digital hearing aid terminal, which can display images, videos, text messages, WeChat messages, etc. The terminal can be equipped with any terminal device with a display screen, such as a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, or personal digital assistant. This embodiment of the method for improving the sound source localization accuracy of binaural hearing aids is applied to binaural hearing aids, such as… Figure 1 As shown, the method includes the following steps S10-S30: In step S10, a first frequency signal and a second frequency signal are acquired, and the intensity information of the first frequency signal and the second frequency signal and their respective acquisition timestamps are recorded. The first frequency signal and the second frequency signal are the same specific frequency signal acquired at different locations. In this implementation, the first frequency signal and the second frequency signal are acquired by two microphones located on both sides of the head. Since the two microphones are positioned differently relative to the head, there are differences in intensity and acquisition time between the first frequency signal and the second frequency signal.

[0020] In step S20, if the first frequency signal is synchronized with or earlier than the acquisition timestamp of the second frequency signal, the strength information of the first frequency signal and the acquisition timestamp of the first frequency signal are integrated into usable frequency information. In step S30, if the first frequency signal is acquired later than the second frequency signal, the intensity information of the simulated frequency signal after the specific frequency signal is attenuated by the simulated distance and the simulated acquisition time stamp are calculated, and the intensity information of the simulated frequency signal and the simulated acquisition time stamp are integrated into usable frequency information, wherein the simulated distance is the length of the specific frequency signal affected by the head shadow effect on the propagation path. In this implementation, in a binaural hearing aid, when either microphone is closer to the sound source relative to the user's head, the available frequency information includes the intensity information of the first frequency signal and the acquisition timestamp of the first frequency signal. That is, the data collected by that microphone is usable data. When either microphone is farther from the sound source relative to the user's head, the available frequency information includes the intensity information of the analog frequency signal and the analog acquisition timestamp of the analog frequency signal. That is, the data collected by that microphone is unusable data. In this case, usable data needs to be calculated based on the unusable data. It is worth noting that although traditional binaural hearing aids directly use data from both sets of microphones for sound processing, which helps users determine the location of the sound source under the influence of head shadow effects, directly using data from both sets of microphones for sound source localization will cause errors in the sound source location. This results in an excessively large distance between the actual sound source location and the calculated sound source location. This is detrimental to the implementation of the range gain and directional gain of the binaural hearing aid, interfering with the use effect of the binaural hearing aid to some extent, easily causing user misjudgment, and seriously affecting the user experience. Improvement is urgently needed.

[0021] Among them, such as Figure 2 As shown, in step S30, if the first frequency signal is acquired later than the second frequency signal's acquisition timestamp, the intensity information of the simulated frequency signal after the specific frequency signal attenuates through simulated distance and the simulated acquisition timestamp are calculated, and the intensity information of the simulated frequency signal and the simulated acquisition timestamp are integrated into usable frequency information. The simulated distance is the length of the specific frequency signal affected by the shadow effect along its propagation path. This includes the following steps S201-S203: In step S31, the attenuation value of the intensity information of the first frequency signal relative to the intensity information of the second frequency signal is calculated. In this implementation, the different positions of the user's head relative to the sound source result in different lengths of sound waves affected by the head shadow effect along the propagation path, which in turn affects the attenuation value. Through experiments, the mapping relationship between the angle between the straight line between the two sets of microphones and the straight line between the sound source and the microphone and the attenuation value can be obtained. Given the attenuation value, the angle between the straight line between the two sets of microphones and the straight line between the sound source and the microphone can be matched, i.e., the orientation information.

[0022] In step S32, the azimuth information of the acquisition position of the second frequency signal relative to the acquisition position of the first frequency signal is matched according to the attenuation value. The azimuth information is the angle between the maximum distance between the acquisition positions of the first and second frequency signals and the length of the specific frequency signal affected by the head shadow effect on the propagation path.

[0023] In step S33, the product of the azimuth information and the maximum distance between the acquisition location of the first frequency signal and the acquisition location of the second frequency signal is calculated, and this data is used as the simulated distance. In this implementation, the maximum distance between the acquisition positions of the first and second frequency signals is the known straight-line distance between the two sets of microphones. When the sound source is located on the straight line between the two sets of microphones, the angle between the maximum distance between the acquisition positions of the first and second frequency signals and the length of the specific frequency signal affected by the head shadow effect on the propagation path is 0. The maximum distance between the acquisition positions of the first and second frequency signals is equal to the length of the specific frequency signal affected by the head shadow effect on the propagation path. When the sound source is not located on the straight line between the two sets of microphones, the length of the specific frequency signal affected by the head shadow effect on the propagation path can be calculated using the known straight-line distance between the two sets of microphones and the Pythagorean theorem.

[0024] In step S34, the product of the simulated distance and the first unit attenuation value is calculated and the sum of the intensity information of the first frequency signal is used as the intensity information of the initial simulated frequency signal. The first unit attenuation value is the attenuation intensity per unit length of the sound wave when affected by the head shadow effect. In step S35, the difference between the intensity information of the initial analog frequency signal and the product of the analog distance and the second unit attenuation value is calculated. This data is used as the intensity information of the analog frequency signal, wherein the second unit attenuation value is the attenuation intensity of the sound wave per unit length in the air. In this implementation, given the known length of the propagation path affected by the shadow effect of a specific frequency signal, the intensity information of the specific frequency signal before being affected by the shadow effect can be calculated based on the sum of the intensity information of the first frequency signal and the total attenuation value of the specific frequency signal under the shadow effect. This is the intensity information of the initial simulated frequency signal. Then, based on the difference between the intensity information of the initial simulated frequency signal and the total attenuation value of the specific frequency signal before being affected by the shadow effect, the intensity information value of the specific frequency signal after traveling the simulated distance under the state of not being affected by the shadow effect can be calculated.

[0025] In step S36, the difference between the acquisition timestamp of the first frequency signal and the quotient of the analog distance and the first unit attenuation value is calculated, and the sum of this difference and the quotient of the analog distance and the second unit attenuation value is used as the analog acquisition timestamp of the analog frequency signal. In this implementation, given the length of the propagation path affected by the shadow effect of a specific frequency signal, the acquisition timestamp of the first frequency signal and the difference between the acquisition timestamp of the specific frequency signal and the total attenuation time of the signal affected by the shadow effect are calculated first. This allows us to calculate the acquisition timestamp of the specific frequency signal before the shadow effect. Then, we calculate the acquisition timestamp of the specific frequency signal before the shadow effect and the specific frequency signal itself. Finally, we calculate the sum of the acquisition timestamp of the specific frequency signal before the shadow effect and the total attenuation time of the specific frequency signal after traveling the simulated distance in the state where the signal is unaffected by the shadow effect. This gives us the simulated acquisition timestamp of the simulated frequency signal.

[0026] In one embodiment, the available frequency information is the raw parameter data of the binaural hearing aid sound source localization system; In this implementation, in a binaural hearing aid, the closer the sound source is to one microphone, the earlier that microphone will receive the sound compared to the other microphone. By measuring the time difference between the two microphones receiving the same sound, the position of the sound source relative to the listener can be calculated based on the speed of sound. The available frequency information can provide more accurate intensity information and timestamps, avoiding the large differences caused by the head shadow effect between the two sets of microphones. This greatly improves the accuracy of the time difference and intensity difference between the two microphones receiving the same sound, and significantly improves the accuracy of sound source localization.

[0027] The following are embodiments of the apparatus disclosed herein, which can be used to execute embodiments of the method disclosed herein.

[0028] Figure 3 This invention patent provides a block diagram of a device for improving the sound source localization accuracy of binaural hearing aids. This device can be implemented as part or all of an electronic device through software, hardware, or a combination of both. Figure 3 As shown, the device, applied to a binaural hearing aid, includes: The acquisition module 100 is used to acquire a first frequency signal and a second frequency signal, and record the intensity information of the first frequency signal and the second frequency signal and their respective acquisition timestamps, wherein the first frequency signal and the second frequency signal are the same specific frequency signal acquired at different locations. The first generation module 200 is used to integrate the intensity information of the first frequency signal and the acquisition timestamp of the first frequency signal into usable frequency information if the first frequency signal is synchronized with or earlier than the acquisition timestamp of the second frequency signal. The second generation module 300 is used to calculate the intensity information of the simulated frequency signal after the specific frequency signal is attenuated by the simulated distance and the simulated acquisition timestamp if the first frequency signal is acquired later than the acquisition timestamp of the second frequency signal, and to integrate the intensity information of the simulated frequency signal and the simulated acquisition timestamp into usable frequency information, wherein the simulated distance is the length of the specific frequency signal affected by the head shadow effect on the propagation path.

[0029] This disclosure addresses the issue of head shadow effects affecting binaural hearing aids. By calculating the intensity difference between a first frequency signal and a second frequency signal, and the time difference in the timestamp, it can deduce the simulated distance of a specific frequency signal affected by head shadow effects along its propagation path. Furthermore, by utilizing the difference in the propagation speed of sound waves in different media, it can calculate the intensity information of the simulated frequency signal and the simulated timestamp, thereby generating usable frequency information. When using usable frequency information for sound source localization calculations, the influence of head shadow effects is avoided, improving the accuracy of sound source localization and resulting in better gain performance for the hearing aid.

[0030] In one embodiment, such as Figure 3 As shown, the second generation module 300 includes: The first calculation module 301 is used to calculate the attenuation value of the intensity information of the first frequency signal relative to the intensity information of the second frequency signal. The matching module 302 is used to match the azimuth information of the acquisition position of the second frequency signal relative to the acquisition position of the first frequency signal according to the attenuation value, wherein the azimuth information is the angle between the maximum distance between the acquisition positions of the first frequency signal and the acquisition positions of the second frequency signal and the length of the specific frequency signal affected by the head shadow effect on the propagation path. The second calculation module 303 is used to calculate the product of the azimuth information and the maximum distance between the acquisition position of the first frequency signal and the acquisition position of the second frequency signal, and this data is used as the simulated distance. The third calculation module 304 is used to calculate the sum of the product of the simulated distance and the first unit attenuation value and the intensity information of the first frequency signal. This data is used as the intensity information of the initial simulated frequency signal. The first unit attenuation value is the attenuation intensity per unit length of the sound wave when affected by the head shadow effect. The fourth calculation module 305 is used to calculate the difference between the intensity information of the initial analog frequency signal and the product of the analog distance and the second unit attenuation value. This data is used as the intensity information of the analog frequency signal, wherein the second unit attenuation value is the attenuation intensity of the sound wave per unit length in the air.

[0031] The fifth calculation module 306 is used to calculate the difference between the acquisition timestamp of the first frequency signal and the quotient of the analog distance and the first unit attenuation value. The sum of this difference and the quotient of the analog distance and the second unit attenuation value is used as the analog acquisition timestamp of the analog frequency signal.

[0032] In one embodiment, the available frequency information is the raw parameter data of the binaural hearing aid sound source localization system.

[0033] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0034] This disclosure also provides another device for improving the sound source localization accuracy of binaural hearing aids: Figure 4 This is a block diagram illustrating a device 800 for improving the sound source localization accuracy of a binaural hearing aid, according to an exemplary embodiment. For example, device 800 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0035] Reference Figure 4 The device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0036] Processing component 802 typically controls the overall operation of device 800, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 802 may include one or more modules to facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

[0037] Memory 804 is configured to store various types of data to support the operation of device 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0038] Power supply component 806 provides power to various components of device 800. Power supply component 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power to device 800.

[0039] Multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 808 includes a front-facing camera and / or a rear-facing camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0040] Audio component 810 is configured to output and / or input audio signals. For example, audio component 810 includes a microphone (MIC) configured to receive external audio signals when device 800 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 804 or transmitted via communication component 816. In some embodiments, audio component 810 includes a speaker for outputting audio signals.

[0041] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0042] Sensor assembly 814 includes one or more sensors for providing status assessments of various aspects of device 800. For example, sensor assembly 814 may detect the on / off state of device 800, the relative positioning of components such as the display and keypad of device 800, changes in the position of device 800 or a component of device 800, the presence or absence of user contact with device 800, the orientation or acceleration / deceleration of device 800, and temperature changes of device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 814 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.

[0043] The communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other devices. The device 800 can access wireless networks based on communication standards, such as WiFi, 2G or 3G, or combinations thereof.

[0044] In one exemplary embodiment, the communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component 816 includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0045] In an exemplary embodiment, the apparatus 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0046] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, which can be executed by a processor 820 of the device 800 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0047] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0048] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A method for improving the sound source localization accuracy of binaural hearing aids, applied to binaural hearing aids, characterized in that, The method includes: Acquire a first frequency signal and a second frequency signal, and record the intensity information of the first frequency signal and the second frequency signal and their respective acquisition timestamps, wherein the first frequency signal and the second frequency signal are the same specific frequency signal acquired at different locations; If the first frequency signal is synchronized with or earlier than the acquisition timestamp of the second frequency signal, the strength information of the first frequency signal and the acquisition timestamp of the first frequency signal are integrated into usable frequency information. If the first frequency signal is acquired later than the second frequency signal's acquisition timestamp, then the intensity information of the simulated frequency signal after the specific frequency signal attenuates through the simulated distance and the simulated acquisition timestamp are calculated, and the intensity information of the simulated frequency signal and the simulated acquisition timestamp are integrated into usable frequency information, wherein the simulated distance is the length of the specific frequency signal affected by the head shadow effect on the propagation path.

2. The method according to claim 1, characterized in that, If the first frequency signal is acquired later than the second frequency signal's acquisition timestamp, then the intensity information of the simulated frequency signal after attenuation by the simulated distance and the simulated acquisition timestamp are calculated, and the intensity information of the simulated frequency signal and the simulated acquisition timestamp are integrated into usable frequency information. The simulated distance is the length of the specific frequency signal affected by the head shadow effect along its propagation path, including: Calculate the attenuation value of the intensity information of the first frequency signal relative to the intensity information of the second frequency signal; The azimuth information of the acquisition position of the second frequency signal relative to the acquisition position of the first frequency signal is matched according to the attenuation value, wherein the azimuth information is the angle between the maximum distance between the acquisition positions of the first frequency signal and the acquisition positions of the second frequency signal and the length of the specific frequency signal affected by the head shadow effect on the propagation path. Calculate the product of the azimuth information and the maximum distance between the acquisition location of the first frequency signal and the acquisition location of the second frequency signal; this data is used as the simulated distance. The product of the simulated distance and the first unit attenuation value is calculated and the sum of the intensity information of the first frequency signal is used as the intensity information of the initial simulated frequency signal, wherein the first unit attenuation value is the attenuation intensity per unit length of the sound wave when affected by the head shadow effect. The difference between the intensity information of the initial signal at the simulated frequency and the product of the simulated distance and the second unit attenuation value is calculated. This data is used as the intensity information of the simulated frequency signal, where the second unit attenuation value is the attenuation intensity of the sound wave per unit length in the air.

3. Calculate the difference between the acquisition timestamp of the first frequency signal and the quotient of the analog distance and the first unit attenuation value. The sum of this difference and the quotient of the analog distance and the second unit attenuation value shall be used as the analog acquisition timestamp of the analog frequency signal.

4. The method according to claim 1, characterized in that, The available frequency information is the raw parameter data of the binaural hearing aid sound source localization system.

5. A device for improving the sound source localization accuracy of binaural hearing aids, applied to binaural hearing aids, characterized in that, The method includes: The acquisition module is used to acquire a first frequency signal and a second frequency signal, and record the intensity information of the first frequency signal and the second frequency signal and their respective acquisition timestamps, wherein the first frequency signal and the second frequency signal are the same specific frequency signal acquired at different locations; The first generation module is used to integrate the intensity information of the first frequency signal and the acquisition timestamp of the first frequency signal into usable frequency information if the first frequency signal is synchronized with or earlier than the acquisition timestamp of the second frequency signal. The second generation module is used to calculate the intensity information of the simulated frequency signal after the specific frequency signal is attenuated by the simulated distance and the simulated acquisition timestamp if the first frequency signal is acquired later than the second frequency signal. The intensity information of the simulated frequency signal and the simulated acquisition timestamp are then integrated into usable frequency information. The simulated distance is the length of the specific frequency signal affected by the head shadow effect on the propagation path.

6. The apparatus according to claim 4, characterized in that, The second generation module includes: The first calculation module is used to calculate the attenuation value of the intensity information of the first frequency signal relative to the intensity information of the second frequency signal. The matching module is used to match the azimuth information of the acquisition position of the second frequency signal relative to the acquisition position of the first frequency signal according to the attenuation value, wherein the azimuth information is the angle between the maximum distance between the acquisition positions of the first frequency signal and the acquisition positions of the second frequency signal and the length of the specific frequency signal affected by the head shadow effect on the propagation path. The second calculation module is used to calculate the product of the azimuth information and the maximum distance between the acquisition location of the first frequency signal and the acquisition location of the second frequency signal, and this data is used as the simulated distance. The third calculation module is used to calculate the sum of the product of the simulated distance and the first unit attenuation value and the intensity information of the first frequency signal. This data serves as the intensity information of the initial simulated frequency signal, wherein the first unit attenuation value is the attenuation intensity per unit length of the sound wave when affected by the head shadow effect. The fourth calculation module is used to calculate the difference between the intensity information of the initial analog frequency signal and the product of the analog distance and the second unit attenuation value. This data serves as the intensity information of the analog frequency signal, wherein the second unit attenuation value is the attenuation intensity of the sound wave per unit length in the air.

7. The fifth calculation module is used to calculate the difference between the acquisition timestamp of the first frequency signal and the quotient of the analog distance and the first unit attenuation value, and the sum of the difference and the quotient of the analog distance and the second unit attenuation value is used as the analog acquisition timestamp of the analog frequency signal.

8. The apparatus according to claim 4, characterized in that, The available frequency information is the raw parameter data of the binaural hearing aid sound source localization system.

9. A device for improving the sound source localization accuracy of binaural hearing aids, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is configured to perform the steps of the method of any one of claims 1 to 3.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of any one of claims 1 to 3.

Images