Method and apparatus for adjusting audio source of binaural hearing aid system
By comparing the signal intensity difference between the two hearing aids in the binaural hearing aid system, and combining the accelerometer data to adjust the audio parameters, the problem of inaccurate determination of the user's head movement direction in the prior art is solved, and a more accurate audio source is achieved Improve positioning and user experience.
Patent Information
- Application Number
- CN202411153777.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-08-21
- Filing Date
- 2024-08-21
- Publication Date
- 2025-02-21
AI Technical Summary
Existing binaural hearing aid systems are unable to accurately determine the direction of user's head movement, resulting in inaccuracy of spatial sound and time drift.
The first hearing aid and the second hearing aid respectively obtain the audio signal from the first audio source, and compare the signal intensity difference between the two, and combine the accelerometer data to determine the user's head movement and line of sight direction, thereby adjusting the audio parameters, such as Gain and attenuation.
It realizes more accurate audio source positioning and user experience, reduces spatial sound drift, and enhances users' voice understanding and cognition in streaming situations.
Smart Images

Figure CN119497025A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of hearing aids and binaural hearing aid systems, and more particularly to a method for improving a user's binaural hearing aid system experience. Background Art
[0002] It is possible to sense the head movement of a hearing aid user (e.g., of a binaural hearing aid system) using motion data obtained by sensors, such as data from an accelerometer, gyroscope, or magnetometer. However, it is not possible to infer the direction of the head movement from this data alone. In addition, all current systems have the disadvantage of not knowing whether the user is looking at their screen or streaming source or looking in a direction away from the streaming source, so it is impossible to set a true reference point for where the streaming sound should come from. Currently, if the system has not moved for a certain period of time, the system usually resets the spatial orientation to "in front of the user." This is because the headphones or hearing instruments have no way of knowing in which direction the TV or streaming source is located. This non-ideal solution means that the system is not accurate and the spatial sound will drift and move over time. Summary of the invention
[0003] Method for adjusting an audio source of a binaural hearing aid system
[0004] In one aspect of the present application, a method for adjusting an audio source of a binaural hearing aid system is disclosed. The method includes obtaining an audio signal from a first audio source through a first hearing aid. The method includes determining a first signal strength of the audio signal through the first hearing aid. The method includes obtaining the audio signal from the first audio source through a second hearing aid. The method includes determining a second signal strength of the audio signal through the second hearing aid. The method includes obtaining accelerometer data through the first hearing aid and / or the second hearing aid. Based on a difference between the first signal strength and the second signal strength satisfying a difference criterion and the accelerometer data indicating movement of the first hearing aid and / or the second hearing aid, changing at least one audio parameter in the first hearing aid and the second hearing aid. Changing the at least one audio parameter includes attenuating the audio signal of the first audio source. Changing the at least one audio parameter includes increasing a gain of a second audio signal of the second audio source.
[0005] Advantageously, embodiments of the method of the present invention enable users of binaural hearing aid systems to have improved awareness of environments that utilize at least two different audio sources, such as a streaming source and a hearing aid environment or two streaming sources. For example, the method of the present invention may enable a user to seamlessly transition from listening to a streaming source to listening to the environment around the user, and vice versa. The method may advantageously utilize the signal strength difference between the two hearing aids to more accurately determine the best audio parameters for use. In addition, embodiments of the method of the present invention may enhance speech understanding and awareness in streaming situations when the user focuses on their surroundings rather than the streaming source. In some cases, the method of the present invention may result in less social isolation of the end user when using an auxiliary streaming device.
[0006] Embodiments of the method of the present invention may combine the use of an accelerometer to obtain accelerometer data along with determining signal strength. The combination may be useful for determining whether a user is turning their head, which may be an indication of a change in audio source. The combination of accelerometer data and signal strength may provide significant synergistic advantages over using either single system to appropriately determine the audio source that the user wishes to hear (e.g., with increased gain). The combination may be useful for confirming head rotation and / or understanding whether the head is turned in a particular direction (e.g., left, right).
[0007] Manufacturers of commercial wireless earbuds are including inertial measurement units (IMUs) in their devices. The key driver for high-quality spatial audio in an IMU is a gyroscope, which is used to measure the 3D rotation angle of the user's head with high accuracy. However, gyroscopes are naturally susceptible to bias instabilities that cause measurement drift over time, effectively making spatial audio processing inaccurate after a period of time unless otherwise corrected. The methods described herein can be advantageously used to correct for slow drift and re-reference the measured head rotation angle.
[0008] Furthermore, in the case where only the accelerometer is used, there are frequent "false positives" when looking back at the TV and thus the motion sensor is triggered, causing the TV volume to go down simply because the user is looking back at the TV.
[0009] In one or more examples, the method of the present invention can be used to determine the source of the streaming using left-right (LR) signal analysis (e.g., from a first hearing aid and a second hearing aid). For example, a streaming source such as Bluetooth can use a 2.4 GHz carrier frequency to transmit data. The signal path can have a line of sight between the streaming source and the receiver (in this example, two head-mounted hearing instruments), but it can also be partially blocked by the head of the hearing aid user if the user is not looking directly at the streaming source, creating a shadowing effect. Typically, one of the two hearing aids in a binaural hearing aid system will always be in line of sight, while the other hearing aid receives the transmitted radio frequency waves as surface waves that follow the curvature of the user's head and / or through scattering and reflection from the surrounding environment. To become surface waves, part of the energy of these waves will be lost due to refraction and absorption by the user's head, so that only a portion of the original wave reaches the blocked hearing aid. The amount of signal energy lost will depend on the relative angle between the user's head and the signal source, which can be used to help estimate the orientation of the user's head relative to the streaming source.
[0010] By measuring the signal strength of the audio signal received in the hearing aid (e.g., the first signal strength and the second signal strength), and then comparing the signal strengths of the two hearing aids (e.g., signal quality, the difference between the second signal strength and the first signal strength), the method can advantageously determine whether the user is watching TV, for example, or whether the TV is oriented to the right or the left, and appropriately change at least one audio parameter in the first hearing aid and the second hearing aid. In addition, the implementation of the present invention can avoid false positives, such as changing at least one audio parameter that does not need to be changed.
[0011] The method may include obtaining (e.g., receiving) an audio signal from a first audio source via a first hearing aid. The first hearing aid may be, for example, a hearing aid configured for use with a left ear of a user (e.g., a left hearing aid HAL). Obtaining the audio signal may include obtaining audio via a microphone of the first hearing aid and converting the audio received via the microphone into an audio signal. Obtaining the audio signal may include obtaining audio via wireless communication. Obtaining the audio signal may include obtaining audio via an antenna. The antenna may be used for wireless communication. The wireless communication may include, for example, Bluetooth. The audio signal may represent audio from the first audio source.
[0012] As used herein, "audio" and "audio signal" are used interchangeably. An audio signal may be a digital and / or electronic signal representing audio. For example, once the audio is obtained by the first hearing aid and / or the second hearing aid via a microphone or an antenna, it may be converted into an electronic signal representing the audio (e.g., an audio signal) by, for example, one or more processors. In addition, the audio signal may undergo one or more processing steps. Thereafter, the audio signal may be converted into output audio for output to a user. When certain steps of the method are discussed as applying to audio, they may be considered to be applied to an audio signal representing audio.
[0013] The first audio source may be a first streaming audio source. In other words, the first audio source may be an audio source connected to the first hearing aid via wireless communication (e.g., via an antenna in the first hearing aid). The first audio source may be an external device (e.g., a third-party device, a remote control device). For example, the first audio source may include one or more of the following: a television, a mobile phone, a computer, a tablet, a TV adapter, an EduMic, and a smart phone. The first hearing aid may obtain an audio signal from the first streaming audio source via wireless communication such as Bluetooth. The first streaming audio source may be any device that actively streams an audio signal to the first hearing aid.
[0014] In the case where the first stream transmits an audio source, the first hearing aid and the second hearing aid may both obtain an audio signal from the first audio source. In some examples, the audio signal obtained by the first hearing aid and the audio signal obtained by the second hearing aid may vary slightly. The first hearing aid may obtain an audio signal from the first audio source separately from the second hearing aid obtaining an audio signal from the first audio source. In other words, the first hearing aid and the second hearing aid may both be separately connected to the first audio source. The audio signal obtained by the first hearing aid may indicate the same audio as the audio signal obtained by the second hearing aid. For example, if the first audio source is a television, the first hearing aid and the second hearing aid obtain an audio signal of the current audio output by the television.
[0015] The first audio source may be a first ambient audio source. For example, the first audio source may generate audio in the environment surrounding the hearing aid user. The first hearing aid may obtain the audio from the first audio source via one or more microphones in the first hearing aid (e.g., via a microphone). This may be understood as a "standard" hearing aid use. Thus, obtaining audio from the first audio source may include obtaining audio via at least one microphone of the first hearing aid and converting the audio into an audio signal representing the audio.
[0016] In the case of a first ambient audio source, both the first hearing aid and the second hearing aid may obtain an audio signal from the first audio source. In some examples, there may be slight changes in the audio signal obtained by the first hearing aid and the audio signal obtained by the second hearing aid. For example, the conversion of audio to audio signals in the first hearing aid and the second hearing aid may vary. The first hearing aid may obtain an audio signal from the first audio source separately from the second hearing aid obtaining an audio signal from the first audio source. In other words, the first hearing aid may include a first microphone and the second hearing aid may include a second microphone, each microphone receiving audio from the first audio source and converting it into a corresponding audio signal. The audio signal obtained by the first hearing aid may indicate the same audio as the audio signal obtained by the second hearing aid. For example, if the first audio source is a person speaking, the first hearing aid and the second hearing aid obtain an audio signal of the current audio spoken by the person.
[0017] In one or more example methods, a first signal strength of an audio signal is determined by a first hearing aid. In one or more example methods, a first signal strength of a signal representing audio is determined by a first hearing aid. The first signal strength may indicate a strength of an audio signal received from a first audio source. The first signal strength may indicate a strength of an audio signal received at the first hearing aid.
[0018] In one or more example methods, the first signal strength may indicate a measurement of the quality or strength of the audio signal. In one or more example methods, the first signal strength may indicate a measurement of the quality or strength of the 2.4 GHz audio signal and may include one or more of a received signal strength indication (RSSI), an average RSSI, and a bit error rate. The 2.4 GHz audio signal may be standard Bluetooth, LE audio, a proprietary 2.4 GHz connection, and / or WiFi. The first signal strength may indicate time data. For example, the first signal strength may indicate a flight time. The first signal strength may be a first audio signal strength. The first signal strength may be a first radio frequency signal strength.
[0019] The method of the present invention may include obtaining an audio signal from the first audio source by the second hearing aid. In other words, the second hearing aid may obtain the same audio signal as the first hearing aid from the same audio source. For example, the second hearing aid and the first hearing aid may work together with each other for obtaining the audio signal.
[0020] The second hearing aid may be, for example, a hearing aid configured for use with the user's right ear (e.g., a right hearing aid HAR). Obtaining an audio signal may include obtaining audio via a microphone of the second hearing aid and converting it into an audio signal. Obtaining audio may include obtaining an audio signal via wireless communication, such as via an antenna. Wireless communication includes, for example, Bluetooth. Obtaining an audio signal may include converting the audio into an audio signal (e.g., an electronic signal representing the audio) through the second hearing aid. Obtaining an audio signal may include converting the audio into an audio signal, such as an electronic signal, representing the audio. As used herein, "audio" and "signal" are used interchangeably.
[0021] In one or more example methods, determining a second signal strength of the audio signal by a second hearing aid is included. In one or more example methods, determining a second signal strength of the signal representing the audio by a second hearing aid is included. The second signal strength may indicate a strength of the audio signal received from the first audio source. The second signal strength may indicate a strength of the audio signal received at the second hearing aid.
[0022] In one or more example methods, determining a second signal strength of an audio signal by a first hearing aid is included. In one or more example methods, determining a second signal strength of a signal representing an audio signal by a first hearing aid is included. The second signal strength may indicate a strength of an audio signal received from a first audio source. The second signal strength may indicate a strength of an audio signal received at a second hearing aid. In other words, the first hearing aid may determine the first signal strength and the second signal strength.
[0023] In one or more example methods, the second signal strength may indicate a measurement of the quality or strength of the audio signal. In one or more example methods, the second signal strength may indicate a measurement of the quality or strength of the 2.4 GHz signal and may include one or more of a received signal strength indication (RSSI), an average RSSI, and a bit error rate. The 2.4 GHz signal may be standard Bluetooth, LE audio, a proprietary 2.4 GHz connection, and / or WiFi. The second signal strength may indicate time data. For example, the second signal strength may indicate flight time. The second signal strength may be a second audio signal strength. The second signal strength may be a second radio frequency signal strength.
[0024] The method of the present invention may include obtaining the same audio signal from the same first audio source through a first hearing aid and a second hearing aid. However, the signal strength of the audio signal may vary, depending on the positioning of the first hearing aid and the second hearing aid, which may result in a difference between the first signal strength and the second signal strength. For example, if the user's head turns away from the first audio source, the first signal strength (e.g., of the first hearing aid that is closer to the first audio source) may be stronger than the second signal strength (e.g., of the second hearing aid that is farther away from the first audio source).
[0025] In other words, both the first hearing aid and the second hearing aid can measure the signal strength of the same audio signal (e.g., the same audio) (even though the specific audio signal may have slight differences). For example, both the first hearing aid and the second hearing aid can measure the signal strength of an audio signal from the same audio source (e.g., signal source) (in this example, the first audio source). Both the first hearing aid and the second hearing aid can obtain the same audio signal, but the strength of the received audio may vary. For example, the first hearing aid may be a left hearing aid and the second hearing aid may be a right hearing aid. The strength of the received audio signal (as indicated by the first signal strength and the second signal strength) may vary from left to right based on the line of sight of the streaming source. For example, the angle of the user's head relative to the first audio source may affect the signal strength.
[0026] In one or more example methods, the method includes comparing the second signal strength and the first signal strength to determine the difference between the second signal strength and the first signal strength. The difference may be the signal strength difference between the second signal strength and the first signal strength. The difference may be an absolute value (e.g., a positive value). The method of the present invention may include comparing the second signal strength and the first signal strength through a first hearing aid to determine the difference between the second signal strength and the first signal strength. The method of the present invention may include comparing the second signal strength and the first signal strength through a second hearing aid to determine the difference between the second signal strength and the first signal strength.
[0027] In one or more example methods, the first signal strength and / or the second signal strength is communicated between a first hearing aid and a second hearing aid. For example, the method may include communicating between the first hearing aid and the second hearing aid via a binaural link. The method may include wirelessly communicating between the first hearing aid and the second hearing aid. The method may include transmitting (e.g., communicating) the first signal strength from the first hearing aid to the second hearing aid. The method may also include transmitting the first signal strength from the first hearing aid to the second hearing aid.
[0028] In one or more example methods, the comparison is performed by a first hearing aid. In one or more example methods, the comparison is performed by a second hearing aid. In one or more example methods, one of the first hearing aid and the second hearing aid may perform the comparison. In one or more example methods, the comparison is performed by a third device, such as a smartphone.
[0029] In one or more example methods, the present method may cause the first hearing aid to act as a master device and the second hearing aid to act as a slave device. For example, the present method may include communicating the second signal strength from the second hearing aid to the first hearing aid.
[0030] In one or more example methods, based on the difference between the first signal strength and the second signal strength satisfying a difference criterion, the method of the present invention may include changing (e.g., modifying, adjusting) at least one audio parameter in the first hearing aid and the second hearing aid. In one or more example methods, based on the difference between the first signal strength and the second signal strength satisfying a difference criterion, the method of the present invention may include changing at least one audio parameter in the first hearing aid and the second hearing aid related to the first audio source. In one or more example methods, based on the difference between the first signal strength and the second signal strength satisfying a difference criterion, the method of the present invention may include changing at least one audio parameter in the first hearing aid and the second hearing aid related to the second audio source. As used herein, "related to..." may include one or more of the following: concerning, associated with, involving, connected with, etc.
[0031] In one or more example methods, changing at least one audio parameter in the first hearing aid and the second hearing aid includes changing at least one audio parameter in the first hearing aid and the second hearing aid. Advantageously, the method of the present invention adjusts at least one audio parameter in the first hearing aid and the second hearing aid so that they can work in coordination with each other.
[0032] In one or more example methods, based on the difference between the first signal strength and the second signal strength satisfying a difference criterion, the method of the present invention may include changing at least one audio parameter related to the audio signal in the first hearing aid and the second hearing aid. In one or more example methods, based on the difference between the first signal strength and the second signal strength satisfying a difference criterion, the method of the present invention may include changing at least one audio parameter related to the second audio signal in the first hearing aid and the second hearing aid. As used herein, "related to..." may include one or more of the following: concerning, associated with, involving, connected with, etc.
[0033] Examples of the at least one audio parameter may include one or more of the following: gain level, amplification, attenuation, and filtering. The at least one audio parameter may be a gain of an output of the first hearing aid and the second hearing aid (e.g., a gain applied to the audio signal and / or the second audio signal). The at least one audio parameter may be a volume of the first hearing aid and the second hearing aid. The at least one audio parameter may be a weighting of the audio signals of the first hearing aid and the second hearing aid. The at least one audio parameter may be a power level of the first hearing aid and the second hearing aid. The at least one audio parameter may be an output (e.g., an audio output).
[0034] In one or more example methods, based on the difference between the first signal strength and the second signal strength satisfying a difference criterion, the method of the present invention may include changing at least one audio parameter in the first hearing aid and the second hearing aid from the first audio source to the second audio source. The at least one audio parameter may be the same in the first hearing aid and the second hearing aid. Thus, the method of the present invention may change the same audio parameter in the first hearing aid and the second hearing aid. This enables the first hearing aid and the second hearing aid to operate in the same (or similar) manner.
[0035] In one or more example methods, changing at least one audio parameter in the first hearing aid and the second hearing aid may include changing a gain applied to the audio signal. In one or more example methods, changing at least one audio parameter in the first hearing aid and the second hearing aid may include changing a gain applied to the second audio signal obtained by the first hearing aid and the second hearing aid. In one or more example methods, changing at least one audio parameter in the first hearing aid and the second hearing aid may include changing a gain applied to the audio signal obtained by the first hearing aid and the second audio signal.
[0036] In other words, the method of the present invention changes at least one audio parameter in the first hearing aid and the second hearing aid when it is determined that the user is not looking at the first audio source. This enables the user to obtain better sound quality based on where they may be looking. For example, the method of the present invention enables the gain of a particular audio source to be modified (e.g., by changing at least one audio parameter). For example, as the user moves away from a television and turns his head towards a person, the method of the present invention may reduce the gain of an audio signal received from the television (and / or attenuate the audio signal) and increase the gain of an audio signal received from the person.
[0037] The second audio signal may come from a second audio source (e.g., output by the second audio source). The second audio signal may come from a second audio source of the same type as the first audio source. In other words, both the first audio source and the second audio source may be streaming audio sources. The second audio signal may come from a second audio source of a different type than the first audio source. In other words, the second audio source may be an ambient audio source, and the first audio source may be a streaming audio source.
[0038] The second audio source may be a second streaming audio source. In other words, the second audio source may be an audio source connected to the first hearing aid via wireless communication. For example, the second audio source may include one or more of the following: a television, a mobile phone, a computer, a tablet, a television adapter, an EduMic, and a smart phone. The first hearing aid may obtain the second audio signal from the second streaming audio source via wireless communication, such as Bluetooth. The second streaming audio source may be any device that actively streams the second audio signal to the first hearing aid. Thus, obtaining the second audio signal from the second audio source may include obtaining a signal representation of the audio from the second audio source.
[0039] The second audio source may be a second ambient audio source. For example, the second audio source may be generating a second audio signal in the environment surrounding the hearing aid user. The first hearing aid may obtain audio from the second audio source via one or more microphones in the first hearing aid. This may be understood as standard hearing aid use. Thus, obtaining audio from the second audio source may include obtaining audio via at least one microphone of the first hearing aid and converting the audio into a second audio signal representing the audio.
[0040] In one or more example methods, based on the difference between the first signal strength and the second signal strength satisfying the difference criterion, the present method may include changing at least one audio parameter in the first hearing aid and the second hearing aid from the first audio source to the second audio source. In other words, the first hearing aid and the second hearing aid may change the "focus" from the first audio source to the second audio source. For example, changing at least one audio parameter in the first hearing aid and the second hearing aid from the first audio source to the second audio source may include increasing the gain of the second audio signal from the second audio source and decreasing the gain of the audio signal obtained from the first audio source. In one or more example methods, changing at least one audio parameter in the first hearing aid and the second hearing aid from the first audio source to the second audio source may include stopping acquiring the audio signal from the first audio source and starting acquiring the second audio signal from the second audio source.
[0041] In one or more example methods, based on the difference between the first signal strength and the second signal strength satisfying a difference criterion, the present method may include changing at least one audio parameter related to (and / or associated with) the first audio source in the first hearing aid and the second hearing aid to an updated audio parameter related to (and / or associated with) the second audio source.
[0042] In one or more example methods, changing at least one audio parameter in the first hearing aid and the second hearing aid includes changing a gain output representative of the first audio source and / or changing a gain output representative of the second audio source.
[0043] In one or more example methods, based on a difference between the first signal strength and the second signal strength satisfying a difference criterion, the method may include changing at least one audio parameter in the first hearing aid and the second hearing aid from a first setting configured for the first audio source to a second setting configured for the second audio source. The first setting may provide an optimized output for the first audio source. The second setting may provide an optimized output for the second audio source.
[0044] In other words, the method of the present invention may change at least one audio parameter of the first hearing aid and the second hearing aid so that the user can better hear and / or understand the second audio source. For example, in order to participate in a conversation with a family member in the room (such as the second audio source), the user may look away from the television (such as the first audio source). As the difference indicates that the user is looking away from the first audio source, for example, focusing on the second audio source, it may be beneficial to adjust at least one audio parameter of the first hearing aid and the second hearing aid to better enable the user to hear the second audio source. This may involve changing the gain of the first audio source and / or the second audio source (e.g., changing the gain of the audio signal and / or the second audio signal).
[0045] In one or more examples, the first audio source and the second audio source can both be streaming sources (eg, a first streaming source and a second streaming source).
[0046] In one or more examples, the first audio source may be a streaming source and the second audio source may be an ambient audio source. In one or more examples, the second audio source may be a streaming source and the first audio source may be an ambient audio source.
[0047] In one or more example methods, changing at least one audio parameter in the first hearing aid and the second hearing aid may include weighting the gains of the first audio source and the second audio source (e.g., weighting the gains of the audio signal and / or the second audio signal). For example, changing at least one audio parameter in the first hearing aid and the second hearing aid may include increasing the gain of the audio signal and decreasing the gain of the second audio signal.
[0048] In one or more example methods, the method may further include determining a distance between the first audio source and the second audio source. In one or more example methods, changing at least one audio parameter in the first hearing aid and the second hearing aid may include weighting gains of the first audio source and the second audio source based on the difference and the distance.
[0049] In other words, the inventive method enables changing the gain of the first audio source and / or the second audio source based on their position and the direction in which the user of the binaural hearing aid system is looking.
[0050] In one or more example methods, after changing at least one audio parameter in the first hearing aid and the second hearing aid, the method of the present invention may adjust to the second audio source. For example, after changing at least one audio parameter in the first hearing aid and the second hearing aid, the method of the present invention may include:
[0051] obtaining a second audio signal from a second audio source through the first hearing aid;
[0052] determining, by the first hearing aid, a third signal strength of the second audio signal;
[0053] obtaining a second audio signal from a second audio source through a second hearing aid;
[0054] determining, by the second hearing aid, a fourth signal strength of the second audio signal;
[0055] comparing the third signal strength and the fourth signal strength to determine a difference between the third signal strength and the fourth signal strength;
[0056] In response to a difference between the third signal strength and the fourth signal strength satisfying a difference criterion, at least one audio parameter in the first hearing aid and the second hearing aid is changed.
[0057] In other words, the method of the invention enables resetting for a new audio source, such as a second audio source. For the new audio source, the method of the invention can be repeated.
[0058] The difference criterion may be, for example, a difference threshold. In one or more example methods, based on the difference being greater than the difference threshold, the method of the present invention includes determining that the difference satisfies the difference criterion. In one or more example methods, based on the difference being less than or equal to the difference threshold, the method of the present invention includes determining that the difference does not satisfy the difference criterion. For example, the difference threshold may be one of: 5, 10, 15, 20, 25, 30, 35, or 40 dB. In one or more example methods, the difference threshold may be a static value. In one or more example methods, the difference threshold may be an adaptive value. In one or more example methods, the method of the present invention may include changing the difference threshold based on one or more parameters of the audio.
[0059] In one or more example methods, based on the difference being greater than a difference threshold for a time period, the method of the present invention includes determining that the difference satisfies a difference criterion. Advantageously, the use of a time period can prevent inappropriate changes in at least one audio parameter due to short spike audio levels for a given hearing aid. The time period can be, for example, 1, 2, 3, 4, or 5 seconds. In one or more example methods, based on the difference not being greater than a difference threshold for a time period, the method of the present invention includes determining that the difference does not satisfy the difference criterion.
[0060] Setting the time period below 1 second will provide an extremely fast reaction system where attention can be switched quickly, but will also necessarily result in the streaming audio being undesirably attenuated in situations where the user briefly looks in another direction (i.e., out the window), and the signal to noise being less robust (e.g., if the signal strength at one ear drops momentarily due to packet loss, etc.). Setting it above 5 seconds may have the opposite effect, where the user may have to wait a while for the hearing aid to switch from focusing on one audio source to another, but most likely only when they want the hearing aid to do so, making the signal to noise more robust. The disclosed implementation of the time period may advantageously enable the user to adjust the time period themselves using an app interface, etc. In one or more embodiments, the method of the present invention may include receiving user input setting the time period.
[0061] Based on the difference between the first signal strength and the second signal strength not satisfying a difference criterion, the method may include not changing at least one audio parameter in the first hearing aid and the second hearing aid. For example, the method may include maintaining at least one audio parameter.
[0062] In one or more example methods, the method of the present invention may further include adjusting the difference criterion based on the first signal strength and the second signal strength. For example, the user may look away from the first audio source for a period of time, and for such eccentric positioning of the first hearing aid and the second hearing aid, resetting the baseline of the difference criterion may be beneficial. In one or more example methods, the method of the present invention may further include, according to the difference satisfying the difference criterion for a period of time, adjusting the difference criterion based on the first signal strength and the second signal strength.
[0063] In one or more example methods, changing at least one audio parameter includes attenuating a first audio source (e.g., attenuating an audio signal). In one or more example methods, changing at least one audio parameter includes attenuating the first audio source (e.g., attenuating an audio signal) in a first hearing aid and a second hearing aid. In one or more example methods, changing at least one audio parameter includes attenuating an audio signal from the first audio source. In one or more example methods, changing at least one audio parameter includes reducing a gain of the first audio source (e.g., reducing a gain of the audio signal). In one or more example methods, changing at least one audio parameter includes reducing a gain of the audio signal from the first audio source. In one or more example methods, changing at least one audio parameter includes increasing a gain of the second audio source (e.g., increasing a gain of the second audio signal). In one or more example methods, changing at least one audio parameter includes attenuating the second audio source (e.g., attenuating the second audio signal).
[0064] Advantageously, the inventive method enables attenuation of the audio from the first audio source, since the user may no longer be looking at the first audio source and may be focused elsewhere.
[0065] In one or more example methods, changing the at least one audio parameter includes increasing a gain of the second audio source (eg, increasing a gain of the second audio signal). In one or more example methods, changing the at least one audio parameter includes increasing a gain of the second audio signal from the second audio source.
[0066] Advantageously, the user may be looking towards the second audio source, and the method of the present invention may improve the user's understanding of the second audio source.
[0067] In one or more example methods, changing at least one audio parameter includes changing a gain of a first audio source and / or changing a gain of a second audio source. In one or more example methods, changing at least one audio parameter includes changing a gain of an audio signal and / or changing a gain of a second audio signal.
[0068] In one or more example methods, changing at least one audio parameter includes attenuating a gain of a first audio source (eg, an audio signal) and / or increasing a gain of a second audio source (eg, a second audio signal).
[0069] Advantageously, this will enable adaptively changing the gain ratio between a first audio source (e.g., a streaming audio source) and a second audio source (e.g., a hearing aid microphone output) based on the user's attention. For example, as indicated by the difference satisfying a difference criterion, when the user looks away from the first audio source, the method of the present invention may change at least one audio parameter by reducing the first audio source gain (e.g., streaming gain) and increasing the second audio source gain (e.g., microphone gain). Advantageously, this may enable the user to communicate with their environment in a more "seamless" manner without having to switch hearing aid modes or having to start / stop audio streaming. Vice versa, when the user looks towards a streaming source (e.g., a television), the user may be able to focus on the streaming source audio.
[0070] In one or more example methods, determining the first signal strength includes determining a first received signal strength indication (RSSI) of the audio signal. In one or more example methods, determining the second signal strength includes determining a second received signal strength indication (RSSI) of the audio signal. In one or more example methods, determining the first signal strength includes determining a first received signal strength indication (RSSI) of the signal representing the audio. In one or more example methods, determining the second signal strength includes determining a second received signal strength indication (RSSI) of the signal representing the audio. Other types of signal strengths may be used. In one or more example methods, determining the first signal strength of the audio signal may include determining a first signal quality of the audio.
[0071] In one or more example methods, determining the first signal strength includes determining the RSSI of all received packets. In one or more example methods, determining the second signal strength includes determining the RSSI of all received packets. In one or more example methods, the first hearing aid and / or the second hearing aid may include an accelerometer. Obtaining accelerometer data may include obtaining accelerometer data from the accelerometer. The first hearing aid and / or the second hearing aid may include a gyroscope. The first hearing aid may include a first accelerometer and the second hearing aid may include a second accelerometer. In some examples, the first accelerometer may obtain first accelerometer data. The second accelerometer may obtain second accelerometer data.
[0072] In one or more example methods, the present method may include obtaining accelerometer data through the first hearing aid and / or the second hearing aid. In one or more example methods, the present method may include obtaining accelerometer data through the first hearing aid and / or the second hearing aid. For example, the accelerometer data may be first accelerometer data from the first hearing aid and / or second accelerometer data from the second hearing aid. The accelerometer data may be the first accelerometer data, the second accelerometer data, or a combination of the first accelerometer data and the second accelerometer data. The accelerometer data may indicate movement of the first hearing aid. The accelerometer data may indicate movement of the second hearing aid. The accelerometer data may indicate movement of the first hearing aid and / or the second hearing aid.
[0073] In some examples, if the accelerometer data meets the accelerometer criteria, the accelerometer data may indicate motion. In some examples, if the accelerometer data does not meet the accelerometer criteria, the accelerometer data may not indicate motion. In some examples, if the accelerometer data meets the accelerometer threshold, the accelerometer may indicate motion. In some examples, if the accelerometer data does not meet the accelerometer threshold, the accelerometer may not indicate motion.
[0074] In some examples, if the accelerometer data indicates motion greater than 0.1 m / s, the present method may determine that the accelerometer data satisfies the accelerometer criteria and that the accelerometer data indicates motion.
[0075] In some example methods, the present method may include applying a low pass filter to the accelerometer data. Advantageously, this may reduce noise and therefore false notifications of motion from the accelerometer data.
[0076] In one or more example methods, the accelerometer data may be accelerometer intensity data. For example, the accelerometer data may provide acceleration data along three axes, and the accelerometer intensity data may be a single value representing a combination of the three axes.
[0077] The accelerometer data may be velocity. The accelerometer criteria may be velocity. The accelerometer data may be acceleration. The accelerometer criteria may be acceleration. The accelerometer data may be positive or negative. For example, positive accelerometer data may indicate a left turn, and negative accelerometer data may indicate a right turn.
[0078] In one or more example methods, the accelerometer data may be normalized between 0 and 1, with 0 representing no acceleration and 1 representing high acceleration. Based on the acceleration data being at least 0.5, the method includes determining that the acceleration data indicates motion. Based on the acceleration data being below 0.5, the method includes determining that the acceleration data indicates no motion.
[0079] In one or more examples, the accelerometer data may be in degrees per second. The acceleration criterion may be met when the acceleration data is above 50 degrees per second. Based on the acceleration data being at least 50 degrees per second, the method of the present invention includes determining that the acceleration data indicates motion. Based on the acceleration data being below 50 degrees per second, the method of the present invention includes determining that the acceleration data indicates no motion.
[0080] Other acceleration criteria may also be used. For example, an acceleration criterion may be satisfied based on accelerometer data indicating a velocity greater than 20, 30, 40, 50, 60, 70, or 80 degrees per second.
[0081] In one or more examples, the accelerometer data may be in degrees per second squared. The acceleration criterion may be met when the acceleration data is above 50 degrees per second squared. Based on the acceleration data being at least 50 degrees per second squared, the method of the present invention includes determining that the acceleration data indicates motion. Based on the acceleration data being below 50 degrees per second squared, the method of the present invention includes determining that the acceleration data indicates no motion.
[0082] Other acceleration criteria may also be used. For example, the acceleration criterion may be satisfied at above 50, 100, 150 or 200 degrees per second squared.
[0083] In some examples, the method may include obtaining accelerometer data for a time period from the first hearing aid and / or the second hearing aid. When the accelerometer data indicates that the cumulative acceleration for the time period is above a cumulative threshold, the method may include determining that the accelerometer data indicates movement of the first hearing aid and / or the second hearing aid. When the accelerometer data indicates that the cumulative acceleration for the time period is equal to or below the cumulative threshold, the method may include determining that the accelerometer data indicates that the first hearing aid and / or the second hearing aid is not moving.
[0084] Exemplary time periods may be 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8, 0.9, 1.0, 1.5, 2.0, or 3.0 seconds.
[0085] Based on the difference between the first signal strength and the second signal strength satisfying a difference criterion and the accelerometer data indicating movement of the first hearing aid and / or the second hearing aid, the method may include changing at least one audio parameter in the first hearing aid and the second hearing aid. For example, the method may only change the at least one audio parameter when the difference satisfies the difference criterion and the accelerometer data indicates movement of the first hearing aid and / or the second hearing aid. This may advantageously reduce inappropriate changes to the at least one audio parameter in situations where it may not be necessary.
[0086] Based on the difference between the first signal strength and the second signal strength not satisfying a difference criterion or the accelerometer data not indicating movement of the first hearing aid and / or the second hearing aid, the method may include not changing at least one audio parameter in the first hearing aid and the second hearing aid.
[0087] In one or more example methods, changing at least one audio parameter includes changing from a Bluetooth streaming mode to a hearing aid mode, or changing from a hearing aid mode to a Bluetooth streaming mode.
[0088] The Bluetooth streaming mode may be one or more audio parameters of the first hearing aid and the second hearing aid that enable the user to better hear the audio from the streaming audio source. For example, the Bluetooth streaming mode may be understood as receiving an audio signal from an external device through the binaural hearing system. The external device may be, for example, a television, a telephone, a computer. The Bluetooth streaming mode may be understood as receiving an audio signal via an antenna. The Bluetooth streaming mode may be understood as not receiving an audio signal from a microphone of the binaural hearing aid system. The Bluetooth streaming mode may be understood as an audio signal received through the antenna having a higher gain than an audio signal received through the microphone of the binaural hearing aid system.
[0089] The hearing aid mode may be one or more audio parameters of the first hearing aid and the second hearing aid that enable the user to better hear the audio from the environment through the microphones of the first hearing aid and the second hearing aid. For example, the hearing aid mode may be understood as receiving an audio signal from the user's surroundings of the binaural hearing aid system through the binaural hearing system. The hearing aid mode may be understood as receiving an audio signal via one or more microphones of the binaural hearing aid system. The hearing aid mode may be understood as not receiving an audio signal from the antenna of the binaural hearing aid system. The hearing aid mode may be understood as an audio signal received through one or more microphones having a higher gain than the audio signal received through the antenna of the binaural hearing aid system.
[0090] In one or more example methods, changing at least one audio parameter includes adjusting a relative gain of a first audio source and a second audio source.
[0091] In one or more example methods, determining the first signal strength includes applying a filter to the audio signal. In one or more example methods, determining the second signal strength includes applying a filter to the audio signal. The method of the present invention may apply the same filter to the first hearing aid and the second hearing aid. In one or more example methods, the filter is a median filter and / or a low-pass filter and / or a Kalman filter. In one or more example methods, the filter is a low-pass filter, i.e., a median filter, and / or a prediction filter, i.e., a Kalman filter. The filter type is not limited, and different filters may be used for different purposes. In one or more examples, applying the filter may include applying multiple filters. In one or more examples, applying the filter may include applying one or more filters. In one or more example methods, the median and / or mean filters may be classified as low-pass filters. In one or more example methods, the filter may be a signal smoother. In one or more example methods, the filter may be an estimation and / or prediction filter. For example, the filter may be based on statistical results and probabilities, which may be used to further smooth the audio (e.g., a signal representing the audio) by removing statistical noise.
[0092] Applying the filter may enable smoothing of the audio signal (e.g., smoothing of a signal representing the audio). For example, the filter may be used to remove signal outliers and artifacts. In some examples, the filter may be used to remove a DC offset. In other words, filtering may be used such that a signal level difference of approximately 0 (from left to right, or from a first hearing aid to a second hearing aid) will indicate a viewing direction of a first audio source, and a level difference greater than or less than 0 will indicate a direction looking away from the first audio source. The sign of the difference (e.g., negative or positive) may indicate a viewing direction (e.g., left or right, first hearing aid or second hearing aid).
[0093] In practice, even if the worst effects are reduced by intelligent packet selection and level estimation, the resulting signal level is very noisy and significantly affected by environmental factors such as other RF sources, reflections and shadow fading. Therefore, when applying the method of the invention, it is advantageous to apply additional signal filtering.
[0094] For example, applying a filter can remove as much random variation in the signal as possible. Using robust smoothing filters such as low-pass filters and median filters is advantageous because these filters will be able to remove some of the effects of noisy measurements with large amplitudes. A median filter works by sorting the measured signal values and producing an output value that is the middle value of the sorted list. The median filter output can be calculated as:
[0095] y[n]=median(x[n],…,x[nT])
[0096] Where n is the current sample and T is the length of the filter.
[0097] To assess signal strength, the DC level is of most interest. Therefore, it is advantageous to use a low-pass filter to remove faster signal fluctuations. In practice, the most appropriate low-pass filter for the application can be selected based on the recorded signal characteristics, processing power limitations, etc. Common types of low-pass filters to be used may include Butterworth filters, Chebyshev filters, and Bessel filters. A low-cost implementation of a low-pass filter may be a mean filter as shown below:
[0098] y[n]=mean(x[n],…,x[nT])
[0099] Where n is the current sample and T is the length of the filter.
[0100] In addition, the signal estimate can also be enhanced using a predictive filter. One possible implementation of this method can be a Kalman filter. The Kalman filter uses a series of equations to update the estimate of the measurement result for each time step based on the previous estimate, the control input and the original measurement result. It can be used to filter out noise and eliminate errors in the original measurement result, resulting in a more accurate estimate of the true value of the measurement.
[0101] The basic equation of the Kalman filter consists of two steps: a prediction step and an update step.
[0102] Prediction Step
[0103] At each time step, the Kalman filter uses the previous estimate of the system state (x(k-1)) and the control input (u(k)) to predict the current state of the system (x(k))
[0104] x(k)=F(k)·x(k-1)+B(k)·u(k)+w(k)
[0105] Among them, F(k) is the state transition matrix, B(k) is the control input matrix, and w(k) is the process noise.
[0106] Update steps
[0107] After the prediction step, the Kalman filter uses the measurement of the system state (z(k)) to update the estimate of the current state (x(k))
[0108] x(k)=x(k)+K(k)·(z(k)-H(k)·x(k))
[0109] Where K(k) is the Kalman gain, H(k) is the measurement matrix, and z(k)-H(k)*x(k) is the measurement residual.
[0110] The Kalman gain is calculated as follows:
[0111] K(k)=P(k)·H(k)T·(H(k)·P(k)·H(k)T+R(k)) -1
[0112] Where P(k) is the estimator of the state covariance matrix and R(k) is the measurement noise covariance matrix.
[0113] These equations form the core of the Kalman filter and are the main equations used to update the system state estimate based on the measurements.
[0114] In one or more example methods, obtaining an audio signal through a first hearing aid includes obtaining an audio signal from a first plurality of channels through the first hearing aid. In one or more example methods, determining a first signal strength includes determining a first average signal strength for each of the first plurality of channels through the first hearing aid. In one or more example methods, obtaining an audio signal through a second hearing aid includes obtaining an audio signal from a second plurality of channels through the second hearing aid. In one or more example methods, determining a second signal strength through the second hearing aid includes determining a second average signal strength for each of the second plurality of channels through the second hearing aid. In one or more example methods, comparing the second signal strength to the first signal strength includes comparing the first average signal strength to the second average signal strength.
[0115] In one or more example methods, obtaining an audio signal through a first hearing aid includes obtaining an audio signal from a first plurality of channels through the first hearing aid. In one or more example methods, determining a first signal strength includes determining a first average signal strength of the first plurality of channels through the first hearing aid. In one or more example methods, obtaining an audio signal through a second hearing aid includes obtaining an audio signal from a second plurality of channels through the second hearing aid. In one or more example methods, determining a second signal strength through the second hearing aid includes determining a second average signal strength of the second plurality of channels through the second hearing aid. In one or more example methods, comparing the second signal strength to the first signal strength includes comparing the first average signal strength to the second average signal strength.
[0116] In other words, the first hearing aid may obtain the audio signal via a plurality of different channels (e.g., a first plurality of channels). Similarly, the second hearing aid may obtain the audio signal via a second plurality of channels. The first plurality of channels may be channels of the same type as the second plurality of channels. For example, the indexes of the first plurality of channels and the second plurality of channels may be the same. For example, the first plurality of channels and the second plurality of channels may be the same channels, that is, channels for the respective first hearing aid and the second hearing aid. In one or more examples, the first plurality of channels and / or the second plurality of channels may consist of 37 channels. In one or more examples, the first plurality of channels and / or the second plurality of channels may consist of up to 37 channels. However, the number of the first plurality of channels and / or the second plurality of channels may vary depending on the protocol of the audio signal.
[0117] In one or more example methods, determining the first signal strength includes removing channels from the first plurality of channels having a fading effect greater than a fading effect threshold. In one or more example methods, determining the second signal strength includes removing channels from the second plurality of channels having a fading effect greater than a fading effect threshold. Advantageously, by utilizing the fading effect threshold, the method of the present invention can compensate for situations with reverberation and / or reflections.
[0118] For example, an audio signal will have multiple paths to the first hearing aid and the second hearing aid: direct path, reflection from the wall, crawling along the skin, etc. This means that the same audio will arrive at the first hearing aid and the second hearing aid at different stages. The sum of the multiple paths will be seen as a change in amplitude / RSSI level, called a fading effect. This fading effect may be different for each channel used in Bluetooth LE. The RSSI can be saved as the average RSSI on each channel to enable channel-to-channel comparison (left to right device). This enables the dynamic removal of the channel with the highest fading effect, making the RSSI more stable / correct. The RSSI average (in each channel) can be optimized for the best balance between stable signal and reaction speed (head rotation).
[0119] In one or more example methods, obtaining a signal through a first hearing aid includes obtaining an audio signal from a first plurality of channels through the first hearing aid. In one or more example methods, determining a first signal strength through the first hearing aid includes determining an individual first signal strength for each of the first plurality of channels through the first hearing aid. In one or more example methods, obtaining a signal through a second hearing aid includes obtaining an audio signal from a second plurality of channels through the second hearing aid. In one or more example methods, determining a second signal strength through the second hearing aid includes determining an individual second signal strength for each of the second plurality of channels through the second hearing aid. In one or more example methods, comparing the first signal strength and the second signal strength includes comparing each of the individual first signal strengths with a corresponding individual second signal strength. In other words, the comparison may be performed for the corresponding signal strength for each of the plurality of channels.
[0120] In one or more example methods, instead of changing at least one parameter in the first hearing aid and the second hearing aid, the method includes changing at least one parameter in one of the first hearing aid and the second hearing aid. This may enable the method to apply binaural gain and delay differences between the hearing aids, which may provide a spatial representation of the location of the first audio source.
[0121] Also disclosed herein is a binaural hearing aid system configured to perform the method disclosed herein. The binaural hearing aid system may include a first hearing aid and a second hearing aid. The first hearing aid and the second hearing aid may be configured to wirelessly communicate with each other.
[0122] The method and the corresponding binaural hearing aid system of the present invention may be adapted to provide frequency dependent gain and / or level dependent compression and / or frequency transposition of one or more frequency ranges to one or more other frequency ranges (with or without frequency compression) to compensate for hearing loss of the user. The hearing aid (e.g. the first hearing aid and / or the second hearing aid) may comprise a signal processor for enhancing an input signal and providing a processed output signal.
[0123] The hearing aid (e.g. the first hearing aid and / or the second hearing aid) may comprise an output unit for providing a stimulus perceived by a user as an acoustic signal based on a processed electrical signal (e.g. the processed audio signal). The output unit may comprise a vibrator of a bone conduction hearing aid. The output unit may comprise an output transducer. The output transducer may comprise a receiver (speaker) for providing the stimulus as an acoustic signal to the user (e.g. in an acoustic (air conduction based) hearing aid). The output transducer may comprise a vibrator for providing the stimulus as a mechanical vibration of the skull to the user (e.g. in a bone attached or bone anchored hearing aid). The output unit may (in addition or as an alternative) comprise a (e.g. wireless) transmitter for transmitting the sound picked up by the hearing aid (e.g. via a network, e.g. in a telephone operating mode, or in a headset configuration) to another device, such as a remote communication partner.
[0124] The hearing aid (e.g. the first hearing aid and / or the second hearing aid) may comprise an input unit for providing an electrical input signal (e.g. a signal) representing audio (e.g. a sound). The input unit may be configured to receive and / or determine environmental data. The input unit may comprise an input transducer such as a microphone for converting the input sound into an audio signal. The input unit may comprise a wireless receiver for receiving a wireless signal comprising or representing a sound and providing the electrical input signal representing the sound.
[0125] The wireless receiver and / or transmitter may be configured to receive and / or transmit electromagnetic signals in the radio frequency range (3kHz to 300GHz), for example. The wireless receiver and / or transmitter may be configured to receive and / or transmit electromagnetic signals in the optical frequency range (e.g., infrared light 300GHz to 430THz or visible light such as 430THz to 770THz), for example.
[0126] A hearing aid (e.g., a first hearing aid and / or a second hearing aid) may include a directional microphone system adapted to spatially filter sounds from the environment so as to enhance a target sound source among a plurality of sound sources in the local environment of a user wearing the hearing aid. The directional system may be adapted to detect (e.g., adaptively detect) from which direction a particular portion of a microphone signal originates. This may be implemented in a variety of different ways, such as described in the prior art. In hearing aids, microphone array beamformers are typically used to spatially attenuate background noise sources. The beamformer may include a linear constrained minimum variance (LCMV) beamformer. Many beamformer variants may be found in the literature. Minimum variance distortionless response (MVDR) beamformers are widely used in microphone array signal processing. Ideally, an MVDR beamformer keeps the signal from the target direction (also referred to as the line of sight) unchanged, while maximally attenuating sound signals from other directions. A generalized sidelobe canceler (GSC) structure is an equivalent representation of an MVDR beamformer, which provides computational and digital representation advantages over a direct implementation of the original form.
[0127] The hearing aid (e.g. the first hearing aid and / or the second hearing aid) may comprise an antenna and a transceiver circuit which enables a wireless link to a streaming audio source such as an entertainment device (e.g. a television), a communication device (e.g. a telephone), a wireless microphone, a separate (external) processing device, or another hearing aid. The hearing aid (e.g. the first hearing aid and / or the second hearing aid) may thus be configured to wirelessly receive a direct electrical input signal from another device. Similarly, the hearing aid may be configured to wirelessly transmit a direct electrical output signal to another device. The direct electrical input or output signal may represent or include an audio signal and / or a control signal and / or an information signal.
[0128] In general, the wireless link established by the antenna and the transceiver circuit of the hearing aid (e.g. the first hearing aid and / or the second hearing aid) may be of any type. The wireless link may be a link based on near field communication, e.g. an inductive link based on inductive coupling between antenna coils of a transmitter part and a receiver part. The wireless link may be based on far field electromagnetic radiation. Preferably, the frequency used to establish the communication link between the hearing aid and the other device is lower than 70 GHz, e.g. in the range from 50 MHz to 70 GHz, e.g. higher than 300 MHz, e.g. in the ISM range higher than 300 MHz, e.g. in the 900 MHz range or in the 2.4 GHz range or in the 5.8 GHz range or in the 60 GHz range (ISM = Industry, Science and Medicine, such standardized ranges are defined, for example, by the International Telecommunication Union ITU). The wireless link may be based on standardized or dedicated technologies. The wireless link may be based on Bluetooth technology (e.g. low power Bluetooth technology, e.g. LE Audio) or ultra-wideband (UWB) technology.
[0129] A hearing aid (e.g. a first hearing aid and / or a second hearing aid) may comprise a "forward" (or "signal") path between an input and an output of the respective hearing aid for processing an audio signal. A signal processor may be located in the forward path. The signal processor may be adapted to provide a frequency-dependent gain according to the specific needs of a user (e.g. hearing loss). The hearing aid may comprise an "analysis" path having functional parts for analyzing signals and / or controlling processing of the forward path. Part or all of the signal processing of the analysis path and / or the forward path may be performed in the frequency domain, in which case the hearing aid comprises appropriate analysis and synthesis filter banks. Part or all of the signal processing of the analysis path and / or the forward path may be performed in the time domain.
[0130] The hearing aid (eg the first hearing aid and / or the second hearing aid) may also include other suitable functions for the application in question, such as compression, noise reduction, etc.
[0131] The hearing aid (eg the first hearing aid and / or the second hearing aid) may comprise a hearing instrument, eg a hearing instrument adapted to be located at an ear of a user or fully or partially in an ear canal.
[0132] Computer readable medium or data carrier
[0133] The present invention further provides a tangible computer-readable medium (data carrier) storing a computer program including program code (instructions), which, when executed on a data processing system (computer), enables the data processing system to execute (implement) at least part (such as most or all) of the steps of the method described above, described in detail in the "Specific Implementation Method" and defined in the claims.
[0134] As an example but not limitation, the aforementioned tangible computer readable medium may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage device, or any other medium that can be used to execute or store the desired program code in the form of instructions or data structures and can be accessed by a computer. As used herein, disks include compact disks (CDs), laser disks, optical disks, digital versatile disks (DVDs), floppy disks, and blue-ray disks, wherein these disks usually reproduce data magnetically, while these disks can reproduce data optically with lasers. Other storage media include storage in DNA (e.g., in synthetic DNA chains). Combinations of the above disks should also be included in the scope of computer readable media. In addition to being stored on tangible media, computer programs can also be transmitted via transmission media such as wired or wireless links or networks such as the Internet and loaded into a data processing system to run at a location different from the tangible media.
[0135] For example, disclosed herein is a tangible computer-readable medium (data carrier) storing a computer program including program code (instructions), wherein the program code causes a data processing system (computer) to: obtain an audio signal from a first audio source through a first hearing aid, determine a first signal strength of the audio signal through the first hearing aid, obtain the audio signal from the first audio source through a second hearing aid, determine a second signal strength of the audio signal through the second hearing aid, compare the second signal strength with the first signal strength to determine a difference between the second signal strength and the first signal strength, and change at least one audio parameter in the first hearing aid and the second hearing aid based on the difference between the first signal strength and the second signal strength satisfying a difference criterion.
[0136] Computer Programs
[0137] In addition, the present application provides a computer program (product) comprising instructions, which, when executed by a computer, causes the computer to execute (the steps of) the method described above, described in detail in the “Detailed Description” and defined in the claims.
[0138] For example, disclosed herein is a computer program (product) comprising instructions, which, when the program is executed by a computer, causes the computer to implement: obtaining an audio signal from a first audio source through a first hearing aid, determining a first signal strength of the audio signal through the first hearing aid, obtaining the audio signal from the first audio source through a second hearing aid, determining a second signal strength of the audio signal through the second hearing aid, comparing the second signal strength with the first signal strength to determine a difference between the second signal strength and the first signal strength, and changing at least one audio parameter in the first hearing aid and the second hearing aid based on the difference between the first signal strength and the second signal strength satisfying a difference criterion.
[0139] Data processing system
[0140] On the one hand, the present invention further provides a data processing system comprising a processor and a program code, wherein the program code enables the processor to perform at least part (such as most or all) of the steps of the method described above, described in detail in the "Specific Implementation Method" and defined in the claims.
[0141] For example, a data processing system is disclosed herein, comprising a processor and a program code causing the processor to perform the following processing: obtaining an audio signal from a first audio source through a first hearing aid, determining a first signal strength of the audio signal through the first hearing aid, obtaining the audio signal from the first audio source through a second hearing aid, determining a second signal strength of the audio signal through the second hearing aid, comparing the second signal strength with the first signal strength to determine a difference between the second signal strength and the first signal strength, and changing at least one audio parameter in the first hearing aid and the second hearing aid based on the difference between the first signal strength and the second signal strength satisfying a difference criterion.
[0142] definition
[0143] In this specification, a hearing aid, such as a hearing instrument, refers to a device suitable for improving, enhancing and / or protecting the hearing ability of a user by receiving an acoustic signal from the user's environment, generating a corresponding audio signal, possibly modifying the audio signal, and providing the possibly modified audio signal as an audible signal to at least one ear of the user. The audible signal may be provided, for example, in the form of an acoustic signal radiated into the user's outer ear, an acoustic signal transmitted to the user's inner ear as mechanical vibrations through the bone structure of the user's head and / or through parts of the middle ear, and an electrical signal transmitted directly or indirectly to the user's cochlear nerve.
[0144] The hearing aid may be configured to be worn in any known manner, such as as a unit worn behind the ear (with a tube directing the radiated acoustic signal into the ear canal or with an output transducer such as a loudspeaker arranged close to or in the ear canal), as a unit arranged wholly or partly in the auricle and / or ear canal, as a unit connected to a fixed structure implanted in the skull, such as a vibrator, or as a connectable or wholly or partly implanted unit, etc. The hearing aid may comprise a single unit or several units that communicate with each other (e.g. acoustically, electrically or optically). The loudspeaker may be arranged in a housing together with the other components of the hearing aid, or it may itself be an external unit (possibly in combination with a flexible guiding element such as a dome-shaped element).
[0145] The hearing aid may be adapted to the needs of a specific user, such as hearing loss. The configurable signal processing circuit of the hearing aid may be adapted to apply frequency- and level-dependent compression amplification of the input signal. The customized frequency- and level-dependent gain (amplification or compression) may be determined during the fitting process by the fitting system based on the user's hearing data, such as an audiogram, using the basic principles of fitting (e.g. adaptation to speech). The frequency- and level-dependent gain may, for example, be embodied in a processing parameter, uploaded to the hearing aid, for example, via an interface to a programming device (fitting system), and used by a processing algorithm executed by the configurable signal processing circuit of the hearing aid.
[0146] "Hearing system" refers to a system including one or two hearing aids. "Binaural hearing system" refers to a system including two hearing aids and adapted to provide audible signals to the two ears of a user in a coordinated manner. A hearing system or binaural hearing system may also include one or more "auxiliary devices" that communicate with the hearing aids and affect and / or benefit from the functions of the hearing aids. The aforementioned auxiliary devices may include at least one of the following: a remote controller, a remote microphone, an audio gateway device, an entertainment device such as a music player, a wireless communication device such as a mobile phone (e.g., a smart phone) or a tablet computer or another device, for example, including a graphical interface. Hearing aids, hearing systems or binaural hearing systems may be used, for example, to compensate for the loss of hearing ability of hearing-impaired persons, enhance or protect the hearing ability of normal hearing persons, and / or transmit electronic audio signals to people. Hearing aids or hearing systems may, for example, form part of or interact with a broadcasting system, an active ear protection system, a hands-free telephone system, a car audio system, an entertainment (e.g., TV, music playback or karaoke) system, a teleconferencing system, a classroom amplification system, etc. BRIEF DESCRIPTION OF THE DRAWINGS
[0147] Various aspects of the present invention will be best understood from the detailed description below in conjunction with the accompanying drawings. For clarity, the drawings are schematic and simplified, and only the details necessary for understanding the present invention are given, while other details are omitted. Throughout the specification, the same reference numerals are used for the same or corresponding parts. The various features of each aspect may be combined with any or all features of the other aspects. These and other aspects, features and / or technical effects will be apparent from and illustrated in conjunction with the following figures, in which:
[0148] Figures 1A-1C shows different positions of a user's binaural hearing aid system;
[0149] Figure 2 shows a signal path experienced by a user of a binaural hearing aid system according to the present invention;
[0150] Figure 3A-3B A specific scenario using the method of the present invention is shown;
[0151] Figure 4A-4BA specific scenario using the method of the present invention is shown;
[0152] Figure 5 An example method according to the present invention is shown;
[0153] Figure 6 An example signal strength curve according to the present invention is shown.
[0154] By the detailed description given below, the further scope of application of the present invention will be apparent. However, it should be understood that while the detailed description and specific examples show the preferred embodiments of the present invention, they are only provided for illustrative purposes. For those skilled in the art, based on the following detailed description, other embodiments of the present invention will be apparent. DETAILED DESCRIPTION
[0155] The detailed description proposed below in conjunction with the accompanying drawings serves as a description of a variety of different configurations. The detailed description includes specific details for providing a thorough understanding of a number of different concepts. However, it is apparent to those skilled in the art that these concepts can be implemented without these specific details. Several aspects of the apparatus and method are described by a number of different blocks, functional units, modules, components, circuits, steps, processes, algorithms, etc. (collectively referred to as "elements"). Depending on the specific application, design limitations or other reasons, these elements can be implemented using electronic hardware, computer programs or any combination thereof.
[0156] The electronic hardware may include microelectromechanical systems (MEMS), (e.g., application specific) integrated circuits, microprocessors, microcontrollers, digital signal processors (DSPs), field programmable gate arrays (FPGAs), programmable logic devices (PLDs), gating logic, discrete hardware circuits, printed circuit boards (PCBs) (e.g., flexible PCBs), and other appropriate hardware configured to perform a number of different functions described in this specification, such as sensors for sensing and / or recording physical properties of the environment, equipment, users, etc. Computer programs shall be broadly construed as instructions, instruction sets, codes, code segments, program codes, programs, subroutines, software modules, applications, software applications, software packages, routines, subroutines, objects, executables, execution threads, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.
[0157] The present application relates to the field of hearing aids, and in particular to an operating method of a binaural hearing aid system.
[0158] Figures 1A-1C Different positions of a user 100 of a binaural hearing aid system, for example for use with the method of the present invention, are shown. Figure 1AIt is shown that the first hearing aid 102 (e.g., the left hearing aid) is blocked by the user's head while obtaining an audio signal from the first audio source 110, while the second hearing aid 104 (e.g., the right hearing aid) is obtaining an audio signal from the first audio source 110 (e.g., a television) and has a direct line of sight, and thus will have a better signal strength than the first hearing aid 102 (e.g., when comparing the first signal strength and the second signal strength). Figure 1B A situation is shown where both hearing aids 102, 104 will have approximately equal signal levels. Figure 1C Shown with Figure 1A The opposite situation.
[0159] As users Figures 1A-1C In some examples, the accelerometer data may be used to indicate the movement of the first hearing aid 102 and / or the second hearing aid 104. Thus, it may be beneficial to adjust at least one audio parameter of the first hearing aid 102 and the second hearing aid 104. For example, adjusting the gain of the audio signal from the first audio source 110 and / or the second audio signal from the second audio source may be beneficial to improve the hearing ability of the user 100.
[0160] exist Figure 1A and 1C In , the difference between the first signal strength and the second signal strength will satisfy the difference criterion. Figure 1B In the example above, the difference between the first signal strength and the second signal strength will not satisfy the difference criterion.
[0161] Figure 2 The signal path of the user experience of a binaural hearing aid system is shown. By comparing the signal levels between the first hearing aid 102 and the second hearing aid 104 and seeing how they change over time, the method of the present invention can measure which direction the television is located relative to the user 100. The direction 202 shows where the first audio source is located. As shown, the second hearing aid 104 obtains the direct audio signal 204, while the first hearing aid 102 obtains the audio signal 204 through the user's head. Therefore, the difference between the first signal strength and the second signal strength will meet the difference criterion. This enables the method of the present invention to change at least one audio parameter of the hearing aids 102 / 104.
[0162] Figure 3A-3B A specific scenario using the method of the present invention is shown.After signal filtering and smoothing of the Bluetooth signal level on each of the first hearing aid 102 and the second hearing aid 104, the binaural signal level difference (eg, the difference between the first signal strength and the second signal strength) may be analyzed.
[0163] exist Figure 3AIn FIG. 1 , the user 100 looks directly at the first audio source 310 (e.g., a television or other streaming source), while in Figure 3B , the user 100 has turned his head and is looking away from the first audio source 310, for example, towards the second audio source 312. The signal strength determined by the first hearing aid 102 and the second hearing aid 104 is indicated by the length of the arrows, with longer arrows representing weaker signals because the audio and / or signal must travel a longer distance between the streaming source and the respective hearing aid. Figure 3A The situation and Figure 3B In the case of Figure 3B The situation, Figure 3A The difference in case φ will have a lower amplitude (closer to 0).
[0164] As an example, the user 200 may be watching television and receiving a streaming audio signal from a first audio source 310, such as Figure 3A As shown in . User 100 looks directly at the first audio source, the first signal strength and the second signal strength will not meet the difference criterion. Therefore, the method of the present invention does not take further action.
[0165] A person in the room (eg, second audio source 312) begins speaking to user 100, and user 100 turns (314) his head toward the person (eg, second audio source 312), as shown in FIG. Figure 3B . Now, the difference between the first signal strength and the second signal strength will satisfy the difference criterion. In addition, the accelerometer data indicates the movement of the first hearing aid and / or the second hearing aid (e.g., head rotation 314). As a result, the method of the present invention changes at least one audio parameter in the first hearing aid 102 and the second hearing aid 104. Specifically, the method of the present invention may attenuate the first audio source 310 and increase the gain of the second audio source 312. This enables the user 100 to better hear the person speaking (e.g., the second audio source 312).
[0166] Based on the differences, the implementation looks like the following process:
[0167] 1. The method of the present invention determines the signal strength of an audio signal (eg, the first signal strength of the first audio source 310 ) via the first hearing aid 102 . This generates a data point for the first hearing aid 102 .
[0168] 2. The data points from step 1 are sent to the second hearing aid 104 via a binaural link.
[0169] 3. The second hearing aid 104 will perform step 1 in the same manner as the first hearing aid 102, and compare the signal level from the first hearing aid 102 received in step 2 with its own signal level (eg, second signal strength) in the same time period.
[0170] 4. If the difference between the two does not meet the difference criterion, the method of the present invention will indicate that the user 100 is looking at the streaming source (eg, the first audio source 310), and there is no need to change at least one audio parameter.
[0171] 5. If the second signal strength>the first signal strength (eg, if the difference satisfies a difference criterion), the user 100 looks to the left, and the method of the present invention includes changing at least one audio parameter.
[0172] 6. If the second signal strength < the first signal strength (eg, if the difference satisfies a difference criterion), the user looks to the right, and the method of the present invention includes changing at least one audio parameter.
[0173] Based on the quality and stability of the signal strength indication calculated at each hearing aid, head turn detection can be calculated in a separate step based on the head turn angle. Thus, the difference in signal level can produce an angular estimate of the angle of the head relative to the first audio source. This can enable adjustment of the difference criterion to improve the ability of the binaural hearing aid system to operate in the most efficient manner.
[0174] The estimation of the head angle and the head rotation can be used for the spatialization of the sound signal transmitted by the stream to the first hearing aid and the second hearing aid. It can also be used to control the gain (e.g., change at least one audio parameter) of any one or both of the first hearing aid 102 and the second hearing aid 104 when the user 100 is looking towards the first audio source 310 or looking away from the first audio source 310. In addition, establishing a reference point of the first audio source 310 can be used to control and correct the head angle estimate and the head rotation estimate of other sensors such as accelerometers and / or gyroscopes in the first hearing aid 102 and the second hearing aid 104.
[0175] Figure 4A-4B An example scenario for estimating distance is shown. The difference in binaural signal strength can also be used to estimate the distance between the user and the first audio source. If the user 100 moves closer to or further away from the first audio source, the total level of the signal strength of the first hearing aid 102 and the second hearing aid 104 should change equally, such as Figure 4A-4B as shown in .
[0176] The arrow indicates how far the signal must travel, so a longer arrow will result in a lower signal strength due to attenuation. Figure 4B , when user 100 Figure 4AAs shown in , the signal strength of the first hearing aid 102 and the second hearing aid 104 will both increase as the user 100 moves closer to the first audio source. The relative change in signal strength when the user 100 is moving away from the first audio source will be stronger than the measurable difference described above for detecting head rotation. In addition, using a binaural link, it can be verified that the change in signal strength is similar in the first hearing aid 102 and the second hearing aid 104.
[0177] Based on the type of application, the method of the present invention may average the signal strength received across the first hearing aid 102 and the second hearing aid 104 and compare the averaged measurement to, for example, a lookup table where the signal strength may be converted to discrete distance steps. Given that signal strength is measured in dB of power, an example of the aforementioned conversion is shown in Table 1.
[0178] Table 1
[0179] Average power [dB] Distance from the streaming source >–40dB Very close 40–50dB close 50–60dB average 60–70dB Far <h2 style=";text-align:left;direction:ltr"><–70dB<h2 style=";text-align:left;direction:ltr"> Very far
[0180] The information of how far the user 100 is from the streaming source can be used for a variety of different applications for the method of the present invention. It can be used for adaptive control of gain, i.e. reducing the streaming gain in discrete steps as the user 100 moves away from the first audio source. It can also be used to simulate room acoustics, where a longer distance between the user and the first audio source can infer the size of the room the user 100 is in, which can be used when applying reverberation / room acoustics to the audio signal. If the user 100 is connected to multiple audio sources, the distance can also be used to automatically switch between these audio sources if the signal strength of the currently active audio source drops significantly compared to other available audio sources. This will allow the user 100 to hear the audio source they are closest to without having to manually switch between these audio sources.
[0181] Figure 5 An example method according to the present invention is shown. Specifically, Figure 5A method 600 for adjusting an audio source of a binaural hearing aid system is shown. The method 600 includes step 602 of obtaining audio from a first audio source via a first hearing aid. The method 600 includes step 604 of determining a first signal strength of the audio via the first hearing aid. The method 600 includes step 606 of obtaining the audio from the first audio source via a second hearing aid. The method 600 includes step 608 of determining a second signal strength of the audio via the second hearing aid. The method 600 includes step 610 of comparing the second signal strength to the first signal strength to determine a difference between the second signal strength and the first signal strength. Based on the difference between the first signal strength and the second signal strength satisfying a difference criterion, the method 600 includes step 612 of changing at least one audio parameter of the first hearing aid and the second hearing aid from the first audio source to the second audio source. Based on the difference between the first signal strength and the second signal strength not satisfying the difference criterion, the method 600 includes step 614 of not changing at least one audio parameter in the first hearing aid and the second hearing aid.
[0182] The method 600 comprises a step 611 of obtaining accelerometer data by a first hearing aid and / or a second hearing aid. Based on the difference between the first signal strength and the second signal strength satisfying a difference criterion and the accelerometer data indicating movement of the first hearing aid and / or the second hearing aid, at least one audio parameter of the first hearing aid and the second hearing aid is changed in step 612. Based on the difference between the first signal strength and the second signal strength not satisfying the difference criterion or the accelerometer data not indicating movement of the first hearing aid and / or the second hearing aid, at least one audio parameter of the first hearing aid and the second hearing aid is not changed in step 612.
[0183] In some examples, changing the at least one audio parameter includes attenuating an audio signal of a first audio source. In some examples, changing the at least one audio parameter includes increasing a gain of a second audio signal of a second audio source.
[0184] Figure 6 An exemplary signal strength curve between positive and negative values according to the present invention is shown. The curve illustrates a difference 700 determined by the method of the present invention. When the difference 700 is between a positive threshold 702 and a negative threshold 704, it may be considered that the difference criterion is not met. Therefore, at least one audio parameter will not be changed. Once the difference 700 exceeds any threshold 702 / 704, the difference 700 will meet the difference criterion. In one or more example methods, the corresponding method may also utilize a time period so that a short spike 706 will not cause the difference 700 to meet the difference criterion. Instead, for the difference 700 to meet the difference criterion, the spike should last for a longer time, such as shown in 708. The threshold, such as the positive threshold 702 and / or the negative threshold 704, may be a static value. The threshold, such as the positive threshold 702 and / or the negative threshold 704, may be an adaptive threshold. For example, the threshold, such as the positive threshold 702 and / or the negative threshold 704, may be adaptively changed based on signal characteristics, statistical conditions, etc.
[0185] Embodiments of the methods of the present invention may follow certain steps in certain implementations.
[0186] 1. Obtain RSSI signal levels from a first audio source from each hearing aid (e.g., determine first signal strength and second signal strength after the first hearing aid and second hearing aid obtain the audio). Levels may be measured in multiple channels, such as whenever operating at a particular frequency.
[0187] 2. Optionally, each of the multiple channels of RSSI signal levels may be smoothed using a mean filter or other filter (eg, filtering applied to audio).
[0188] 3. Calculate the RSSI level difference (left-right) between each of the multiple channels to generate binaural RSSI level differences of the multiple channels (eg, compare the second signal strength with the first signal strength).
[0189] 4. A subset of the best performing channels may be taken for further processing. The "best" channels may be those that exhibit the least amount of fading / artifact characteristics.
[0190] a. The metric for the estimation of fading / artifacts in each channel can be based on a number of different statistical time series measurements, and most commonly one or a combination of mean, variance, median, etc. An example could be channel selection based on the median absolute deviation.
[0191] b. The number of channels selected for further processing may be a fixed number of channels (eg, less than the total available channels), or may be adaptive based on a threshold of fading / artifact measurements.
[0192] 5. The remaining number of channels may be post-processed into a single channel which is a combination of these channels. The combination of post-filtering may include:
[0193] a. All remaining channels are median, mean or Kalman filtered. Several of these filters can be applied by cascading these filters in any desired order.
[0194] b. The filtered signal channels can be combined into a single channel / measurement result by taking the average of these channels.
[0195] c. In some embodiments, the resulting single channel measurement results may be further smoothed using the same method as in step a below (median / mean / Kalman or similar filtering methods).
[0196] d. Finally, the DC offset value of the signal can be removed. This is achieved by subtracting the mean or median of the signal across a predetermined signal length.
[0197] 6. The total smoothed binaural RSSI signal level difference generated in step 5 can be used to control hearing aid parameters, such as streaming signal and hearing aid signal gain.
[0198] a. At least one audio parameter may be controlled based on an estimate of whether the hearing aid user is looking "towards" or "away" from the streaming source. If the user is looking towards the streaming source, the difference level will drift towards 0. If looking away from the streaming source, the values will drift away from 0.
[0199] i. The "difference criterion" threshold for estimating the viewing direction ("towards" - "away") can be based on a predetermined value, but may also include signal statistics such as signal standard deviation.
[0200] ii. When "away" is detected, the viewing direction can be further indicated by looking at the sign of the binaural level difference. If left-right is used as in step 3, a negative sign would indicate that the user is looking "away" from the streaming source to the left, and if the sign is positive, to the right (the hearing aid most affected by head shadowing will have the weakest signal strength).
[0201] iii. Generally, when looking "away" from the streaming source, the hearing aid gain will be increased and the streaming source gain will be decreased (for both hearing aids). When looking "towards" the TV, the opposite is true.
[0202] The structural features of the apparatus described above, described in detail in the “Detailed Description of the Invention” and defined in the claims may be combined with the steps of the method of the present invention when appropriately replaced by corresponding processes.
[0203] Unless expressly stated, the singular forms "one", "the" used herein include the plural form (i.e., have the meaning of "at least one"). It should be further understood that the terms "having", "including" and / or "comprising" used in the specification indicate the presence of the described features, integers, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or combinations thereof. It should be understood that, unless expressly stated, when an element is referred to as being "connected" or "coupled" to another element, it may be directly connected or coupled to the other element, or there may be an intermediate intervening element. As used herein, the term "and / or" includes any and all combinations of one or more listed related items. Unless expressly stated, the steps of any method disclosed herein do not have to be performed in the exact order disclosed.
[0204] It should be appreciated that reference to "an embodiment" or "embodiment" or "aspect" or features that "may" include in this specification means that the specific features, structures or characteristics described in conjunction with the embodiment are included in at least one embodiment of the present invention. In addition, the specific features, structures or characteristics may be appropriately combined in one or more embodiments of the present invention. The foregoing description is provided to enable those skilled in the art to implement the various aspects described herein. Various modifications will be apparent to those skilled in the art.
[0205] The claims are not limited to the various aspects shown herein, but rather have the full scope consistent with the claim language wherein, unless expressly stated otherwise, elements referred to in the singular do not mean "one and only one" but rather "one or more." Unless expressly stated otherwise, the term "some" means one or more.
Claims
1. A method for adjusting an audio source of a binaural hearing aid system, the method comprising: obtaining an audio signal from a first audio source via a first hearing aid; determining, by a first hearing aid, a first signal strength of the audio signal; obtaining the audio signal from the first audio source through the second hearing aid; determining, by a second hearing aid, a second signal strength of the audio signal; comparing the second signal strength to the first signal strength to determine a difference between the second signal strength and the first signal strength; obtaining accelerometer data via the first hearing aid and / or the second hearing aid; changing at least one audio parameter in the first hearing aid and the second hearing aid based on a difference between the first signal strength and the second signal strength satisfying a difference criterion and the accelerometer data indicating movement of the first hearing aid and / or the second hearing aid; Wherein, changing at least one audio parameter comprises attenuating the audio signal of the first audio source; and Wherein, changing at least one audio parameter includes increasing a gain of a second audio signal of a second audio source.
2. A method according to any preceding claim, wherein: Determining the first signal strength includes determining a first received signal strength indication of the audio signal, and determining the second signal strength includes determining a second received signal strength indication of the audio signal.
3. The method according to any of the preceding claims, further comprising communicating the first signal strength and / or the second signal strength between the first hearing aid and the second hearing aid.
4. A method according to any preceding claim, wherein: Changing at least one audio parameter includes changing from a Bluetooth streaming mode to a hearing aid mode or changing from a hearing aid mode to a Bluetooth streaming mode.
5. A method according to any preceding claim, wherein: Determining the first signal strength includes applying a filter to the audio signal, and determining the second signal strength includes applying a filter to the audio signal.
6. The method according to claim 5, wherein: The filter is a median filter and / or a low-pass filter and / or a Kalman filter.
7. A method according to any preceding claim, wherein: Based on the difference being greater than a difference threshold, the method includes determining that the difference satisfies a difference criterion.
8. The method according to claim 7, wherein: Based on the difference being greater than a difference threshold for a period of time, the method includes determining that the difference satisfies a difference criterion.
9. A method according to any preceding claim, wherein: Obtaining an audio signal through a first hearing aid includes obtaining an audio signal from a first plurality of channels through the first hearing aid; determining a first signal strength includes determining a first average signal strength of each of the first plurality of channels through the first hearing aid; obtaining an audio signal through a second hearing aid includes obtaining an audio signal from a second plurality of channels through the second hearing aid; determining a second signal strength through the second hearing aid includes determining a second average signal strength of each of the second plurality of channels through the second hearing aid; and comparing the second signal strength with the first signal strength includes comparing the first average signal strength with the second average signal strength.
10. The method according to claim 9, wherein: Determining the first signal strength includes removing channels whose fading effects are greater than a fading effect threshold value from the first plurality of channels; determining the second signal strength includes removing channels whose fading effects are greater than a fading effect threshold value from the second plurality of channels.
11. A method according to any preceding claim, wherein: Obtaining the signal through the first hearing aid includes obtaining the audio signal from the first plurality of channels through the first hearing aid; Determining, by the first hearing aid, the first signal strength comprises determining, by the first hearing aid, an individual first signal strength for each channel of the first plurality of channels; Obtaining the signal through the second hearing aid includes obtaining the audio signal from the second plurality of channels through the second hearing aid; determining, by the second hearing aid, the second signal strength comprises determining, by the second hearing aid, an individual second signal strength for each channel of the second plurality of channels; Comparing the first signal strengths and the second signal strengths includes comparing each of the individual first signal strengths to a corresponding individual second signal strength.
12. A binaural hearing aid system configured to perform the method according to any preceding claim.