Hearing device with fovea fovea beamforming and related methods
By adopting the technology of foveal beamformer and cost function optimization in hearing equipment, the problem of difficulty in recovering binaural cues of sound sources in noisy environments is solved, and better sound focus and spatial perception effects are achieved.
Patent Information
- Application Number
- CN202411887900.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-12-22
- Filing Date
- 2024-12-20
- Publication Date
- 2025-06-24
AI Technical Summary
Existing hearing devices are difficult to effectively restore and maintain binaural cues of sound sources in noisy environments while providing adequate directional focus.
A hearing device including a foveal beamformer is designed that determines the coefficients of the beamformer based on a cost function through a set of microphones and processors to provide directional input signals, enhancing sound quality and spatial perception.
It realizes improving voice intelligibility in noisy environments, reducing undesired sound sources, while retaining binaural clues of sound sources, and enhancing users' spatial impression of the acoustic environment.
Smart Images

Figure CN120201355A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to hearing devices for a binaural hearing system and related methods, including a method for designing a beamformer for a hearing device. Background Art
[0002] People with hearing loss often have difficulty understanding speech in noisy environments. Listening devices, including hearing devices with compensation for hearing loss, use beamforming to help people with hearing loss hear more clearly in noisy environments. Beamforming focuses sound from a specific direction and reduces noise from other directions. However, beamforming also affects the extent to which a hearing aid captures spatial cues that help the user locate where the sound is coming from. For example, the supercardioid pattern is a type of beamforming with a very narrow focus and loses spatial cues.
[0003] There remains a challenge to recover and maintain binaural cues of a sound source while providing sufficient directional focusing. Summary of the Invention
[0004] Accordingly, there is a need for hearing devices and methods with improved spatial cues of a sound source and / or improved beamforming.
[0005] A hearing device (e.g., for a binaural hearing system) is disclosed, the hearing device including: a set of microphones including a first BTE microphone for providing a first BTE microphone input signal and a second BTE microphone for providing a second BTE microphone input signal; a first beamformer, optionally connected to the first BTE microphone and / or the second BTE microphone, for providing a directional input signal based on the first BTE microphone input signal and / or the second BTE microphone input signal; a processor or processing unit configured to provide an electrical output signal based on the directional input signal; and a receiver for converting the electrical output signal into an audio output signal, wherein the first beamformer is a foveal beamformer.
[0006] A method for designing a beamformer (e.g., the first beamformer) of a hearing device is disclosed, the method including: obtaining a first BTE microphone input signal from the first BTE microphone, for example; obtaining a second BTE microphone input signal from the second BTW microphone, for example; determining first beamformer coefficients of the first beamformer based on a cost function; and applying the first beamformer coefficients to the first beamformer of the hearing device. The first beamformer coefficients of the first beamformer are determined based on a cost function, the cost function including an omnidirectional component and / or a first cost component associated with a first angular range and / or a first frequency range, for example.
[0007] In addition, a hearing device for a binaural hearing system is disclosed, the hearing device comprising: a set of microphones including a first BTE microphone for providing a first BTE microphone input signal and a second BTE microphone for providing a second BTE microphone input signal; a first beamformer configured to provide a directional input signal based on the first BTE microphone input signal and the second BTE microphone input signal; a processor or processing unit configured to provide an electrical output signal based on the directional input signal; and a receiver configured to provide an audio output signal based on the electrical output signal, wherein the first beamformer is a foveal beamformer.
[0008] In addition, a binaural hearing system is disclosed, the binaural hearing system comprising a first hearing device and a second hearing device, wherein the first hearing device is a hearing device as disclosed herein and the second hearing device is a hearing device as disclosed herein.
[0009] The present disclosure allows for improved spatial discrimination of sound sources associated with different spatial positions while providing sufficient focusing of incoming sounds. Improved speech intelligibility in noisy environments is provided.
[0010] The present disclosure allows for the reduction of undesired sound sources while retaining the binaural cues of the sound sources to preserve the user's spatial impression of the acoustic environment.
[0011] The present disclosure advantageously utilizes synergistic vision and / or auditory integration. Auditory spatial cues in the field of view are improved and off-field noise sources are suppressed.
[0012] The foveal beamforming of the present disclosure processes audio signals with different levels of detail according to the position of the source and enhances sound quality and spatial perception by providing better spatial cues for sources in a first angular range (e.g., the field of view) and suppressing noise from sources in a second angular range (e.g., outside the field of view). Description of the Drawings
[0013] The above and other features and advantages of the present invention will become apparent to those skilled in the art from the following detailed description of exemplary embodiments of the present invention with reference to the accompanying drawings, wherein: Figure 1 An exemplary hearing device according to the present disclosure is schematically shown, Figure 2 A binaural hearing system according to the present disclosure is schematically shown, Figure 3 is an example of the polar pattern of a foveal beamformer according to the present disclosure, Figure 4 is an example of the polar pattern of a first MIE microphone, and
[0014] Figure 5 is an example of the polar pattern of a BTE fixed beamformer.
[0015] List of reference signs:
[0016] 1 Binaural hearing system
[0017] 2 Hearing device
[0018] 2A First hearing device, left hearing device
[0019] 2B Second hearing device, right hearing device
[0020] 10 First BTE microphone
[0021] 10A First BTE microphone input signal
[0022] 12 Second BTE microphone
[0023] 12A Second BTE microphone input signal
[0024] 14 First MIE microphone
[0025] 14A First MIE microphone input signal
[0026] 13 Memory
[0027] 16 Processor / processing unit
[0028] 16A Electrical output signal
[0029] 18 Receiver
[0030] 20 Transceiver module
[0031] 22 Radio transceiver
[0032] 24 Antenna
[0033] 26 Wireless communication
[0034] 28 Transceiver input signal
[0035] 28A Contralateral microphone input signal
[0036] 32 First beamformer
[0037] 32A Directional input signal
[0038] 34 First filter
[0039] 34A First filter output
[0040] 36 Second filter
[0041] 36A Second filter output
[0042] 38 Adder
[0043] D_0 Zero direction
[0044] DL_1 First left direction
[0045] DR_1 First right direction
[0046] f_1 First frequency
[0047] f_2 Second frequency
[0048] f_3 Third frequency
[0049] f_4 Fourth frequency
[0050] f_5 Fifth frequency
[0051] VL_1 First left angle
[0052] VL_2 Second left angle
[0053] VR_1 First right angle
[0054] VR_2 Second right angle Detailed implementation manners
[0055] Various exemplary embodiments and details are described below with reference to the accompanying drawings when relevant. It should be noted that in all the drawings, elements with similar structures or functions are denoted by the same reference numerals. It should also be noted that the drawings are only intended to facilitate the description of the embodiments. They are not intended to be an exhaustive description of the present invention or a limitation on the scope of the present invention. Additionally, the illustrated embodiments do not necessarily have all the aspects or advantages shown. The aspects or advantages described in connection with a particular embodiment are not necessarily limited to that embodiment and may be applied in any other embodiment, even if not so shown or if not so explicitly described.
[0056] A hearing device, also referred to as the first hearing device and / or the second hearing device, is disclosed, for example, a hearing device for a binaural hearing system. The hearing device may be configured to be worn at the user's ear and may be an on-ear hearing device or a hearing aid, wherein the processor is configured to compensate for the user's hearing loss.
[0057] The hearing device may be of the behind-the-ear (BTE) type, in-the-ear (ITE) type, in-the-canal (ITC) type, receiver-in-the-canal (RIC) type, receiver-in-the-ear (RITE) type, or microphone-in-the-ear (MIE) type. The hearing aid may be a binaural hearing aid. The hearing device may include a first earpiece and a second earpiece, wherein the first earpiece and / or the second earpiece is an earpiece as disclosed herein.
[0058] A hearing device may be configured for wireless communication with one or more devices (e.g., with another hearing device, e.g., as part of a binaural hearing system) and / or with one or more accessory devices (e.g., a smart phone and / or a smart watch).
[0059] The hearing device may include a transceiver module for communicating with a contralateral hearing device of a binaural hearing system and / or one or more accessory devices. The transceiver module is optionally configured to receive contralateral data from the contralateral hearing device, the contralateral data optionally including a contralateral directional input signal.
[0060] Accordingly, the hearing device / transceiver module optionally includes an antenna for converting one or more wireless input signals (e.g., a first wireless input signal and / or a second wireless input signal) into an antenna output signal. The wireless input signals may originate from an external source, such as a spouse microphone device, a wireless TV audio transmitter, and / or a distributed microphone array associated with a wireless transmitter. The wireless input signals may originate from another hearing device, e.g., as part of a binaural hearing system, and / or from one or more accessory devices.
[0061] The hearing device / transceiver module optionally includes a radio transceiver coupled to the antenna for converting the antenna output signal into a transceiver input signal. Wireless signals from different external sources may be multiplexed into a transceiver input signal in the radio transceiver or provided as separate transceiver input signals at separate transceiver outputs of the radio transceiver. The hearing device may include multiple antennas and / or one antenna, which may be configured to operate in one or more antenna modes. The transceiver input signal optionally includes a first transceiver input signal representing a first wireless signal from a first external source.
[0062] The hearing device includes a set of microphones. The set of microphones may include one or more microphones. The set of microphones includes a first microphone, such as a first BTE microphone, for providing a first microphone input signal, such as a first BTE microphone input signal. The first BTE (behind-the-ear) microphone is arranged in a housing configured to be arranged behind the user's ear. The set of microphones includes a second microphone, such as a second BTE microphone, for providing a second microphone input signal, such as a second BTE microphone input signal. The second BTE (behind-the-ear) microphone is optionally arranged in a housing configured to be arranged behind the user's ear. The set of microphones optionally includes a third microphone, such as a first MIE microphone, for providing a third microphone input signal, such as a first MIE microphone input signal. The first MIE (in-ear microphone) microphone is arranged near, at, or in the user's ear canal, such as in a receiver connected to the BTE housing by a wire. The set of microphones may include N microphones for providing N microphone signals, where N is an integer in the range from 1 to 10. In one or more example hearing devices, the number N of microphones is two, three, four, five, or more.
[0063] The hearing device includes a first beamformer connected to the first BTE microphone and the second BTE microphone for providing a directional input signal based on the first BTE microphone input signal and / or the second BTE microphone input signal. In other words, the first beamformer may be configured to provide a directional input signal based on the first BTE microphone input signal and the second BTE microphone input signal. The first beamformer may be a fixed beamformer. The first beamformer may be a foveal beamformer. The first beamformer may include a first filter for filtering the first BTE microphone input to provide a first filter output, and the first beamformer optionally includes a second filter for filtering the second BTE microphone input signal to provide a second filter output. The first filter output and the second filter output are optionally added in an adder to provide a directional input signal.
[0064] The design of the first beamformer is an optimization process for obtaining two filters under specific constraints. In the present disclosure, new constraints or cost components are added to reduce the mismatch between two polar patterns, such as in the field of view (-30, 30) or the peripheral field of view (-60, 60).
[0065] In this context, a foveal beamformer is a beamformer designed to maintain spatial cues in a first angular range and suppress noise in a second angular range and / or a third angular range.
[0066] The hearing device includes a processor or processing unit configured to provide an electrical output signal based on a directional input signal. In other words, the processor / processing unit can be configured to process the input signal (e.g., the directional input signal) to provide an electrical output signal. The processor is optionally configured to compensate for the hearing loss of a user of the hearing device.
[0067] The hearing device includes a receiver for converting the electrical output signal into an audio output signal. In other words, the receiver can be configured to provide an audio output signal based on the electrical output signal.
[0068] The present disclosure provides improved auditory focusing in the field of view while maintaining spatial cues.
[0069] Note that the descriptions and features of the functions of the hearing device, such as the hearing device being configured to, also apply to the method, and vice versa. For example, the description of the hearing device configured to determine also applies to the method, such as a method of operating a hearing device, which includes determining, and vice versa.
[0070] In one or more examples, a hearing device for a binaural hearing system is disclosed, the hearing device including: a set of microphones including a first BTE microphone for providing a first BTE microphone input signal and a second BTE microphone for providing a second BTE microphone input signal; a first beamformer connected to the first BTE microphone and the second BTE microphone for providing a directional input signal based on the first BTE microphone input signal and the second BTE microphone input signal; a processor configured to provide an electrical output signal based on the directional input signal; and a receiver for converting the electrical output signal into an audio output signal, wherein the first beamformer is optionally a foveal beamformer.
[0071] In one or more examples, the first beamformer is configured to process the first BTE microphone input signal and the second BTE microphone input signal with a first level of accuracy for maintaining spatial cues within a first angular range and a second level of accuracy for maintaining spatial cues within a second angular range.
[0072] The first angular range can be the field of view angular range. The first angular range can be from a first left angle (a first left direction forms a first left angle to the zero direction) to a first right angle (a first right direction forms a first right angle to the zero direction). The first left angle is also denoted as VL_1 or - It can be in the range of -60 degrees to -15 degrees, such as -30 degrees or -45 degrees. The first right angle is also denoted as VR_1 or It can be within the range of 15 degrees to 60 degrees, such as 30 degrees or 45 degrees. It should be noted that the angle is indicated relative to the zero direction (0 degrees), which is also represented as the viewing direction or the front direction. In one or more examples, the first left angle is -30 degrees and the first right angle is 30 degrees, which corresponds to the human binocular field of view. In other words, the first angle range can be or correspond to the human binocular field of view.
[0073] The second angle range can be or include the peripheral angle range. The second angle range can include the second left angle range. The second angle range can be from the second left angle (the second left direction forms the second left angle to the zero direction) to the first left angle, or from the first right angle to the second right angle (the second right direction forms the second right angle to the zero direction). The second angle range can be at least a part from the first right angle to the first left direction. The second angle range can be regarded as a part of the omnidirectional angle range that does not overlap with the first angle range.
[0074] The second left angle (also represented as VL_2) can be within the range of -180 degrees to -15 degrees, such as -30 degrees, -45 degrees or -60 degrees. The second right angle (also represented as VR_2) can be within the range of 15 degrees to 95 degrees, such as 30 degrees, 45 degrees or 60 degrees.
[0075] In one or more examples, the first accuracy level regarding the spatial cue maintenance is higher than the second accuracy level regarding the spatial cue maintenance.
[0076] In one or more examples, the first angle range includes the left focusing range and / or the right focusing range. The left focusing range can be from the first left angle to the zero direction. The right focusing range can be from the zero direction to the first right angle.
[0077] In one or more examples, the second angle range includes the left peripheral range and / or the right peripheral range. The left peripheral range can be from the second left angle to the first left angle. The right peripheral range can be from the first right angle to the second right angle.
[0078] In one or more examples, the second angle range of the left hearing device is from -180 to the first left angle (such as -60, -45 or -30 degrees).
[0079] In one or more examples, the second angle range of the right hearing device is from the first right angle (such as 30, 45 or 60 degrees) to 180 degrees.
[0080] The beamforming pattern P for the hearing device configured as a left hearing device l can be given as:
[0081] P l (f,θ)=F fl (f,b)*Hfl (f,θ)+F bl (f,α)*H bl (f,θ)
[0082] where a and b are the FIR filter coefficients of the first beamformer; H fl is the transfer function (e.g., HRTF) of the first BTE microphone (left front microphone), H bl is the transfer function (e.g., HRTF) of the second BTE microphone (left rear microphone), F fr is the first filter of the first beamformer, and F br is the second filter of the first beamformer.
[0083] The beamforming pattern P for a hearing device configured as a right hearing device r can be given as:
[0084] P r (f,θ) = F fr (f,d)*H fr (f,θ)+F br (f,c)*H br (f,θ),
[0085] where c and d are the FIR filter coefficients of the first beamformer; H fr is the transfer function (e.g., HRTF) of the first BTE microphone (right front microphone), H br is the transfer function (e.g., HRTF) of the second BTE microphone (right rear microphone), F fr is the first filter of the first beamformer, and F br is the second filter of the first beamformer.
[0086] In one or more examples, the first beamformer coefficients (e.g., the first filter coefficients and / or the second filter coefficients) of the first beamformer are based on a cost function, e.g., by minimizing the cost function. The cost function can include multiple cost components, e.g., the sum of cost components.
[0087] The cost function optionally includes an omnidirectional component. The omnidirectional component can be based on the beamforming objective function and the beamforming pattern of the hearing device / first beamformer. The beamforming objective function is also denoted as BF, and for a hearing device configured as a left hearing device, the beamforming objective function is denoted as BF l and for a hearing device configured as a right hearing device, the beamforming objective function is denoted as BF r . The beamforming pattern is also denoted as P, and for a hearing device configured as a left hearing device, the left beamforming pattern is denoted as Pl and for a hearing device configured as a right hearing device, the right beamforming pattern is also denoted as P r .
[0088] The omnidirectional component of the cost function of the left hearing device is also denoted as OC_L and can be given as:
[0089]
[0090] where BF l is the left beamforming objective function and P l is the left beamforming pattern.
[0091] The omnidirectional component of the cost function of the right hearing device is also denoted as OC_R and can be given as:
[0092]
[0093] where BF r is the right beamforming objective function and P r is the right beamforming pattern.
[0094] The omnidirectional component can be associated with (e.g., determined or calculated for) an omnidirectional angular range (e.g., from -180 degrees to 180 degrees) and / or an omnidirectional frequency range (e.g., from 200 Hz to 3.5 kHz).
[0095] The omnidirectional component of the cost function of the left hearing device is also denoted as OC_L and can be given as:
[0096]
[0097] where fl is the omnidirectional low frequency of the omnidirectional frequency range (e.g., 200 Hz) and fh is the omnidirectional high frequency of the omnidirectional frequency range (e.g., 3.5 kHz), [-180, 180] is the omnidirectional angular range, where BF l is the left beamforming objective function and P l is the left beamforming pattern.
[0098] In one or more examples, the first beamformer coefficients of the first beamformer are based on a cost function that includes a first cost component associated with a first angular range (e.g., from -30 degrees to 30 degrees, from -45 degrees to 45 degrees, or from -60 degrees to 60 degrees) and / or a first frequency range (e.g., from a first low frequency to a first high frequency). The first low frequency, also denoted as fl1, can be less than 1 kHz, e.g., in the range of 100 Hz to 500 Hz, and / or the first high frequency, also denoted as fh1, can be greater than 2 kHz, e.g., in the range of 3 kHz to 8 kHz, e.g., 3.5 kHz.
[0099] In other words, the cost function optionally includes a first cost component. The first cost component can be based on the beamforming pattern P and optionally on the polar pattern of the first MIE microphone. The first cost component can be based on a regularization parameter or weight, for example in the range from 1 to 100.
[0100] For example, when the first MIE microphone is not available in the hearing device, the first cost component can be based on the beamforming pattern P and the open ear response, also denoted as OER.
[0101] The first cost component is also denoted as CC_1, for a hearing device configured as a left hearing device, the first cost component is also denoted as CC_L_1, and for a hearing device configured as a right hearing device, the first cost component is also denoted as CC_R_1.
[0102] The first cost component CC_L_1 of the cost function of the left hearing device can be given as:
[0103]
[0104] where fl1 is the first low frequency of the first frequency range, for example 200 Hz, and fh1 is the first high frequency of the first frequency range, for example 3.5 kHz, is the first angular range, for example from -30 degrees to 30 degrees, from -45 degrees to 45 degrees, or from -60 degrees to 60 degrees, MIE l is the polar pattern of the first MIE microphone, P l is the beamforming pattern of the first beamformer, and R a is the regularization parameter.
[0105] The first cost component CC_R_1 of the cost function of the left hearing device can be given as:
[0106]
[0107] where fl1 is the first low frequency of the first frequency range, for example 200 Hz, and fh1 is the first high frequency of the first frequency range, for example 3.5 kHz, is the first angular range, for example from -30 degrees to 30 degrees, from -45 degrees to 45 degrees, or from -60 degrees to 60 degrees, OER r is the polar pattern of the open ear response, P l is the left beamforming pattern of the first beamformer, and R a is the regularization parameter.
[0108] The first cost component CC_R_1 of the cost function of the right hearing device can be given as:
[0109]
[0110] Wherein, fl1 is the first low frequency of the first frequency range, such as 200 Hz, and fh1 is the first high frequency of the first frequency range, such as 3.5 kHz. is the first angle range, such as from -30 degrees to 30 degrees, from -45 degrees to 45 degrees, or from -60 degrees to 60 degrees, MIE r is the polar pattern of the first MIE microphone, P r is the left beamforming pattern of the first beamformer, and R a is the regularization parameter.
[0111] The first cost component CC_R_1 of the cost function of the right hearing device can be given as:
[0112]
[0113] Wherein, fl1 is the first low frequency of the first frequency range, such as 200 Hz, and fh1 is the first high frequency of the first frequency range, such as 3.5 kHz. is the first angle range, such as from -30 degrees to 30 degrees, from -45 degrees to 45 degrees, or from -60 degrees to 60 degrees, OER r is the polar pattern of the open ear response, P r is the right beamforming pattern of the first beamformer, and R a is the regularization parameter.
[0114] In one or more examples, the cost function includes a second cost component associated with a second angle range and / or a second frequency range, wherein the first beamformer coefficients are based on the second cost component. The second cost component can be based on the (left / right) beamforming objective function and / or the (left / right) beamforming pattern.
[0115] The second frequency range of the second cost component can be different from the first frequency range of the first cost component. This can allow for improved noise reduction and spatial cue preservation.
[0116] The second angle range of the second cost component in the cost function of the left hearing device can be from -180 degrees to -60 degrees, -45 degrees, or -30 degrees.
[0117] The second cost component CC_L_2 of the cost function of the left hearing device can be given as:
[0118]
[0119] where fl2 is the second low frequency of the second frequency range, such as 200 Hz, and fh2 is the second high frequency of the second frequency range, such as 3.5 kHz. is the second angle range, where can be in the range of 15 degrees to 90 degrees, such as 30 degrees, 45 degrees or 60 degrees, where BF l is the left beamforming objective function, and P l is the left beamforming pattern.
[0120] The second angle range of the second cost component in the cost function of the right hearing device can be from 30 degrees, 45 degrees or 60 degrees to 180 degrees.
[0121] The second cost component CC_R_2 of the cost function of the right hearing device can be given as:
[0122]
[0123] where fl2 is the second low frequency of the second frequency range, such as 200 Hz, and fh2 is the second high frequency of the second frequency range, such as 3.5 kHz. is the second angle range, where can be in the range of 15 degrees to 90 degrees, such as 30 degrees, 45 degrees or 60 degrees, where BF r is the right beamforming objective function, and P r is the right beamforming pattern.
[0124] The second frequency range of the second cost component in the cost function can be from the second low frequency to the second high frequency. The second low frequency can be less than 1 kHz, such as in the range of 100 Hz to 500 Hz, and / or the second high frequency can be greater than 2 kHz, such as in the range of 3 kHz to 8 kHz, such as 3.5 kHz.
[0125] In one or more examples, the cost function includes an omnidirectional component and a first cost component.
[0126] In one or more examples, the cost function includes a first cost component and a second cost component.
[0127] In one or more examples, the cost function includes a third cost component associated with a third angle range and / or a third frequency range, where the first beamformer coefficients are based on the third cost component. The third cost component can be based on the (left / right) beamforming objective function and / or the (left / right) beamforming pattern. In one or more examples, the cost function includes a first cost component, a second cost component and a third cost component.
[0128] The third angular range of the third cost component in the cost function of the left hearing device or the right hearing device can be from 30 degrees, 45 degrees, or 60 degrees to 180 degrees.
[0129] The third cost component CC_L_3 of the cost function of the left hearing device can be given as:
[0130]
[0131] where fl3 is the third low frequency of the third frequency range, such as 200 Hz, and fh3 is the third high frequency of the third frequency range, such as 3.5 kHz, is the third angular range, where, can be in the range from 15 degrees to 90 degrees, such as 30 degrees, 45 degrees, or 60 degrees, where BF l is the left beamforming objective function, and P l is the left beamforming pattern.
[0132] The third angular range of the third cost component in the cost function of the right hearing device can be from -180 degrees to -30 degrees, -45 degrees, or -60 degrees.
[0133] The third cost component CC_R_3 of the cost function of the right hearing device can be given as:
[0134]
[0135] where fl3 is the third low frequency of the third frequency range, such as 200 Hz, and fh3 is the third high frequency of the third frequency range, such as 3.5 kHz, is the third angular range, where, can be in the range from 15 degrees to 90 degrees, such as 30 degrees, 45 degrees, or 60 degrees, where, BF r is the right beamforming objective function, and P r is the right beamforming pattern.
[0136] In one or more examples, the hearing device includes a first MIE microphone for providing a first MIE microphone input signal, where the cost function COST (e.g., for the left hearing device) is given by
[0137]
[0138]
[0139] where, P l is the left beamforming pattern of the first beamformer, BF l is the beamforming objective function, MIE lis the polar pattern of the first MIE microphone, are the angular bounds of the first angular range, fh1, fh2, fh3, fl1, fl2, and fl3 are the frequency bounds of the respective frequency ranges, and R a is the regularization parameter.
[0140] In one or more examples, a hearing device includes a first MIE microphone for providing a first MIE microphone input signal, wherein a cost function COST (e.g., for a right hearing device) is given by
[0141]
[0142] wherein, P r is the right beamforming pattern of the first beamformer, BF r is the beamforming objective function, MIE r is the polar pattern of the first MIE microphone, are the angular bounds of the first angular range, fh1, fh2, fh3, fl1, fl2, and fl3 are the frequency bounds of the respective frequency ranges, and R a is the regularization parameter.
[0143] In one or more examples, the first beamformer coefficients of the first beamformer match the polar pattern or the open ear response of the first MIE microphone.
[0144] For example, one of the left BFs (e.g., in the second cost component or the third cost component) can be given by:
[0145]
[0146] For example, one of the right BFs (e.g., in the second cost component or the third cost component) can be given by:
[0147]
[0148] To personalize the first beamformer coefficients / filters to match the MIE polar pattern, the first beamformer coefficients / filters of the first beamformer can be adapted by playing sounds with a sound source at a first angle (e.g., -30 degrees or -60 degrees for a left hearing device or 30 degrees or 60 degrees for a right hearing device). Thus, the power of the beamforming will be close to the power of the MIE microphone input signal (or its filtered version that equalizes the zero-degree response between the first MIE microphone and the front BTE microphone), while keeping the zero-degree response unchanged. This process can be done in a fitting room or can be done by oneself with guidance and an application, such as on a mobile phone. The first MIE microphone input signal is only used for designing and calibrating the first beamformer and will not be used for any further processing in the mode. Note that the receiver is muted during the first beamformer design to avoid feedback mixing with the direct sound.
[0149] In one or more examples, the first beamformer coefficients of the first beamformer are adapted to maintain the internal time difference between the first MIE microphone input signal of the contralateral hearing device and the contralateral first MIE microphone input signal.
[0150] For example, FIR filters a, b, c, d can be adapted to maintain the ITD and ILD of the MIE microphone input signal as follows:
[0151]
[0152] where f l and f r are the spectra of the captured MIE microphone input signals.
[0153] In other words, determining the first beamformer coefficients of the first beamformer based on the cost function of the method can include maintaining the internal time difference between the first MIE microphone input signal of the contralateral hearing device and the contralateral first MIE microphone input signal.
[0154] In one or more examples, the first beamformer coefficients of the first beamformer are adapted to maintain the internal level difference between the first MIE microphone input signal of the contralateral hearing device and the contralateral first MIE microphone input signal. In other words, determining the first beamformer coefficients of the first beamformer based on the cost function of the method can include maintaining the internal level difference between the first MIE microphone input signal of the contralateral hearing device and the contralateral first MIE microphone input signal.
[0155] In one or more examples, providing an electrical output signal based on a directional input signal includes providing an electrical output signal based on one or more high-frequency components of the directional input signal and the first MIE microphone input signal.
[0156] In one or more examples, a method of designing a beamformer for a hearing device is disclosed. The method includes: obtaining a first BTE microphone input signal; obtaining a second BTE microphone input signal; determining first beamformer coefficients of a first beamformer based on a cost function; and applying, for example, the first beamformer coefficients to the first beamformer of the hearing device using the first beamformer, wherein determining the first beamformer coefficients of the first beamformer based on the cost function includes determining the first beamformer coefficients of the first beamformer based on a cost function including a first cost component associated with a first angular range.
[0157] In one or more examples, determining the first beamformer coefficients of the first beamformer based on the cost function includes determining the first beamformer coefficients of the first beamformer based on a cost function including one or both of an omnidirectional component (associated with an omnidirectional angular range and / or an omnidirectional frequency range) and a second cost component (associated with a second angular range and / or a second frequency range).
[0158] In one or more examples, the method includes obtaining a first MIE microphone input signal, wherein determining the first beamformer coefficients of the first beamformer based on the cost function includes determining the first beamformer coefficients based on the first MIE microphone input signal.
[0159] Determining the first beamformer coefficients based on the cost function optionally includes solving an optimization problem based on the cost function, such as minimizing the cost function.
[0160] Figure 1Shows an example hearing device 2 according to the present disclosure, such as a first (left) hearing device 2A and / or a second (right) hearing device 2B. The hearing device 2 includes a set of microphones, including a first BTE microphone 10 for providing a first BTE microphone input signal 10A, a second BTE microphone 12 for providing a second BTE microphone input signal 12A, and optionally a first MIE microphone 14 for providing a first MIE microphone input signal 14A. The hearing device 2 includes a first beamformer 32 connected to the first BTE microphone 10 and the second BTE microphone 12 for providing a directional input signal 32A based on the first BTE microphone input signal 10A and the second BTE microphone input signal 12A. The first beamformer 32 includes a first filter 34 and a second filter 36 for filtering the respective microphone input signals 10A and 12A. For the left hearing device 2A, as described above, the first filter 34 has filter coefficients b, and the second filter 36 has filter coefficients a. For the right hearing device 2B, as described above, the first filter 34 has filter coefficients d, and the second filter 36 has filter coefficients c. The filter outputs 34A, 36A from the respective filters 34, 36 are summed in an adder 38 to provide the directional input signal 32A.
[0161] The hearing device 2 includes a processor 16 for processing the directional input signal 32A to provide an electrical output signal 16A. The hearing device 2 includes a receiver 18 for converting the electrical output signal 16A into an audio output signal.
[0162] The hearing device 2 optionally includes a transceiver module 20 for communicating with a contralateral hearing device (such as the hearing device 2B). The radio transceiver 22 is configured to receive contralateral data 28 from the contralateral hearing device, and the contralateral data 28 includes a contralateral directional input signal 28A.
[0163] The transceiver module 20 includes a radio transceiver 22 and an antenna 24. The radio transceiver 22 is configured for wireless communication as shown by arrow 26 (such as with a contralateral hearing device of a binaural hearing system). The transceiver module 20 and / or the radio transceiver 22 is configured to receive contralateral data 28 from the contralateral hearing device, and the contralateral data 28 includes a contralateral directional input signal 28A.
[0164] The first beamformer 32 is a foveal beamformer, wherein the first beamformer 32 is configured to process the first BTE microphone input signal 10A and the second BTE microphone input signal 12A at a first accuracy level within a first angular range (such as from -30 degrees to 30 degrees) and at a second accuracy level within a second angular range (such as an angular range that does not overlap with or is outside the first angular range), and wherein the first accuracy level is higher than the second accuracy level.
[0165] Figure 2 Shows an example binaural hearing system 1 including a first hearing device 2A configured as a left hearing device and a second hearing device 2B configured as a right hearing device. The first beamformer 32 includes a first filter 34 and a second filter 36 for filtering the respective microphone input signals 10A and 12A. In the first hearing device 2A, the first filter 34 has FIR filter coefficients b, and the second filter 36 has filter coefficients a forming a foveal beamformer. In the second hearing device 2B, the first filter 34 has FIR filter coefficients d, and the second filter 36 has filter coefficients c forming a foveal beamformer.
[0166] Figures 3 - 5 Shows an example polar pattern for four frequencies f1 = 1030 Hz, f2 = 2050 Hz, f3 = 3070 Hz, and f4 = 5160 Hz.
[0167] Figure 3 Is an example of the polar pattern of a foveal beamformer according to the present disclosure. The hearing device is configured as a right hearing device, and the first angular range AR_1 is from -45 degrees (the first left angle formed between the zero direction D_0 and the first left direction DL_1) to 45 degrees (the first right angle formed between the zero direction D_0 and the first right direction DR_1). The foveal beamformer is designed to maintain spatial cues in the first angular range by including a first cost component based on the polar pattern of the first MIE microphone in the cost function. The foveal beamformer is designed to suppress noise in a second angular range AR_2 from 45 degrees to 180 degrees and a third angular range AR_3 from -180 degrees to -45 degrees by based on including a second cost component and a third cost component of the right beamforming objective function in the cost function.
[0168] Figure 4 Shows for determining Figure 3 The polar pattern of the first MIE microphone of the foveal beamformer.
[0169] Figure 5 Is an example of the polar pattern of a BTE fixed beamformer.
[0170] Also disclosed is a hearing device and method according to any one of the following items and clauses:
[0171] Item 1. A hearing device for a binaural hearing system, the hearing device comprising:
[0172] A set of microphones, including a first BTE microphone for providing a first BTE microphone input signal and a second BTE microphone for providing a second BTE microphone input signal;
[0173] A first beamformer, connected to the first BTE microphone and the second BTE microphone, for providing a directional input signal based on the first BTE microphone input signal and the second BTE microphone input signal;
[0174] A processor, configured to provide an electrical output signal based on the directional input signal; and a receiver for converting the electrical output signal into an audio output signal,
[0175] wherein the first beamformer is a foveal beamformer.
[0176] Item 2. The hearing device according to item 1, wherein the first beamformer is configured to process the first BTE microphone input signal and the second BTE microphone input signal at a first accuracy level within a first angular range and at a second accuracy level within a second angular range.
[0177] Item 3. The hearing device according to item 2, wherein the first accuracy level is higher than the second accuracy level.
[0178] Item 4. The hearing device according to any one of items 2-3, wherein the first angular range includes a left focus range or a right focus range.
[0179] Item 5. The hearing device according to any one of items 2-4, wherein the second angular range includes a left peripheral range or a right peripheral range.
[0180] Item 6. The hearing device according to any one of items 1-5, wherein the first beamformer coefficients of the first beamformer are based on a cost function that includes a first cost component associated with the first angular range.
[0181] Item 7. The hearing device according to item 6, the cost function includes a second cost component associated with the second angular range, wherein the first beamformer coefficients are based on the second cost component.
[0182] Item 8. The hearing device according to any one of items 6-7, the cost function includes a third cost component associated with a third angular range, wherein the first beamformer coefficients are based on the third cost component.
[0183] Item 9. The hearing device according to any one of items 6-7, the hearing device includes a first MIE microphone for providing a first MIE microphone input signal, wherein the cost function COST is given by the following formula:
[0184]
[0185] where P l is the beamforming pattern of the first beamformer, BF l is the beamforming objective function, MIE is the polar pattern of the first MIE microphone, is the angular limit of the first angular range, fh1, fh2, fh3, fl1, fl2, and fl3 are the frequency limits of the corresponding frequency ranges, and R a is the regularization parameter.
[0186] Item 10. The hearing device according to Item 9, wherein the first beamformer coefficients of the first beamformer match the polar pattern of the first MIE microphone.
[0187] Item 11. The hearing device according to any one of Items 1-10, wherein the first beamformer coefficients of the first beamformer are adapted to maintain: the internal time difference between the input signal of the first MIE microphone of the contralateral hearing device and the input signal of the contralateral first MIE microphone and / or the internal level difference between the input signal of the first MIE microphone of the contralateral hearing device and the input signal of the contralateral first MIE microphone.
[0188] Item 12. The hearing device according to any one of Items 1-10, wherein providing an electrical output signal based on the directional input signal includes: providing an electrical output signal based on one or more high-frequency components of the directional input signal and the input signal of the first MIE microphone.
[0189] Item 13. A method of designing a beamformer of a hearing device, the method comprising:
[0190] - Obtaining a first BTE microphone input signal;
[0191] - Obtaining a second BTE microphone input signal;
[0192] - Determining first beamformer coefficients of the first beamformer based on a cost function; and
[0193] - Applying the first beamformer coefficients to the first beamformer of the hearing device,
[0194] wherein determining the first beamformer coefficients of the first beamformer based on the cost function includes: determining the first beamformer coefficients of the first beamformer based on a cost function including a first cost component associated with the first angular range.
[0195] Item 14. The method according to item 13, the method comprising obtaining a first MIE microphone input signal, wherein determining first beamformer coefficients of a first beamformer based on a cost function comprises: determining the first beamformer coefficients based on the first MIE microphone input signal.
[0196] Clause 1. A hearing device for a binaural hearing system, the hearing device comprising:
[0197] A set of microphones, including a first BTE microphone for providing a first BTE microphone input signal and a second BTE microphone for providing a second BTE microphone input signal;
[0198] A first beamformer configured to provide a directional input signal based on the first BTE microphone input signal and the second BTE microphone input signal;
[0199] A processing unit configured to provide an electrical output signal based on the directional input signal; and a receiver configured to provide an audio output signal based on the electrical output signal;
[0200] wherein the first beamformer is a foveal beamformer.
[0201] Clause 2. The hearing device according to clause 1, wherein the first beamformer is configured to process the first BTE microphone input signal and the second BTE microphone input signal at a first accuracy level within a first angular range and to process the first BTE microphone input signal and the second BTE microphone input signal at a second accuracy level within a second angular range.
[0202] Clause 3. The hearing device according to clause 2, wherein the first accuracy level is higher than the second accuracy level.
[0203] Clause 4. The hearing device according to any one of clauses 2-3, wherein the first angular range includes a left focus range or a right focus range.
[0204] Clause 5. The hearing device according to any one of clauses 2-4, wherein the second angular range includes a left peripheral range or a right peripheral range.
[0205] Clause 6. The hearing device according to any one of clauses 2-5, wherein the first beamformer coefficients of the first beamformer are based on a cost function that includes a first cost component associated with the first angular range.
[0206] Clause 7. The hearing device according to clause 6, the cost function including a second cost component associated with the second angular range, wherein the first beamformer coefficients are based on the second cost component.
[0207] Clause 8. The hearing device according to clause 7, wherein the cost function includes a third cost component associated with a third angular range, and wherein the first beamformer coefficients are based on the third cost component.
[0208] Clause 9. The hearing device according to any one of clauses 6 - 8 further includes a first MIE microphone for providing a first MIE microphone input signal, wherein the cost function is given by:
[0209]
[0210] where COST is the cost function, P l is the beamforming pattern of the first beamformer, BF l is the beamforming objective function, MIE l is the polar pattern of the first MIE microphone, are the angular bounds of the first angular range, fh1, fh2, fh3, fl1, fl2, and fl3 are the frequency bounds of the respective frequency ranges, and R a is the regularization parameter.
[0211] Clause 10. The hearing device according to any one of clauses 1 - 9 further includes a first MIE microphone, wherein the first beamformer coefficients of the first beamformer correspond to the polar pattern of the first MIE microphone.
[0212] Clause 11. The hearing device according to any one of clauses 1 - 10 further includes a first MIE microphone configured to provide a first MIE microphone input signal, wherein the first beamformer coefficients of the first beamformer are adapted to maintain: the internal time difference between the first MIE microphone input signal of the contralateral hearing device and the first MIE microphone input signal of the contralateral first MIE microphone.
[0213] Clause 12. The hearing device according to any one of clauses 1 - 11 further includes a first MIE microphone configured to provide a first MIE microphone input signal, wherein the first beamformer coefficients of the first beamformer are adapted to hold the internal level difference between the first MIE microphone input signal of the contralateral hearing device and the first MIE microphone input signal of the contralateral first MIE microphone.
[0214] Clause 13. The hearing device according to any one of clauses 1 - 12 further includes a first MIE microphone configured to provide a first MIE microphone input signal, wherein the processing unit is configured to provide an electrical output signal based on one or more high - frequency components of the directional input signal and the first MIE microphone input signal.
[0215] Clause 14. A method of configuring a hearing device, the method comprising:
[0216] Obtain a first BTE microphone input signal;
[0217] Obtain a second BTE microphone input signal;
[0218] Determine first beamformer coefficients for a first beamformer based on a cost function that includes a first cost component associated with a first angular range; and
[0219] Apply the first beamformer coefficients to the first beamformer of the hearing device.
[0220] Clause 15. The method according to Clause 14 further includes obtaining a first MIE microphone input signal, wherein the first beamformer coefficients of the first beamformer are determined based on the first MIE microphone input signal.
[0221] The use of the terms "first", "second", "third", and "fourth", "primary", "secondary", "tertiary", etc. does not imply any particular order, but is included to identify individual elements. Additionally, the use of the terms "first", "second", "third", and "fourth", "primary", "secondary", "tertiary", etc. does not denote any order or importance, but rather the terms "first", "second", "third", and "fourth", "primary", "secondary", "tertiary", etc. are used to distinguish one element from another. Note that the words "first", "second", "third", and "fourth", "primary", "secondary", "tertiary", etc. are used only for labeling purposes here and elsewhere and are not intended to denote any particular spatial or temporal ordering.
[0222] Furthermore, labeling a first element does not imply the existence of a second element, and vice versa.
[0223] It can be understood that the drawings include some modules or operations shown in solid lines and some modules or operations shown in dashed lines. The modules or operations included in the solid lines are the modules or operations included in the broadest example embodiments. The modules or operations included in the dashed lines are included in example embodiments of the modules or operations in the solid line example embodiments, or are a part thereof, or are additional modules or operations that can be taken in addition to the modules or operations of the solid line example embodiments. It should be understood that these operations do not need to be performed in the order presented. Additionally, it should be understood that not all operations need to be performed. Exemplary operations can be performed in any order and in any combination.
[0224] It should be noted that the word "comprising" does not necessarily exclude the existence of other elements or steps beyond those listed.
[0225] It should be noted that the words "a" or "an" (the articles a and an) before an element do not exclude the existence of a plurality of such elements.
[0226] It should be noted that the term "indicates" can be regarded as "associated with", "related to", "describes", "characterizes", and / or "defines". The terms "indicates", "associated with", "related to", "describes", "characterizes", and "defines" can be used interchangeably. The term "indicates" can be regarded as indicating a certain relationship. For example, weight data indicating weights can include one or more weight parameters.
[0227] It should be noted that the word "based on" can be regarded as "according to" and / or "derived from". The terms "based on" and "according to" can be used interchangeably. For example, a parameter determined "based on" a data set can be regarded as a parameter determined "according to" the data set. In other words, the parameter can be the output of one or more functions of the data set as input.
[0228] A function can characterize the relationship between input and output, such as a mathematical relationship, a database relationship, a hardware relationship, a logical relationship, and / or other suitable relationships.
[0229] It should also be noted that any reference signs do not limit the scope of the claims, exemplary embodiments can be implemented at least in part by hardware and software, and multiple "devices", "units", or "apparatuses" can be represented by the same hardware. The various exemplary methods, devices, and systems described herein are described in the general context of method steps processes.
[0230] The method steps process can be implemented by a computer program product in one aspect, the computer program product being embodied in a computer-readable medium and including computer-executable instructions executed by a computer in a networked environment, such as program code. The computer-readable medium can include removable and non-removable storage devices, including but not limited to read-only memory (ROM), random access memory (RAM), compact disc (CD), digital versatile disc (DVD), etc. Generally, program modules can include routines, programs, objects, components, data structures, etc. that perform specified tasks or implement specific abstract data types. The computer-executable instructions, associated data structures, and program modules represent examples of program code for performing the steps of the methods disclosed herein. A particular sequence of such executable instructions or associated data structures represents an example of the corresponding actions for implementing the functions described in such steps or processes.
[0231] Although the features have been shown and described, it should be understood that they are not intended to limit the claimed invention, and it will be apparent to those skilled in the art that various changes and modifications can be made without departing from the spirit and scope of the claimed invention. Therefore, the specification and drawings are considered illustrative rather than restrictive. The claimed invention is intended to cover all alternatives, modifications, and equivalents.
Claims
1. A hearing device for a binaural hearing system, the hearing device comprising: a set of microphones, including a first BTE microphone for providing a first BTE microphone input signal and a second BTE microphone for providing a second BTE microphone input signal; a first beamformer connected to the first BTE microphone and the second BTE microphone for providing a directional input signal based on the first BTE microphone input signal and the second BTE microphone input signal; a processor configured to provide an electrical output signal based on the directional input signal; as well as a receiver for converting the electrical output signal into an audio output signal, Wherein, the first beamformer is a foveal beamformer.
2. The hearing device according to claim 1, wherein The first beamformer is configured to process the first BTE microphone input signal and the second BTE microphone input signal with a first level of accuracy within a first angular range and a second level of accuracy within a second angular range.
3. The hearing device according to claim 2, wherein: The first accuracy level is higher than the second accuracy level.
4. The hearing device according to any one of claims 2-3, wherein: The first angle range includes a left focusing range or a right focusing range.
5. The hearing device according to any one of claims 2 to 4, wherein: The second angle range includes a left peripheral range or a right peripheral range.
6. The hearing device according to any one of claims 1 to 5, wherein: First beamformer coefficients of the first beamformer are based on a cost function including a first cost component associated with a first angular range.
7. The hearing device of claim 6, wherein the cost function comprises a second cost component associated with a second angular range, wherein: The first beamformer coefficients are based on the second cost component.
8. The hearing device according to any one of claims 6-7, the cost function comprising a third cost component associated with a third angular range, wherein: The first beamformer coefficients are based on the third cost component.
9. The hearing device according to any one of claims 6-7, comprising a first MIE microphone for providing a first MIE microphone input signal, wherein: The cost function COST is given by: Among them, P l is the beamforming pattern of the first beamformer, BF l is the beamforming objective function, MIE l is the polar pattern of the first MIE microphone, [-θ,θ] are the angular limits of the first angular range, fh1, fh2, fh3, fl1, fl2 and fl3 are the frequency limits of the corresponding frequency ranges, and R a is the regularization parameter.
10. The hearing device according to claim 9, wherein First beamformer coefficients of the first beamformer are matched to a polar pattern of the first MIE microphone.
11. The hearing device according to any one of claims 1 to 10, wherein: The first beamformer coefficients of the first beamformer are adapted to maintain an internal time difference and / or an internal level difference between the first MIE microphone input signal of the contralateral hearing device and the first MIE microphone input signal of the contralateral hearing device.
12. The hearing device according to any one of claims 1 to 10, wherein: Providing an electrical output signal based on the directional input signal includes providing an electrical output signal based on the directional input signal and one or more high frequency components of the first MIE microphone input signal.
13. A method of designing a beamformer for a hearing instrument, the method comprising: - obtain the first BTE microphone input signal; - Get the second BTE microphone input signal; - determining first beamformer coefficients of a first beamformer based on the cost function; as well as - applying first beamformer coefficients to said first beamformer of said hearing device, Wherein determining first beamformer coefficients of the first beamformer based on the cost function includes: determining the first beamformer coefficients of the first beamformer based on a cost function including a first cost component associated with the first angular range.
14. The method of claim 13, comprising obtaining a first MIE microphone input signal, wherein: Determining first beamformer coefficients of the first beamformer based on the cost function includes determining the first beamformer coefficients based on the first MIE microphone input signal.