Hearing device with bi-directional beamforming with binaural cues
The hearing device enhances speech intelligibility and spatial sound source discrimination by reintroducing binaural cues through a transceiver module, beamformers, and spatializer, addressing the challenge of maintaining binaural cues in noisy environments.
Patent Information
- Application Number
- CN202410685240.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-05-30
- Filing Date
- 2024-05-30
- Publication Date
- 2024-12-03
AI Technical Summary
Existing hearing devices struggle to effectively restore and maintain binaural cues of sound sources in noisy environments, leading to difficulties in speech intelligibility and spatial sound source discrimination.
A hearing device with a transceiver module, microphones, beamformers, and a spatializer that reintroduces binaural cues by combining directional and contralateral input signals using binaural transfer functions, enhancing spatial discrimination and sound source isolation.
Improves speech intelligibility and spatial sound source discrimination by maintaining binaural cues, reducing unwanted sound sources, and controlling axial sound source suppression, thereby enhancing the listening experience and safety in noisy environments.
Smart Images

Figure CN119071707A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to hearing devices for binaural hearing systems and related methods including methods of operating a hearing device. Background Art
[0002] People with hearing loss often have difficulty understanding speech in noisy environments. Listening devices, including hearing devices with hearing loss compensation functions, hearing devices with directional sound capture functions (such as with spatial filtering functions), can be an option to improve speech intelligibility in noisy environments, such as improving the signal-to-noise ratio (SNR). The use of directional microphones including beamforming methods (which involve multiple microphones and arrays of multiple microphones located on both sides of the user in a ipsilateral device, which can be referred to as a first device, and a contralateral device, which can be referred to as a second device) can be an option to obtain directional sound capture. Beamforming microphone arrays in listening devices can improve the SNR and thus improve speech intelligibility. Challenges still exist in restoring and maintaining binaural cues of sound sources. Summary of the invention
[0003] Therefore, there is a need for hearing devices and methods with improved spatial cueing of sound sources.
[0004] The present invention discloses a hearing device for a binaural hearing system. The hearing device includes a transceiver module, for example, for communicating with or configured to communicate with a contralateral hearing device of the binaural system. The transceiver module is configured to receive contralateral data from the contralateral hearing device, and the contralateral data optionally includes a contralateral directional input signal. The hearing device includes a set of microphones, including a first BTE microphone for providing a first BTE microphone input signal, a second BTE microphone optionally for providing a second BTE microphone input signal, and a first MIE microphone optionally for providing a first MIE microphone input signal. The hearing device includes a first beamformer connected to the first BTE microphone and / or the second BTE microphone, for providing a directional input signal based on the first BTE microphone input signal and / or the second BTE microphone input signal. The hearing device includes a second beamformer connected to the first beamformer and the transceiver module, for providing a binaural beamformed signal based on a binaural transfer function, a directional input signal and a contralateral directional input signal. The hearing device comprises a spatializer connected to the second beamformer for providing a spatial binaural beamforming signal based on the binaural beamforming signal and the spatialization transfer function. The hearing device comprises a processor configured to provide an electrical output signal based on the spatial binaural beamforming signal; and a receiver, for example, for converting the electrical output signal into an audio output signal or configured to provide an audio output signal based on the electrical output signal.
[0005] Furthermore, the present invention discloses a binaural hearing system comprising a first hearing device and a second hearing device, wherein the first hearing device is the hearing device disclosed herein and the second hearing device is the hearing device disclosed herein.
[0006] The present invention can improve the spatial discrimination of sound sources associated with different spatial locations and provides improved speech intelligibility in noisy environments.
[0007] The present invention can reduce unwanted sound sources while maintaining binaural cues of the sound sources to maintain the user's spatial impression of the acoustic environment.
[0008] The present invention can control axial sound source suppression in a flexible manner by applying shielding techniques to sound sources (eg, directional input signals and contralateral input signals).
[0009] The present invention can implant binaural cues into the binaural beamforming signal, for example into sound sources in the focus direction of the first beamformer, thereby relieving the task of sound source isolation, for example for sound sources in front of and / or behind the user's head. Thus, improved sound source isolation is provided. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] The above and other features and advantages of the present invention will become apparent to those skilled in the art through the following detailed description of exemplary embodiments of the present invention with reference to the accompanying drawings, in which:
[0011] Figure 1 schematically illustrating an example hearing device according to the present invention,
[0012] Figure 2 Schematically illustrating an example binaural cue recovery module according to the present invention,
[0013] Figure 3 Schematically illustrating an example binaural cue recovery module according to the present invention,
[0014] Figure 4 shows an example representation of a shielding transfer function according to the present invention, and
[0015] FIG. 5A to FIG. 5B Example diagrams illustrating polarity patterns of directional input signals and auricle recovered signals are shown. DETAILED DESCRIPTION
[0016] Various exemplary embodiments and details will be described below with reference to the relevant drawings. It should be noted that the drawings may or may not be drawn to scale, and in all drawings, elements of similar structure or function are represented by similar reference numerals. It should also be noted that the drawings are only for the convenience of describing the embodiments. They are not intended to be an exhaustive description of the present invention or as a limitation on the scope of the present invention. In addition, the illustrated embodiments do not need to have all the aspects or advantages shown. The aspects or advantages described in conjunction with a specific embodiment are not necessarily limited to that embodiment, and may be implemented in any other embodiment, even if not shown or not so clearly described.
[0017] The present invention provides a hearing device also referred to as a first hearing device and / or a second hearing device, such as a hearing device for a binaural hearing system. The hearing device may be configured to be worn at the ears of a user and may be a hearable aid or a hearing aid, wherein the processor is configured to compensate for the hearing loss of the user.
[0018] The hearing device may be of behind-the-ear (BTE) type, in-the-ear (ITE) type, in-the-canal (ITC) type, receiver-in-the-canal (RIC) type, receiver-in-the-ear (RITE) type, or microphone-in-the-ear (MIE) type. The hearing aid may be a binaural hearing aid. The hearing device may include a first earpiece and a second earpiece, wherein the first earpiece and / or the second earpiece are earpieces as disclosed herein.
[0019] The hearing device may be configured for wireless communication with one or more devices, for example, with another hearing device, for example, as part of a binaural hearing system, and / or with one or more accessory devices (e.g., a smartphone and / or a smartwatch). The hearing device optionally comprises an antenna for converting one or more wireless input signals (e.g., a first wireless input signal and / or a second wireless input signal) into one or more antenna output signals. The wireless input signal(s) may originate from an external source(s), for example, a spouse microphone device(s), a wireless TV audio transmitter, and / or a distributed microphone array associated with a wireless transmitter. The wireless input signal(s) may originate from another hearing device, for example, as part of a binaural hearing system, and / or from one or more accessory devices.
[0020] The hearing device optionally comprises a radio transceiver coupled to the antenna for converting the antenna output signal into a transceiver input signal. Wireless signals from different external sources may be multiplexed in the radio transceiver as the transceiver input signal or provided as separate transceiver input signals at separate transceiver output terminals of the radio transceiver. The hearing device may comprise a plurality of antennas and / or the antenna may be configured to operate in one or more antenna modes. The transceiver input signal optionally comprises a first transceiver input signal representing a first wireless signal from a first external source.
[0021] The hearing device includes a set of microphones. The set of microphones may include one or more microphones. The set of microphones includes a first microphone, such as a first BTE microphone, for providing a first microphone input signal, such as a first BTE microphone input signal. The first BTE (behind the ear) microphone is arranged in a housing configured to be arranged behind the ear of the user. The set of microphones includes a second microphone, such as a second BTE microphone, for providing a second microphone input signal, such as a second BTE microphone input signal. The second BTE (behind the ear) microphone is optionally arranged in a housing configured to be arranged behind the ear of the user. The set of microphones optionally includes a third microphone, such as a first MIE microphone, for providing a third microphone input signal, such as a first MIE microphone input signal. The first MIE microphone is arranged near, at or in the ear canal of the user, such as in an earphone connected to the BTE housing by a wire. The set of microphones may include N microphones for providing N microphone signals, where N is an integer ranging from 1 to 10. In one or more example hearing devices, the number N of microphones is two, three, four, five or more.
[0022] The hearing device comprises a processor for processing an input signal, such as a spatial binaural beamforming signal. The processor is optionally configured to compensate for a hearing loss of a user of the hearing device. The processor provides an electrical output signal to the processor based on the input signal, such as based on the spatial binaural beamforming signal.
[0023] In one or more examples, the hearing device includes a transceiver module for communicating with a contralateral hearing device of a binaural system, the transceiver module being configured to receive contralateral data from the contralateral hearing device, the contralateral data including a contralateral directional input signal; a group of microphones including a first BTE microphone for providing a first BTE microphone input signal, a second BTE microphone for providing a second BTE microphone input signal, and a first MIE microphone for providing a first MIE microphone input signal; a first beamformer connected to the first BTE microphone and the second BTE microphone for providing a directional input signal based on the first BTE microphone input signal and the second BTE microphone input signal; a second beamformer connected to the first beamformer and the transceiver module for providing a binaural beamforming signal based on a binaural transfer function, the directional input signal, and the contralateral directional input signal; a spatializer connected to the second beamformer for providing a spatial binaural beamforming signal based on the binaural beamforming signal and the spatialized transfer function; a processor configured to provide an electrical output signal based on the spatial binaural beamforming signal; and a receiver for converting the electrical output signal into an audio output signal.
[0024] Listening to spatially distributed sound sources can provide multiple benefits, including spatial perception, spatial demasking, higher quality sound experience, enhanced communication, and improved safety. The brain has evolved to process binaural cues and integrate different sensory modalities to create an accurate spatial representation of the environment, allowing the listener to effectively identify and localize sound sources.
[0025] Spatial demasking is a phenomenon that occurs when a listener is able to distinguish between sounds coming from different directions, even when the sounds overlap in time and frequency. This ability is critical in noisy environments where listeners need to focus on a specific sound source and ignore other distracting sounds. Listening to spatially distributed sound sources can enhance spatial demasking by providing the brain with the necessary binaural cues to effectively separate sounds from different sources.
[0026] Overall, listening to spatially distributed sound sources offers multiple advantages that can enhance the listening experience and increase safety in a variety of environments. The brain's ability to process binaural cues and integrate different sensory modalities to create an accurate spatial representation of the environment is critical for successful navigation and survival.
[0027] The present invention provides improved auditory source separation by increasing the frequency separation, time separation and / or spatial separation of the sources.
[0028] The advantage is that reintroducing auditory source separation cues while maintaining noise suppression can improve the encoding of auditory sources, reduce listening difficulty, and benefit the quality of the listening experience in noise, supporting users to optimize source separation for less strenuous directional auditory attention.
[0029] The hearing device comprises a first beamformer connected to a first BTE microphone and / or a second BTE microphone, the first beamformer being configured to combine (e.g., beamform) a first BTE microphone input signal and a second BTE microphone input signal for providing a directional input signal. The first beamformer may be a bidirectional beamformer. The first beamformer may be an adaptive beamformer. The first beamformer may result in a loss of binaural cues (e.g., interaural time difference (ITD) and interaural level difference (ILD)) included in the first BTE microphone input signal and the second BTE microphone input signal. Binaural cues may be considered as spatial cues for localizing a sound source, for example, for determining the direction and / or orientation of a sound source.
[0030] In one or more example hearing devices, a first beamformer is connected to the first MIE microphone, the first beamformer being configured to combine (eg, beamform) the first BTE microphone input signal and the first MIE microphone input signal to provide a directional input signal.
[0031] The hearing device may include a binaural cue restoration module connected to the first beamformer, the transceiver module and the processor, the binaural cue restoration module being configured to reintroduce binaural cues in the directional input signal. In other words, the binaural cue restoration module may be configured to generate binaural cues for a sound source in the focus of the first beamformer.
[0032] It should be noted that descriptions and features of the hearing device functionality, e.g. the hearing device is configured to, also apply to the method and vice versa. For example, a description of a hearing device configured to determine also applies to, e.g., a method of operating a hearing device, wherein the method comprises a determining step and vice versa.
[0033] In one or more example hearing devices, the hearing device comprises a transceiver module for communicating with a contralateral hearing device (also referred to as a second hearing device) of a binaural hearing system. In one or more example hearing devices, the transceiver module is configured to receive contralateral data from the contralateral hearing device. In one or more example hearing devices, the contralateral data comprises a contralateral directional input signal, also denoted as F R . In other words, the contralateral data optionally represents a contralateral directional input signal.
[0034] In one or more example hearing devices, the hearing device comprises a set of microphones including a first BTE microphone for providing a first BTE microphone input signal, a second BTE microphone for providing a second BTE microphone input signal, and a first MIE microphone for providing a first MIE microphone input signal.
[0035] In one or more example hearing devices, the hearing device comprises a first beamformer connected to a first BTE microphone and a second BTE microphone for providing a directional input signal based on the first BTE microphone input signal and the second BTE microphone input signal, also denoted as F L . In one or more examples, the first beamformer maintains an undistorted sound signal at a zero degree azimuth, e.g., a directional input signal, while suppressing off-axis sound sources. In one or more examples, the first beamformer is a bidirectional beamformer. In one or more examples, the directional input signal is a bidirectional beamformed signal. In one or more examples, the directional input signal and the contralateral directional input signal are associated with the same sound source, wherein the contralateral directional input signal differs from the directional input signal in the arrival time and intensity (e.g., sound pressure level) of the corresponding original input signal obtained by the contralateral ear and the ipsilateral ear, respectively.
[0036] In one or more example hearing devices, the hearing device includes a second beamformer connected to the first beamformer and the transceiver module for providing a binaural beamformed signal (also denoted as V) based on a binaural transfer function (also denoted as H), a directional input signal, and a contralateral directional input signal. In one or more examples, the second beamformer is configured to combine the binaural transfer function, the directional input signal, and the contralateral directional input signal to provide the binaural beamformed signal. In one or more examples, the binaural beamformed signal is a function of the binaural transfer function.
[0037] In one or more example hearing devices, the hearing device comprises a spatializer connected to the second beamformer for spatializing the second audio signal based on the binaural beamformed signal and a spatialization transfer function (also denoted as H L ) to provide a spatial binaural beamforming signal (also denoted as V L ). In one or more examples, the spatialized transfer function can be considered an interaural transfer function, such as a transfer function that embeds ITD and / or ILD information of the source signal.
[0038] In one or more example hearing devices, the hearing device includes a binaural cue recovery module for providing a binaural beamforming signal based on a contralateral directional input signal and a directional input signal. In one or more example hearing devices, the binaural cue recovery module includes a second beamformer, a spatializer, and a beamforming controller. In one or more examples, the binaural cue recovery module can be configured to perform spatialized bilateral beamforming on the contralateral directional input signal and the directional input signal.
[0039] The hearing device comprises a processor configured to provide an electrical output signal based on the spatial binaural beamforming signal. The hearing device comprises a receiver for converting the electrical output signal into an audio output signal.
[0040] In one or more example hearing devices, a binaural cue restoration module (e.g., a second beamformer) is connected to a first MIE microphone and is configured to determine a binaural transfer function based on a first MIE microphone input signal from the first MIE microphone. In other words, the binaural transfer function may be based on the first MIE microphone input signal from the first MIE microphone.
[0041] In one or more example hearing devices, a beamforming controller is connected to a first MIE microphone and is configured to determine a binaural transfer function based on a first MIE microphone input signal from the first MIE microphone.
[0042] In one or more examples, a beamforming controller (e.g., a beamforming controller of a second beamformer and / or a binaural cue restoration module) is configured to determine a binaural transfer function, for example, based on a first MIE microphone input signal.
[0043] In one or more example hearing devices, the contralateral data includes a contralateral MIE microphone input signal of a contralateral MIE microphone. The second beamformer may be configured to determine a binaural transfer function based on the contralateral MIE microphone input signal.
[0044] In one or more example hearing devices, the binaural beamforming signal V is given by:
[0045] V = F L H + F R (1 - H),
[0046] where F L is a directional input signal, F R is a contralateral directional input signal, and H is a binaural transfer function. In one or more examples, the binaural beamforming signal is a combination of a directional input signal and a contralateral directional input signal. In one or more examples, F L and F R are frequency domain signals. In one or more examples, H is a frequency domain transfer function. In one or more examples, H is an equalization filter. In one or more example hearing devices, H satisfies 0 < H < 1. In one or more examples, the binaural transfer function H is based on the minimization of the power of the binaural beamforming signal v.
[0047] In one or more example hearing devices, an adaptive process is used to estimate the binaural transfer function to minimize the power of the binaural beamforming signal. In one or more examples, the binaural transfer function at iteration i is adaptively determined as follows:
[0048]
[0049] where Hi-1 is the binaural transfer function at iteration i-1, V i-1 is the binaural beamforming signal at iteration i-1, is the conjugate of the binaural beamforming signal at iteration i-1, and μ is a constant. In one or more examples, is the power of the binaural beamforming signal at iteration i-1. In one or more examples, H i The second component of can be considered as an adaptive factor. The constant μ is also denoted as the step size and can be in the range from 0.00001 to 0.005.
[0050] In one or more examples, based on the binaural beamforming signal V i-1 To determine the binaural transfer function H i In one or more examples, the binaural beamformed signal at iteration i-1 is given by:
[0051] V i-1 =H i-1 F L +F R (1-H i-1 ).
[0052] In one or more examples, the binaural beamforming signal V i-1 An updated version of the binaural beamforming signal V i , is given by:
[0053] V i =H i F L +F R (1-H i ).
[0054] In one or more examples, the binaural transfer function H, such as H i , can be represented by a previous version of the binaural transfer function H, such as H i-1 , and the previous version of the binaural beamformed signal V, such as V i-1 , iteratively determined. In one or more examples, the binaural beamforming signal V, such as V i , can be expressed by the binaural transfer function H, for example H i , determined iteratively.
[0055] The binaural beamforming signal may be based on a minimum and / or maximum value of the directional input signal and the contralateral directional input signal.
[0056] In one or more example hearing devices, the binaural beamforming signal is given by:
[0057] V=max(F L,F R )H+min(F L ,F R )(1-H),
[0058] where F L is the directional input signal, F R is the contralateral directional input signal, and H is the binaural transfer function. In one or more examples, for a source at zero degree azimuth, F L =F R And V = F R , which satisfies the distortion-free constraints, such as avoiding binaural cue distortion, thus ensuring that binaural cues are maintained.
[0059] The binaural beamforming signal may be based on a masking transfer function, which is optionally based on a binaural transfer function.
[0060] Thus, in one or more examples, the beamforming controller / second beamformer can be configured to determine a shielding transfer function based on the binaural transfer function. The second beamformer can be configured to provide a binaural beamforming signal based on the shielding transfer function, the directional input signal, and the contralateral directional input signal.
[0061] In one or more examples, the masking transfer function is based on a smoothing function, such as a smoothed exponential function, optionally applied to the binaural transfer function.
[0062] In one or more example hearing devices, the shielding transfer function is given by:
[0063] M = exp(-c(β-H)),
[0064] Where H is the binaural transfer function, c is a constant greater than zero and β ≥ 1. In one or more examples, c is in the range of 1 to 5, such as 1.5, optionally combined with β in the range of 1.5 to 5, such as 2. In an example, c=1.5 and β=2.
[0065] In one or more examples, the masking transfer function is determined or generated based on the binaural transfer function. In other words, the binaural transfer function can be transformed and / or converted into the masking transfer function using a smooth exponential function.
[0066] In one or more example hearing devices, the shielding transfer function is given by:
[0067]
[0068] Where H is the binaural transfer function, c is a constant greater than zero and β ≥ 1. In one or more examples, c is in the range of 1 to 5, such as 2, optionally combined with β in the range of 1 to 5, such as 2. In an example, c=2 and β=1.
[0069] In one or more examples, the binaural beamformed signal is binaurally spatialized into a spatial binaural beamformed signal based on the following equation:
[0070] V L =|V|H L ,
[0071] Where V L is the spatial binaural beamforming signal, V is the binaural beamforming signal, and H L is the spatialized transfer function.
[0072] In one or more examples, the masked transfer function is generated using a sigmoid function. In one or more examples, the binaural transfer function can be transformed and / or converted into a masked transfer function using a sigmoid function.
[0073] In one or more example hearing devices, the binaural beamforming signal is given by:
[0074] V=max(F L ,F R )M+min(F L ,F R )(1-M),
[0075] where F L is the directional input signal, F R is the contralateral directional input signal, and M is a shielding transfer function. In one or more examples, the shielding transfer function is a binaural shielding for beamforming. The present invention provides a binaural beamforming signal by using a shielding transfer function, so that the suppression of off-axis sources can be more flexibly controlled.
[0076] The spatializer is configured to provide a spatial binaural beamformed signal based on the binaural beamformed signal and the spatialization transfer function, for example by applying the spatialization transfer function to the binaural beamformed signal.
[0077] In one or more example hearing devices, the binaural beamformed signal is binaurally spatialized into a spatial binaural beamformed signal V by the following equation: L :
[0078] V L =|V|H L ,
[0079] where |V| is the amplitude of the complex binaural beamforming signal V, and H L is the spatialized transfer function.
[0080] In one or more examples, the spatialized transfer function H Lis based on the power of the directional input signal and the power of the contralateral directional input signal.
[0081] The spatialized transfer function restores and / or preserves the ITD and ILD relationship in the binaural beamformed signals.
[0082] The present invention enables binaural cues to be retained to improve the accuracy of sound source localization. The present invention can transplant binaural cues (such as ILD and ITD information) into directional input signals. Perceptually, users can benefit from binaural cues embedded in directional input signals because binaural cues of all sound sources in the acoustic scene are retained, thereby retaining the user's spatial impression of the acoustic scene.
[0083] In one or more examples, the disclosed technology is implemented in the frequency domain using a short-time Fourier transform. In one or more examples, the directional input signal and the contralateral directional input signal are transformed into a time-frequency (TF) representation, the TF representation comprising TF units, each unit corresponding to time and frequency. In other words, the present invention may include applying the TF shielding technology to the directional input signal and the contralateral directional input signal.
[0084] In one or more examples, the binaural transfer function / masking function can be viewed as a time-frequency (TF) masking technique, such as ideal binary masking (IBM) and / or ideal ratio masking (IRM), which can be estimated based on the directional input signal and the contralateral input signal. In one or more examples, the IBM and IRM techniques can be used to enhance the masking effect on softer sounds to improve speech intelligibility under noisy conditions. For example, the IRM technique specifies a value between 0 and 1 based on the SNR. For example, the IBM technique takes a value of 0 or 1. Expressed in a general way, after applying the IBM and IRM techniques to the sound source, in some speech segments, soft sounds become inaudible and / or less audible.
[0085] For multiple speakers, the sources may be statistically independent, for example, the sound from each speaker in a noisy environment is uncorrelated. Time-frequency (TF) units may be sparsely associated with one dominant speaker. Dominant detection may be made easier due to the head shadow effect of off-axis sources. In other words, the head shadow effect may improve sound localization. Input signals such as directional input signals and contralateral input signals may enable a user to identify the location of a sound in space.
[0086] In binaural hearing, an off-axis source may be weak in one ear but dominant in the other ear. For example, the present invention is able to suppress the stronger off-axis source while keeping the target source (e.g., frontal source) undistorted. For example, the IRM and IBM techniques involve suppressing the dominant TF unit near the weak side of both channels at time T (see Figure 4).
[0087] The binaural transfer function may be based on a minimum power and / or a maximum power of the power of the directional input signal and the power of the contralateral directional input signal.
[0088] The binaural transfer function can be based on P L The directional input signal power and is also denoted as P R The ratio or difference between the minimum power and the maximum power in the opposite directional input signal power.
[0089] In one or more example hearing devices, the binaural transfer function is given by:
[0090]
[0091] Where P L is the power of the directional input signal, and P R is the power of the opposite directional input signal. In one or more examples, H satisfies 0<H≤1.
[0092] In one or more example hearing devices, the binaural transfer function is given by:
[0093]
[0094] Where P L is the power of the directional input signal, and P R is the power of the opposite directional input signal. In one or more examples, H satisfies 0<H≤0.5.
[0095] The spatialized transfer function may be based on a minimum power and / or a maximum power of the power of the directional input signal and the power of the contralateral directional input signal, for example a function thereof.
[0096] The spatialized transfer function may be based on a ratio or a difference between a minimum power and a maximum power of the power of the directional input signal and the power of the contralateral directional input signal.
[0097] The spatialized transfer function may be based on the directional input signal, eg the amplitude of the directional input signal, eg a function of the directional input signal.
[0098] In one or more example hearing devices, the spatialized transfer function H L Given by:
[0099]
[0100] where F L is the directional input signal, P L is the power of the directional input signal, and P Ris the power of the opposite directional input signal. In one or more examples, H L is the spatialized transfer function associated with the directional input signal.
[0101] It may not be feasible to estimate the ITD and ILD information of source signals from a multi-source mixture to recover binaural cues from bilateral beamformed signals. The present invention can determine and / or estimate the spatialized transfer function of ITD and ILD information embedded in source signals (e.g., ITD and ILD information from directional input signals and contralateral directional input signals).
[0102] In one or more examples, the spatialized transfer function needs to be normalized so that it does not amplify suppressed signals, such as off-axis sound sources. In one or more examples, the spatialized transfer function is a normalized interaural transfer function (NITF). In one or more examples, binaural cues can be estimated from the spatialized transfer function.
[0103] In one or more examples, the spatialized transfer function restores or preserves the ITD and ILD relationship in the directional input signal.In one or more examples, the directional input signal is an ear-to-ear (E2E) stream signal from a fixed mono beamformer, such as a hyper-cardioid signal.
[0104] In one or more example hearing devices, the spatialization transfer function may be determined based on a first MIE microphone input signal from a first MIE microphone.
[0105] In one or more example hearing devices, the spatialization transfer function is given by:
[0106]
[0107] where F mie-L is the first MIE microphone input signal, P L is the power of the directional input signal, and P L is the power of the opposite directional input signal. In one or more examples, H L is the spatialization transfer function associated with the first MIE microphone input signal.
[0108] In one or more example hearing devices, a spatialization transfer function may be determined based on the pinna restoration signal. In one or more example hearing devices, the spatialization transfer function is given by:
[0109]
[0110] where F pr-L It is the auricle recovery signal, P L is the power of the directional input signal, and PR is the power of the opposite directional input signal. In one or more examples, H L is the spatialized transfer function associated with the pinna-recovered signal.
[0111] In one or more examples, the first MIE microphone input signal and the pinna restored signal are not transmitted to the opposite side of the ear. In one or more examples, the spatialization transfer function is normalized based on the power of the directional input signal and the power of the contralateral directional input signal. In one or more examples, the polarity pattern associated with the pinna restored signal and the first MIE microphone input signal can be calibrated (e.g., normalized) so that the polarity pattern of the pinna restored signal and the first MIE microphone input signal is similar to the polarity pattern of the directional input signal of the frontal source.
[0112] In one or more examples, considering the rear portion of the polar pattern of the pinna-recovered signal, the magnitude of the spatialized transfer function should be less than 1, e.g., unamplified, as shown below,
[0113] H L =min(1,H L ),
[0114] The rear part of the polarity pattern of the pinna restored signal is made similar to the rear part of the polarity pattern of the directional input signal.
[0115] In one or more example hearing devices, the power of the directional input signal and the power of the contralateral directional input signal are given by:
[0116]
[0117]
[0118] Where 0≤γ<1, ω=2πf is the angular frequency, and n is an integer indicating a frame index. The frequency f may be in the range of 0 to 20 kHz.
[0119] In one or more example hearing devices, the hearing device, such as a binaural cue recovery module, includes a beamforming controller for providing a binaural transfer function and a spatialized transfer function. In one or more examples, the beamforming controller is configured to determine the binaural transfer function based on the power of the directional input signal and the power of the contralateral directional input signal. In one or more examples, the beamforming controller is configured to determine the spatialized transfer function based on the power of the directional input signal, the power of the contralateral directional input signal, and the directional input signal. In one or more examples, the beamforming controller is configured to determine the spatialized transfer function based on the power of the directional input signal, the power of the contralateral directional input signal, and the first MIE microphone input signal. In one or more examples, the beamforming controller is configured to determine the spatialized transfer function based on the power of the directional input signal, the power of the contralateral directional input signal, and the auricle recovery signal. The beamforming controller outputs the binaural transfer function or a control signal representing the binaural transfer function to the second beamformer, so that the second beamformer can apply the binaural transfer function to the directional input signal and the contralateral directional input signal. The beamforming controller outputs the spatialization transfer function or a control signal representing the spatialization transfer function to the spatializer, so that the spatializer can apply the spatialization transfer function to the binaural beamforming signal to provide a spatial binaural beamforming signal.
[0120] Figure 1An example hearing device 2 according to the present invention is shown, such as a first hearing device 2A and / or a second hearing device 2B. In one or more examples, the first hearing device 2A is an ipsilateral hearing device. In one or more examples, the second hearing device 2B is an opposite hearing device. The hearing device 2 includes a transceiver module 22 for communicating with an opposite hearing device (e.g., the hearing device 2B). The transceiver module 22 is configured to receive opposite data 28 from the opposite hearing device, the opposite data 28 including an opposite directional input signal 28A. The hearing device 2 includes a set of microphones, including a first BTE microphone 10 for providing a first BTE microphone input signal 10A, a second BTE microphone 12 for providing a second BTE microphone input signal 12A, and a first MIE microphone 14 for providing a first MIE microphone input signal 14A. The hearing device 2 includes a first beamformer 32 connected to the first BTE microphone 10 and the second BTE microphone 12 for providing a directional input signal 32A based on the first BTE microphone input signal 10A and the second BTE microphone input signal 12A. The hearing device 2 comprises a binaural cue recovery module 34 connected to the first beamformer 32, the transceiver module 22 and the processor 16 for providing a spatial binaural beamformed signal 34A. The hearing device 2 comprises a processor 16 for processing the spatial binaural beamformed signal 34A to provide an electrical output signal 16A. The hearing device 2 comprises a receiver 18 for converting the electrical output signal 16A into an audio output signal.
[0121] The hearing device 2 comprises a wireless communication unit 20, which comprises a transceiver module 22 coupled to an antenna 24. The wireless communication unit 20 is configured for wireless communication, e.g. with a contralateral hearing device of a binaural hearing system, as indicated by an arrow 26. The transceiver module 22 and / or the wireless communication 20 are configured to receive contralateral data 28 from the contralateral hearing device, the contralateral data 28 comprising a contralateral directional input signal 28A.
[0122] The binaural cue recovery module 34, 35 includes a second beamformer 36, a spatializer 38 and a beamforming controller 40, and is configured to provide a spatial binaural beamforming signal 34A to the processor 16. The spatial binaural beamforming signal 34A may be considered as a directional input signal 32A, which includes information indicative of binaural spatial cues, such as the spatial cues ILD and ITD.
[0123] Figure 2An example binaural cue recovery module 34 according to the present invention is shown. The binaural cue recovery module 34 includes a second beamformer 36 for providing a binaural beamformed signal 36A based on a binaural transfer function 40A, a directional input signal 32A, and contralateral data 28 including a contralateral directional input signal 28A. The binaural cue recovery module 34 includes a spatializer 38 connected to the second beamformer 36 for providing a spatial binaural beamformed signal 38A based on the binaural beamformed signal 36A and the spatialized transfer function 40B. In one or more examples, the binaural cue recovery module 34 includes a beamforming controller 40 for providing the binaural transfer function 40A (e.g., H described herein) to the second beamformer 36 and providing the spatialized transfer function 40B (e.g., H described herein) to the spatializer. L In one or more examples, the second beamformer 36 is configured to transform the binaural transfer function 40A into a masking transfer function, such as the masking transfer function M described herein, and apply the masking transfer function to the input signals 28A, 32A.
[0124] Figure 3 An example binaural cue recovery module 35 according to the present invention is shown. The binaural cue recovery module 35 includes a second beamformer 36 for providing a binaural beamformed signal 36A based on a masked transfer function 40C, a directional input signal 32A, and contralateral data 28 including a contralateral directional input signal 28A. The binaural cue recovery module 35 includes a spatializer 38 connected to the second beamformer 36 for providing a spatial binaural beamformed signal 38A based on the binaural beamformed signal 36A and the spatialized transfer function 40B. In one or more examples, the binaural cue recovery module 35 includes a beamforming controller 40 for providing a masked transfer function 40C (e.g., a masked transfer function M as described herein) to the second beamformer 36 based on a binaural transfer function (e.g., H as described herein), and for providing a spatialized transfer function 40B (e.g., H as described herein) to the spatializer 38. L ).
[0125] Figure 4 An example representation of a shielding transfer function 50 according to the present invention is shown. Figure 3 A representation of a masking transfer function 50 in a TF unit is shown. The mask 50 may be generated by comparing the power of the TF unit from two channels, e.g., a first channel 56 and a second channel 58. In other words, the mask 50 may be considered as a masking transfer function, also denoted as M, which is generated, for example, based on a binaural transfer function, also denoted as H. For example, the first channel 56 is a first hearing channel, e.g., a contralateral hearing channel. For example, the second channel 58 is a second hearing channel, e.g., an ipsilateral hearing channel.
[0126] The TF unit associated with the pattern area, such as TF unit 52, is associated with a first sound source, such as a source obtained by the left ear through the contralateral hearing device, such as also denoted as F R The TF unit associated with the white area (e.g. TF unit 54) is associated with a second sound source, such as a source obtained by the right ear through the ipsilateral hearing device, for example, also denoted as F L For example, the first channel 56 is dominated by the second sound source, while the second channel 58 is dominated by the first sound source.
[0127] FIG. 5A to FIG. 5B An example graph illustrating polarity patterns of a directional input signal (eg, a hypercardioid signal) and a pinna recovered signal is shown. Figure 5A The polarity pattern associated with a directional input signal is shown. Figure 5B The polarity pattern associated with the pinna recovery signal is shown.
[0128] FIG. 5A to FIG. 5B The polarity patterns of the directional input signal and the pinna restored signal are shown to be similar within an azimuth range of (-30, 30) degrees. However, the polarity patterns of the directional input signal and the pinna restored signal may differ around an angle around the zero point of the polarity pattern of the directional signal input.
[0129] In one or more examples, the polarity pattern associated with the pinna restored signal can be calibrated so that the polarity pattern of the pinna restored signal is similar to the polarity pattern of the directional input signal of the frontal source. Given the rear portion of the polarity pattern of the pinna restored signal, the magnitude of the spatialization transfer function should be less than 1, e.g., unamplified, so that the rear portion of the polarity pattern of the pinna restored signal is similar to the rear portion of the polarity pattern of the directional input signal.
[0130] Furthermore, examples of hearing devices are disclosed according to the following items.
[0131] Item 1. A hearing device for a binaural hearing system, the hearing device comprising:
[0132] a transceiver module for communicating with a contralateral hearing device of a binaural system, the transceiver module being configured to receive contralateral data from the contralateral hearing device, the contralateral data comprising a contralateral directional input signal;
[0133] a set of microphones, including a first BTE microphone for providing a first BTE microphone input signal, a second BTE microphone for providing a second BTE microphone input signal, and a first MIE microphone for providing a first MIE microphone input signal;
[0134] A first beamformer connected to a first BTE microphone and a second BTE microphone, for providing a directional input signal based on a first BTE microphone input signal and a second BTE microphone input signal;
[0135] A second beamformer connected to the first beamformer and a transceiver module, for providing a binaural beamforming signal based on a binaural transfer function, a directional input signal, and a contralateral directional input signal;
[0136] A spatializer connected to the second beamformer, for providing a spatial binaural beamforming signal based on the binaural beamforming signal and a spatialization transfer function;
[0137] A processor, configured to provide an electrical output signal based on the spatial binaural beamforming signal; and a receiver, for converting the electrical output signal into an audio output signal.
[0138] Item 2. The hearing device according to item 1, wherein the second beamformer is connected to a first MIE microphone and is configured to determine the binaural transfer function based on a first MIE microphone input signal from the first MIE microphone.
[0139] Item 3. The hearing device according to any one of items 1 to 2, wherein the contralateral data includes a contralateral MIE microphone input signal of a contralateral MIE microphone, and the second beamformer is configured to determine the binaural transfer function based on the contralateral MIE microphone input signal.
[0140] Item 4. The hearing device according to any one of items 1 to 3, wherein the binaural beamforming signal V is given by:
[0141] V = F L H + F R (1 - H),
[0142] where F L is the directional input signal, F R is the contralateral directional input signal, and H is the binaural transfer function, where 0 < H < 1 and an adaptive process is used to estimate it to minimize the power of the binaural beamforming signal.
[0143] Item 5. The hearing device according to any one of items 1 to 3, wherein the binaural beamforming signal V is given by:
[0144] V = max(F L , F R )H + min(F L , F R )(1 - H),
[0145] where F Lis the directional input signal, F R is the contralateral directional input signal, and H is the binaural transfer function.
[0146] Item 6. A hearing device according to any one of items 1 to 3, wherein the binaural beamforming signal V is given by:
[0147] V=max(F L ,F R )M+min(F L ,F R )(1-M),
[0148] where F L is the directional input signal, F R is the opposite directional input signal, and M is the shielding transfer function.
[0149] Item 7. A hearing device according to any one of Items 4 to 6, wherein the binaural beamforming signal is binaurally spatialized into a spatial binaural beamforming signal V by the following formula L :
[0150] V L =|V|H L ,
[0151] where V is the binaural beamforming signal, and H L is the spatialized transfer function.
[0152] Item 8. A hearing device according to Item 6, wherein the shielding transfer function is given by:
[0153] M = exp(-c(β-H)),
[0154] where H is the binaural transfer function, c is a constant greater than zero and β ≥ 1.
[0155] Item 9. The hearing device of Item 6, wherein the shielding transfer function is given by:
[0156]
[0157] where H is the binaural transfer function, c is a constant greater than zero and β ≥ 1.
[0158] Item 10. The hearing device according to any one of items 4 to 9, wherein the binaural transfer function H is given by:
[0159]
[0160] Where P L is the power of the directional input signal, P R is the power of the opposite directional input signal.
[0161] Item 11. A hearing device according to any one of items 4 to 9, wherein the binaural transfer function H is given by:
[0162]
[0163] Where P L is the power of the directional input signal, and P R is the power of the opposite directional input signal.
[0164] Item 12. The hearing device according to any one of Items 4 to 9, wherein the spatialized transfer function H L Given by:
[0165]
[0166] where F L is the directional input signal, P L is the power of the directional input signal, and P R is the power of the opposite directional input signal.
[0167] Item 13. A hearing device according to any one of Items 4 to 9, wherein the spatialized transfer function H L Given by:
[0168]
[0169] where F mie-L is the first MIE microphone input signal, P L is the power of the directional input signal, and P R is the power of the opposite directional input signal.
[0170] Item 14. A hearing device according to any one of Items 4 to 9, wherein the spatialized transfer function H L Given by:
[0171]
[0172] where F pr-L It is the auricle recovery signal, P L is the power of the directional input signal, and P R is the power of the opposite directional input signal.
[0173] Item 15. A hearing device according to any one of items 10 to 14, wherein the power of the directional input signal and the power of the contralateral directional input signal are given by the following formula:
[0174]
[0175]
[0176] Where 0≤γ<1, ω is the angular frequency, and n is an integer.
[0177] Item 16. A hearing device according to any one of items 1 to 15, wherein the hearing device comprises a beamforming controller for providing a binaural transfer function and a spatialized transfer function.
[0178] Item A1. A hearing device for a binaural hearing system, the hearing device comprising:
[0179] a transceiver module configured to communicate with a contralateral hearing device of the binaural system, the transceiver module configured to receive contralateral data from the contralateral hearing device, the contralateral data comprising a contralateral directional input signal;
[0180] a set of microphones, including a first BTE microphone for providing a first BTE microphone input signal, a second BTE microphone for providing a second BTE microphone input signal, and a first MIE microphone for providing a first MIE microphone input signal;
[0181] a first beamformer connected to the first BTE microphone and the second BTE microphone for providing a directional input signal based on the first BTE microphone input signal and the second BTE microphone input signal;
[0182] a second beamformer connected to the first beamformer and the transceiver module for providing a binaural beamformed signal based on the binaural transfer function, the directional input signal, and the contralateral directional input signal;
[0183] a spatializer connected to the second beamformer for providing a spatial binaural beamformed signal based on the binaural beamformed signal and the spatialization transfer function;
[0184] A processor is configured to provide an electrical output signal based on the spatial binaural beamforming signal; and a receiver is configured to provide an audio output signal based on the electrical output signal.
[0185] Item A2. A hearing device according to Item A1, wherein the second beamformer is connected to the first MIE microphone.
[0186] Item A3. The hearing device of Item A2, wherein the second beamformer is configured to determine a binaural transfer function based on a first MIE microphone input signal from the first MIE microphone.
[0187] Item A4. The hearing device of any one of items A1 to A4, wherein the binaural transfer function is based on a first MIE microphone input signal from a first MIE microphone.
[0188] Item A5. The hearing device of any one of Items A1 to A4, wherein the contralateral data comprises a contralateral MIE microphone input signal of a contralateral MIE microphone.
[0189] Item A6. The hearing device of Item A5, wherein the binaural transfer function is based on a contralateral MIE microphone input signal.
[0190] Item A7. A hearing device according to any one of Items A1 to A6, wherein the binaural beamforming signal is given by:
[0191] V=F L H+F R (1-H),
[0192] Where V is the binaural beamforming signal, F L is the directional input signal, F R is the contralateral directional input signal, and H is the binaural transfer function, where H satisfies 0<H<1.
[0193] Item A8. A hearing device according to Item A7, wherein H is based on minimization of the power of the binaural beamforming signal.
[0194] Item A9. A hearing device according to any one of Items A1 to A8, wherein the binaural beamforming signal is given by:
[0195] V=max(F L ,F R )H+min(F L ,F R )(1-H),
[0196] Where V is the binaural beamforming signal, F L is the directional input signal, F R is the contralateral directional input signal, and H is the binaural transfer function.
[0197] Item A10. A hearing device according to any one of Items A1 to A9, wherein the binaural beamforming signal is given by:
[0198] V=max(F L ,F R )M+min(F L ,F R )(1-M),
[0199] Where V is the binaural beamforming signal, F L is the directional input signal, F R is the contralateral directional input signal, and M is the shielding transfer function.
[0200] Item A11. The hearing device of Item A10, wherein the shielding transfer function is given by:
[0201] M = exp(-c(β-H)),
[0202] where H is the binaural transfer function, c is a constant greater than zero and β ≥ 1.
[0203] Item A12. The hearing device of Item A10, wherein the shielding transfer function is given by:
[0204]
[0205] where H is the binaural transfer function, c is a constant greater than zero and β ≥ 1.
[0206] Item A13. The hearing device according to any one of Items A1 to A12, wherein the binaural beamforming signal is binaurally spatialized into a spatial binaural beamforming signal based on the following formula:
[0207] V L =|V|H L ,
[0208] Where V L is the spatial binaural beamforming signal, V is the binaural beamforming signal, and H L is the spatialized transfer function.
[0209] Item A14. A hearing device according to any one of Items A1 to A13, wherein the binaural transfer function is given by:
[0210]
[0211] Where H is the binaural transfer function, P L is the power of the directional input signal, and P R is the power of the opposite directional input signal.
[0212] Item A15. A hearing device according to any one of Items A1 to A14, wherein the binaural transfer function is given by:
[0213]
[0214] Where H is the binaural transfer function, P L is the power of the directional input signal, and P R is the power of the opposite directional input signal.
[0215] Item A16. A hearing device according to any one of items A1 to A15, wherein the spatialization transfer function is based on the power of the directional input signal and the power of the contralateral directional input signal.
[0216] Item A17. The hearing device of any one of Items A1 to A16, wherein the spatialized transfer function is given by:
[0217]
[0218] Among them, H L is the spatialized transfer function, F L is the directional input signal, P L is the power of the directional input signal, and P R is the power of the opposite directional input signal.
[0219] Item A18. The hearing device of any one of Items A1 to A16, wherein the spatialized transfer function is given by:
[0220]
[0221] Among them, H L is the spatialized transfer function, F mie-L is the first MIE microphone input signal, P L is the power of the directional input signal, and P R is the power of the opposite directional input signal.
[0222] Item A19. A hearing device according to any one of Items A1 to A16, wherein the spatialized transfer function is given by:
[0223]
[0224] Among them, H L is the spatialized transfer function, F pr-L It is the auricle recovery signal, P L is the power of the directional input signal, and P R is the power of the opposite directional input signal.
[0225] Item A20. A hearing device according to any one of Items A1 to A19, wherein the power of the directional input signal and the power of the contralateral directional input signal are given by:
[0226]
[0227]
[0228] Where P L is the power of the directional input signal, and P R is the power of the opposite directional input signal, 0≤γ<1, ω is the angular frequency, and n is an integer.
[0229] Item A21. A hearing device according to any one of Items A1 to A20, wherein the hearing device comprises a beamforming controller for providing a binaural transfer function and a spatialized transfer function.
[0230] The use of the terms "first," "second," "third," and "fourth," "primary," "secondary," "tertiary," and the like does not imply any particular order, but are included to identify individual elements. Furthermore, the use of the terms "first," "second," "third," and "fourth," "primary," "secondary," "tertiary," and the like does not imply any order or importance, and the terms "first," "second," "third," and "fourth," "primary," "secondary," "tertiary," and the like are used to distinguish one element from another. Note that the words "first," "second," "third," and "fourth," "primary," "secondary," "tertiary," and the like are used herein and elsewhere for labeling purposes only and are not intended to imply any particular spatial or temporal order.
[0231] Furthermore, the reference of a first element does not imply the presence of a second element, and vice versa.
[0232] It will be appreciated that the accompanying drawings include some modules or operations shown with solid lines and some modules or operations shown with dotted lines. The modules or operations included in the solid lines are the modules or operations included in the broadest example implementation. The modules or operations included in the dotted lines are example implementations, which may be included in or part of the modules or operations of the solid line example implementations, or other modules or operations that may be adopted in addition to the modules or operations of the solid line example implementations. It will be appreciated that these operations do not need to be performed in the order given. In addition, it will be appreciated that not all operations need to be performed. The exemplary operations may be performed in any order and in any combination.
[0233] It should be noted that the word "comprising" does not exclude the presence of other elements or steps than those listed.
[0234] It should be noted that the word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements.
[0235] It should also be noted that any reference signs do not limit the scope of the claims, that exemplary embodiments may be implemented at least partially by means of hardware and software, and that multiple "components," "units," or "means" may be represented by the same hardware.
[0236] The various exemplary methods, devices, and systems described herein are described in the general context of method step processes, which in one aspect may be implemented by a computer program product contained in a computer-readable medium, including computer executable instructions, such as program code, executed by a computer in a network environment. Computer-readable media may include removable and non-removable storage devices, including but not limited to read-only memory (ROM), random access memory (RAM), compact disk (CD), digital versatile disk (DVD), etc. In general, program modules may include routines, programs, objects, components, data structures, etc., which perform specific tasks or implement specific abstract data types. Computer executable instructions, associated data structures, and program modules represent examples of program codes for performing the steps of the methods disclosed herein. A specific sequence of such executable instructions or associated data structures represents an example of corresponding actions for implementing the functions described in such steps or processes.
[0237] Although features have been shown and described, it should be understood that they are not intended to limit the claimed invention, and it will be apparent to those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the claimed invention. Therefore, the specification and drawings should be regarded as illustrative rather than restrictive. The claimed invention is intended to cover all alternatives, modifications and equivalents.
[0238] Reference numerals list
[0239] 2 Hearing devices
[0240] 2A First Hearing Device
[0241] 2B Second hearing device
[0242] 10. The First BTE Microphone
[0243] 10A 1st BTE microphone input signal
[0244] 12 Second BTE microphone
[0245] 12A Second BTE microphone input signal
[0246] 14. The First MIE Microphone
[0247] 14A First MIE microphone input signal
[0248] 13 Memory
[0249] 16 processors / processing units
[0250] 16A electrical output signal
[0251] 18 Receiver
[0252] 20 Wireless Communication Unit
[0253] 22 Radio transceiver
[0254] 24 Antenna
[0255] 26 Wireless Communication
[0256] 27 One or more opposite input signals
[0257] 28 Transceiver input signal
[0258] 28A Opposite microphone input signal
[0259] 32 First beamformer
[0260] 32A Directional input signal
[0261] 34, 35 Binaural prompt recovery module
[0262] 34A Spatial binaural beamforming signal
[0263] 36 Second beamformer
[0264] 36A Binaural Beamforming Signal
[0265] 38 Spatializer
[0266] 38A Spatial Binaural Beamforming Signal
[0267] 40 Beamforming Controller
[0268] 40A Binaural Transfer Function
[0269] 40B Spatialized Transfer Function
[0270] 40C Shielding Transfer Function
Claims
1. A hearing device for a binaural hearing system, the hearing device comprising: a transceiver module for communicating with a contralateral hearing device of the binaural system, the transceiver module being configured to receive contralateral data from the contralateral hearing device, the contralateral data comprising a contralateral directional input signal; a set of microphones, including a first BTE microphone for providing a first BTE microphone input signal, a second BTE microphone for providing a second BTE microphone input signal, and a first MIE microphone for providing a first MIE microphone input signal; a first beamformer connected to the first BTE microphone and the second BTE microphone for providing a directional input signal based on the first BTE microphone input signal and the second BTE microphone input signal; a second beamformer connected to the first beamformer and the transceiver module for providing a binaural beamformed signal based on a binaural transfer function, the directional input signal, and the contralateral directional input signal; a spatializer connected to the second beamformer for providing a spatial binaural beamformed signal based on the binaural beamformed signal and a spatialization transfer function; a processor configured to provide an electrical output signal based on the spatial binaural beamformed signal; as well as A receiver is used to convert the electrical output signal into an audio output signal.
2. The hearing device according to claim 1, wherein The second beamformer is connected to the first MIE microphone and is configured to determine the binaural transfer function based on the first MIE microphone input signal from the first MIE microphone.
3. The hearing device according to any one of claims 1 to 2, wherein: The contralateral data comprises a contralateral MIE microphone input signal of a contralateral MIE microphone, and the second beamformer is configured to determine the binaural transfer function based on the contralateral MIE microphone input signal.
4. The hearing device according to any one of claims 1 to 3, wherein: The binaural beamforming signal V is given by: V=F L H+F R (1-H), where F L is the directional input signal, F R is the contralateral directional input signal, and H is the binaural transfer function, where H satisfies 0 < H < 1 and is estimated using an adaptive process to minimize the power of the binaural beamformed signal.
5. The hearing device according to any one of claims 1 to 3, wherein: The binaural beamforming signal V is given by: V=max(F L ,F R )H+min(F L ,F R )(1-H), Among them, F L is the directional input signal, F R is the contralateral directional input signal, and H is the binaural transfer function.
6. The hearing device according to any one of claims 1 to 3, wherein: The binaural beamforming signal V is given by: V=max(F L ,F R )M+min(F L ,F R )(1-M), Among them, F L is the directional input signal, F R is the contralateral directional input signal, and M is the shielding transfer function.
7. The hearing device according to any one of claims 4 to 6, wherein: The binaural beamforming signal is binaurally spatialized into the spatial binaural beamforming signal V by the following formula: L : V L =|V|H L , where V is the binaural beamforming signal, and H L is the spatialized transfer function.
8. The hearing device according to claim 6, wherein: The shielding transfer function is given by: M = exp(-c(β-H)), Wherein, H is the binaural transfer function, c is a constant greater than zero and β≥1.
9. The hearing device according to claim 6, wherein: The shielding transfer function is given by: Wherein, H is the binaural transfer function, c is a constant greater than zero and β≥1.
10. The hearing device according to any one of claims 4 to 9, wherein: The binaural transfer function H is given by: Among them, P L is the power of the directional input signal, P R is the power of the contralateral directional input signal.
11. The hearing device according to any one of claims 4 to 9, wherein: The binaural transfer function H is given by: Among them, P L is the power of the directional input signal, and P R is the power of the contralateral directional input signal.
12. The hearing device according to any one of claims 4 to 9, wherein: The spatialized transfer function H L Given by: Among them, F L is the directional input signal, P L is the power of the directional input signal, and P R is the power of the contralateral directional input signal.
13. The hearing device according to any one of claims 4 to 9, wherein: The spatialized transfer function H L Given by: Among them, F mie-L is the first MIE microphone input signal, P L is the power of the directional input signal, and P R is the power of the contralateral directional input signal.
14. The hearing device according to any one of claims 4 to 9, wherein: The spatialized transfer function H L Given by: Among them, F pr-L It is the auricle recovery signal, P L is the power of the directional input signal, and P R is the power of the contralateral directional input signal.
15. The hearing device according to any one of claims 10 to 14, wherein: The power of the directional input signal and the power of the opposite directional input signal are given by the following formula: Where 0≤γ<1, ω is the angular frequency, and n is an integer.
16. The hearing device according to any one of claims 1 to 15, wherein: The hearing device comprises a beamforming controller for providing the binaural transfer function and the spatialized transfer function.
Citation Information
Cited By
Hearing device having bilateral beamforming with binaural cues
US12452615B2
Hearing device having bilateral beamforming with binaural cues
US20240406642A1
