Hearing aid system providing beamformed signal output and comprising an asymmetric valve state
By employing asymmetric valve states and beamforming signal design in a binaural hearing aid system, the problem of balancing speech intelligibility and off-axis sound source perception in noisy environments has been solved, resulting in a better experience for hearing-impaired individuals.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- GN HEARING AS
- Filing Date
- 2021-05-06
- Publication Date
- 2026-06-16
AI Technical Summary
In noisy listening environments, existing binaural hearing aid systems, while improving speech clarity, often sacrifice the perception of off-axis sound sources, causing hearing-impaired individuals to experience the discomfort of 'tunnel hearing'.
By employing an asymmetric valve design in a binaural hearing aid system, one hearing aid generates a beamforming signal while the other generates an omnidirectional signal. These signals are exchanged via a wireless communication link, and the valve control device adjusts the opening and closing state of the valve to achieve asymmetric signal transmission and environmental noise management.
It improves speech clarity, reduces ambient noise, enhances the perception of off-axis sound sources, improves the user experience for people with hearing loss, and avoids the feeling of 'tunnel hearing'.
Smart Images

Figure CN113613154B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to a binaural hearing aid system that provides beamformed signals to at least one receiver in the binaural hearing aid system. Each hearing aid in the binaural hearing aid system includes a sound channel in which a valve is opened or closed. The valves in the two hearing aids are in an asymmetrical state, wherein one of the two valves is opened more than the other.
[0002] Furthermore, the present invention relates to a method for providing a beamforming signal to one receiver of a binaural hearing aid system, providing an omnidirectional signal to the other receiver of the binaural hearing aid system, and closing a valve in one sound channel while opening a valve in the other sound channel. Background Technology
[0003] In noisy listening conditions such as restaurants, bars, and concert venues (i.e., so-called cocktail party scenarios), individuals with normal hearing can selectively focus on, for example, the target speaker to achieve speech intelligibility and maintain situational awareness. They can utilize better listening strategies, where they concentrate their attention on the speech signal in their ears to achieve the optimal signal-to-noise ratio for the target speaker or speaker (i.e., the desired sound source). This better listening strategy can also monitor off-axis, unattended speakers through cognitive filtering mechanisms such as selective attention.
[0004] Conversely, in such noisy sound environments, it remains an extremely challenging task for hearing-impaired individuals to listen to specific desired sound sources while simultaneously maintaining environmental awareness by monitoring off-axis or unattended speakers. Therefore, it is desirable to provide hearing-impaired individuals with similar hearing capabilities, for example, by utilizing the well-known spatial filtering capabilities of existing binaural hearing aid systems. However, the use of binaural hearing aid systems and associated beamforming techniques typically focuses on improving or enhancing the signal-to-noise ratio (SNR) of bilateral or binaural beamforming microphone signals or incoming sound from a specific target direction (typically frontal), at the cost of reduced audibility of unattended (typically off-axis) speakers in the sound environment. The improvement in the SNR of binaural beamforming microphone signals is due to the high directivity index of binaural beamforming microphone signals, meaning that sound sources placed outside a relatively narrow angular range around the selected target direction are severely attenuated or suppressed. The narrow angular range in which a sound source remains essentially unattenuated may only extend within an azimuth angle of + / - 20–40 degrees around the target direction. This property of binaural beamforming microphone signals causes individuals or patients / users with hearing loss who have lost situational awareness to experience an unpleasant sensation known as "tunnel hearing."
[0005] There is a need in the field for a binaural hearing aid system that provides improved speech intelligibility to hearing-impaired individuals in the acoustic environment of a cocktail party or similar adverse hearing conditions, without sacrificing off-axis perception to provide enhanced situational awareness. Summary of the Invention
[0006] This invention relates to a binaural hearing aid system that provides beamformed signals to at least one receiver within the binaural hearing aid system. The sound channel in each hearing aid is configured to allow ambient sounds originating outside the hearing aid to reach the user's ear canal. Within the sound channel of each hearing aid, valves open or close, allowing ambient sounds to propagate or be blocked from propagating in the sound channel, respectively. The valves are in an asymmetrical state, wherein one valve in the hearing aid is more open than the other. The binaural hearing aid system utilizes ear-to-ear wireless exchange or streaming of multiple monoaural directional signals over a wireless communication link. The left or right hearing aid is configured to generate bilateral or monoaural beamformed signals with a high directivity index, which may exhibit maximum sensitivity in the target direction (e.g., in the user's line of sight) and reduce the sensitivity of the same side of the left and right hearing aids. Contralateral hearing aids can generate a bilateral omnidirectional signal at the contralateral ear by mixing a pair of mono-ear directional signals. The bilateral omnidirectional signal exhibits an omnidirectional response or polarity pattern with a low directional index, so the sensitivity to all sound incident directions or azimuth angles around the user's head is basically equal.
[0007] By installing a valve in the sound channel of each hearing aid and configuring the valve to an asymmetrical state (i.e., the two valves are not equally open or closed), the effects of providing beamforming signals and optional omnidirectional signals, as described above, can be further enhanced. An open valve in the sound channel of the hearing aid allows ambient sounds to travel through the sound channel to the user's ear, while a closed valve prevents ambient sounds from reaching the hearing aid user's ear.
[0008] The closed valve provides good low-frequency gain and reduces ambient noise propagating to the eardrum, which improves beamforming and noise reduction efficiency, thus improving speech intelligibility. The downside of the closed valve is occlusion (which can cause the user to have an odd feeling about their own voice), reduced ability to control their voice level while chewing, walking, or running, and the production of unpleasant noise.
[0009] An open valve reduces occlusion, making it more comfortable for the user. The disadvantages of an open valve include reduced sound quality, as it doesn't provide good low-frequency gain, and speech intelligibility is further reduced.
[0010] By providing valves in the sound channels of each hearing aid, users can experience the benefits of opening or closing valves within the same hearing aid, and can change the state of one or both valves to best suit the current situation, thus allowing them to choose the lesser of two disadvantages in any given condition. Therefore, an asymmetrical state where one valve is more open than the other will improve the effectiveness of the binaural hearing aid system and enhance the user experience.
[0011] Binaural hearing aid systems generate beamforming signals for one ear and omnidirectional signals for the other. They utilize the human cognitive ability to separate and integrate sound sources, enabling individuals with hearing loss to focus on the clean target signal provided by bilateral or monoaural beamforming signals and simultaneously monitor off-axis sound sources / speakers by using omnidirectional signals.
[0012] A first aspect of the present invention relates to a binaural hearing aid system comprising: a first hearing aid for placement in or in the left or right ear of a user, the first hearing aid comprising a first microphone device, a first wireless communication unit, a first receiver, and a first sound channel including a first valve, the first valve being movable from an open state to a closed state and from a closed state to an open state.
[0013] A second hearing aid is used to be placed in or in the other ear of a user. The second hearing aid includes a second microphone device, a second wireless communication unit, and a second sound channel including a second valve, the second valve being movable from an open state to a closed state and from a closed state to an open state.
[0014] A signal processing device adapted to generate a beamforming signal based on microphone signals provided by a first microphone device and / or a second microphone device, and adapted to apply the beamforming signal to a first receiver and / or a second receiver, wherein the signal processing device is further adapted to generate an omnidirectional signal based on the microphone signals provided by the first microphone device and / or the second microphone device, and wherein the signal processing device is further adapted to apply the beamforming signal to one of the first receiver and the second receiver and to apply the omnidirectional signal to the other of the first receiver and the second receiver; and a valve control device having an asymmetric mode, wherein, in the asymmetric mode, the valve control device is configured to asymmetrically control a first valve and a second valve by moving a first valve and a second valve to a position in which one of the first valve and the second valve is opened to a greater extent than the other of the first valve and the second valve, and wherein the valve control device is further configured, when in the asymmetric mode, such that a valve included in a hearing aid including a receiver to which an omnidirectional signal is applied is opened to a greater extent than a valve included in a hearing aid including a receiver to which a beamforming signal is applied.
[0015] When one valve is open more than the other, it means that one valve can be closed and the other valve can be opened to a certain extent, or that both valves are open but one valve is opened to a greater extent than the other.
[0016] The signal processing device is adapted to process microphone signals from a first microphone device and a second microphone device by compensating for the user's hearing impairment. In this context, the meaning of the term "receiver" in common hearing aid terminology depends on the context. In the case of radio / wireless communication, the receiver may be a receiving unit for wireless signals. However, in this case, the receiver refers to a speaker that provides audio signals to the user's ear canal after processing by the signal processing device. From the context, it will be apparent to those skilled in the art which of these two meanings applies to the specified paragraphs of this application, whether it refers to wireless communication or providing audio signals to the user.
[0017] In embodiments of the invention, the processing device includes a first processing unit located in a first hearing aid and a second processing unit located in a second hearing aid. The first and second processing units can operate independently of each other; they can be in a master / slave configuration, with one sending control signals to the other, or they can work collaboratively based on signals provided by a microphone device to perform beamforming, hearing loss compensation, etc. By providing a separate processing unit for each of the first and second hearing aids, the hearing aid system achieves more efficient processing and reduces reliance on communication links.
[0018] In an embodiment of a binaural hearing aid system, the valve control device is further configured to completely close the first valve when the second valve is open, and to completely close the second valve when the first valve is open.
[0019] The first sound channel may be located in a portion of the user's ear canal during the use of the first hearing aid, and the second sound channel may be located in a portion of the user's other ear canal during the use of the second hearing aid.
[0020] The first sound channel and the first valve may each have the same shape factor as the second sound channel and the second valve. That is, the dimensions and shapes of the first and second channels may be substantially the same, and similarly, the dimensions and shapes of the first and second valves may be substantially the same. Furthermore, the first and second sound channels may be made of the same material. Likewise, the first and second valves may be made of the same material.
[0021] In an embodiment of a binaural hearing aid system, the first valve is further configured to open at least partially or close at least partially in response to a first valve control signal, and the second valve is further configured to open at least partially or close at least partially in response to a second valve control signal, wherein the first valve control signal and the second valve control signal are generated by a valve control device.
[0022] In embodiments of a binaural hearing aid system, in response to an omnidirectional signal applied to the receiver of the first or second hearing aid, a valve control device opens the valve of the first or second hearing aid, respectively; and / or in response to a beamforming signal applied to the receiver of the first or second hearing aid, the valve control device closes the valve of the first or second hearing aid, respectively.
[0023] In embodiments of a binaural hearing aid system, the valve control device is adapted to incorporate an asymmetric state in response to the hearing aid system entering a dialogue mode, which is entered at the user's request or in response to the signal strength of microphone signals from a first microphone device and / or a second microphone device exceeding a noise threshold.
[0024] In embodiments of a binaural hearing aid system, the beamforming signal is based at least on two or more microphone signals provided in response to an input sound provided by a microphone device included in a hearing aid comprising a receiver to which the beamforming signal is applied.
[0025] During hearing aid fitting, hearing aid audiologists or hearing specialists can select the ear with the greatest hearing loss to receive omnidirectional signals, while the ear with the better hearing receives (bilateral or monocular) beamforming signals. Before or during the fitting of a binaural hearing aid system, the audiologist can determine the hearing loss in each of the patient's or user's ears. The signal processing unit of a binaural hearing aid system can be configured to perform hearing loss compensation for bilateral or monocular beamforming signals, and can also be configured to perform hearing loss compensation for omnidirectional signals.
[0026] The valve control device is also configured such that, when in an asymmetrical state, the valve included in a hearing aid comprising a receiver to which an omnidirectional signal is applied is opened more than the valve included in a hearing aid comprising a receiver to which a beamforming signal is applied.
[0027] In this way, the valve corresponding to the receiver to which an omnidirectional signal is applied in the first and second receivers is opened more than the valve corresponding to the receiver to which a beamforming signal is applied in the first and second receivers.
[0028] The individual hearing aids in a binaural hearing aid system can be fitted to a user or an individual with hearing loss so that the ear with the greatest hearing loss receives bilateral omnidirectional signals, while the ear with the least or best hearing receives bilateral beamforming signals. An audiologist can determine the individual hearing loss in the left and right ears of the patient or user using conventional methods, in conjunction with the hearing aid accessories. In this way, individuals with hearing loss can employ better hearing strategies, where, due to significant attenuation of all sound sources located outside a narrow angular range around the target direction, the individual uses the ear receiving bilateral or monoaural beamforming signals to focus their attention on the target speaker in the target direction, where the bilateral or monoaural beamforming signal has a good signal-to-noise ratio (SNR) for the target speaker. While the closed valve in the beamforming ear has the disadvantage of occlusion, it helps to provide improved sound quality and speech intelligibility by reducing ambient sound. Omnidirectional signals allow individuals with hearing loss to monitor off-axis sound sources—that is, sound sources located outside a narrow angular range around the target direction—using cognitive filtering mechanisms such as selective attention. The omnidirectional signal reproduced to the user's other ear provides good situational awareness, thus at least partially eliminating the undesirable "tunneling hearing" sensation associated with traditional beamforming algorithms and binaural hearing aid systems. Furthermore, the open valve in the ear receiving the omnidirectional signal helps provide improved environmental awareness.
[0029] Those skilled in the art will understand that the signal processing device can be configured to perform bilateral beamforming hearing loss compensation before applying a signal to the user's left or right hearing aid. Bilateral beamforming hearing loss compensation can be determined based on hearing loss in the relevant ear, measured or determined individually during hearing aid fitting (e.g., in an audiologist's office). Similarly, the signal processing device can be configured to perform bilateral omnidirectional hearing loss compensation. Bilateral omnidirectional hearing loss compensation can also be determined based on hearing loss in the relevant ear, measured or determined individually during hearing aid fitting.
[0030] In embodiments of a binaural hearing aid system, the omnidirectional signal is a bilateral omnidirectional signal based on microphone signals provided by first and second microphone devices.
[0031] In an embodiment of a binaural hearing aid system, a microphone signal provided by a hearing aid including a receiver to which a beamforming signal is applied has a time delay relative to a microphone signal provided by a hearing aid including a receiver to which an omnidirectional signal is applied, and then the two microphone signals are mixed to generate a bilateral omnidirectional signal.
[0032] In this manner, a first monoaural directional signal provided by a microphone in a hearing aid, including a receiver to which a beamforming signal is applied, has a time delay relative to a second monoaural directional signal provided by a microphone in a hearing aid, including a receiver to which an omnidirectional signal is (to be) applied, and then the first and second monoaural directional signals are mixed. The relative time delay between the first and second monoaural directional signals can be between 3 ms and 50 ms, for example, between 5 ms and 20 ms, wherein the time delay is determined at 2 kHz. This relative time delay between the first and second monoaural directional signals provides beneficial auditory fusion between these signals by utilizing the so-called Haas effect, as well as other advantages, which are discussed in more detail below with reference to the accompanying drawings.
[0033] In an embodiment of a binaural hearing aid system, the hearing aid system further includes an omnidirectional processing device, which includes a first omnidirectional signal processor and a second omnidirectional signal processor.
[0034] A first omnidirectional signal processor is disposed within the housing of a hearing aid, which includes a receiver to which beamforming signals are applied, and is configured as follows:
[0035] - Generate the first monoaural directional signal
[0036] - A first monocular directional signal is transmitted to a hearing aid, including a receiver to which an omnidirectional signal is applied, via a wired or wireless communication link; and
[0037] The second omnidirectional signal processor is disposed within the housing of the hearing aid, which includes a receiver to which an omnidirectional signal is applied, and is configured as follows:
[0038] - Receive the first monoa directional signal sent by another hearing aid via a wired or wireless communication link.
[0039] - Generate a second monoaural directional signal and mix the first monoaural directional signal and the second monoaural directional signal at a fixed or adjustable ratio to generate a bilateral omnidirectional signal.
[0040] In embodiments of a binaural hearing aid system, the signal processing device and the omnidirectional processing device are included in the same processing unit.
[0041] In an embodiment of a binaural hearing aid system, the signal processing device includes a first signal processing unit housed in a first hearing aid and a second signal processing unit housed in a second hearing aid.
[0042] A second aspect of the invention relates to a method for providing a beamforming signal at the left or right ear of a hearing aid user and a bilateral omnidirectional signal at the opposite ear of the hearing aid user, the method comprising:
[0043] - Generate bilateral or monoaural beamforming signals using a beamforming device based on two or more microphone signals provided by the microphone device of the hearing aid in the user's left or right ear;
[0044] - Convert bilateral or monoaural beamforming signals into corresponding audible beamforming signals for the user's left or right ear.
[0045] -A first monoaural directional signal is generated by an omnidirectional processing device based on one or more microphone signals provided by the microphone device of the hearing aid in the user's left or right ear;
[0046] - A second monoaural directional signal is generated by an omnidirectional processing device based on one or more microphone signals provided by a microphone device relative to the hearing aid;
[0047] - The first monoaural directional signal and the second monoaural directional signal are mixed at a fixed or adjustable ratio to generate a bilateral omnidirectional signal;
[0048] - Convert the bilateral omnidirectional signals into corresponding audible signals for the user's relative ear, and
[0049] - The valve control device performs the steps of closing the valve in the user's left or right ear of the hearing aid; and opening the valve in the user's opposite ear of the hearing aid.
[0050] In an embodiment of the method, the method further includes performing the following step via a valve control device: causing a valve included in a hearing aid that emits an audible omnidirectional signal to open more than a valve included in another hearing aid that emits an audible beamforming signal.
[0051] In an embodiment of the method, the steps of the valve control device further include: the closed valve is completely closed, and the open valve is completely open.
[0052] In an embodiment of the method, the steps of the valve control device further include: the valve opening or closing in response to a valve control signal.
[0053] In an embodiment of the method, the step of mixing the first and second monoaural directional signals further includes: a microphone signal provided by a hearing aid that will emit an audible beamforming signal having a time delay relative to a microphone signal provided by a hearing aid that will emit an audible omnidirectional signal, and then the two microphone signals are mixed to generate a bilateral omnidirectional signal.
[0054] Exemplary signal processing of a signal processing device
[0055] In one embodiment of a binaural hearing aid system, the signal processing device is configured to generate a bilateral omnidirectional signal by mixing the first and second monoaural directional signals according to the following formula:
[0056] S=β*dl+(1-β)dr e2e (t1);
[0057] in:
[0058] S: Time-domain representation of a bilateral omnidirectional signal based on a mixture of the first and second monoauricular directional signals;
[0059] dl: is the time-domain representation of the second monoaural directional signal;
[0060] dr e2e (t1): is the time-domain representation of the first monoaural directional signal with a relative time delay of (t1).
[0061] β: is a scalar scaling factor between 0 and 1 that sets the mixing ratio of the first and second monoaural directional signals, or a filter used to set the frequency-dependent mixing ratio of the first and second monoaural directional signals.
[0062] In one such embodiment, the signal processing device is configured to adaptively adjust a scaling factor β based on the relative powers of the first and second monoauricular directional signals, for example by calculating β according to the following formula:
[0063]
[0064] The signal processing device is configured to adaptively adjust the scaling factor β to maximize the power of the bilateral omnidirectional signal S; or to adaptively adjust the coefficients of the digital filter to maximize the power of the bilateral omnidirectional signal S. The filter, which can set the frequency-dependent mixing ratio of the first and second monoaural directional signals, may include a digital filter, such as an FIR filter or an IIR filter.
[0065] In an embodiment, the scaling factor β includes a linear-phase FIR filter with a group delay d, and the signal processing device is configured to generate a bilateral omnidirectional signal according to the following formula:
[0066] S=β*dl+(z -d -β)dr e2e (t1).
[0067] There is a corresponding microphone sound inlet in each of the user's left and right ear canals, for example on the outwardly oriented surface of the ITE, ITC, CIC, RIC shell structure of the relevant hearing aid or earplug, which allows the first and second monoaural directional signals to be formed in a computationally effective manner.
[0068] According to one embodiment of a binaural hearing aid system and a method for providing beamforming signals at the left or right ear of the hearing aid user and bilateral omnidirectional signals at the other ear of the hearing aid user, the signal processing device is further configured to adaptively calculate the bilateral beamforming signal based on a fourth monoaural directional signal and a third monoaural directional signal using a time delay and summation mechanism; said calculation includes minimizing the cost function C(α,β) according to the following formula:
[0069] C(α,β)={E{(αZ l +βZ r )·(αZ l * +βZ r * )}+λ * (α+β-1)+λ(α+β-1) *
[0070] The constraint is α + β = 1; and where
[0071] E represents the statistical expectation.
[0072] dl i This represents the i-th sub-band of the fourth monoauricular directional signal.
[0073] dr i This represents the i-th sub-band of the third monoauricular directional signal; and
[0074] * indicates the conjugation of a complex function.
[0075] According to an embodiment of a binaural hearing aid system, the signal processing device is further configured to generate a first monoaural directional signal according to the following formula.
[0076]
[0077] Furthermore, the signal processing device is configured to generate a second monoaural directional signal according to the following formula.
[0078]
[0079] in Indicates the angle relative to the sound source. It is the target direction.
[0080] The head-related transfer function of the first microphone of the second hearing aid, as measured on an acoustic mannequin (e.g., KEMAR or HATS).
[0081] The head-dependent transfer function of the second microphone of the second hearing aid, as measured on an acoustic mannequin (e.g., KEMAR or HATS).
[0082] The head-dependent transfer function of the first microphone of the first hearing aid, as measured on an acoustic mannequin (e.g., KEMAR or HATS).
[0083] The head-dependent transfer function of the second microphone of the first hearing aid, as measured on an acoustic mannequin (e.g., KEMAR or HATS); and
[0084] F fl (f,b) represents the frequency response of the first discrete-time filter (e.g., an FIR filter) of the first hearing aid.
[0085] F bl (f,a) represents the frequency response of the second discrete-time filter (e.g., an FIR filter) of the first hearing aid.
[0086] F fr (f,d) represents the frequency response of the first discrete-time filter (e.g., an FIR filter) of the second hearing aid.
[0087] F br (f,c) represents the frequency response of the second discrete-time filter (e.g., an FIR filter) of the second hearing aid;
[0088] The filter F is determined by minimizing the following cost function. bl (f,a), F fl (f,b), F br (f,c), F fr The sets of filter coefficients a, b, c, and d for (f,d):
[0089]
[0090] Where trueOmniTarget(f,θ) is the selected objective function for the bilateral omnidirectional signal;
[0091] P l It is the frequency response of the first monoaural directional signal;
[0092] P r It is the frequency response of the second monoaural directional signal;
[0093] w o w zeroL and w zeroRThese are weighting functions representing the trade-off costs between the three components of the cost function for frequency and optional source angles.
[0094] Using narrowband test signals such as sine waves, and with a properly fitted binaural hearing aid system mounted on an acoustic mannequin, various sensitivities or responsivenesses of polarity modes for bilateral or monoaural beamforming signals and bilateral omnidirectional signals can be determined at 2 kHz. The various sensitivities of polarity modes can be determined using alternative types of test signals, such as band-limited white noise signals in the 1.5 kHz–5 kHz range. The latter measurement condition may provide more representative results of the actual performance of the binaural hearing aid system due to the average values over the frequency range important for speech comprehension.
[0095] The acoustic mannequin can be a commercially available acoustic mannequin, such as KEMAR or HATS or any similar acoustic mannequin, designed to simulate or represent the average acoustic properties of the human head and torso. Those skilled in the art will understand that the aforementioned polarity patterns will generally be substantially the same when the binaural hearing aid system is properly positioned on the user or patient and on the acoustic mannequin. However, reference to the determination results based on the acoustic mannequin ensures well-defined and reproducible measurement conditions. Attached Figure Description
[0096] Exemplary embodiments of the invention are described in more detail below with reference to the accompanying drawings, in which:
[0097] Figure 1 The illustration schematically depicts a binaural hearing aid system according to an exemplary embodiment of the present invention, comprising a left-ear hearing aid and a right-ear hearing aid connected via a bilateral wireless data communication channel.
[0098] Figure 2 A schematic block diagram of the left hearing aid in a binaural hearing aid system according to an embodiment of the present invention is shown.
[0099] Figure 3 A schematic block diagram of the right hearing aid in a binaural hearing aid system according to an embodiment of the present invention is shown.
[0100] Figure 4 This is a schematic diagram of a hearing-impaired individual equipped with a binaural hearing aid system according to an exemplary embodiment of the present invention.
[0101] Figure 5 This is a schematic diagram illustrating the properties of bilateral beamforming signals and bilateral omnidirectional signals generated by an exemplary embodiment of a binaural hearing aid system.
[0102] Figure 6This demonstrates a set of measured polarity patterns of bilateral omnidirectional microphone signals based on the first and second monoauricular directional signals at test frequencies of 1, 2, and 4 kHz, with a second hearing aid fitted to KEMAR's right ear.
[0103] Figure 7 A set of polarity patterns of the bilateral beamforming signal generated by an exemplary embodiment of the bilateral beamformer of the hearing aid in a bilateral hearing aid system are shown, measured at 1 kHz, 2 kHz and 4 kHz.
[0104] List of reference numerals
[0105] 1. Binaural hearing aid system
[0106] 10 Left / Right Hearing Aids
[0107] 12. Data communication connection or link
[0108] 14 Wireless Communication Units
[0109] 16 antennas
[0110] 18 Hearing Aid Circuits
[0111] 20 microphone devices
[0112] 22 Signal processing device
[0113] 22L Signal Processing Unit
[0114] 22R Signal Processing Unit
[0115] 24 receivers
[0116] 26 audio channels
[0117] 28 valves
[0118] 30 Valve control device
[0119] 100 Omnidirectional Microphone
[0120] 102 First Single-Ear Beamformer
[0121] 104 Second Single-ear Beamformer
[0122] 106 Third monoauricular beamforming signal
[0123] 108-sided beamformer
[0124] 110 First monoaural directional signal
[0125] 112 Fourth monoauricular directional signal
[0126] 114 Bilateral Beamforming Signal
[0127] 116 Conventional Hearing Loss Processor
[0128] 120 Ambient Audio Signal
[0129] 122 Valve control signal
[0130] 124 Signals from bilateral beamformer to valve control device
[0131] 202 Third Single-Ear Beamformer
[0132] 204 Fourth Single-ear Beamformer
[0133] 206 Second monoaural directional signal
[0134] 208 First proportional function
[0135] 210 Signal mixer or combiner
[0136] 212 Second proportional function
[0137] 214 Bilateral omnidirectional signal
[0138] 216 Conventional Hearing Loss Processor
[0139] 401 Individuals with Hearing Impairment
[0140] 402 Target Sound Source
[0141] 404 Interference Source
[0142] 406 Interference Source
[0143] 502 Directivity of bilateral beamforming signals
[0144] 504 Directivity of bilateral omnidirectional signals
[0145] t1 and t2 are delay elements. Detailed Implementation
[0146] Various exemplary embodiments of the present binaural hearing aid system are described below with reference to the accompanying drawings. Those skilled in the art will understand that the drawings are schematic and simplified for clarity, and therefore only details essential for understanding the invention are shown, while other details are omitted. Throughout the text, similar reference numerals refer to similar elements. Therefore, it is not necessary to describe similar elements in detail with respect to each drawing.
[0147] Figure 1A binaural hearing aid system 1 is schematically illustrated, comprising a left-ear hearing aid 10L and a right-ear hearing aid 10R, wherein each of the hearing aids 10L and 10R includes a wireless communication unit 14L, 14R for connection to the other hearing aid. In this embodiment, the left-ear hearing aid 10L and the right-ear hearing aid 10R are connected to each other via a bidirectional wireless (or possibly wired) data communication connection or link 12 supporting real-time streaming of digitized microphone signals. A unique ID can be associated with each of the left-ear hearing aid 10L and the right-ear hearing aid 10R. Each of the illustrated wireless communication units 14L, 14R of the binaural hearing aid system 1 can be configured to operate in the 2.4 GHz Industrial Science and Medical (ISM) band and can be compliant with the Bluetooth LE standard. Alternatively, each illustrated wireless communication unit 14L, 14R may include an electromagnetic coil antenna 16L, 16R and is based on near-field magnetic coupling of NMFI, which operates in a frequency region such as between 10 MHz and 20 MHz.
[0148] Apart from the unique ID mentioned above, in some embodiments of this hearing aid system, the left hearing aid 10L and the right hearing aid 10R may be substantially identical, such that unless otherwise stated, the following description of the features, components, and signal processing functions of the left hearing aid 10L also applies to the right hearing aid 10R. The left hearing aid 10L may include a ZnO2 battery (not shown) or a rechargeable battery connected to power the hearing aid circuitry 18L. The left hearing aid 10L includes a microphone device 20L, which preferably includes at least a first omnidirectional microphone and may include a second omnidirectional microphone, as discussed in further detail below.
[0149] The left hearing aid 10L also includes a sound channel 26L configured to allow ambient sounds to propagate from the outside of the hearing aid 10L into the user's ear canal. Depending on the type of hearing aid 10L, the sound channel may be located in the portion of the hearing aid 10L that is located within the user's ear canal during use. Within the sound channel 26L, a valve 28L can move from an open state to a closed state and back again. When in the open state, the valve 28L can be partially or fully open. A closed valve 28L will prevent ambient sounds from propagating into the user's ear canal, while an open valve 28L will allow ambient sounds to propagate into the user's ear canal. The more the valve 28L is opened, the easier it is for ambient sounds to propagate within the sound channel 26L.
[0150] The state of valve 28L is controlled by a valve control signal generated by valve control device 30L. Both the left hearing aid 10L and the right hearing aid 10R may include valve control devices 30L and 30R, or a second valve of a single valve control device (e.g., in the left hearing aid 10L) may control the state of both valves via wireless communication units 14L and 14R. The valve control devices are configured to have an asymmetrical state, thereby setting the positions of the two valves 28L and 28R in an asymmetrical configuration, i.e., the positions of valve 28L in the left hearing aid 10L and valve 28R in the right hearing aid 10R, such that... Figure 1 As shown, one valve opens more than the other, with one valve 28L completely closed and the other valve 28R partially open. The asymmetric state can be configured such that when the other valve 28L, 28R is open, one valve 28L, 28R is completely closed, such that only one of the valves 28L, 28R in the left and right hearing aids 10L, 10R is partially or completely open, while the other is completely closed.
[0151] The left hearing aid 10L also includes a signal processing unit 22L, which may include a hearing loss processor. The signal processing unit 22L is further configured to create monoaural and / or bilateral beamforming signals based on microphone signals from the left hearing aid 10L and / or based on signals from the contralateral microphone (i.e., microphone signals from the other (here, the right) hearing aid). The hearing loss processor is configured to compensate for the hearing loss of the user of the left hearing aid 10L. Preferably, the hearing loss processor includes known dynamic range compressor circuitry or algorithms for compensating for frequency-related losses in the user's dynamic range, commonly referred to in the art as recruitment. Thus, the signal processing unit 22L can generate beamforming audio signals with additional hearing loss compensation and output them to a speaker or receiver 24L. The speaker or receiver 24L converts the electro-audio signals into corresponding acoustic signals for transmission into the user's left ear canal.
[0152] The contralateral hearing aid (right hearing aid in this example) can generate a monocular or bilateral omnidirectional signal at the user's contralateral ear. The bilateral omnidirectional signal is based on microphone signals from both the left hearing aid 10L and the right hearing aid 10R. An omnidirectional signal can be generated by mixing a pair of monocular signals. The bilateral omnidirectional signal exhibits an omnidirectional response or polarity pattern with a low directivity index, thus providing essentially equal sensitivity for all sound incident directions or azimuths around the user's head, reducing the shadowing effect on the user's head.
[0153] The binaural hearing aid system 1 may additionally include an omnidirectional processing unit (not shown), comprising a first omnidirectional signal processor and a second omnidirectional signal processor. The omnidirectional processing unit and the signal processing unit may be included within the same processing unit. The first omnidirectional signal processor is disposed in the housing of a hearing aid including a receiver to which a beamforming signal is applied, and is configured to generate a first monoaural directional signal and transmit the first monoaural directional signal to the hearing aid including the receiver to which the omnidirectional signal is applied via a wired or wireless communication link 12. Similarly, the second omnidirectional signal processor is disposed in the housing of a hearing aid including a receiver to which the omnidirectional signal is applied, and is configured to receive a first monoaural directional signal transmitted by another hearing aid via a wired or wireless communication link 12. The second omnidirectional signal processor then generates a second monoaural directional signal and mixes the first and second monoaural directional signals at a fixed or adjustable ratio to generate a bilateral omnidirectional signal.
[0154] Advantageously, the valve control devices 30L, 30R can be further configured such that the valves 28L, 28R included in hearing aids 10L, 10R with receivers to which omnidirectional signals are applied are opened more fully than the valves in hearing aids with receivers to which beamforming signals are applied. This provides good low-frequency gain and reduces ambient noise propagating to the ear, which improves the efficiency of beamforming and noise reduction, and thus improves speech intelligibility.
[0155] Those skilled in the art will understand that each of the signal processing units 22L and 22R may include a digital processor, such as a software-programmable microprocessor, like a digital signal processor (DSP). The signal processing units 22L and 22R together form a signal processing device 22 for the hearing aid system 1. Preferably, the signal processing device 22 is provided by the signal processing units 22L and 22R in each hearing aid 10.
[0156] However, alternatively, the signal processing device 22 may be located in one of the left and right (first and second) hearing aids 10. In such an embodiment, the hearing aid where the processing device 22 is located will use the communication connection 12 to send the processed signals, control signals, etc. to another hearing aid and receive microphone signals from the other hearing aid.
[0157] The operation of each of the left-ear hearing aid 10L and the right-ear hearing aid 10R can be controlled by a suitable operating system executing on a software-programmable microprocessor. The operating system can be configured to manage hearing aid hardware and software resources, including, for example, the calculation of bilateral beamforming signals, the calculation of mono-ear beamforming signals, the calculation of hearing loss compensation, and possibly other processors and related signal processing algorithms, the wireless data communication unit 14L, certain memory resources, etc. The operating system can schedule tasks for the efficient use of hearing aid resources and may also include accounting software for cost allocation, including power consumption, processor time, storage location, wireless transmission, and other resources. The operating system can control the operation of the wireless bidirectional data communication unit 14L, such that, through the wireless bidirectional data communication unit 14L and communication connection 12, a first mono-ear beamforming signal is transmitted to the right-ear hearing aid 10R and a second mono-ear beamforming signal is received from the right-ear hearing aid. The right-ear hearing aid 10R can have the same hardware and software components functioning accordingly.
[0158] Figure 2 This is a schematic block diagram of an embodiment of a left-ear hearing aid 10L of a binaural hearing aid system 1, placed in or in the left ear of a user. The components shown in the left-ear hearing aid 10L can be arranged within one or more hearing aid housing portions (e.g., hearing aid housings of types such as BTE, RIE, ITE, ITC, CIC, RIC, etc.). The hearing aid 10L includes a microphone device 20L, which preferably includes at least the aforementioned first omnidirectional microphone 100a and may include a second omnidirectional microphone 100b, which generates first and second microphone signals respectively in response to incoming or outgoing sound. The respective sound inlets or ports (not shown) of the first and second omnidirectional microphones 100a, 100b are preferably arranged at intervals within one of the housing portions of the hearing aid 10L. The spacing between the sound inlets or ports depends on the size and type of the housing portion but can be between 5 and 30 mm. This port spacing range can form a first monoaural beamforming signal by applying a summation and delay function or algorithm to the first and second microphone signals. The hearing aid 10L preferably includes one or more analog-to-digital converters (not shown) that convert analog microphone signals into corresponding digital microphone signals with a certain resolution and sampling frequency before being applied to the first monoauricular beamformer 102 and possibly before being applied to the second monoauricular beamformer 104.
[0159] The first monoauricular beamformer 102 is configured to generate a third monoauricular beamforming signal 106, such as a third monoauricular directional signal, for example, by using a summation-delay type beamforming algorithm. The first monoauricular beamformer 102 is configured to generate the third monoauricular beamforming signal 106 based on digitized first and second microphone signals. This third monoauricular beamforming signal 106 preferably has a third polarity pattern with maximum response or sensitivity in the target direction (i.e., the zero-degree direction or the user's gaze direction). The maximum sensitivity in the target direction (or at least very close to the target direction, for example, within an angular range of 350 degrees to 10 degrees) makes the third monoauricular beamforming signal 106 well-suited as an input signal to the bilateral beamformer 108, because the third polarity pattern exhibits reduced sensitivity to incoming sound signals from the same side of the user's left ear and the posterior hemisphere of the user's head (i.e., in the direction of sound incidence or at an angle of approximately 180 degrees) relative to the maximum sensitivity. Compared to the target direction, the relative attenuation or suppression of sound arriving from the sides and rear may be greater than 6 dB, or greater than 10 dB, for example greater than 12 dB or 15 dB, as determined using a narrowband test signal at 2 kHz, such as a sine wave. The response or sensitivity of the third polarity mode can exhibit the same relative attenuation of these off-axis sound signals over a wider frequency range, for example determined by a band-limited white noise signal of 1.5 kHz–5 kHz.
[0160] The second monoauricular beamformer 104 is configured, for example, to generate a first monoauricular directional signal 110 using a summation-delay type beamforming algorithm based on, for example, digitized first and second microphone signals provided by the microphone device 20L. Figure 7 As illustrated by the azimuth convention, the first monoaural directional signal 110 has a first polarity mode that exhibits good sensitivity in the target direction and maximum sensitivity (determined at 2 kHz) on or near the user's left ear. This substantially equal sensitivity in the target direction and on the same side as the user's left ear preferably means that the sensitivity variation of the first polarity mode is less than 6 dB, more preferably less than 4 dB, and for example less than 2 dB, for the direction of sound incidence or the angular range between 180 and 330 degrees, as determined using a narrowband test signal (e.g., a sine wave) at 2 kHz. In a wider frequency range, for example determined by a 1.5 kHz–5 kHz band-limited white noise signal, the response or sensitivity of the first polarity mode can exhibit the same uniformity for the direction of sound incidence between 180 and 330 degrees. The first polarity mode can, for example, be substantially equal to the open-ear directional response of KEMAR's left ear.
[0161] The signal processing device 22L is configured to transmit a first monoaural directional signal 110 to the right or right-side (i.e., contralateral) hearing aid 10R via an RF or NFMI antenna 16L and a bidirectional data communication unit 14L using an appropriate proprietary or standardized communication protocol supporting real-time audio. Those skilled in the art will understand that the first monoaural directional signal 110 is preferably encoded in a digital format, such as a standardized digital audio format, prior to wireless transmission. The signal processing device 22L is also configured to receive a fourth monoaural directional signal 112 from the right-side hearing aid 10R via the bidirectional data communication unit 14L and a wireless communication link 12.
[0162] Those skilled in the art will understand that the first mono-ear beamformer 102 can be implemented as dedicated computing hardware integrated on the signal processing device 22L, or as a first set of suitable executable program instructions that execute on the signal processing device 22L (e.g., the previously discussed programmable microprocessor or DSP), or as any combination of dedicated computing hardware and executable program instructions. Similarly, the second mono-ear beamformer 104 can be implemented as dedicated computing hardware of the signal processing device 22L, or as a second set of suitable executable program instructions that execute on the signal processing device 22L (e.g., the previously discussed programmable microprocessor or DSP), or as any combination of dedicated computing hardware and executable program instructions.
[0163] A third monoaural beamforming signal 106 and a fourth monoaural directional signal 112 (wherein the fourth monoaural directional signal 112 is received from the right hearing aid 10R) are applied to the input of a bilateral beamformer 108, which is configured to generate a bilateral beamforming signal 114 in response to the third monoaural beamforming signal and the fourth monoaural directional signals 106, 112. The polarity pattern of the bilateral beamforming signal has maximum sensitivity in the target direction and relatively reduced sensitivity for all other sound incident angles, including the same side of the left hearing aid, the same side of the right hearing aid, and the posterior hemisphere of the user's head, for example, a sound incident angle of approximately 160-200 degrees determined using a narrowband test signal (e.g., a sine wave) at 2 kHz. The response or sensitivity of the bilateral beamforming signal 114 can exhibit the same relative attenuation of these off-axis sound signals over a wide frequency range, for example, determined by a band-limited white noise signal of 1.5 kHz to 5 kHz. The sensitivity or response of the bilateral beamforming signal 114 to sound incident on the same side of the left and right hearing aids can be at least 10 dB lower than the sensitivity in the target direction, for example, 12 dB or 15 dB lower, as determined using a narrowband test signal at 2 kHz.
[0164] Those skilled in the art will understand that the bilateral beamformer 108 can be configured to generate the bilateral beamforming signal 114 by applying various types of fixed or adaptive beamforming algorithms known in the art, such as delay and summation beamforming algorithms or filtering and summation beamforming algorithms.
[0165] Signal processing device 22L can be configured to apply bilateral beamforming signal 114 to conventional hearing loss processor 116 of left hearing aid 10L. Conventional hearing loss processor 116 is configured to compensate for the hearing loss of the user of left hearing aid 10L and to provide a hearing loss-compensated output signal to miniature speaker or receiver 24L. Conventional hearing loss processor 116 may include the output of a Class D amplifier or a power amplifier (not shown), such as a digitally modulated pulse width modulator (PWM) or pulse density modulator (PDM), to drive miniature speaker or receiver 24L. Miniature speaker or receiver 24L converts the hearing loss-compensated output signal into a corresponding audible signal, such as an electrical or acoustic output signal, which can be transmitted to the user's eardrum, for example, via an earpiece of suitable shape and size of left hearing aid 10L.
[0166] Connecting the external left hearing aid 10L to the sound channel of the user's left ear canal allows the ambient audio signal 120L to propagate towards the user's eardrum. Within the sound channel, valve 28L adjusts the amount of ambient audio signal 120L that can pass through by fully opening, partially opening, or fully closing. Figure 2 In the illustrated embodiment of the left hearing aid, valve 28L in the left hearing aid 10L is completely closed to reduce the amount of ambient sound propagating to the user's left eardrum and provide good low-frequency gain. This improves the efficiency of beamforming and noise reduction, thus improving speech intelligibility. In other cases, valve 28L may be partially or fully open.
[0167] The open or closed state of valve 28L is controlled by valve control device 30 via valve control signal 122 from valve control device 30L to valve 28L. Valve control device 30L can be configured to respond to bilateral beamforming signal 114 applied to receiver 24L of hearing aid 10L by closing valve 28L. For example, this can be accomplished by signal 124 from bilateral beamformer 108 to valve control device 30.
[0168] Figure 3This is a schematic block diagram of an embodiment of a right-ear hearing aid or instrument 10R for placement in or in the right ear of a user's binaural or bilateral hearing aid system 1. The illustrated components of the right-ear hearing aid 10R can be arranged within one or more hearing aid housing portions (e.g., hearing aid housings of the BTE, RIE, ITE, ITC, CIC, RIC, etc. types), preferably the same type of housing as the previously discussed left-ear hearing aid. The hearing aid 10R includes a second microphone device 20R, which can be the same as the first microphone device 20L described above, and therefore includes first and second omnidirectional microphones 101a, 101b as shown. The hearing aid 10R preferably includes one or more analog-to-digital converters (not shown) that convert analog microphone signals into corresponding digital microphone signals with a certain resolution and sampling frequency, and then the corresponding digital microphone signals are applied to the corresponding inputs of a third monoaural beamformer 202 and a fourth monoaural beamformer 204.
[0169] The third monoauricular beamformer 202 is configured to generate the aforementioned fourth monoauricular directional signal 112. The third monoauricular beamformer 202 is configured to generate the fourth monoauricular directional signal 112, for example, by using a beamforming algorithm of the summation and delay type applied to the digitized first and second microphone signals provided by the second microphone device 20R. The fourth monoauricular directional signal 112 preferably has a fourth polarity mode, which is in the target direction (i.e., the user's zero-degree direction or gaze direction, i.e., as shown in the image). Figure 7 The fourth polarity mode exhibits maximum sensitivity in the target direction (or at least very close to the target direction, e.g., within an angular space of 350 degrees to 10 degrees). The maximum sensitivity in the target direction is similar to the polarity mode of the third monoauricular beamforming signal 106. Relative to the maximum sensitivity, the fourth polarity mode shows reduced sensitivity to incoming sound signals from the same side of the user's right ear and the posterior hemisphere of the user's head (i.e., in a direction of approximately 180 degrees). The response or sensitivity of the fourth polarity mode can exhibit a relative attenuation or suppression of greater than 6 dB or greater than 10 dB, e.g., greater than 12 dB or even greater than 15 dB, from incoming sound from the same side and posterior to the user's right ear, determined using a narrowband test signal at 2 kHz, e.g., a sine wave. The response or sensitivity of the fourth polarity mode can exhibit the same relative attenuation of these off-axis sound signals over a wider frequency range, e.g., determined by a band-limited white noise signal of 1.5 kHz–5 kHz. The fourth monoauricular directional signal 112 is transmitted to the left hearing aid 10L via the wireless communication unit 14R and the electromagnetic coil antenna 16R.
[0170] Signal processing device 22 is also configured to implement the function of a third monoauricular beamformer 202, which is configured to generate a second monoauricular directional signal 206. Figure 7As per the conventional sound incidence angle, the second monoaural directional signal 206 has a second polarity mode that exhibits good sensitivity (determined at 2 kHz) in the target direction and on the same side as the user's right ear. This substantially equal sensitivity in the target direction and on the same side as the user's left ear preferably means that, over an angular range between 180 and 30 degrees, the variation in response or sensitivity of the second polarity mode is less than 6 dB, more preferably less than 4 dB, for example less than 3 dB, as determined at 2 kHz. This substantially equal sensitivity in the target direction and on the same side as the user's right ear preferably means that, for the sound incidence direction or an angular range between 180 and 30 degrees, the variation in sensitivity of the second polarity mode is less than 6 dB, more preferably less than 4 dB, for example less than 2 dB, as determined using a narrowband test signal (e.g., a sine wave) at 2 kHz. In a wider frequency range, for example determined by a 1.5 kHz–5 kHz band-limited white noise signal, the response or sensitivity of the second polarity mode can exhibit the same uniformity for the sound incidence direction between 180 and 30 degrees. The first polarity mode can be, for example, substantially equal to the open-ear orientation response of KEMAR's right ear.
[0171] For the reasons discussed above, the sensitivity of the second monoaural directional signal 206 reflected in the second polarity mode in the target direction (360 degrees or 0 degrees) may be about 4-10 dB lower than its sensitivity in the 90-degree angle. This lower sensitivity in the target direction (360 degrees or 0 degrees) results in an appropriate sensitivity in the target direction for the bilateral omnidirectional signal (also known as a true omnidirectional signal) after the mixing of the second monoaural directional signal 206 and the first monoaural directional signal 110. Those skilled in the art will understand that the polarity modes of the first monoaural directional signal 110 and the second monoaural directional signal 206 can be substantially mirror-symmetrical about the front-back axis or direction (i.e., from 0 degrees to 180 degrees). The second monoaural directional signal 206 exhibits good sensitivity not only in the target direction but also over a wide angular range on the same side as the user's right ear. Those skilled in the art will understand that the second polarity mode is preferably designed such that the sensitivity to sound reaching the user's contralateral ear (left ear in the illustrated embodiment) is significantly less than the sensitivity to sound from the same side of the user's left ear, as determined using a narrowband test signal at 2 kHz.
[0172] Those skilled in the art will understand that the fourth mono-ear beamformer 204 can be implemented as dedicated computing hardware integrated on the signal processing device 22, or can be implemented by a first set of suitable executable program instructions that execute on the signal processing device 22 (e.g., the previously discussed programmable microprocessor or DSP), or can be implemented as any combination of dedicated computing hardware and executable program instructions. Similarly, the third mono-ear beamformer 202 can be implemented as dedicated computing hardware of the signal processing device 22, or can be implemented by a second set of suitable executable program instructions that execute on the signal processing device 22 (e.g., the previously discussed programmable microprocessor or DSP), or can be implemented as any combination of dedicated computing hardware and executable program instructions.
[0173] Those skilled in the art will understand that there are multiple implementations of the second monoauricular beamformer 104 (which creates a first polarity mode of the first monoauricular directional signal 110), and similarly, multiple implementations of the third monoauricular beamformer 202 (which creates a second polarity mode of the second monoauricular directional signal 206). In a particular embodiment of the binauricular hearing aid system 1, the second monoauricular beamformer 104 and the fourth monoauricular beamformer 204 are completely omitted, which saves computational resources and power consumption of the signal processing device 22. The functions of the second monoauricular beamformer 104 and the fourth monoauricular beamformer 204 are replaced by utilizing the natural directional properties of the user's outer ear (e.g., the auricle and ear canal) to form the first monoauricular directional signal and the second monoauricular directional signal.
[0174] The left hearing aid includes at least one housing portion shaped and sized to fit inside the user's left ear canal. At least one housing portion includes at least one omnidirectional microphone of a first microphone device 20L, and has a sound inlet at an outwardly oriented surface of the at least one housing portion. Similarly, the right hearing aid includes at least one housing portion shaped and sized to fit inside the user's right ear canal. At least one housing portion includes at least one omnidirectional microphone of a right microphone device 20R, and has a sound inlet at an outwardly oriented surface of the at least one housing portion of the right hearing aid. The at least one housing portion of the left hearing aid can be a separately formed housing of an ITE, CIC, or ITC hearing aid, or an earpiece of a RIC type hearing aid, as can the at least one housing portion of the right hearing aid.
[0175] The signal processing device 22 receives a first monoaural directional signal 110 from the left-ear hearing aid 10L via the wireless communication unit 14R and the electromagnetic coil antenna 16R. Preferably, the first monoaural directional signal 110 has a time delay relative to the second monoaural directional signal 206 before or in association with the signal mixer or combiner 210, after being processed by the scaling function 208. The relative time delay of the first monoaural directional signal 110 is schematically indicated by the delay element t1 and includes the inherent transmission time delay of the first monoaural directional signal 110 via the wireless communication link 12 and the time delay introduced by the signal processing device 22 to achieve the target or desired time delay.
[0176] A first monoaural directional signal 110, after a relative time delay, is applied to the input of a first scaling function 208, which applies a scaling factor β between 0 and 1 to the first monoaural directional signal 110. The scaling factor-applied version of the first monoaural directional signal 110 is then input to a signal mixer or combiner 210. A second monoaural directional signal 206 is transmitted through an optional time delay function (schematically represented by delay element t2) and then applied to the input of a second scaling function 212, which applies a scalar scaling factor (1-β) to the second monoaural directional signal 206. The scaling factor-applied version of the second monoaural directional signal 206 is then applied to the second input of the signal mixer or combiner 210.
[0177] Accordingly, the signal mixer or combiner 210 mixes the first monoaural directional signal 110 and the second monoaural directional signal 206 at a mixing ratio set by the value of the scalar scaling factor β to generate a bilateral omnidirectional signal 214. The signal processing device 22 may be configured to apply the bilateral omnidirectional signal 214 to the previously discussed conventional hearing loss processor 216 of the right hearing aid 10R. The conventional hearing loss processor 216 is configured to compensate for hearing loss in the user's right ear and provide a hearing loss-compensated output signal to the miniature speaker or receiver 24R. The conventional hearing loss processor 216 and the miniature speaker or receiver 24R, etc., may be identical to the corresponding components of the left hearing aid described above. The target or desired value of the delay element t1 may be set to a value between 3 ms and 50 ms, for example, between 5 ms and 20 ms, wherein the time delay is determined at 2 kHz if the time delay varies within an audio range from 100 Hz to 10 kHz.
[0178] Due to the well-known Haas effect, introducing a relative delay element t1 between the first monoaural directional signal 110 and the second monoaural directional signal 206 to generate a bilateral omnidirectional signal 214 offers several important advantages, such as providing good perceptual or auditory fusion between the first monoaural directional signal 110 and the second monoaural directional signal 206, which is particularly evident for the relative delay element t1, which is between 5 and 20 ms. Another advantage of the relative delay element t1 is that when the signal mixer or combiner 210 sums or adds the first monoaural directional signal 110 and the second monoaural directional signal 206, it decorrelates the first monoaural directional signal 110 and the second monoaural directional signal 206, thereby minimizing the signal cancellation effect.
[0179] Connecting the external portion of the right hearing aid 10R to the sound channel of the user's right ear canal allows the ambient audio signal 120R to propagate towards the user's eardrum. Within the sound channel, valve 28R adjusts the amount of ambient audio signal 120R that can pass through by fully opening, partially opening, or fully closing. Figure 3 In the embodiment of the right hearing aid shown, the valve 28R in the right hearing aid 10R is partially or fully open to reduce occlusion and associated discomfort.
[0180] The open or closed state of valve 28R is controlled by valve control device 30R via valve control signal 122 from valve control device 30R to valve 28R. Valve control device 30R can be configured to respond to a bilateral omnidirectional signal 214 applied to receiver 24R of hearing aid 10R by closing valve 28R. For example, this can be accomplished by signal 124 from signal mixer 210 to valve control device 30R.
[0181] exist Figure 2 and Figure 3 In the illustrated embodiment, each hearing aid 10R, 10L includes a valve control device 30R, 30L; however, it could also be as described above for... Figure 1 The hearing aids 10R and 10L, only one of them, include a valve control device 30.
[0182] Figure 4 This is a schematic diagram of a hearing-impaired individual 401 equipped with a binaural hearing aid system, which includes first and second hearing aids 10L and 10R installed in the user's left and right ears. The schematic sound source device or setup includes a target sound source 402, such as a desired speaker, positioned at a 0-degree azimuth angle in the target direction. The sound source device may include one or more interfering sound sources 404 and 406 arranged around the user's head in various off-axis directions (i.e., outside the target direction).
[0183] Figure 5This is a schematic diagram of a high directivity index 502 of a bilateral beamforming signal applied to the user's left ear and a relatively much lower directivity index 504 of a bilateral omnidirectional signal applied to the user's right ear, according to an exemplary embodiment of a bilateral hearing aid system.
[0184] Figure 6 The diagram shows a set of measured polarity patterns of a bilateral omnidirectional signal 214, a mixture of a first monoauricular directional signal 110 and a second monoauricular directional signal 206, when the binaural hearing aid system is fitted to the left and right ears of a KEMAR, at test frequencies of 1, 2, and 4 kHz. The bilateral omnidirectional signal 214 is generated using a fixed scalar scaling factor β of 0.5.
[0185] Figure 7 The various polarity modes of the bilateral beamforming signal 114, determined at 1 kHz, 2 kHz, and 4 kHz, for the above-described embodiment of the bilateral beamformer 108 are shown. The polarity modes of the bilateral beamforming signal 114 are obtained by measuring its sensitivity as a function of the 0-360 degree azimuth angle of the test sound source. The left and right hearing aids are appropriately placed on a KEMAR or similar acoustic mannequin simulating the average acoustic properties of a human head and torso. The test sound source can generate a broadband test signal, such as a maximum length sequence (MLS) sound signal, which is reproduced at each azimuth angle from 0 to 360 degrees in steps of a predetermined size (e.g., 5 or 10 degrees). The acoustic transfer function is derived from the bilateral beamforming signal 114 and the test signal. The power spectrum of the acoustic transfer function represents the amplitude response of the bilateral beamforming signal 114 at each azimuth angle. For adaptive beamformers and beamforming algorithms, to avoid overestimating the sensitivity of the bilateral beamforming signal 114, it may be advantageous to simulate the user's real acoustic environment by using the Schroeder phase composite harmonics as the acoustic test sound signal in the diffuse sound field. For example, the amplitude spectrum response can be estimated based on the harmonic amplitude between the playback of the test sound signal and the bilateral beamforming signal 114 obtained in the response.
[0186] project
[0187] 1. A binaural hearing aid system, comprising:
[0188] A first hearing aid is used to be placed in or in the left or right ear of a user. The first hearing aid includes a first microphone device, a first wireless communication unit, a first receiver, and a first sound channel including a first valve, the first valve being movable from an open state to a closed state and from a closed state to an open state.
[0189] A second hearing aid is used to be placed in or in the other ear of a user. The second hearing aid includes a second microphone device, a second wireless communication unit, and a second sound channel including a second valve, the second valve being movable from an open state to a closed state and from a closed state to an open state.
[0190] A signal processing apparatus, adapted to generate a beamforming signal based on microphone signals provided by a first microphone device and / or a second microphone device, and adapted to apply the beamforming signal to a first receiver and / or a second receiver; and
[0191] A valve control device having an asymmetric mode, wherein, in the asymmetric mode, the valve control device is configured to asymmetrically control a first valve and a second valve by moving a first valve and a second valve to a position in which one of the first valve and the second valve is opened to a greater extent than the other of the first valve and the second valve.
[0192] 2. The binaural hearing aid system according to Item 1, wherein the signal processing device is adapted to generate an omnidirectional signal based on a microphone signal provided by a first microphone device and / or a second microphone device, and wherein the signal processing device is adapted to apply the beamforming signal to one of a first receiver and a second receiver and to apply the omnidirectional signal to the other of the first receiver and the second receiver.
[0193] 3. The binaural hearing aid system according to Item 2, wherein the valve control device is further configured such that, when in the asymmetric mode, the valve included in the hearing aid comprising a receiver to which an omnidirectional signal is applied is opened more than the valve included in the hearing aid comprising a receiver to which a beamforming signal is applied.
[0194] 4. The binaural hearing aid system according to any one of Item 2 or Item 3, wherein the omnidirectional signal is a bilateral omnidirectional signal based on microphone signals provided by the first microphone device and the second microphone device.
[0195] 5. The binaural hearing aid system according to item 4, wherein a microphone signal provided by a hearing aid including a receiver to which a beamforming signal is applied has a time delay relative to a microphone signal provided by a hearing aid including a receiver to which an omnidirectional signal is applied, and then the two microphone signals are mixed to generate the bilateral omnidirectional signal.
[0196] 6. The binaural hearing aid system according to any one of the preceding items, wherein the beamforming signal is based at least on two or more microphone signals provided in response to an input sound, the input sound being provided by a microphone device included in a hearing aid comprising a receiver to which the beamforming signal is applied.
[0197] 7. The binaural hearing aid system according to any one of items 2-6, wherein the hearing aid system further includes an omnidirectional processing device, the omnidirectional processing device including a first omnidirectional signal processor and a second omnidirectional signal processor;
[0198] The first omnidirectional signal processor is disposed within the housing of a hearing aid that includes a receiver to which beamforming signals are applied, and is configured as follows:
[0199] - Generate the first monoaural directional signal
[0200] - The first monoaural directional signal is transmitted to a hearing aid including a receiver to which an omnidirectional signal is applied via a wired or wireless communication link; and
[0201] The second omnidirectional signal processor is disposed within the housing of a hearing aid that includes a receiver to which an omnidirectional signal is applied, and is configured as follows:
[0202] - Receive the first monoaural directional signal sent by another hearing aid via a wired or wireless communication link.
[0203] - Generate a second monoaural directional signal and mix the first monoaural directional signal and the second monoaural directional signal at a fixed or adjustable ratio to generate a bilateral omnidirectional signal.
[0204] 8. The binaural hearing aid system according to Item 7, wherein the signal processing device and the omnidirectional processing device are included in the same processing unit.
[0205] 9. A binaural hearing aid system according to any one of items 1-8, wherein the signal processing device comprises a first signal processing unit housed in the first hearing aid and a second signal processing unit housed in the second hearing aid.
[0206] 10. The binaural hearing aid system according to any one of the preceding items, wherein the valve control device is further configured to completely close the first valve when the second valve is open, and to completely close the second valve when the first valve is open.
[0207] 11. The binaural hearing aid system according to any one of the preceding items, wherein, in response to the omnidirectional signal being applied to the receiver of the first hearing aid or the second hearing aid, the valve control device opens a valve of the first hearing aid or the second hearing aid, respectively; and / or
[0208] In response to the beamforming signal being applied to the receiver of the first hearing aid or the second hearing aid, the valve control device closes the valve of the first hearing aid or the second hearing aid respectively.
[0209] 12. The binaural hearing aid system according to any one of the preceding items, wherein the first valve is further configured to at least partially open or at least partially close in response to a first valve control signal, and the second valve is further configured to at least partially open or at least partially close in response to a second valve control signal.
[0210] 13. The binaural hearing aid system according to any one of the preceding items, wherein the first sound channel is located in a portion of the user's ear canal during use of the first hearing aid, and the second sound channel is located in a portion of the user's relative ear canal during use of the second hearing aid.
[0211] 14. The binaural hearing aid system according to any one of the preceding items, wherein the valve control device is adapted to combine the asymmetric mode in response to the binaural hearing aid system entering a dialogue mode, the dialogue mode being entered at the request of a user, or in response to the signal strength of a microphone signal from a first microphone device and / or a second microphone device exceeding a noise threshold.
[0212] 15. A method for providing a beamforming signal at the left or right ear of a hearing aid user and a bilateral omnidirectional signal at the other ear of the hearing aid user;
[0213] The method includes:
[0214] - Generate bilateral or monoaural beamforming signals using a beamforming device based on two or more microphone signals provided by the microphone device of the hearing aid in the user's left or right ear;
[0215] - Convert bilateral or monoaural beamforming signals into corresponding audible beamforming signals for the user's left or right ear.
[0216] -A first monoaural directional signal is generated by an omnidirectional processing device based on one or more microphone signals provided by the microphone device of the hearing aid in the user's left or right ear;
[0217] - A second monoaural directional signal is generated by an omnidirectional processing device based on one or more microphone signals provided by a microphone device relative to the hearing aid;
[0218] - The first monoaural directional signal and the second monoaural directional signal are mixed at a fixed or adjustable ratio to generate the bilateral omnidirectional signal;
[0219] - Convert the bilateral omnidirectional signal into a corresponding audible omnidirectional signal for the user's other ear, and
[0220] - The valve control device is used to close the valve in the hearing aid in the user's left or right ear; and to open the valve in the hearing aid in the user's other ear.
Claims
1. A binaural hearing aid system, comprising: A first hearing aid is used to be placed in or in the left or right ear of a user. The first hearing aid includes a first microphone device, a first wireless communication unit, a first receiver, and a first sound channel including a first valve. The first valve is movable from an open state to a closed state and from a closed state to an open state. The first sound channel is configured to allow ambient sounds outside the first hearing aid to reach the user's ear canal. A second hearing aid for placement in or in the other ear of a user, the second hearing aid including a second microphone device, a second wireless communication unit and a second sound channel including a second valve, the second valve being movable from an open state to a closed state and from a closed state to an open state, the second sound channel being configured to allow ambient sounds outside the second hearing aid to reach the user's ear canal; A signal processing apparatus is adapted to generate a beamforming signal based on microphone signals provided by a first microphone device and / or a second microphone device, and is adapted to apply the beamforming signal to a first receiver and / or a second receiver, wherein the signal processing apparatus is adapted to generate an omnidirectional signal based on microphone signals provided by the first microphone device and / or the second microphone device, and wherein the signal processing apparatus is adapted to apply the beamforming signal to one of the first receiver and the second receiver and to apply the omnidirectional signal to the other of the first receiver and the second receiver; as well as A valve control device having an asymmetric mode, wherein, in the asymmetric mode, the valve control device is configured to asymmetrically control a first valve and a second valve by moving a first valve and a second valve to a position in which one of the first valve and the second valve is opened to a greater extent than the other of the first valve and the second valve, and wherein the valve control device is further configured, when in the asymmetric mode, such that a valve included in a hearing aid comprising a receiver to which an omnidirectional signal is applied is opened to a greater extent than a valve included in a hearing aid comprising a receiver to which a beamforming signal is applied.
2. The binaural hearing aid system according to claim 1, wherein, The omnidirectional signal is a bilateral omnidirectional signal based on the microphone signals provided by the first microphone device and the second microphone device.
3. The binaural hearing aid system according to claim 2, wherein, The microphone signal provided by the hearing aid, which includes a receiver to which a beamforming signal is applied, has a time delay relative to the microphone signal provided by the hearing aid, which includes a receiver to which an omnidirectional signal is applied, and then the two microphone signals are mixed to generate the bilateral omnidirectional signal.
4. The binaural hearing aid system according to claim 1, wherein, The beamforming signal is based at least on two or more microphone signals provided in response to an input sound, the input sound being provided by a microphone device included in a hearing aid that includes a receiver to which the beamforming signal is applied.
5. The binaural hearing aid system according to claim 2, wherein, The hearing aid system also includes an omnidirectional processing unit, which includes a first omnidirectional signal processor and a second omnidirectional signal processor; The first omnidirectional signal processor is disposed within the housing of a hearing aid that includes a receiver to which beamforming signals are applied, and is configured as follows: - Generate the first monoaural directional signal - The first monoaural directional signal is transmitted to a hearing aid including a receiver to which an omnidirectional signal is applied via a wired or wireless communication link; and The second omnidirectional signal processor is disposed within the housing of a hearing aid that includes a receiver to which an omnidirectional signal is applied, and is configured as follows: - Receive the first monoaural directional signal sent by another hearing aid via a wired or wireless communication link. - Generate a second monoaural directional signal and mix the first monoaural directional signal and the second monoaural directional signal at a fixed or adjustable ratio to generate a bilateral omnidirectional signal.
6. The binaural hearing aid system according to claim 5, wherein, The signal processing device and the omnidirectional processing device are included in the same processing unit.
7. The binaural hearing aid system according to claim 1, wherein, The signal processing device includes a first signal processing unit housed in the first hearing aid and a second signal processing unit housed in the second hearing aid.
8. The binaural hearing aid system according to claim 7, wherein, The first signal processing unit and the second signal processing unit operate in a master / slave configuration, with one signal processing unit sending control signals to the other signal processing unit.
9. The binaural hearing aid system according to claim 1, wherein, The valve control device is further configured to completely close the first valve when the second valve is open, and to completely close the second valve when the first valve is open.
10. The binaural hearing aid system according to claim 1, wherein, In response to the omnidirectional signal being applied to the receiver of the first hearing aid or the second hearing aid, the valve control device opens the valve of the first hearing aid or the second hearing aid, respectively; and / or In response to the beamforming signal being applied to the receiver of the first hearing aid or the second hearing aid, the valve control device closes the valve of the first hearing aid or the second hearing aid respectively.
11. The binaural hearing aid system according to claim 1, wherein, The first valve is further configured to open at least partially or close at least partially in response to a first valve control signal, and the second valve is further configured to open at least partially or close at least partially in response to a second valve control signal.
12. The binaural hearing aid system according to claim 1, wherein, The first sound channel is located in a portion of the user's ear canal during the use of the first hearing aid, and the second sound channel is located in a portion of the user's relative ear canal during the use of the second hearing aid.
13. The binaural hearing aid system according to claim 1, wherein, The valve control device is adapted to combine the asymmetric mode in response to the binaural hearing aid system entering a dialogue mode, the dialogue mode being entered at the user's request, or in response to the signal strength of the microphone signal from the first microphone device and / or the second microphone device exceeding a noise threshold.
14. A method for providing a beamforming signal at the left or right ear of a hearing aid user and a bilateral omnidirectional signal at the other ear of the hearing aid user; The method includes: - Generate bilateral or monoaural beamforming signals using a beamforming device based on two or more microphone signals provided by the microphone device of the hearing aid in the user's left or right ear; - Convert bilateral or monoaural beamforming signals into corresponding audible beamforming signals for the user's left or right ear. -A first monoaural directional signal is generated by an omnidirectional processing device based on one or more microphone signals provided by the microphone device of the hearing aid in the user's left or right ear; - A second monoaural directional signal is generated by an omnidirectional processing device based on one or more microphone signals provided by a microphone device relative to the hearing aid; - The first monoaural directional signal and the second monoaural directional signal are mixed at a fixed or adjustable ratio to generate the bilateral omnidirectional signal; - Convert the bilateral omnidirectional signal into a corresponding audible omnidirectional signal for the user's other ear, and - The valve control device performs the step of closing the valve in the user's left or right hearing aid; and opens the valve in the user's other hearing aid. Each valve is included in a sound channel in the hearing aid, and each sound channel is configured to allow ambient sounds from outside the hearing aid to reach the user's ear canal. The valve in a hearing aid that includes a receiver to which an omnidirectional signal is applied is opened more than the valve in a hearing aid that includes a receiver to which a beamforming signal is applied.