Binaural hearing aid system, hearing aid and method of operating a hearing aid and use

Abstract

A binaural hearing aid system and a hearing aid including self voice estimation are disclosed, wherein the binaural hearing aid system comprises a first and a second hearing aid, each comprising: at least one input transducer configured to pick up sound and to convert the sound into at least one electrical input signal; a controller for evaluating the sound at the at least one input transducer and for providing a control signal indicative of a characteristic of the sound; a transceiver configured to establish a communication link between the first and the second hearing aid; a transmitter for establishing an audio link for transmitting the at least one electrical input signal to another device; the controller being configured to: transmit a locally provided control signal, receive a corresponding remotely provided control signal from the contralateral hearing aid via the communication link, compare the locally provided control signal and the remotely provided control signal and provide a comparison control signal in dependence on the comparison, and transmit the at least one electrical input signal to the other device via the audio link in dependence on the comparison control signal.

Description

Technical Field

[0001] This application relates to the field of hearing aids, and more particularly to self-voice estimation in noisy environments, for example. Background Technology

[0002] Existing binaural hearing aid systems or self-voice estimation in hearing aids cannot meet the needs of telephone conversations, especially in noisy environments. Summary of the Invention

[0003] Binaural hearing aid system

[0004] In one aspect of this application, a binaural hearing aid system is provided, comprising first and second hearing aids configured to be worn, respectively, in or on a user's first and second ears. Each of the first and second hearing aids includes:

[0005] - At least one input converter configured to pick up sound at at least one input converter and convert the sound into at least one electrical input signal representing it, the sound at at least one input converter including a mixture of target signal and noise;

[0006] - A controller for evaluating sound at at least one input converter and providing control signals that specify the characteristics of said sound;

[0007] - A transceiver configured to establish a communication link between the first and second hearing aids, thereby enabling the exchange of the control signals between the first and second hearing aids;

[0008] - A transmitter used to establish an audio link that transmits at least one electrical input signal or a processed version thereof to another device.

[0009] The controller can be configured to:

[0010] - Transmit locally provided control signals;

[0011] - Receive corresponding remote control signals from the hearing aid on the other side via the communication link;

[0012] - Compare the locally provided control signal with the remotely provided control signal and provide a comparison control signal based on the comparison result; and

[0013] - Based on the comparison control signal, at least one electrical input signal or its processed version is transmitted to the other device via the audio link.

[0014] This can provide improved hearing aids.

[0015] At least one input converter may include at least one microphone.

[0016] At least one input converter may include at least two input converters that provide at least two electrical input signals. At least two input converters may include at least two microphones.

[0017] The first and second hearing aids may include beamforming filters connected to at least two input converters.

[0018] Beamformer filters may include self-voice beamformers configured to provide an estimate of a user's self-voice based on at least two electrical input signals. The self-voice beamformer may be implemented as a linear combination of at least two electrical input signals (IN1, IN2, …, INM, where M is the number of input converters). The estimate of the user's self-voice (OVE) can thus be expressed as: OVE = w1∙IN1 + w2∙IN2 + wM∙INM, where wm (in the frequency domain) is a (complex-valued) weight vector (wm(k) = (wm(1), wm(2), …, wm(K)), where K is the number of frequency bands), these weights may be fixed or adaptively updated, for example, to adapt to changing noise environments.

[0019] The characteristics of the sound include the signal-to-noise ratio (SNR). The first and second hearing aids may include an estimator for the quality parameters (such as SNR) of at least one electrical input signal or a processed version thereof. The controller may be configured to determine, based on the comparison control signal, whether to transmit at least one electrical input signal or a processed version thereof from a given hearing aid to "another device." The controller may also be configured to transmit at least one electrical input signal or a processed version thereof from the hearing aid exhibiting the highest SNR to "another device," such as a telephone.

[0020] The characteristics of the sound may include a noise level estimate or a level estimate of at least one electrical input signal. The first and second hearing aids may include estimators of the corresponding current noise levels at the first and second hearing aids. In an embodiment, the noise level is estimated in the absence of detected self-voice. The controller may be configured to transmit at least one electrical input signal or a processed version thereof from the hearing aid exhibiting the lowest noise estimate, or to transmit the lowest level estimate of at least one electrical input signal or a processed version thereof. The noise may include wind noise or may be constituted by wind noise. The characteristics of the sound may include a wind noise estimate. Each of the first and second hearing aids may include a wind noise estimator. Wind noise is generally unlikely to occur simultaneously in both ears (or at similar levels). The controller may be configured to transmit at least one electrical input signal or a processed version thereof from the hearing aid exhibiting the lowest wind noise.

[0021] The level estimate can be obtained in short time-frequency units, which are updated, for example, every millisecond or every two milliseconds.

[0022] The level estimate can be based on a mixture of some or all of the available microphone signals or their processed versions.

[0023] Because the lowest noise levels of different time-frequency units of different microphones or combinations of different microphones can be obtained, the resulting signal becomes a mixture of all microphone signals or their processed versions. However, this requires that binaural signals be available at the hearing aid that transmits the audio signal to the external device.

[0024] As an alternative, only the level estimate is exchanged between hearing aids to produce a (binary) gain mask, which selects the time-frequency unit with the minimum energy after binaural level comparison.

[0025] The controller can be configured to generate a (binary) gain mask based on level estimates at the first and second hearing aids.

[0026] The controller can be configured to generate a (binary) gain mask (binary gain mode) based on the comparison control signal.

[0027] The controller can be configured to transmit at least one electrical input signal or a processed version thereof via the audio link to the other device based on the comparison control signal and / or the (binary) gain mask.

[0028] The controller can be configured to transmit at least one electrical input signal or a processed version thereof to the contralateral hearing aid based on the comparison control signal and / or the (binary) gain mask.

[0029] The controller can be configured to attenuate, maintain, or enhance at least one electrical input signal or its processed version based on the comparison control signal and / or the (binary) gain mask (binary gain mode).

[0030] The characteristics of the sound may include a speech intelligibility estimate. Each of the first and second hearing aids may include a speech intelligibility estimator. The controller may be configured to transmit at least one electrical input signal or a processed version thereof from the hearing aid exhibiting the highest speech intelligibility metric.

[0031] The characteristics of the sound may include a feedback estimate. Each of the first and second hearing aids may include an estimator of the feedback from the output-to-input converter of the hearing aid in question. The controller may be configured to transmit at least one electrical input signal or a processed version thereof from the hearing aid exhibiting the lowest feedback estimate.

[0032] The beamformer filter may also include an ambient beamformer configured to provide an estimate of the target signal in the (far-field) environment (of the user).

[0033] A binaural hearing aid system (e.g., each of the first and second hearing aids) can be configured to operate in at least two modes: a normal mode and a self-voice mode. In the normal mode, the estimation of the target signal in the environment has a first priority, and in the self-voice mode, the estimation of the user's self-voice has a first priority. The binaural hearing aid system can be configured to prioritize processing capabilities according to the two operating modes. The binaural hearing aid system can be configured to apply adaptive noise reduction (and / or post-processing, neural network-based processing) in the self-voice beamformer when the binaural hearing aid system is in self-voice mode. On the other hand, the binaural hearing aid system can be configured to apply fixed beamforming in the environmental beamformer when the binaural hearing aid system is in self-voice mode.

[0034] Similarly, a binaural hearing aid system can be configured to apply adaptive noise reduction (and / or post-processing, neural network-based processing) in the ambient beamformer when the binaural hearing aid system is in normal mode. On the other hand, a binaural hearing aid system can be configured to apply fixed beamforming in the self-voice beamformer when the binaural hearing aid system is in normal mode. If the hearing aid is in normal mode, most of the processing is focused on ambient enhancement, with less (or no) processing power applied to pick up the self-voice signal (e.g., preprocessing for keyword detection). Conversely, if the hearing aid is in self-voice mode (e.g., telephone mode), it is proposed to modify the processing so that most of the processing power available for noise reduction is applied to the self-voice signal, with less processing applied to the local sound presented to the hearing aid wearer; see [link to relevant documentation]. Figure 9A , 9B In other modes where the primary signal of interest is not received by the hearing aid microphone, processing of changes in focus can be applied, such as during TV streaming, Bluetooth streaming, FM, or coaxial pickup streaming.

[0035] The first and second hearing aids of a binaural hearing aid system may consist of or include air conduction hearing aids, bone conduction hearing aids, cochlear implant hearing aids, or combinations thereof.

[0036] hearing aids

[0037] The present invention provides a hearing aid configured for wear by a user in or on their ear. The hearing aid includes:

[0038] - At least one input converter configured to pick up sound at at least one input converter and convert the sound into at least one electrical input signal representing it, the sound at at least one input converter including a mixture of target signal and noise;

[0039] - A controller for evaluating sound at at least one input converter and providing control signals that specify the characteristics of said sound;

[0040] - A transceiver configured to establish a communication link to the contralateral hearing aid in a binaural hearing aid system, thereby enabling the exchange of control signals between the two hearing aids;

[0041] - Transmitter, used to establish an audio link for transmitting at least one electrical input signal or a processed version thereof to another device;

[0042] The controller is configured as follows:

[0043] -- Transmit locally provided control signals;

[0044] -- Receive corresponding control signals provided from a distance from the hearing aid on the other side via the communication link;

[0045] -- Compare the locally provided control signal with the remotely provided control signal and provide a comparison control signal based on the comparison result; and

[0046] -- Based on the comparison control signal, at least one electrical input signal or its processed version is transmitted to the other device via the audio link.

[0047] The hearing aids can be used as the first and / or second hearing aids in the binaural hearing aid system according to the present invention. Each of the first and second hearing aids in the binaural hearing aid system can be implemented as the hearing aids described above and below.

[0048] The controller can be configured to evaluate an audio link used to transmit at least one electrical input signal or a processed version thereof to another device.

[0049] The controller can be configured to provide control signals that specify the quality of the audio link between the hearing aid and another device, such as a mobile phone.

[0050] The quality of an audio link can depend on the distance between the hearing aid and another device.

[0051] For example, when the distance between the first hearing aid and another device is shorter than the distance between the second hearing aid and another device, the quality of the audio link between the first hearing aid and the other device will most likely be better than the quality of the audio link between the second hearing aid and the other device.

[0052] The controller can be configured to:

[0053] - Transmit locally provided control signals;

[0054] - Receive corresponding remote control signals from the hearing aid on the other side via the communication link;

[0055] - Compare the locally provided control signal with the remotely provided control signal and provide a comparison control signal based on the comparison result; and

[0056] - Based on the comparison control signal, at least one electrical input signal or its processed version is transmitted to the other device via the audio link.

[0057] The controller can be configured to transmit at least one electrical input signal to the contralateral hearing aid and / or receive at least one electrical input signal from the contralateral hearing aid.

[0058] The controller can be configured to transmit at least one electrical input signal to the contralateral hearing aid based on the comparison control signal.

[0059] For example, consider a binaural hearing system with first and second hearing aids, and another device such as a mobile phone. An audio link (such as a wireless connection) may exist between each of the two hearing aids and the mobile phone. The quality of the audio link at one ear may be better than that at the other ear. In this case, it may be advantageous to transmit at least one electrical input signal from the hearing aid with the better audio link.

[0060] In another example, a binaural hearing system and a mobile phone, the controller can determine the hearing aid that best receives the user's voice based on an evaluation of the sound at each input transducer. However, the hearing aid that best receives the user's voice may not be the hearing aid with the best audio link to the mobile phone. Therefore, the electrical input signal may need to be transmitted via a communication link (e.g., via a magnetic link) from the hearing aid that best receives the user's voice to the hearing aid with the best audio link before being transmitted to the mobile phone.

[0061] Hearing aids may include batteries for powering the hearing aids.

[0062] The controller can be configured to evaluate the hearing aid's battery.

[0063] The controller can be configured to provide control signals that indicate the availability of battery power.

[0064] Battery power availability may include one or more of the following: current battery power consumption and / or remaining battery life and / or maximum power consumption, for example, based on a battery indicator or battery usage indicator.

[0065] The controller can be configured to:

[0066] - Transmit locally provided control signals;

[0067] - Receive corresponding remote control signals from the hearing aid on the other side via the communication link;

[0068] - Compare the locally provided control signal with the remotely provided control signal and provide a comparison control signal based on the comparison result; and

[0069] - Based on the comparison control signal, at least one electrical input signal or its processed version is transmitted to the other device via the audio link.

[0070] The controller can be configured to transmit at least one electrical input signal to the contralateral hearing aid and / or receive at least one electrical input signal from the contralateral hearing aid.

[0071] The controller can be configured to transmit at least one electrical input signal or a processed version thereof via the audio link to the other device in accordance with the comparison control signal.

[0072] For example, when considering a binaural hearing system with first and second hearing aids, the controller of the first hearing aid can transmit an electrical input signal or a processed version thereof to a mobile phone during a first telephone call, and the controller of the second hearing aid can transmit an electrical input signal or a processed version thereof to a mobile phone during a subsequent second telephone call. Thus, the power consumption during a telephone call is shared between the first and second hearing aids.

[0073] For example, when considering a binaural hearing system with first and second hearing aids, the controller of the first or second hearing aid can transmit an electrical input signal or a processed version thereof to a mobile phone based on the remaining battery life of the first or second hearing aid (e.g., during a first telephone call). Thus, the hearing aid with the longest remaining battery life can be used to transmit the electrical input signal.

[0074] For example, when considering a binaural hearing system with first and second hearing aids, the controller of the first or second hearing aid can transmit an electrical input signal, or a processed version thereof, to a mobile phone based on the current battery power consumption of the first and second hearing aids. For instance, a hearing aid user may have significantly greater hearing loss in one ear than the other, which could result in greater battery power consumption for the hearing aid used in the ear with greater hearing loss. Therefore, the hearing aid providing the minimum gain could be used to transmit the electrical input signal.

[0075] For example, when considering a binaural hearing system with first and second hearing aids, the controller of the first or second hearing aid may transmit an electrical input signal, or a processed version thereof, to a mobile phone based on maximum power consumption. Thus, for example, if the battery of the first hearing aid is at risk of approaching or exceeding its maximum power consumption, the electrical input signal should be transmitted by the controller of the second hearing aid.

[0076] The control signal may specify the characteristics of the sound at at least one input converter, and / or the quality of the audio link between the hearing aid and another device, and / or the battery power availability of the hearing aid battery.

[0077] Hearing aids may be adapted to provide frequency-varying gain and / or level-varying compression and / or frequency shifting (with or without frequency compression) from one or more frequency ranges to one or more other frequency ranges to compensate for a user's hearing loss. Hearing aids may include a signal processor for amplifying the input signal and providing a processed output signal.

[0078] Hearing aids may include an output unit for providing stimulation, perceived by the user as an acoustic signal, based on processed electrical signals. The output unit may include multiple electrodes of a cochlear implant (for CI-type hearing aids) or a vibrator of a bone conduction hearing aid. The output unit may include an output transducer. The output transducer may include a receiver (speaker) for providing the stimulation as an acoustic signal to the user (e.g., in acoustic (air conduction-based) hearing aids). The output transducer may also include a vibrator for providing the stimulation as mechanical vibrations of the skull to the user (e.g., in bone-attached or bone-anchored hearing aids).

[0079] Hearing aids may include an input unit for providing at least one electrical input signal representing sound. The input unit may include an input transducer, such as a microphone, for converting the input sound into an electrical input signal. The input unit may include a wireless receiver for receiving wireless signals that include or represent sound and providing an electrical input signal representing said sound. The wireless receiver may, for example, be configured to receive electromagnetic signals in the radio frequency range (3 kHz to 300 GHz). The wireless receiver may, for example, be configured to receive electromagnetic signals in the optical frequency range (e.g., infrared light 300 GHz to 430 THz or visible light such as 430 THz to 770 THz).

[0080] Hearing aids may include a directional microphone system connected to at least one electrical input signal and adapted to spatially filter sound from the environment, thereby enhancing a target sound source among multiple sound sources in the local environment of the user wearing the hearing aid. The directional system may be adapted to detect (e.g., adaptively detect) the direction from which a specific portion of the at least one electrical input signal originates. The directional system may be adapted to attenuate (e.g., adaptively attenuate) noise in the user's surrounding environment. This can be achieved, for example, in a variety of different ways described in the prior art. In hearing aids, microphone array beamformers are commonly used to spatially attenuate background noise sources. Many beamformer variations can be found in the literature. Minimum variance distortionless response (MVDR) beamformers are widely used in microphone array signal processing. Ideally, an MVDR beamformer keeps the signal from the target direction (also known as the line of sight) unchanged while attenuating sound signals (noise) from other directions to the greatest extent possible. A generalized sidelobe canceller (GSC) structure is an equivalent representation of an MVDR beamformer, offering computational and digital representation advantages over a direct implementation of the original form.

[0081] Hearing aids may include antenna and transceiver circuitry (such as a wireless receiver) for wirelessly receiving direct electrical input signals from another device, such as an entertainment device (e.g., a television), a communication device (e.g., a telephone), a wireless microphone, or another hearing aid. The direct electrical input signal may represent or include audio signals and / or control signals and / or information signals. Hearing aids may include demodulation circuitry for demodulating the received direct electrical input signal, thereby providing a direct electrical input signal representing audio signals and / or control signals, such as for setting operating parameters (e.g., volume) and / or processing parameters of the hearing aid. Generally, the wireless link established by the antenna and transceiver circuitry of the hearing aid can be of any type (including unidirectional or bidirectional). The wireless link can be established between two devices, such as between an entertainment device (e.g., a TV) and a hearing aid, or between two hearing aids, such as via a third intermediary device (e.g., a processing device, such as a remote control, smartphone, etc.). The wireless link can be used under power-limited conditions, for example because the hearing aid may be constituted or comprise a portable (typically battery-powered) device. Wireless links can be based on near-field communication, such as inductive links based on inductive coupling between the antenna coils of the transmitter and receiver sections. Wireless links can also be based on far-field electromagnetic radiation. Communication via a wireless link can be arranged according to specific modulation schemes, such as analog modulation schemes like FM (Frequency Modulation), AM (Amplitude Modulation), or PM (Phase Modulation), or digital modulation schemes like ASK (Amplitude Shift Keying) such as On-Key, FSK (Frequency Shift Keying), PSK (Phase Shift Keying) such as MSK (Minimum Frequency Shift Keying), or QAM (Quadrature Amplitude Modulation), etc.

[0082] Communication between the hearing aid and another device can be based on a type of modulation at frequencies above 100 kHz. Preferably, the frequency used to establish the communication link between the hearing aid and the other device is below 70 GHz, for example, in the range of 50 MHz to 70 GHz, for example, above 300 MHz, for example, in the ISM range above 300 MHz, for example, in the 900 MHz range, or in the 2.4 GHz range, or in the 5.8 GHz range, or in the 60 GHz range (ISM = Industrial, Scientific and Medical, such standardized ranges are defined, for example, by the International Telecommunication Union ITU). The wireless link can be based on standardized or proprietary technologies. The wireless link can be based on Bluetooth technology (such as Bluetooth Low Energy technology).

[0083] The communication link between the first and second hearing aids can be based on the inductive link described above.

[0084] An audio link used to transmit at least one electrical input signal or a processed version thereof to another device may be based on Bluetooth technology (such as Bluetooth Low Energy).

[0085] Hearing aids may include a forward or signal path between an input unit (such as an input converter, for example a microphone or microphone system and / or a direct electrical input (such as a wireless receiver)) and an output unit such as an output converter. A signal processor may be located in this forward path. The signal processor may be adapted to provide frequency-varying gain according to the user's specific needs. Hearing aids may include an analysis path having functionalities for analyzing the input signal (such as determining level, modulation, signal type, acoustic feedback estimate, etc.). Some or all of the signal processing of the analysis path and / or signal path may be performed in the frequency domain. Some or all of the signal processing of the analysis path and / or signal path may be performed in the time domain.

[0086] Analog electrical signals representing sound signals can be converted into digital audio signals during analog-to-digital (AD) conversion, where the analog signal is sampled at a predetermined sampling frequency or sampling rate f. s Perform sampling, f s For example, in the range from 8kHz to 48kHz (to suit specific application needs) at discrete time points t n (or n) Provide digital samples x n (or x[n]), each audio sample passes through a predetermined N b Bit represents the acoustic signal at t n The value of N at time b For example, in a range from 1 to 48 bits, such as 24 bits. Each audio sample therefore uses N. b Bit quantization (resulting in 2^n voltammetry of audio samples) Nb (Number of different possible values). The numerical sample x has 1 / f s The duration of the time, such as 50 μs, for f s = 20 kHz. Multiple audio samples can be arranged in time frames. A time frame can include 64 or 128 audio data samples. Other frame lengths can be used depending on the application.

[0087] Hearing aids may include analog-to-digital (AD) converters to digitize analog inputs (e.g., from an input converter such as a microphone) at a predetermined sampling rate such as 20 kHz. Hearing aids may also include digital-to-analog (DA) converters to convert digital signals into analog output signals, for example, for presentation to the user via an output converter.

[0088] Hearing aids, such as input units and / or antenna and transceiver circuitry, include a time-frequency (TF) conversion unit for providing a time-frequency representation of the input signal. The time-frequency representation may include an array or mapping of corresponding complex or real values ​​of the signal in question over a specific time and frequency range. The TF conversion unit may include a filter bank for filtering the (time-varying) input signal and providing multiple (time-varying) output signals, each output signal encompassing a distinctly different frequency range of the input signal. The TF conversion unit may include a Fourier transform unit for converting the time-varying input signal into a (time-varying) signal in the (time-frequency) domain. The hearing aid considers a frequency range starting from the minimum frequency f. min up to the maximum frequency f max The frequency range can include a portion of the typical human hearing range from 20Hz to 20kHz, such as a portion of the range from 20Hz to 12kHz. Typically, the sampling rate f... s Greater than or equal to the maximum frequency f max twice that, i.e., f s ≥ 2f max The signals from the forward and / or analytical pathways of the hearing aid can be divided into NI (e.g., uniformly wide) frequency bands, where NI is, for example, greater than 5, greater than 10, greater than 50, greater than 100, or greater than 500, and at least some of these bands are processed individually. The hearing aid may be adapted to process the signals from the forward and / or analytical pathways (NP ≤ NI) on NP different channels. The channels may have consistent or inconsistent widths (e.g., width increases with frequency), and may overlap or not overlap.

[0089] Hearing aids can be configured to operate in different modes, such as a normal mode and one or more specific modes, which may be user-selectable or automatically selectable. Operating modes can be optimized for specific acoustic conditions or environments. Operating modes may include a low-power mode, in which the hearing aid's functionality is reduced (e.g., for energy saving), such as disabling wireless communication and / or disabling specific features of the hearing aid. Operating modes may include a telephone mode, which facilitates hands-free communication between the hearing aid and the user's telephone. Another operating mode may be a voice control mode, in which the user can control the functions of the hearing aid (or another device) by speaking commands.

[0090] Hearing aids may include multiple detectors configured to provide status signals relating to the hearing aid's current network environment (such as the current acoustic environment), and / or the current state of the user wearing the hearing aid, and / or the current state or operating mode of the hearing aid. Alternatively or additionally, one or more detectors may form part of an external device that communicates with the hearing aid (e.g., wirelessly). External devices may include, for example, another hearing aid, a remote control, an audio transmission device, a telephone (e.g., a smartphone), external sensors, etc.

[0091] One or more of a plurality of detectors can operate on full-band signals (time domain). One or more of a plurality of detectors can operate on band-split signals ((time-)frequency domain), for example, in a finite number of frequency bands.

[0092] Multiple detectors may include level detectors for estimating the current level of the signal in the forward path. Detectors may be configured to determine whether the current level of the signal in the forward path is higher or lower than a given (L-) threshold. Level detectors operate on full-band signals (time domain). Level detectors operate on band-split signals ((time-)frequency domain).

[0093] Hearing aids may include a voice activity detector (VAD) for estimating whether (or with what probability) an input signal (at a specific point in time) includes a voice signal. In this specification, a voice signal may include speech signals from humans. It may also include other forms of vocalization produced by the human speech system (such as singing). The voice activity detector unit may be adapted to classify the user's current acoustic environment as a "voice" or "no-voice" environment. This has the advantage that time periods including electrophonic signals of human vocalizations (such as speech) in the user's environment can be identified and thus separated from time periods that include only (or primarily) other sound sources (such as artificially generated noise). The voice activity detector may be adapted to also detect the user's own voice as "voice." Alternatively, the voice activity detector may be adapted to exclude the user's own voice from the detection of "voice."

[0094] Hearing aids may include a self-voice detector for estimating whether (or with what probability) a particular input sound (such as speech) originates from the user of the hearing aid system. The microphone system of the hearing aid may be adapted to distinguish between the user's own voice and the voice of another person, and possibly between the user's own voice and the voiceless sound.

[0095] Multiple detectors may include motion detectors, such as accelerometers. Motion detectors may be configured to detect movements of a user's facial muscles and / or bones, such as those caused by speech or chewing (e.g., jaw movements), and provide detector signals indicating those movements.

[0096] The hearing aid may include a classification unit configured to classify the current situation based on input signals from (at least partially) a detector and possibly other inputs. In this specification, "current situation" may be defined by one or more of the following:

[0097] a) Physical environment (including the current electromagnetic environment, such as the presence of electromagnetic signals (including audio and / or control signals) that are planned or unplanned to be received by the hearing aid, or other properties of the current environment that differ from acoustics);

[0098] b) Current acoustic conditions (input level, feedback, etc.); and

[0099] c) The user's current mode or state (movement, temperature, cognitive load, etc.);

[0100] d) The current mode or state of the hearing aid and / or another device communicating with the hearing aid (selected program, time elapsed since the last user interaction, etc.).

[0101] The classification unit may be based on or include a neural network, such as a trained neural network.

[0102] Hearing aids may include acoustic (and / or mechanical) feedback control (such as suppression) or echo cancellation systems. Hearing aids may also include other suitable functions for the application in question, such as compression, noise reduction, etc.

[0103] Hearing aids may include hearing instruments, such as hearing instruments adapted to be located at the user's ear or wholly or partially in the ear canal, such as headphones, headsets, ear protection devices, or combinations thereof.

[0104] application

[0105] On the one hand, applications of the hearing aids described in detail in the "Detailed Description" section and as defined in the claims are provided. Applications can be provided in systems including one or more hearing aids (such as hearing instruments), headphones, headsets, active ear protection systems, etc., such as hands-free telephone systems, remote conferencing systems, etc.

[0106] method

[0107] In one aspect, this application further provides a method for operating a hearing aid configured to be worn on or in a user's ear. The method includes:

[0108] - Convert sound into at least one electrical input signal representing it, wherein the sound at at least one input converter includes a mixture of the target signal and noise;

[0109] - Evaluate the sound at at least one input converter and provide control signals that specify the characteristics of the sound;

[0110] - Establish a communication link to the contralateral hearing aid in the binaural hearing aid system, thereby enabling the exchange of control signals between the two hearing aids;

[0111] - Establish an audio link to transmit at least one electrical input signal or a processed version thereof to another device;

[0112] - Transmit locally provided control signals;

[0113] - Receive corresponding remote control signals from the hearing aid on the other side via the communication link;

[0114] - Compare the locally provided control signal with the remotely provided control signal and provide a comparison control signal based on the comparison result; and

[0115] - Based on the comparison control signal, at least one electrical input signal or its processed version is transmitted to the other device via the audio link.

[0116] When appropriately replaced by a corresponding process, some or all of the structural features of the system described above, in detail in the "Detailed Description," or as defined in the claims can be combined with the implementation of the method of the present invention, and vice versa. The implementation of the method has the same advantages as the corresponding system.

[0117] Hearing system

[0118] On the other hand, hearing aids and hearing systems including assistive devices are provided, including those described above, described in detail in the "Detailed Description" section, and defined in the claims.

[0119] Hearing systems can be adapted to establish a communication link between hearing aids and assistive devices so that information (such as control and status signals, possibly audio signals) can be exchanged or forwarded from one device to another.

[0120] Auxiliary devices may include remote controls, smartphones, or other portable or wearable electronic devices such as smartwatches.

[0121] The assistive device may consist of or include a remote control for controlling the functions and operation of the hearing aid. The remote control functions are implemented in a smartphone, which may run an app that enables the control of audio processing devices via the smartphone (the hearing aid includes a suitable wireless interface to the smartphone, such as Bluetooth or some other standardized or proprietary solution).

[0122] The assistive device may be constituted by or include an audio gateway device, which is adapted to receive multiple audio signals (e.g., from an entertainment device such as a TV or music player, from a telephone device such as a mobile phone, or from a computer such as a PC) and to select and / or combine appropriate signals (or combinations of signals) from the received audio signals to transmit to the hearing aid.

[0123] The assistive device may consist of or include another hearing aid. The hearing system may include two hearing aids suitable for implementing a binaural hearing system, such as a binaural hearing aid system.

[0124] APP

[0125] On the other hand, the present invention also provides a non-transitory application called an APP. An APP includes executable instructions configured to run on an assistive device to implement a user interface for the hearing aid or hearing system described above, in detail in the "Detailed Description," and as defined in the claims. The APP can be configured to run on a mobile phone, such as a smartphone, or another portable device enabled to communicate with said hearing aid or hearing system.

[0126] Another hearing aid

[0127] On the other hand, the present invention provides a hearing aid configured for wear by a user in or on their ear. The hearing aid includes:

[0128] - At least two input converters configured to pick up sound at at least two input converters and convert the sound into at least two electrical input signals representing it;

[0129] - A first filter for filtering at least two electrical input signals and providing a first filtered signal;

[0130] - Output converter for converting a first filtered signal or a signal derived therefrom into a stimulus that can be perceived by the user as sound;

[0131] - A second filter is used to filter at least two electrical input signals and provide a second filtered signal, which includes a current estimate of the user’s own voice;

[0132] - Transceiver, used to establish an audio link to external communication devices (such as telephones);

[0133] - A controller configured to enable the hearing aid to operate in at least two modes: a communication mode and at least one non-communication mode, in which an audio link to an external communication device is established in the communication mode;

[0134] - Each of the first and second filters is configured to operate in a higher power mode and a lower power mode according to the controller;

[0135] - wherein the controller is configured to, when the hearing aid is in the communication mode

[0136] -- Set the first filter to a lower power consumption mode; and

[0137] -- Set the second filter to the higher power consumption mode.

[0138] Alternatively, or as an alternative, the controller can be configured to operate when the hearing aid is in non-communication mode:

[0139] -- Set the first filter to a higher power consumption mode; and

[0140] -- Set the second filter to a lower power consumption mode.

[0141] The controller can provide mode control signals that specify the planned operating mode.

[0142] When the (first or second) filter is in "higher power mode", it consumes more power (e.g., more than twice as much) than when it is in "lower power mode".

[0143] Each of the first and second filters may include a beamformer filter for providing a spatially filtered (beamforming) signal based on at least two electrical input signals (e.g., a linear combination of at least two electrical input signals according to general complex beamformer weights). The beamformer filter may be adaptive, wherein noise is adaptively attenuated (adaptively determining beamformer weights). The beamformer filter may also be adaptive in the direction of adaptively estimating the target signal (adaptively determining beamformer weights). The beamformer filter may be fixed (beamformer weights predetermined).

[0144] Each of the first and second filters may include a post-filter for filtering the spatially filtered (beamforming) signal and providing a signal with further noise reduction.

[0145] When the first or second filter is in a high-power mode, the beamformer weights of the beamformer filter are adaptively determined (and continuously updated). When the first or second filter is in a high-power mode, the post-filter can be enabled.

[0146] When the first or second filter is in low-power mode, the beamformer weights of the beamformer filter are predetermined (not continuously updated). When the first or second filter is in low-power mode, the subsequent filters can be disabled.

[0147] definition

[0148] In this specification, "hearing aid" as a hearing instrument refers to a device suitable for improving, enhancing, and / or protecting a user's hearing ability, which achieves this by receiving sound signals from the user's environment, generating corresponding audio signals, possibly modifying the audio signals, and providing the possibly modified audio signals as audible signals to at least one of the user's ears. The audible signals may be provided, for example, as sound signals radiating into the user's outer ear, sound signals transmitted as mechanical vibrations through the bone structures of the user's head and / or through parts of the middle ear to the user's inner ear, and electrical signals transmitted directly or indirectly to the user's cochlear nerve.

[0149] Hearing aids can be configured to be worn in any known manner, such as as a unit worn behind the ear (having a tube that directs radiated sound signals into the ear canal or having an output transducer, such as a speaker, arranged close to or located within the ear canal), as a unit wholly or partially arranged in the auricle and / or ear canal, as a unit connected to a fixed structure implanted in the skull, such as a vibrator, or as a connectable unit that is wholly or partially implanted. Hearing aids may include a single unit or several units that communicate with each other (e.g., acoustically, electrically, or optically). The speaker may be housed within the housing along with other components of the hearing aid, or it may be an external unit (possibly combined with a flexible guiding element such as a dome-shaped element).

[0150] More generally, a hearing aid includes an input transducer for receiving sound signals from the user's environment and providing a corresponding input audio signal, and / or a receiver for receiving the input audio signal electronically (i.e., wired or wirelessly); a (typically configurable) signal processing circuitry (such as a signal processor, for example including a configurable (programmable) processor, such as a digital signal processor) for processing the input audio signal; and an output unit for providing an audible signal to the user based on the processed audio signal. The signal processor may be adapted to process the input signal in the time domain or in multiple frequency bands. In some hearing aids, amplifiers and / or compressors may constitute the signal processing circuitry. The signal processing circuitry typically includes one or more (integrated or separate) storage elements for executing programs and / or for storing parameters used (or potentially used) in the processing and / or for storing information suitable for the hearing aid's functionality and / or for storing information used, for example, in conjunction with an interface to the user and / or an interface to a programming device (such as processed information, for example, provided by the signal processing circuitry). In some hearing aids, the output unit may include an output transducer, such as a loudspeaker for providing airborne sound signals or a vibrator for providing sound signals propagating through structures or fluids. In some hearing aids, the output unit may include one or more output electrodes for providing electrical signals that electrically stimulate the cochlear nerve (e.g., to a multi-electrode array) (cochlear implant hearing aids).

[0151] In some hearing aids, the vibrator may be adapted to transmit structurally propagated sound signals to the skull transdermally or through the skin. In some hearing aids, the vibrator may be implanted in the middle ear and / or inner ear. In some hearing aids, the vibrator may be adapted to provide structurally propagated sound signals to the middle ear bones and / or cochlea. In some hearing aids, the vibrator may be adapted to provide fluid-propagated sound signals to the cochlear fluid, for example, through the oval window. In some hearing aids, the output electrode may be implanted in the cochlea or on the medial side of the skull and may be adapted to provide electrical signals to the hair cells of the cochlea, one or more auditory nerves, the auditory brainstem, the auditory midbrain, the auditory cortex, and / or other parts of the cerebral cortex.

[0152] Hearing aids can be adapted to the specific needs of users, such as those with hearing loss. The configurable signal processing circuitry of a hearing aid can be adapted to apply frequency- and level-variable compression and amplification of the input signal. Customized frequency- and level-variable gain (amplification or compression) can be determined during the fitting process by the fitting system based on the user's hearing data, such as an audiogram, using basic fitting principles (e.g., speech adaptation). This frequency- and level-variable gain can be reflected, for example, in processing parameters, uploaded to the hearing aid via an interface to a programming device (fitting system), and used by a processing algorithm executed by the hearing aid's configurable signal processing circuitry.

[0153] A “hearing system” refers to a system that includes one or two hearing aids. A “binaural hearing system” refers to a system that includes two hearing aids and is adapted to work together to provide audible signals to both of a user’s ears. A hearing system or a binaural hearing system may also include one or more “assistive devices” that communicate with the hearing aids and influence and / or benefit from the functionality of the hearing aids. The aforementioned assistive devices may include at least one of the following: a remote control, a remote microphone, an audio gateway device, an entertainment device such as a music player, a wireless communication device such as a mobile phone (e.g., a smartphone), or a tablet computer, or another device, such as one that includes a graphical interface. Hearing aids, hearing systems, or binaural hearing systems may be used, for example, to compensate for hearing loss in individuals with hearing impairments, enhance or protect the hearing ability of individuals with normal hearing, and / or transmit electronic audio signals to a person. Hearing aids or hearing systems may, for example, be part of or interact with broadcasting systems, active ear protection systems, hands-free telephone systems, car audio systems, entertainment systems (such as TV, music playback, or karaoke), teleconferencing systems, classroom amplification systems, etc.

[0154] The present invention can be used, for example, in applications such as hands-free calling, keyword detection, and voice control. Attached Figure Description

[0155] Various aspects of the invention will be best understood from the following detailed description taken in conjunction with the accompanying drawings. For clarity, these drawings are schematic and simplified, showing only the details necessary for understanding the invention while omitting other details. Throughout the specification, the same reference numerals are used for the same or corresponding parts. Features of each aspect may be combined with any or all features of other aspects. These and other aspects, features, and / or technical effects will be apparent from and illustrated in the following figures, wherein:

[0156] Figure 1 A hearing aid according to the present invention, in a configuration favorable for telephone conversation, is shown;

[0157] Figure 2 The illustration shows a hearing aid user wearing a binaural hearing aid system according to the invention in a first mode of telephone conversation in asymmetrically distributed background noise.

[0158] Figure 3 The illustration shows a hearing aid user wearing a binaural hearing aid system according to the invention in a second mode of telephone conversation in asymmetrically distributed background noise.

[0159] Figure 4 A first embodiment of a binaural hearing aid system according to the present invention, comprising first and second hearing aids, is shown in telephone mode, wherein a telephone conversation is conducted with a person at a distance.

[0160] Figure 5 A second embodiment of a binaural hearing aid system according to the present invention, comprising first and second hearing aids, is shown in telephone mode, wherein a telephone conversation is conducted with a person at a distance.

[0161] Figure 6 An adaptive (self-voice) beamformer configuration is shown, where the adaptive beamformer Ŝ of the k-th sub-band is... ov (k) is created by subtracting (e.g., fixed) target cancellation beamformer C2(k) from (e.g., fixed) omnidirectional beamformer C1(k) by means of an adaptive factor β(k);

[0162] Figure 7 It shows the relationship with Figure 6 The similar adaptive (self-voice) beamformer configuration shown here, wherein the adaptive beam pattern Ŝ ov (k) is created by subtracting the target elimination beamformer C2(k) converted by the adaptive factor β(k) from another fixed beam pattern C1(k);

[0163] Figure 8 A hearing device in a telephone configuration is shown;

[0164] Figure 9A and 9B A scheme for managing processing within a hearing device according to its operating mode is shown, wherein Figure 9A The normal operating mode is shown. Figure 9B The phone's operating mode is shown;

[0165] Figure 10A A binaural hearing aid system including first and second hearing aids is shown, wherein binaural audio signals are combined; and

[0166] Figure 10B Another binaural hearing aid system is shown, which includes first and second hearing aids, wherein binaural audio signals are combined.

[0167] The further applicability of the invention will become apparent from the detailed description given below. However, it should be understood that while the detailed description and specific examples illustrate preferred embodiments of the invention, they are given for illustrative purposes only. Other embodiments of the invention will become apparent to those skilled in the art based on the following detailed description. Detailed Implementation

[0168] The detailed description below, taken in conjunction with the accompanying drawings, serves as a description of various different configurations. This detailed description includes specific details to provide a thorough understanding of several different concepts. However, it will be apparent to those skilled in the art that these concepts can be implemented without these specific details. Several aspects of the apparatus and method are described by various different blocks, functional units, modules, elements, circuits, steps, processes, algorithms, etc. (collectively, “elements”). Depending on the specific application, design constraints, or other reasons, these elements may be implemented using electronic hardware, computer programs, or any combination thereof.

[0169] Electronic hardware may include microelectromechanical systems (MEMS), (e.g., application-specific integrated circuits), microprocessors, microcontrollers, digital signal processors (DSPs), field-programmable gate arrays (FPGAs), programmable logic devices (PLDs), gating logic, discrete hardware circuits, printed circuit boards (PCBs) (e.g., flexible PCBs), and other suitable hardware configured to perform the various functions described in this specification, such as sensors for sensing and / or recording the physical properties of the environment, devices, users, etc. Computer programs should be interpreted broadly as instructions, instruction sets, code, code segments, program code, programs, subroutines, software modules, applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, programs, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description languages, or other names.

[0170] Figure 1 A hearing aid according to the invention, in a configuration favorable for telephone conversation, is illustrated. The hearing aid user is presented with a mixture SO of local sound SI and the speech REMV of the distant speaker CP, while the distant listener CP is presented with audio obtained from the hearing aid microphones (M1, M2). The hearing aid microphone signals (IN1, IN2) may be amplified (DSP) to present the hearing aid user's speech UV, wherein noisy background sound SI has been reduced.

[0171] Figure 2 The illustration depicts a hearing aid user wearing a binaural hearing aid system according to the invention, in a first mode of telephone conversation amidst asymmetrically distributed background noise. Hearing instruments (hearing aids, headphones, wearable devices) are used for the telephone conversation, such that the voice (OV) of the hearing aid wearer (U) is picked up by the hearing instrument, which may be amplified and transmitted via telephone to a distant listener. This is in... Figure 1 As shown in the diagram, the audio signal REMV from the distant speaker CP is transmitted directly from the telephone through the hearing aids (HA1, HA2) to the ear canal of the person wearing the hearing aid, U. For the telephone conversation to continue, it is important that both speakers are comprehensible. To enhance the signal transmitted to the distant listener, background noise can be suppressed, for example, using a self-voice beamformer, with the goal of minimizing noise while preserving the self-voice. The self-voice can be further enhanced using a self-voice filter. Typically, signal enhancement is performed locally at one of the hearing aids, which then transmits the enhanced signal to the telephone. In some cases, such as... Figure 2 As shown, one hearing instrument (HA2) is exposed to more background noise than another hearing instrument (HA1) (in this case, due to noise sources such as a baby crying). In this situation, the enhanced audio signal transmitted by the hearing instrument (HA1), which is exposed to less background noise (e.g., due to the head shadow effect), will be better. This is in Figure 3 As shown in the image.

[0172] Figure 3 The illustration depicts a hearing aid user wearing a binaural hearing aid system according to the present invention, in a second mode of telephone conversation amidst asymmetrically distributed background noise. The second telephone conversation mode is... Figure 2 The first mode shown is similar, but compared to the first mode which picks up the user's voice UV at Ear2, the second mode picks up the user's voice UV at the contralateral Ear1. By transmitting (potentially enhanced) audio signal OV from a hearing instrument (HA1) exposed to minimal background noise, a more intelligible signal can be presented to the distant speaker.

[0173] By utilizing two hearing aids (HA1, HA2), a better estimate of the user's self-voice (OV) can be obtained. To realize the full potential of the two hearing aids, combining the microphone signals from both would be advantageous. This would require transmitting the microphone signal from one hearing aid to the other (relatively positioned) hearing aid, which would then transmit the (potentially) linear combination of the microphone signals to the distant speaker via telephone. However, transmitting audio signals from one hearing aid (e.g., HA1) to another (e.g., HA2) is expensive (in terms of power consumption). Alternatively, the enhanced signals (OV1, OV2) from both hearing aids (HA1, HA2) are transmitted to the telephone, which then combines the signals from the left and right hearing aids into a single enhanced signal. However, this solution is difficult because fully utilizing the signal processing capabilities of different telephones (e.g., different brands) is not always possible.

[0174] Figure 1 , 4 And 5 show the pair Figure 2 An exemplary embodiment of the solution to the problem shown. Figure 1 , 3 Figures 4 and 5 show hearing aids in telephone operation mode. Figure 1 ) and binaural hearing aid systems ( Figure 3-5 In this system, the user engages in telephone conversations with a distant communication partner (CP) via a corresponding telephone and, for example, the Public Switched Telephone Network (PSTN). The user's hearing aid HA and the first and second hearing aids (HA1, HA2) of the binaural hearing aid system serve as the audio interface to the user's telephone device (in this case, a mobile phone, such as a smartphone). Figure 1 As shown, the electrical input signals (S1, S2) branch from the forward (audio) path of the hearing aid and are processed in a processor (such as a digital signal processor, DSP) to provide an estimate of the user's self-voice. ov The user transmits their own voice (e.g., wirelessly, via a wireless link (WL), see OV) to another device, where it is transmitted to a telephone device, and when in telephone operation mode, it can be transmitted from that telephone device to the telephone device of a remotely connected communication partner CP.

[0175] In other embodiments (operating modes), the user's self-voice (OV) can be transmitted to a personal digital assistant, such as a smartphone or similar device, for example, to provide an audio interface to a search engine or cloud service, for example, for keyword detection, speech recognition, sound source separation, or other tasks.

[0176] exist Figure 1 , 4 In the telephone operation mode shown in Figure 5, the hearing aid receives audio input from the user's telephone, representing a message from a distant communication partner (CP). The distant voice REMV is received by the appropriate transceiver circuitry in the hearing aid and transmitted as a signal S. REM The signal is forwarded to the combination unit CU, such as the summation unit "+" located in the forward (audio) path. The forward (audio) path includes a processor (e.g., a digital signal processor, DSP) for applying one or more processing algorithms to the electrical input signals (S1, S2), such as beamforming, noise reduction, compression (e.g., to compensate for the user's hearing loss), and for providing a processed signal PS representing sound received from the environment SI via the input transducer (in this case, the microphone) (M1, M2) of the hearing aid. The processed signal PS can be combined with a signal S including sound received from a remote telephone device. REM (For example, including the voice of the communication partner CP) is mixed, for example, added. The resulting (combined) signal OUT is fed to the output converter of the hearing aid, in this case, the speaker SPK, which is configured to convert the output signal OUT into an acoustic stimulus (sound) SO propagated to the user's ear. Thus, a hands-free audio interface to the user's telephone device is established, see, for example, US20150163602A1.

[0177] Figure 4 A first embodiment of a binaural hearing aid system according to the present invention, comprising first and second hearing aids, is shown in telephone mode, wherein a telephone conversation is conducted with a person at a distance. Each of the first and second hearing aids (HA1, HA2) includes... Figure 1 Functional elements of the embodiment. Based on locally estimated background noise level (e.g., background noise level estimate, SNR estimate (e.g.)) Figure 4 (as shown in the diagram), speech intelligibility estimate, sound quality, or simply level estimate, can be used to select a hearing instrument (HA1 or HA2) with the best self-speech estimate quality and transmit the self-speech audio from it to a remote listener via telephone.

[0178] At the left and right hearing instruments (HA1, HA2), the local self-voice enhancement algorithm runs in the processor DSP. However, in principle, the enhancement algorithm is not necessary for the proposed method. Furthermore, the SNR estimator (SNR) in each hearing instrument is configured to estimate the local (self-voice) signal-to-noise ratio, which can be exchanged between the first and second hearing instruments (HA1, HA2) via an interaural link, such as a wireless link (see the dashed arrows denoted as SNR1 (from HA1 to HA2) and SNR2 (from HA2 to HA1)). The SNR values ​​(SNR1 and SNR2) are compared in the corresponding controller C&S RxTx in each hearing instrument, with the self-voice signal estimate (SNR1) from the hearing instrument with the highest signal-to-noise ratio being... ov1 , Ŝ ov2 (This can be selected for audio transmission to the phone.) Figure 4 and 5 In the example, the best quality self-voice signal estimate is the self-voice signal estimate provided by the first hearing instrument HA1. As a result, the self-voice signal estimate Ŝ of the first hearing instrument HA1... ov1 The signal is transmitted from HA1 to the user's telephone equipment, see the Z-shaped arrow (denoted as OV1) from the unit (C&S Rx / Tx) of the first hearing aid HA1 to the user's telephone equipment. Each controller (C&S Rx / Tx) includes a comparator for comparing the characteristics (in this case, SNR) of the two electrical input signals from the local and contralateral hearing aids (or, as shown here, the self-voice estimate (Ŝ)). ov1 , Ŝ ov2The controller is configured to provide a control signal indicating which of the first and second hearing instruments has the best self-voice estimate, based on a criterion related to the compared characteristic (the characteristic being SNR, and the criterion being, for example, the maximum SNR). Each controller (C&S Rx / Tx) also includes appropriate transceiver circuitry Rx / Tx to enable the exchange of characteristics of the electrical input signal (the signal or the signal derived therefrom, in this case, the SNR of the beamformed self-voice signal) between the two hearing instruments. The signal received from a distant communication partner CP via the user's telephone (e.g., via the PSTN telephone network) (via a wireless link, such as Bluetooth or Bluetooth Low Energy (or similar)) is transmitted to the hearing aid, for example, the hearing instrument (here, HA1) transmitting the user's self-voice to the telephone, or both hearing instruments (HA1, HA2), see “REMV” for the receiver Rx from the telephone to the corresponding hearing instrument (HA1, HA2). The distant signal is received in the hearing instrument via the corresponding wireless receiver Rx, and the corresponding audio signal S REM The signals are extracted and forwarded to the combination unit (CU), and then mixed with, for example, the processed ambient signals (PS1, PS2) from the forward audio path to form output signals (OUT1, OUT2). The output signals (OUT1, OUT2) are then presented to the user via the output converter (SPK) of the hearing aid in question.

[0179] "Tele-selection" refers to choosing which of the first and second hearing instruments has the best self-voice estimate based on criteria related to the characteristics being compared, which can be based on how well each hearing instrument is mounted (or how well it is affected by this). This can be measured, for example, by measuring the tilt of the hearing instruments with an accelerometer. If the microphone array direction is at a small angle relative to the mouth, better self-voice pickup is expected (the worst case is when the microphone direction is perpendicular to the mouth direction).

[0180] Since the self-voice level (due to the symmetry of the head and ears relative to the mouth) is similar at both hearing instruments, a (simpler) measure other than the SNR estimate can be applied for comparison and selection, such as a noise level estimate (selecting the hearing instrument with the lowest noise estimate), or simply a level estimate (selecting the hearing instrument with the lowest level estimate, for example, measured during the absence of OV, and / or, for example, measured when the distant speaker is active).

[0181] As alternatives to SNR, local speech intelligibility estimates or speech quality estimates can be used as selection criteria. To enable possible switching of the transmitting hearing device as inaudibly as possible, the switching can be performed simultaneously with the speaker speaking at the far end.

[0182] Figure 5A second embodiment of a binaural hearing aid system according to the present invention, comprising first and second hearing aids, is shown in telephone mode, wherein a telephone conversation is conducted with a person at a distance. Figure 5 Binaural hearing aid system implementation examples and Figure 4 The embodiments are similar, but include more functional elements, which will be described in detail below. The input units IU of the corresponding first and second hearing aids (HA1, HA2) MIC Input sound at s in1 , s in2 The M electrical input signals S corresponding to the first and second hearing aids are picked up by M input converters such as microphones. 11 , …, S 1M and S 21 , …, S 2M The signal is supplied to the beamformer filter. The electrical input signal of each hearing aid can be represented in time-frequency order (k, n) and passed through a corresponding (M) analysis filter bank (see [reference]). Figure 6 , 7 The "filter bank" in the input unit IU, for example MIC (where k and n are the frequency and time exponents, respectively). The beamformer filter includes an ambient beamformer (BF) and a self-voice beamformer (OVBF). The ambient beamformer (BF) provides spatially filtered ambient signals. env (k,n), for example, an estimate of the target signal in the user's (far-field) environment. The self-voice beamformer (OVBF) provides an estimate of the spatial filtering of the user's self-voice. ov (k,n).

[0183] Each of the first and second hearing aids includes a positive audio processing path for processing the acoustic signals picked up by the input unit and for presenting them to the user (at least in normal operating mode) via the output converter OT, preferably an enhanced version, for example, to be better perceived by the user (e.g., speech intelligibility). Figure 5 In this embodiment, the forward audio processing path is assumed to operate in the frequency domain (k,n). The forward audio processing path includes an ambient beamformer (BF) and a selector-mixer (SEL-MIX) connected to the ambient beamformer. The selector-mixer is configured to enable the processing of ambient signals. env (k,n) (or its processed version) and another signal (here, the signal S received from an external device such as a telephone) and REM Mixing. Output signal from selector-mixer SEL-MIX. x (k,n) represent the two input signals (Ŝ) in the corresponding hearing aids (HD1, HD2). env (k,n),S REMThe weighted combination of signals from the selector-mixer SEL-MIX. x (k,n) can be equal to one of the input signals or equal to a mixture of two input signals (e.g., Ŝ x (k,n)=α Ŝ env (k,n) + (1-α) S REM , 0 ≤ α ≤ 1, for example in each of the first and second hearing aids (HA1, HA2). In telephone mode, the weighting factor α may be less than 0.5 (e.g. ≤ 0.8), such that the maximum weight is given to the audio signal received at a distance. In normal (non-communication) mode, the weighting factor α may be equal to 1, such that only the ambient sound signal is weighted. env (k,n) propagates in the forward audio processing path. The selector-mixer SEL-MIX is controlled by the mode control signal "mode". The forward audio processing path may also include a processor HAG for applying one or more processing algorithms to the input signal (Ŝ). x1 (k,n), Ŝ x2 (k,n)) and provides processed (enhanced) output signals (OUT1, OUT2). One or more processing algorithms may include compression amplification algorithms configured to compensate for the user's hearing impairment (e.g., applying a gain that varies with frequency and level to the input signal of the processor HAG). The forward path may also include a synthesis filter bank FBS configured to convert the frequency domain signal (OUT1, OUT2) into a time domain signal (out1, out2). The time domain output signals (out1, out2) are fed to the respective output converters of the first and second hearing aids (HA1, HA2) to present as a stimulus that can be perceived as sound to the user of the binaural hearing aid system. The output converter OT may include a speaker of an air conduction hearing aid, a vibrator of a bone conduction hearing aid, and / or a multi-electrode array of a cochlear implant hearing aid. Figure 5 In the embodiments, the output converters OT of the first and second hearing aids are assumed to provide output sound s at the user's first and second ears, respectively. out1 and s out2 .

[0184] The self-voice beamformer (OVBF) is configured to respond to the electrical input signal (S) of the corresponding hearing aid (HA1, HA2). 11 ,…, S 1M and S 21 , …, S 2M Provides an estimate of the user's own voice (Ŝ ov1 (k,n), Ŝ ov2(k,n)). An estimate of the user's own speech (or a further processed version thereof, such as with further noise reduction) is fed into a synthesis filter bank FBS, which is used to synthesize the sub-band signal (Ŝ ov1 (k,n), Ŝ ov2 (k,n) is converted into the time-domain signal (ŝ) in the corresponding first and second hearing aids (HA1, HA2). ov1 (t), ŝ ov2 (t), where t is time). The time-domain representation of the self-voice estimate is fed to the transmitter section ATx of the audio transceiver and transmitted to the external device according to the comparison control signals (CTx1, CTx2) (see Figure 5 The “self-voice audio” from HA2 to the telephone (see the thick solid line Z-shaped arrow) is shown below.

[0185] Each of the first and second hearing aids may include a controller (CTR1, CTR2) configured to evaluate one or more electrical input signals (S) of the first and second hearing aids. 11 , …, S 1M and S 21 , …, S 2M (or its processed (e.g., filtered) version) (See the signal S from the self-voice beamformer OVBF to the controllers (CTR1, CTR2) of the first and second hearing aids) x -P1 and S x -P2) and evaluate the input unit IU MIC The system provides control signals (PCT1, PCT2) that specify the characteristics of the sound (such as SNR or noise level). The controllers (CTR1, CTR2) can also be configured to control (e.g., enable, disable) the self-voice beamformer OVBF (see signals CBF1, CBF2) according to an operating mode controlled by a mode control signal. The self-voice beamformer for a specific hearing aid can be disabled when an estimate of the user's self-voice is not needed (e.g., in telephone mode for transmitting to the user or in voice control mode for forwarding to the voice control interface).

[0186] Each of the first and second hearing aids may include a transceiver IARx / IATx configured to establish an interaural communication link IA-WL between the first and second hearing aids (HA1, HA2), thereby enabling the exchange of control signals (PCT1, PCT2) between the first and second hearing aids. Each of the first and second hearing aids may transmit locally provided control signals (PCT1, PCT2) to the contralateral hearing aid and receive corresponding remotely provided control signals (PCT3, PCT1) from the contralateral hearing aid via the interaural communication link IA-WL. The controllers (CTR1, CTR2) of the first and second hearing aids may be configured to compare the locally provided control signals and the remotely provided control signals (PCT1, PCT2) and provide comparison control signals (CTx1, CTx2) based on the comparison result.

[0187] Each of the first and second hearing aids (HA1, HA2) may include an audio transceiver (ATx, ARx) for establishing an audio link, the audio link being used to transmit audio signals such as self-voice estimates (Ŝ ov1 (k,n), Ŝ ov2 (k,n)) or its processed version is transmitted to another device, such as a telephone. The first and second hearing aids (HA1, HA2) are configured to control the transceiver (at least the transmitter portion ATx) according to comparison control signals (CTx1, CTx2). Controllers (CTR1, CTR2) can be enabled or disabled according to mode control signals indicating the current operating mode (e.g., telephone mode or normal (non-communication) mode). Controllers (CTR1, CTR2) can be configured to provide mode control signals indicating the expected current operating mode, for example, based on one or more detectors or external inputs (e.g., requests from the telephone) or based on inputs from the user interface. In telephone operating mode, audio from a distant communication partner can be received by the first and / or second hearing aids (HA1, HA2) via the user's telephone, see “Distant Audio” from the telephone to the receiver ARx (thick solid Z-shaped arrow) of the second hearing aid HA2 and, not necessarily, to the receiver ARx (thick dashed Z-shaped arrow) of the first hearing aid HA1.

[0188] The first and second hearing aids (HA1, HA2) of a binaural hearing aid system are configured to operate in at least two modes, such as a communication mode (e.g., telephone mode), a non-communication mode (e.g., normal mode), and / or a voice control mode, for example, controlled by a mode control signal. The mode control signal may be provided via a user interface (e.g., a remote control, such as via an app embedded in a smartphone or similar device). The mode control signal may be provided automatically as a result of one or more detectors or sensors or other control signals. The first and second hearing aids may be configured to receive a mode control signal from a telephone, for example, indicating an incoming call. The mode control signal, such as an incoming call indicator, may cause the first and second hearing aids to enter a communication mode, where a selector / mixer is controlled to select an input signal SREM from a distant speaker (or to mix that signal with an ambient signal from the first and second hearing aids). ENV1 (k,n), Ŝ ENV2 (k,n)) mixture).

[0189] Each of the first and second hearing aids (HA1, HA2) may also include a keyword detector (KWD-VCT) with a voice control interface, allowing the user to influence the hearing aid's function through a limited number of specific spoken commands (see Signal CHA). The keyword detector receives an estimate of the user's own speech (Ŝ ov1 (k,n), Ŝ ov2 (k,n)). The voice control interface is enabled when controlling the voice control operating mode. The keyword detector / voice control interface KWD-VCT provides control signals CHA to the processor HAG, for example, to change the hearing aid program, such as changing the operating mode (e.g., entering telephone mode), changing the volume, etc. Keyword detection in hearing aids is discussed, for example, in EP3726856A1.

[0190] Figure 6 and 7 Examples of adaptive beamformer configurations are shown, which can be used in, for example, applications according to the invention. Figure 5 The sound capture device shown includes a self-voice beamformer (OVBF). Figure 6 and 7 All examples show a dual-microphone configuration, commonly used in hearing devices such as hearing aids (or other sound capture devices) at the current level of technological advancement. However, these beamformers can be based on more than two microphones, for example, more than three microphones (e.g., as a linear array, or possibly configured in a non-linear manner). For a given frequency band k, the adaptive beam pattern Ŝ ov(k) is obtained by linearly combining two beamformers C1(k) and C2(k). Each of C1(k) and C2(k) (time exponents have been omitted for simplicity) represents a different (possibly fixed) linear combination of the first and second electrical input signals X1 and X2 from the first and second microphones M1 and M2, respectively. The first and second electrical input signals X1 and X2 are provided by corresponding analysis filter banks (“filter banks”). The frequency domain signals (downstream of the corresponding analysis filter banks) are indicated by thick arrows, while the time domain properties of the outputs of the first and second microphones (M1, M2) are indicated by thin arrows. Figure 6 and 7 The module F-BF (indicated by the dashed rectangle) refers to a so-called fixed beamformer that provides beamforming signals C1(k) and C2(k) respectively, which uses multiple sets of composite constants w1 = (w 11 , w 12 ) and w2 = (w 21 , w 22 )definition.

[0191] Figure 6 An adaptive beamformer configuration is shown, where the adaptive beamformer Ŝ of the k-th sub-band is... ov (k) is created by subtracting (e.g., fixed) target cancellation beamformer C2(k) from (e.g., fixed) omnidirectional beamformer C1(k) using an adaptive factor β(k). The adaptive factor β can be determined, for example, as:

[0192]

[0193] Figure 6 The two beamformers C1 and C2 are, for example, orthogonal. However, this is not actually necessary. Figure 7 The beamformers are not orthogonal. When beamformers C1 and C2 are orthogonal, uncorrelated noise will be attenuated when β = 0.

[0194] exist Figure 6 The (reference) beam pattern C1(k) is an omnidirectional beam pattern. Figure 7 The (reference) beam pattern C1(k) in the image is a beamformer with zero beams in the opposite direction to C2(k). Multiple other fixed beam patterns C1(k) and C2(k) can also be used.

[0195] Figure 7 It shows the relationship with Figure 6 The adaptive beamformer configuration shown is similar to the one with the adaptive beam pattern Ŝ ov(k) is created by subtracting the target-cancelling beamformer C2(k), which has been converted by an adaptive factor β(k), from another fixed beam pattern C1(k). This set of beamformers is not orthogonal. Figure 6 and 7 C2 in the context indicates that in the case of a self-voice cancellation beamformer, β will increase when self-voice is present.

[0196] A beam pattern can be, for example, a combination of an omnidirectional delay-sum beamformer C1(k) and a delay-subtraction beamformer C2(k) with its zero direction pointing towards the target (e.g., the mouth of a person wearing the device, i.e., a target-cancelling beamformer). Figure 6 As shown; or, it can be as shown in the image. Figure 7 The two delay-and-subtract beamformers shown have one beamformer C1(k) having maximum gain in the target direction, and the other beamformer C2(k) being a target-cancelling beamformer. Other combinations of beamformers can also be applied. Preferably, the beamformers should be orthogonal, i.e., w1w2 H = Adaptive beammaps utilize complex-valued, frequency-varying conversion factors, such as adaptively updated ones. The target elimination beamformer C2(k) is obtained by subtracting it from C1(k), i.e.

[0197]

[0198]

[0199] in , According to Figure 6 Or a complex beamformer weight of 7, The input signals are at both microphones (after filter bank processing).

[0200] exist Figure 6 and 7 In the context of, the fixed reference beamformer C1= Fixed target cancellation beamformer C2= ,in and For complex beamformer weights, for example, they are predetermined and stored in memory (or updated occasionally during use). This represents the (current) electrical input signal at both microphones (after filter bank processing).

[0201] Example of controlling beamformer processing

[0202] The following describes a method for selecting beamforming using a limited amount of processing.

[0203] consider Figure 8 Hearing devices such as hearing aids or headphones. Figure 8 A hearing device in a telephone configuration is shown. The user of the hearing device is listening to ambient sounds (PS) and the voice of a distant speaker (S). REM The mixed OUT. The remote speaker prefers to hear the user's own voice from the hearing device. ov The background noise has been attenuated.

[0204] In other words, the hearing device HA preferably processes two different sound streams:

[0205] - A stream of sound will be presented to the user of the hearing device, which includes the voice of the distant speaker. REM Mixed with ambient sound (signal PS) that may be noise-reduced;

[0206] - Another audio stream is presented to the distant speaker, primarily consisting of the hearing device wearer's own voice. ov Preferably, a beamformer OVBF has been used to attenuate background noise.

[0207] Figure 8 The hearing device embodiment is equivalent to Figure 1 The embodiments shown may represent hearing aids (earphones in communication operation mode or normal operation mode). Figure 1 The processor DSP in Figure 8 These are denoted as BF-NR and OVBF, respectively. BF-NR represents an ambient beamformer noise reduction system (e.g., a post-filter following a beamformer filter). OVBF represents a self-voice beamformer noise reduction system (e.g., a post-filter following a beamformer filter).

[0208] Enhancing sound by removing noise requires processing power. Adaptive beamformers, for example, may require more processing power than fixed beamformers. Therefore, we need to strike a balance between performance and processing power.

[0209] In a typical hearing aid, the speech enhancement system may include a directional microphone unit following a noise reduction system. This directional system may include an adaptive beamformer that adaptively attenuates noise while keeping the target sound unchanged. An example of such a beamformer is the MVDR beamformer. Compared to a fixed beamformer, an adaptive beamformer can adapt to noise (and sometimes even the direction of the target signal). In the special case where the hearing aid microphone is used as the input signal for telephone conversation, the hearing aid may be able to process the microphone signal into two output signals, each with a different purpose. One output contains the sound to be presented to the person wearing the hearing aid (the local signal), and the other output contains the sound to be presented to a distant listener (the distant signal). In most cases (e.g., in hearing aids), the local signal is the most important sound, and the main processing power should be applied to the local signal to achieve the best possible balance between the sound of interest and background noise. However, in the telephone situation, the situation is different. If the hearing aid wearer's speech is incomprehensible, telephone conversation is impossible. Therefore, the most important signals are: a) the distant signal presented to the hearing aid user, and b) the hearing aid wearer's voice presented to the distant listener. During telephone conversations, the local signal is less important. It is typically presented to the hearing aid wearer at a reduced level, which does not reduce the intelligibility of the distant speaker, but only makes the hearing aid wearer aware of surrounding signals.

[0210] To best utilize processing power, this paper proposes prioritizing processing capabilities (e.g., adaptive noise reduction, post-processing, neural network-based processing, etc.) based on the operating mode of the hearing device. If the hearing device (e.g., a hearing aid) is in normal mode, most of the processing is focused on enhancing the surrounding environment, with less (or no) processing power applied to picking up self-voice signals (e.g., pre-processing for keyword detection). Conversely, if the hearing device is in telephone mode, the paper proposes altering the processing so that most of the processing power available for noise reduction is applied to self-voice signals, with less processing applied to the local sound presented to the hearing aid wearer. The proposed processing scheme... Figures 9A-9B As shown in the image.

[0211] Figure 9A and 9B A scheme for managing the processing in a hearing device according to the device's operating mode is shown.

[0212] Figure 9A and 9BThis embodies the general concept of a hearing aid configured for wear by a user in or on their ear. The hearing aid includes at least two input transducers configured to pick up sound at the at least two input transducers and convert the sound into at least two electrical input signals representing the sound. The hearing aid also includes first and second filters for filtering the at least two electrical input signals and providing first and second filtered signals, respectively. The hearing aid also includes an output transducer for converting the first filtered signal or a signal derived therefrom into a stimulus that can be perceived as sound by the user. A second filter is configured such that the second filtered signal includes a current estimate of the user's own speech. The hearing aid also includes a transceiver for establishing an audio link to an external communication device (such as a telephone). The hearing aid may also include a controller configured to enable the hearing aid to operate in at least two modes: a communication mode and at least one non-communication mode, in which an audio link to an external communication device is established. The first and second filters may be configured to operate in a higher power mode and a lower power mode according to the controller. The controller can be configured to, when the hearing aid is in the communication mode, a) set the first filter to a lower power consumption mode, and b) set the second filter to a higher power consumption mode. Alternatively, the controller can be configured to, when the hearing aid is in a non-communication mode, c) set the first filter to a higher power consumption mode, and d) set the second filter to a lower power consumption mode.

[0213] Figure 9A This illustrates an operational mode (e.g., for a hearing aid) where an adaptive beamformer is applied to local processing (see module BF-NR, which implements an adaptive beamformer and provides a noise-reduced version of the target signal PS in the hearing aid environment; see also...). Figure 6 , 7 The target signal is a signal in the environment, such as a signal in the user's line of sight (the direction of the microphone of the hearing device). On the other hand, the self-voice beamformer (module "fixed OVBF-NR") relies on a fixed self-voice enhancement beamformer (see signal Ŝ'). ov This is because the estimate of the user's self-voice is used to assist processing, such as preprocessing for self-voice keyword detection (see Unit KWD). In the case of a fixed (e.g., self-voice) beamformer, the weights are estimated based on a fixed noise distribution, for example, to maximize directivity or to maximize the ratio between the OV colliding within a certain near-field angle range and the omnidirectional far-field noise.

[0214] Figure 9B The diagram illustrates a telephone operating mode (e.g., a hearing aid or a headset in normal mode) where an adaptive beamformer is applied to enhance the user's self-voice (see the module OVBF-NR that provides an enhanced self-voice estimate, see Signal Ŝ).ov On the other hand, a fixed beamformer (or, as an alternative, a signal from only a single microphone, see module "Fixed BF-NR") is used to process the local signal (see the resulting processed signal PS'), which is presented to the user along with the signal from the distant source, since the primary signal of interest to the hearing instrument user is the signal from the distant speaker.

[0215] In other modes where the primary signal of interest is not received by the microphone of the hearing instrument, the change in focus can be processed. Such scenarios include, for example, TV streaming, Bluetooth streaming, FM or coaxial streaming, see EP3637800A1 for example.

[0216] Figure 10A A binaural hearing aid system including first and second hearing aids is shown, wherein binaural audio signals are combined.

[0217] exist Figure 10A The image illustrates a binaural hearing aid system worn by a hearing aid user U. The binaural hearing aid system may include first and second hearing aids, each hearing aid including a first hearing aid microphone M1. Each of the first and second hearing aids in the binaural hearing aid system may include a level estimator LVL, and one or both of the first and second hearing aids may include a comparison unit COMP. The level estimator may measure the level of the mixed signal or the level of a noise estimate (e.g., the level of a target cancellation beamformer), but since the level of the target signal is assumed to be similar in both ears, a level directly measured on the mixed signal is preferred.

[0218] The level can typically be measured in dB (or in the logarithmic domain). Alternatively, the level can be calculated directly from the magnitude or the square of the magnitude signal (the actual level is irrelevant; only comparisons are needed to find the minimum). The level can be based on a single sample (e.g., per millisecond) or can be measured as an average across several samples, for example, by filtering across the time axis using a first-order IIR low-pass filter with a time constant. In one embodiment, the time constant is 0 milliseconds. In another embodiment, the time constant is less than 5 milliseconds.

[0219] The illustrated diagram shows a case with a single microphone in each ear, but more local microphones can be used (e.g., two or more microphones in the first and / or second hearing aids shown in the diagram above). The selection of local microphones can be done in a similar manner to that illustrated in the diagram, where the microphone with the lowest level (or a linear combination of microphones) is selected.

[0220] exist Figure 10AIn this context, it is assumed that an audio signal (such as an electrical input signal) can be transmitted to a hearing aid, which is selected to transmit a self-enhanced voice signal to an external device such as a mobile phone. The selection criterion for choosing which hearing aid will transmit the audio signal to the external device may be based, for example, on the link quality between each hearing aid and the external device (which may be different from (and independent of) the binaural link quality).

[0221] Based on noise level measurements / estimates of the audio signals (in the time-frequency band) from both hearing aids, the time-frequency band can be selected such that the audio signal with the lowest noise level is chosen. Thus, a binary gain pattern (BGP) can be generated for each of the first and second hearing aids. It can be assumed that, due to the similar and symmetrical distance of the mouth relative to microphone M1, the self-voice signal will be similar in the first and second hearing aids.

[0222] The combining unit of a binaural hearing aid system can provide combined audio signals based on time-frequency bands in a binary gain graph (BGP), where the audio signal with the lowest noise level in each time-frequency band is selected. The resulting signals can be synthesized back into a time-domain signal and transmitted to an external device.

[0223] Therefore, binaural hearing aid systems can combine binaural audio signals to reduce, for example, wind noise.

[0224] Figure 10B Another binaural hearing aid system is shown, comprising first and second hearing aids, wherein binaural audio signals are combined. For use with... Figure 10A Similar features are shown in the figures and are labeled with similar reference numerals.

[0225] exist Figure 10B In this method, only the noise level (estimated by the Level Estimator (LVL)) is exchanged between the first and second hearing aids. Compared to transmitting the complete audio signal between the two hearing devices, exchanging noise levels only between the two ears requires less binaural transmission bandwidth.

[0226] Noise levels can be compared (by the comparison unit COMP in each of the first and second hearing aids) to select / generate two binary gain maps (BGPs), which can be configured to attenuate the time-frequency unit with the highest local noise level after comparison.

[0227] The corresponding binary gain maps (BGPs) of the first and second hearing aids can be applied to the local audio signal, allowing the corresponding audio signal to be attenuated or maintained / enhanced according to the BGP. The synthesized audio signal from the two hearing aids can then be transmitted to an external device (such as a mobile phone), where the audio signals from the first and second hearing aids can be combined, for example, by simple addition.

[0228] Alternatively, the local microphone signal can be directly transmitted to an external device, where similar processing steps can occur. However, the external device may not be able to perform the proposed processing steps, so it may be advantageous to perform most of the processing in the hearing aid before transmitting the audio signal to the external device.

[0229] When appropriately replaced by a corresponding process, the structural features of the apparatus described above, in detail in the "Detailed Description" section, and as defined in the claims can be combined with the steps of the method of the present invention.

[0230] Unless explicitly stated otherwise, the singular forms “a” and “the” used herein include the plural forms (i.e., meaning “at least one”). It should be further understood that the terms “having,” “comprising,” and / or “including” as used in the specification indicate the presence of the stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or combinations thereof. It should be understood that, unless explicitly stated otherwise, when an element is referred to as “connected” or “coupled” to another element, it may be a direct connection or coupling to the other element, or there may be intermediate inserting elements. The term “and / or” as used herein includes any and all combinations of one or more of the listed related items. Unless explicitly stated otherwise, the steps of any method disclosed herein do not necessarily have to be performed in the exact order disclosed.

[0231] It should be understood that references to "an embodiment," "an embodiment," "an aspect," or "may" in this specification mean that a particular feature, structure, or characteristic described in connection with that embodiment is included in at least one embodiment of the invention. Furthermore, particular features, structures, or characteristics may be suitably combined in one or more embodiments of the invention. The foregoing description is provided to enable those skilled in the art to implement the various aspects described herein. Various modifications will be apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects.

[0232] The claims are not limited to the aspects shown herein, but encompass the full scope consistent with the language of the claims, wherein, unless expressly stated, an element referred to in the singular does not mean "one and only one," but rather "one or more." Unless expressly stated, the term "some" means one or more.

[0233] References

[0234] ·US20150163602A1 (Oticon) 11.06.2015;

[0235] ·EP3637800A1 (Oticon) 15.04.2020;

[0236] ·EP3726856A1 (Oticon) 21.10.2020.

Claims

1. A binaural hearing aid system comprising first and second hearing aids configured to be worn on or in a user's first and second ears, respectively, each of the first and second hearing aids comprising: - At least one input converter configured to pick up sound at at least one input converter and convert the sound into at least one electrical input signal representing it, the sound at at least one input converter including a mixture of target signal and noise; - A controller for evaluating sound at at least one input converter and providing control signals that specify the characteristics of said sound; - A transceiver configured to establish a communication link between the first and second hearing aids, thereby enabling the exchange of the control signals between the first and second hearing aids; - Transmitter, used to establish an audio link for transmitting at least one electrical input signal or a processed version thereof to another device; The controller is configured as follows: -- Transmit locally provided control signals; -- Receive corresponding remote control signals from the hearing aid on the other side via the communication link; -- Compare the sound characteristics indicated by the locally provided control signal and the remotely provided control signal, and determine which control signal has better sound characteristics based on the criteria related to the compared sound characteristics; and -- Transmitting at least one electrical input signal or its processed version from a hearing aid that provides control signals with better sound characteristics to the other device via the audio link.

2. The binaural hearing aid system according to claim 1, wherein, The at least one input converter includes at least two input converters that provide at least two electrical input signals.

3. The binaural hearing aid system according to claim 2, wherein, The first and second hearing aids include beamforming filters connected to the at least two input converters.

4. The binaural hearing aid system according to claim 3, wherein, The beamformer filter includes a self-voice beamformer configured to provide an estimate of the user's self-voice based on the at least two electrical input signals.

5. The binaural hearing aid system according to claim 1, wherein, The characteristics of sound include the signal-to-noise ratio.

6. The binaural hearing aid system according to claim 1, wherein, The characteristics of sound include noise level estimates or at least a level estimate of an electrical input signal.

7. The binaural hearing aid system according to claim 1, wherein, The characteristics of sound include speech intelligibility estimates.

8. The binaural hearing aid system according to claim 1, wherein, The characteristics of sound include feedback estimates.

9. The binaural hearing aid system according to claim 4, wherein, The beamformer filter also includes an environmental beamformer configured to provide an estimate of the target signal in the environment.

10. The binaural hearing aid system according to any one of claims 1-9, wherein, The binaural hearing aid system is configured to operate in at least two modes: a normal mode and a self-voice mode, wherein in the normal mode the estimation of the target signal in the environment has a first priority, and in the self-voice mode the estimation of the user's self-voice has a first priority.

11. The binaural hearing aid system according to any one of claims 1-9, wherein, Each of the first and second hearing aids consists of an air conduction hearing aid, a bone conduction hearing aid, a cochlear implant hearing aid, or a combination thereof.

12. The binaural hearing aid system according to any one of claims 1-9, wherein, Each of the first and second hearing aids includes an air conduction hearing aid, a bone conduction hearing aid, a cochlear implant hearing aid, or a combination thereof.

13. A hearing aid configured for wear by a user in or on their ear, the hearing aid comprising: - At least one input converter configured to pick up sound at at least one input converter and convert the sound into at least one electrical input signal representing it, the sound at at least one input converter including a mixture of target signal and noise; - A controller for evaluating sound at at least one input converter and providing control signals that specify the characteristics of said sound; - A transceiver configured to establish a communication link to the contralateral hearing aid in a binaural hearing aid system, thereby enabling the exchange of control signals between the two hearing aids; - Transmitter, used to establish an audio link for transmitting at least one electrical input signal or a processed version thereof to another device; The controller is configured as follows: -- Transmit locally provided control signals; -- Receive corresponding remote control signals from the hearing aid on the other side via the communication link; -- Compare the sound characteristics indicated by the locally provided control signal and the remotely provided control signal, and determine which control signal has better sound characteristics based on the criteria related to the compared sound characteristics; and -- Transmitting at least one electrical input signal or its processed version from a hearing aid that provides control signals with better sound characteristics to the other device via the audio link.

14. A method of operating a hearing aid configured to be worn on or in a user's ear, the method comprising: - Convert sound into at least one electrical input signal representing it, wherein the sound at at least one input converter includes a mixture of the target signal and noise; - Evaluate the sound at at least one input converter and provide control signals that specify the characteristics of the sound; - Establish a communication link to the contralateral hearing aid in the binaural hearing aid system, thereby enabling the exchange of control signals between the two hearing aids; - Establish an audio link to transmit at least one electrical input signal or a processed version thereof to another device; - Transmit locally provided control signals; - Receive corresponding remote control signals from the hearing aid on the other side via the communication link; - Compare the sound characteristics indicated by the locally provided control signal and the remotely provided control signal, and determine which control signal has better sound characteristics based on the criteria related to the compared sound characteristics; and - Transmit at least one electrical input signal or its processed version from one side of the hearing aid that provides a control signal with better sound characteristics to the other device via the audio link.

15. The application of the hearing aid according to claim 13 in a binaural hearing aid system.

Images