Hearing device with adaptive delay and related methods

Abstract

A hearing device is disclosed. The hearing device comprises an interface and a processor. The hearing device is configured to obtain a microphone input signal from a microphone of the hearing device. The hearing device is configured to obtain a transceiver input signal from a transceiver of the interface. The hearing device is configured to determine a time offset between the microphone input signal and the transceiver input signal. The hearing device is configured to determine a time delay based on the time offset. The hearing device is configured to process the transceiver input signal for providing an output signal, wherein processing the transceiver input signal comprises applying the time delay to the transceiver input signal for providing a delayed transceiver input signal. The hearing device is configured to provide the output signal to a receiver of the hearing device for providing an audio output signal.

Description

Technical Field

[0001] This disclosure relates to a hearing device and related methods including a method of operating the hearing device. Specifically, a hearing device and method utilizing adaptive delay (e.g., for determining time delay) are proposed. Background Technology

[0002] Hearing devices, such as those that receive wireless audio broadcasts via microphones, have attracted more attention. Summary of the Invention

[0003] However, challenges remain, as the broadcast audio is also received by the microphone, typically with a time offset, leading to distortion in processing and playback.

[0004] Therefore, there is a need for improved hearing devices and methods for processing and playing back streaming audio.

[0005] A hearing device is disclosed, comprising an interface and a processor (e.g., a first hearing device). The hearing device may also be represented as a first hearing device and is configured to, for example, receive a microphone input signal from a microphone of the hearing device. The (first) hearing device is configured to, for example, receive a transceiver input signal from a transceiver of the interface. The (first) hearing device is configured to: determine a time offset between the microphone input signal and the transceiver input signal. The (first) hearing device (e.g., the processor) is configured to: determine a time delay based on the time offset. The (first) hearing device (e.g., the processor) is configured to: process the transceiver input signal for providing an output signal. Processing the transceiver input signal may include: applying a time delay to the transceiver input signal for providing a delayed transceiver input signal. The (first) hearing device (e.g., the processor) is configured to: provide an output signal to a receiver of the hearing device, for example, for providing an audio output signal. The time delay may be determined as aligning the audio output signal with, for example, an acoustic input signal and / or a microphone input signal received by a microphone.

[0006] A method for operating a hearing device is also disclosed. The hearing device (e.g., a first hearing device) includes an interface and a processor. The method includes, for example, obtaining a microphone input signal from a microphone of the hearing device. The method also includes, for example, obtaining a transceiver input signal from a transceiver of the interface. The method includes, for example, determining a time offset between the microphone input signal and the transceiver input signal using the processor. The method includes, for example, determining a time delay based on the time offset using the processor. The method includes, for example, processing the transceiver input signal using the processor to provide an output signal. Processing the transceiver input signal may include applying a time delay to the transceiver input signal to provide a delayed transceiver input signal. The method may optionally include providing an output signal to a receiver of the hearing device to provide an audio output signal. The time delay may be determined to align the audio output signal with the acoustic input signal.

[0007] The acoustic input signal can be ambient sound (also known as background noise), natural sound, and / or sound from the surrounding atmosphere.

[0008] This avoids the need for a preset time delay to account for any estimated delays involved in wireless audio broadcasting from, for example, a microphone, since the time delay is determined by the hearing device. If there are variations in the wireless audio broadcasting and the acoustic input signal, the hearing device adjusts the time delay accordingly (i.e., adaptively, e.g., substantially in real time) by determining the time delay to align the audio output signal with the acoustic input signal.

[0009] A hearing system is also disclosed, comprising a first hearing device and a second hearing device. The first hearing device may be the (first) hearing device disclosed herein. The second hearing device may be the (second) hearing device disclosed herein. Attached Figure Description

[0010] The above and other features and advantages of this disclosure will become apparent to those skilled in the art from the following detailed description of exemplary embodiments of this disclosure with reference to the accompanying drawings, wherein:

[0011] Figure 1 An exemplary hearing system is schematically shown.

[0012] Figure 2 A flowchart of the example method is shown.

[0013] Figure 3 An exemplary hearing system according to this disclosure is illustrated schematically.

[0014] Figure 4 An exemplary hearing system according to this disclosure is illustrated schematically. Detailed Implementation

[0015] Various exemplary embodiments and details are described below with reference to the accompanying drawings when relevant. It should be noted that the drawings may be drawn to scale or not, and elements with similar structure or function are indicated by the same reference numerals throughout the drawings. It should also be noted that the drawings are intended only to facilitate the description of embodiments. They are not intended as an exhaustive description of the invention or a limitation on the scope of the invention. Furthermore, the illustrated embodiments need not possess all the aspects or advantages shown. Aspects or advantages described in conjunction with a particular embodiment are not necessarily limited to that embodiment and may be practiced in any other embodiment even if not thus shown or so explicitly described.

[0016] A hearing device is disclosed. The hearing device can be configured to be worn on a user's ear. The hearing device can be a hearing aid. The hearing device can be a hearing device, wherein a processor is configured to compensate for the user's hearing loss, for example, based on one or more input signals (e.g., transceiver input signals).

[0017] In one or more examples, the hearing device can be an earplug, headphones, or a hearing aid, etc.

[0018] Hearing devices can be of the following types: behind-the-ear (BTE), in-the-ear (ITE), in-the-canal (ITC), in-the-canal (RIC), in-the-ear (RITE), or in-the-ear microphone and receiver (MaRIE). Hearing devices can be binaural hearing devices. Binaural hearing devices can be part of a binaural hearing system. A binaural hearing system can include a first hearing aid and a second hearing aid, wherein the first hearing aid and / or the second hearing aid can be the hearing devices disclosed herein.

[0019] Hearing devices include an interface and a processor. Hearing devices may also include memory.

[0020] A hearing device / interface can be configured for wireless communication with one or more audio devices (also referred to as audio sources) and one or more hearing devices (e.g., contralateral hearing devices). The hearing device / interface can also be configured for wireless communication with one or more accessory devices (e.g., tablets, laptops, smartphones, and / or smartwatches). Therefore, the hearing device / interface may include a transceiver and / or a transceiver module. Accessory devices may operate, are, and / or function as audio devices. The hearing device / interface / transceiver module may optionally include an antenna for converting one or more wireless input signals (e.g., a first wireless input signal and / or a second wireless input signal) into an antenna output signal. The wireless input signals may include or represent audio data (e.g., first audio data and / or second audio data). In other words, the audio data may be encoded in the wireless input signals. Wireless input signals may originate from external audio sources (e.g., audio devices such as spouse microphone devices, wireless TV audio transmitters, music players, cars, doorbells, mobile phones, smartwatches, and wireless audio transmitters such as those found in airports, train stations, stadiums, cinemas, shopping malls, lectures, during religious services (e.g., in churches), and / or arenas)). Wireless input signals may originate from one or more accessory devices. The term "spouse microphone" is used herein to refer to a microphone (typically a directional microphone) positioned at a distance from the hearing device worn by the hearing device user (i.e., the spouse microphone is not located within the hearing device). The spouse microphone will typically be worn by the hearing device user's spouse or placed on a surface (e.g., a table in front of the spouse) to capture sound (e.g., speech, voice, talking, or conversation from the spouse) for wireless transmission to the hearing device user's hearing device. The person whose voice or speech is captured by the spouse's microphone can be the user's spouse, family member, friend, colleague, business partner, etc. (i.e., anyone the user of the hearing device wants to hear clearly (e.g., conversation) in an environment with a lot of noise (e.g., in a restaurant, office, home, garden, etc.).

[0021] The hearing device / interface / transceiver module includes a radio transceiver coupled to an antenna for converting antenna output signals into audio data. Wireless signals from different external sources can be multiplexed into audio data in the radio transceiver or provided as discrete audio data on a discrete transceiver output terminal of the radio transceiver. The hearing device may include multiple antennas, and / or the antennas may be configured to operate in one or more antenna modes. The transceiver input signal optionally includes a first transceiver input signal representing a first wireless signal from a first external source.

[0022] Hearing devices may include a set of transducers (e.g., microphones). A microphone set may include one or more microphones. A microphone set typically includes: a first microphone for providing a first microphone input signal; and / or a second microphone for providing a second microphone input signal. A microphone set may include N microphones to provide N microphone signals, where N is an integer from 1 to 10. In one or more exemplary hearing devices, the number of microphones N is two, three, four, five, or more. A microphone set may include a third microphone for providing a third microphone input signal.

[0023] The hearing device includes a processor for processing audio data (e.g., microphone input signals, pre-processed transceiver input signals, and / or pre-processed microphone input signals). The processor provides an electrical output signal based on the input signal / audio data. Input terminals of the processor can optionally be connected to corresponding output terminals of the pre-processor. For example, the transceiver input terminals of the processor can be connected to the transceiver output terminals of the pre-processor or transceiver module. One or more microphone input terminals of the processor can be connected to corresponding one or more microphone output terminals of the pre-processor or microphone.

[0024] The hearing device may include a processor for processing transducer input data (e.g., microphone input data / signals) and providing an electrical output signal based on the transducer input data (e.g., microphone input data / signals). The processor may be configured to apply a neural network to network inputs to provide a network output, the network inputs being based on transducer input data (e.g., microphone input data / signals) (e.g., based on a first transducer input signal and / or a second transducer input signal). The first transducer input signal may, for example, be a first microphone input signal from a first microphone. The second transducer input signal may, for example, be a second microphone input signal from a second microphone. In other words, the first microphone input signal may constitute the first transducer input signal, and / or the second microphone input signal may constitute the second transducer input signal. The transducer input data (e.g., microphone input data / signals) may be preprocessed, for example, external to the processor or in a preprocessor integrated within the processor, and then processed to provide an electrical output signal, for example, as a network input feed to a neural network.

[0025] The electrical output signal may be based on (for example, is) a function of the network output. Hearing devices may include a receiver for converting the electrical output signal into an audio output signal.

[0026] The processor may be configured, for example, to obtain transducer input data from or via a set of input transducers. In other words, the processor may be configured, for example, to receive and / or retrieve transducer input data (e.g., microphone input signals from a corresponding microphone) from or via a set of input transducers.

[0027] The processor can be configured, for example, to generate an electrical output signal based on transducer input data. In one or more examples, the processor can be configured to perform hearing loss compensation processing on the transducer input data. For example, the processor can be configured to generate an electrical output signal, for example, by applying a neural network to a network input based on the transducer input data or transceiver input data.

[0028] An electrical output signal can be, for example, an electrical output signal from a processor. An electrical output signal can be considered, for example, an electrical signal provided by the processor as an output.

[0029] The receiver can be configured, for example, to obtain (e.g., receive and / or retrieve) an electrical output signal from a processor. The receiver can be configured, for example, to determine (e.g., generate) an audio output signal based on the electrical output signal. In some cases, the receiver can be configured to provide (e.g., output) an audio output signal.

[0030] A hearing device is disclosed. The hearing device (e.g., a first hearing device) includes an interface and a processor. The hearing device is configured to, for example, receive a microphone input signal from a microphone of the hearing device. (First) The hearing device is configured to, for example, receive a transceiver input signal from a transceiver of the hearing device. (First) The hearing device (e.g., the processor) is configured to determine a time offset between the microphone input signal and the transceiver input signal. (First) The hearing device (e.g., the processor) is configured to determine a time delay based on the time offset. (First) The hearing device (e.g., the processor) is configured to process the transceiver input signal for providing an output signal. Processing the transceiver input signal may include applying a time delay to the transceiver input signal for providing a delayed transceiver input signal. (First) The hearing device is configured to provide an output signal to a receiver of the hearing device, for example, for providing an audio output signal. The time delay may be determined to align the audio output signal with the acoustic input signal.

[0031] In one or more example hearing devices, the hearing device (also referred to as a first hearing device) includes an interface and a processor, wherein the hearing device is configured to: obtain a microphone input signal from a microphone of the hearing device; obtain a transceiver input signal from a transceiver of the hearing device; determine a time offset between the microphone input signal and the transceiver input signal; determine a time delay based on the time offset; process the transceiver input signal to provide an output signal, wherein processing the transceiver input signal includes: applying a time delay to the transceiver input signal to provide a delayed transceiver input signal; and providing the output signal to a receiver of the hearing device to provide an audio output signal, wherein the time delay is determined to align the audio output signal with the acoustic input signal.

[0032] The microphone input signal can be a combination of multiple microphone input signals from a respective microphone (e.g., through beamforming, summation, or linear combination). For example, the microphone input signal can be a combination of a first microphone input signal from a first microphone of the interface and a second microphone input signal from a second microphone of the interface. In other words, the microphone input signal can be based on a first microphone input signal from a first microphone of the interface and a second microphone input signal from a second microphone of the interface.

[0033] A method for operating a hearing device is also disclosed. The hearing device (e.g., a first hearing device) includes an interface and a processor. The method includes, for example, obtaining a microphone input signal from a microphone of the hearing device. The method also includes, for example, obtaining a transceiver input signal from a transceiver of the hearing device. The method includes, for example, determining a time offset between the microphone input signal and the transceiver input signal using the processor. The method includes, for example, determining a time delay based on the time offset using the processor. The method includes, for example, processing the transceiver input signal using the processor to provide an output signal. Processing the transceiver input signal may include applying a time delay to the transceiver input signal to provide a delayed transceiver input signal. The method also includes providing an output signal to a receiver of the hearing device to provide an audio output signal. The time delay may be determined to align the audio output signal with the acoustic input signal.

[0034] In one or more example methods, a method of operating a hearing device (e.g., a first hearing device including an interface and a processor) includes: obtaining a microphone input signal from a microphone of the hearing device; obtaining a transceiver input signal from a transceiver of the hearing device; determining a time offset between the microphone input signal and the transceiver input signal; determining a time delay based on the time offset; processing the transceiver input signal to provide an output signal, wherein processing the transceiver input signal includes: applying the time delay to the transceiver input signal to provide a delayed transceiver input signal; and providing the output signal to a receiver of the hearing device to provide an audio output signal, wherein the time delay is determined to align the audio output signal with the acoustic input signal.

[0035] In one or more examples, a time delay is determined such that the time offset between the microphone input signal and the transceiver input signal is within a desired range (e.g., from 2ms to 50ms; e.g., from 5ms to 30ms)). The time delay can be selected such that the time offset between the microphone input signal and the transceiver input signal is between 2ms and 50ms (e.g., between 5-10ms, 5ms to 15ms, 5ms to 20ms, 10ms to 20ms, 15ms to 25ms, 20ms to 30ms, 30ms to 40ms, 40ms to 50ms). This time offset or time lag between the two signals can be implemented such that the hearing device user will hear the microphone input signal from the hearing aid microphone at an appropriate time before hearing the microphone input signal from, for example, a (spouse's) microphone. In one or more exemplary hearing devices, the time delay can be selected such that the time offset between the first and second summed signals is between 5ms and 30ms.

[0036] In one or more examples, determining the time delay includes: determining whether the microphone input signal precedes the transceiver input signal. In response to determining that the microphone input signal precedes the transceiver input signal, the time offset and / or time delay may optionally be set to zero. Thus, in one or more examples, determining the time delay includes: determining whether the microphone input signal precedes the transceiver input signal, and in response to determining that the microphone input signal precedes the transceiver input signal, setting the time delay to zero.

[0037] In one or more examples, the transceiver input signals include, for example, a transmitter delay control signal that indicates a time delay in the transmitter (e.g., an accessory device). The time delay can be determined based on the transmitter delay control signal.

[0038] In one or more examples, the time delay is based on electrical delay. Electrical delay may include one or more of a receiver delay associated with the receiver and a processing delay associated with the processor. Thus, electrical delay may include a receiver delay associated with the receiver. Alternatively or in combination, electrical delay may include a processing delay associated with the processor.

[0039] In one or more examples, determining the time offset between the microphone input signal and the transceiver input signal involves performing a cross-correlation function on the microphone input signal and the transceiver input signal. Cross-correlation can be obtained by summing the squared differences and summing the absolute differences. Cross-correlation, summing the squared differences, and summing the absolute differences can be called a time offset estimator. Signals can be multiplied, added, subtracted, divided, etc., in cross-correlation and / or in summing the squared differences and / or in summing the absolute differences. If the difference in amplitude between the two input signals is large, for example, in cross-correlation, the cross-correlation may not be optimal. Accordingly, the processor (time offset estimator) can therefore be configured to normalize one or more of the input signals before and / or after cross-correlation to obtain signals with similar amplitudes, thereby providing optimal cross-correlation. The processor can be configured to transmit the time offset between the transceiver input signal and the microphone input signal. The processor in a hearing device can be configured to determine and apply the time delay at a fixed or variable frequency. For example, the time delay can be determined and / or updated at an update frequency of 1 Hz or lower. A suitable update frequency can be in the range of 0.1Hz to 10Hz (e.g., from 0.5Hz to 2Hz (e.g., 1Hz)), for example, to balance the requirements of the input signal during adaptation changes (change of position) and the limited power resources of the hearing device. In one or more examples, the time delay can be adjusted based on user input (e.g., from another hearing device) and / or update criteria and / or update events. The processor can be configured to determine whether the time delay has changed by more than a threshold, and if the change in time delay satisfies the update criteria (e.g., if the applied change in time delay is greater than the threshold), optionally apply the updated time delay. For example, if the time delay change is greater than a predetermined threshold, the processor's algorithmic processing can overrule the change in time delay and / or update because if the person (spouse) wearing the microphone providing the transceiver input signal moves too fast, this could be mistakenly perceived by the hearing device user. Consequently, the two input signals will be out of sync, which is not optimal for the hearing device user to listen.

[0040] In one or more examples, the time delay D_time is given by D_time = S_time – D_elec, where S_time is the time offset and D_elec is the electrical delay in the hearing device. If S_time < D_elec, the time delay can be D_time = 0. Therefore, if the electrical delay is greater than the time offset S_time, the time delay D_time can be set to zero.

[0041] In one or more examples, the time delay D_time is given by D_time = S_time – D_elec – D_acous, where S_time is the time offset, D_elec is the electrical delay in the hearing device, and D_acous is the acoustic delay. If S_time < D_elec + D_acous, then the time delay can be D_time = 0. Therefore, if the sum of the electrical and acoustic delays is greater than the time offset S_time, then the time delay D_time can be set to zero.

[0042] In one or more examples, the hearing device is configured to determine a confidence score. The confidence score can indicate the level of confidence in a time offset. Determining a time delay based on a time offset can include determining the time delay based on both the time offset and the confidence score.

[0043] In one or more examples, the hearing device is configured to optionally determine and send a first delay control signal to the contralateral hearing device. The first delay control signal may indicate, for example, a time offset and / or time delay determined in the hearing device. Thus, in one or more examples, the first delay control signal indicates a detected / estimated time offset in the hearing device. Alternatively or in combination, in one or more examples, the first delay control signal indicates a time delay in the hearing device / time delay estimator.

[0044] The contralateral hearing device can be a second hearing device. That is, when a user wears hearing devices in both ears (i.e., a binaural hearing device system), the contralateral hearing device can be a second hearing device in the user's other ear. This facilitates effective binaural processing, especially when the second input signal is delayed, by enabling the hearing devices in the binaural hearing device system to maintain localization cues.

[0045] In one or more example contralateral hearing devices, the contralateral hearing device (also referred to as a second hearing device) includes an interface and a processor. The (second / contralateral) hearing device can be configured to: receive a microphone input signal from a microphone of the (second / contralateral) hearing device. The (second / contralateral) hearing device can be configured to: receive a transceiver input signal from a transceiver of the interface of the (second / contralateral) hearing device. The (second / contralateral) hearing device can be configured to: determine, for example, use the processor to determine a time offset between the microphone input signal and the transceiver input signal of the (second / contralateral) hearing device. The (second / contralateral) hearing device can be configured to: determine a time delay based on the time offset of the (second / contralateral) hearing device, for example, use the processor. The (second / contralateral) hearing device can be configured to: process the transceiver input signal, for example, using the processor to provide an output signal, wherein processing the transceiver input signal optionally includes: applying a time delay to the transceiver input signal to provide a delayed transceiver input signal of the (second / contralateral) hearing device. The (second / contralateral) hearing device can be configured to provide an output signal to a receiver of the (second / contralateral) hearing device for providing an audio output signal, wherein a time delay can optionally be determined to align the audio output signal with the acoustic input signal of the (second / contralateral) hearing device.

[0046] In one or more examples, the (first) hearing device is configured to, for example, receive a contralateral input signal from the contralateral hearing device via a transceiver. The contralateral input signal may include, for example, a contralateral delay control signal indicating the contralateral time offset and / or contralateral time delay of the contralateral hearing device. Determining the time delay of the (first) hearing device may be based on the contralateral delay control signal. The contralateral delay control signal may indicate the time delay, time offset, and / or confidence score determined by the contralateral hearing device.

[0047] In one or more examples, a hearing system is disclosed, comprising a first hearing device and a second hearing device. The first hearing device may be the hearing device described herein. Thus, the first hearing device may be a hearing device including an interface and a processor, wherein the hearing device is configured to: obtain a microphone input signal from a microphone of the first hearing device; obtain a transceiver input signal from a transceiver of the interface; determine a time offset between the microphone input signal and the transceiver input signal; determine a time delay based on the time offset; process the transceiver input signal to provide an output signal, wherein processing the transceiver input signal includes: applying the time delay to the transceiver input signal to provide a delayed transceiver input signal; and providing the output signal to a receiver of the first hearing device to provide an audio output signal, wherein the time delay is determined to align the audio output signal with the acoustic input signal.

[0048] In one or more example hearing systems, the hearing system includes a first hearing device and a second hearing device, wherein the first hearing device is the hearing device described herein.

[0049] It should be noted that the description and characteristics of the hearing device's functions (e.g., the hearing device configured as such) also apply to the methods, and vice versa. For example, the description of a hearing device configured to enter a pairing mode for pairing with an accessory device also applies to methods of operating the hearing device, wherein the methods include: entering a pairing mode for pairing with an accessory device, and vice versa. The hearing devices disclosed herein can be configured to perform any of the methods herein.

[0050] Figure 1 An exemplary hearing device 2 (e.g., a first hearing device 2A) according to this disclosure is schematically illustrated. The hearing device 2 includes an interface and a processor 10. The hearing device includes a microphone 6 (e.g., a first microphone) for providing a (first) microphone input signal 6A. Optionally, the hearing device includes a second microphone for providing a second microphone input signal, for example, wherein the microphone input signal is based on the second microphone input signal. Thus, the first microphone input signal can form a microphone input signal, or the microphone input signal can be based on the first microphone input signal and the second microphone input signal.

[0051] The interface also includes a transceiver 8 (e.g., a first transceiver) for providing transceiver input signal 8A.

[0052] Transceiver 8 may be part of a first wireless communication unit 18. Communication unit 18 may optionally include an antenna 18A coupled to the first wireless communication unit 18 via transceiver 8. Antenna 18A may be configured for wireless communication, for example, with one or more accessory devices (e.g., accessory device 4) and / or a contralateral hearing aid. Antenna 18A may optionally be configured to receive one or more wireless input signals 4A (e.g., a first wireless input signal and / or a second wireless input signal) from accessory device 4. Wireless input signals 4A may originate from an external audio source (e.g., audio devices such as spouse microphones, wireless TV audio transmitters, music players, cars, doorbells, mobile phones, smartwatches, and wireless audio transmitters (e.g., public wireless audio transmitters in airports, train stations, stadiums, cinemas, shopping malls, lectures, during religious services (e.g., in churches), and / or arenas)). Accessory device 4 may operate, is, and / or functions as an audio device. Accessory device 4 may be a microphone system, tablet computer, laptop computer, smartphone, and / or smartwatch. The transceiver 8 is configured to convert wireless input signals (including the first wireless input signal 4A) from accessory device 4 into one or more transceiver input signals 8A.

[0053] The hearing device 2 / processor 10 is configured to, for example, determine the time offset between the microphone input signal 6A and the transceiver input signal 8A via the time delay determiner 12, and determine a time delay 12A based on the time offset. Therefore, the hearing device 2 is configured to determine the time delay 12A based on the time offset between the microphone input signal 6A and the transceiver input signal 8A.

[0054] The time delay determiner 12 can be implemented separately from the processor 10, or as an integrated part of the processor 10, and can be configured to perform a cross-correlation on the microphone input signal 6A and the transceiver input signal 8A to provide a time offset. In other words, determining the time offset S_time between the microphone input signal 6A and the transceiver input signal 8A can include performing a cross-correlation function on the microphone input signal 6A and the transceiver input signal 8A. If the microphone input signal 6A precedes the transceiver input signal 8A, the time offset and / or time delay 12A can be set to zero. Therefore, determining the time delay 12A can include determining whether the microphone input signal 6A precedes the transceiver input signal 8A, and in response to determining that the microphone input signal 6A precedes the transceiver input signal 8A, the time delay 12A can be set to zero. If the microphone input signal 6A follows the transceiver input signal 8A, the time delay 12B can be greater than zero.

[0055] The time delay 12A may optionally be based on an electrical delay (e.g., the processing delay in processor 10). The time delay 12A may be based on both a time offset and an electrical delay. The time delay may be the sum of the time offset and the electrical delay. If the electrical delay is greater than the time offset, the time delay 12A is normally set to zero.

[0056] For example, a time delay of 12A combined with an electrical delay can be based on an acoustic delay. A time delay of 12A can be based on a time offset, an acoustic delay, and an electrical delay. The time delay can be set to the time offset minus the acoustic delay and then minus the electrical delay. If the sum of the electrical and acoustic delays is greater than the time offset, the time delay can be set to zero.

[0057] Hearing device 2 (e.g., processor 10) is configured to process transceiver input signal 8A to provide output signal 14. Processing transceiver input signal 8A includes, for example, applying a time delay 12A to transceiver input signal 8A in delay unit 13 to provide delayed transceiver input signal 13A. Delayed transceiver input signal 13A may optionally be further processed in processor 10 (e.g., combined with microphone input signal 6A, and / or to compensate for hearing loss), for example, to provide output signal 14. In other words, in hearing loss compensator 15, for example before or after hearing loss compensation, delayed transceiver input signal 13A may form output signal 14, or delayed transceiver input signal 13A and microphone input signal 6A may be combined.

[0058] The hearing device includes a receiver 16. The hearing device 2 / processor 10 is configured to provide an output signal 14 to the receiver 16 for providing an audio output signal 20.

[0059] The time delay 12A can be determined to align the audio output signal 20 with, for example, an acoustic input signal received by a microphone. The acoustic input signal can be ambient sound (also known as background noise), natural sound, and / or ambient atmospheric sound. Therefore, it is possible to avoid pre-setting a time delay to account for any estimated delays involved in wireless audio broadcasting from, for example, a spouse's microphone, since the time delay is determined by the hearing device 2. If there are variations in the wireless audio broadcasting and the acoustic input signal, the time delay is adjusted accordingly, for example, by the hearing device 2, by determining the time delay to align the audio output signal with the acoustic input signal.

[0060] The time delay 12A can be based on an electrical delay, which includes one or more of a receiver delay associated with receiver 16 and a processing delay associated with processor 10. Therefore, the electrical delay can include both the receiver delay associated with receiver 16 and the processing delay associated with processor 10. In other words, the electrical delay can include the receiver delay associated with receiver 16. Alternatively or in combination, the electrical delay can include the processing delay associated with processor 10 (e.g., one or more of time delay determiner 12, delay unit 13, and hearing loss compensator 15).

[0061] The hearing device 2 can be configured to: determine a confidence score indicating a confidence level of time offset. Determining the time delay 12A based on the time offset can include: determining the time delay based on the time offset and the confidence score. The time delay and the confidence score can be summed to obtain the time offset.

[0062] Figure 2Figure 100 illustrates an example method of operating a hearing device 2 (e.g., a first hearing device 2A) including an interface and a processor 10. Method 100 includes: obtaining (S102) a microphone input signal 6A from a microphone 6 or multiple microphones of the hearing device, and obtaining (S104) a transceiver input signal 8A from a transceiver 8 of the interface. The transceiver 8 may be a first transceiver. The transceiver 8 may be part of a first wireless communication unit 18, which further includes an antenna 18A configured for wireless communication, for example, with one or more accessory devices (e.g., accessory device 4) and / or the contralateral hearing device. The antenna 18A may optionally be configured to receive one or more wireless input signals 4A (e.g., a first wireless input signal and / or a second wireless input signal) from the accessory device 4. The wireless input signal 4A may originate from an external audio source (e.g., audio devices such as spouse microphones, wireless TV audio transmitters, music players, cars, doorbells, mobile phones, smartwatches, and wireless audio transmitters such as those found in airports, train stations, stadiums, cinemas, shopping malls, lectures, during religious services (e.g., in churches), and / or arenas)). The accessory device 4 may operate, is, and / or functions as an audio device. The accessory device 4 may be a microphone system, tablet computer, laptop computer, smartphone, and / or smartwatch. The transceiver 8 is configured to convert the wireless input signal (including the first wireless input signal 4A) from the accessory device 4 into one or more transceiver input signals 8A.

[0063] Figure 2 The method shown includes: determining (S106) the time offset between the microphone input signal 6A and the transceiver input signal 8A. Determining (S106) the time offset between the microphone input signal 6A and the transceiver input signal 8A may include: using the processor 10 (e.g., a time delay estimator 12).

[0064] Figure 2 The method shown includes: determining (S108) a time delay based on a time offset. Determining the time delay based on the time offset (S108) may include: using processor 10 (e.g., time delay estimator 12).

[0065] Figure 2The method shown includes: processing (S110) a transceiver input signal 8A to provide an output signal 14. Processing (S110) the transceiver input signal 8A to provide the output signal 14 includes: applying a time delay to the transceiver input signal 8A to provide a delayed transceiver input signal 8B. Processing (S110) the transceiver input signal 8A to provide the output signal 14 may optionally include: applying hearing compensation. Processing (S110) the transceiver input signal 8A to provide the output signal 14 may optionally include: combining a microphone input signal and a delayed transceiver input signal. In other words, the output signal may be based on the microphone input signal and the delayed transceiver input signal. Processing (S110) the transceiver input signal 8A to provide the output signal 14 may include: using a processor 10.

[0066] Figure 2 The method shown includes providing output signal 14 (S112) to receiver 16 of the hearing device for providing audio output signal 20. A time delay is determined to align the audio output signal with the acoustic input signal. The acoustic input signal can be ambient sound (also known as background noise), natural sound, and / or ambient atmospheric sound. This avoids the need for a preset time delay to account for any estimated delays involved in wireless audio broadcasting from, for example, a microphone, since the time delay is determined by the hearing device. If there are variations in the wireless audio broadcasting and the acoustic input signal, the hearing device 2 adjusts the time delay accordingly by determining the time delay to align the audio output signal with the acoustic input signal.

[0067] like Figure 1 As shown, the hearing device may include memory 26. Processor 10 (e.g., time delay estimator 12, delay unit 13, and / or hearing loss compensator 15) is optionally configured to perform... Figure 2 Any operation disclosed in (e.g., any one or more of S102, S104, S106, S108, S110, S112). The operation of processor 10 may be embodied in the form of executable logic routines (e.g., lines of code, software programs, etc.) stored on a non-transitory computer-readable medium (e.g., memory 26) and executed by processor 10.

[0068] Furthermore, the operation of the hearing device 2 can be viewed as a method configured to be performed by the hearing device 2. Additionally, although the described functions and operations can be implemented in software, such functions can also be implemented via dedicated hardware or firmware, or a combination of hardware, firmware, and / or software.

[0069] Memory 26 may be one or more of a buffer, flash memory, hard disk, removable media, volatile memory, non-volatile memory, random access memory (RAM), or other suitable devices. In a typical configuration, memory 26 may include non-volatile memory for long-term data storage and volatile memory operating as system memory for processor 10. Memory 26 may exchange data with processor 10 via a data bus (not shown). Control lines and an address bus may also exist between memory 26 and processor 10. Figure 1 (Not shown in the image). Memory 26 is considered as a non-transitory computer-readable medium.

[0070] Hearing devices / interfaces can be configured for wireless communication with one or more audio devices (also referred to as audio sources) and / or one or more hearing devices (e.g., contralateral hearing devices).

[0071] Figure 3 This illustrates wireless communication between a hearing device 2 (e.g., a first hearing device 2A) and a contralateral hearing device 30 (e.g., a second hearing device). The contralateral hearing device 30 may include... Figure 1 and 2 The interface and processor described with respect to the (first) hearing device 2. In other words, the hearing device / interface of each of the (first) hearing devices 2, 2A and the contralateral hearing device 30 can be configured for wireless communication with other hearing devices. The hearing device / interface of each of the (first) hearing devices 2 and the contralateral hearing device 30 may optionally include an antenna for converting one or more wireless input signals 4A (e.g., a first wireless input signal and / or a second wireless input signal) into an antenna output signal. The wireless input signal 4A includes or represents audio data (e.g., first audio data and / or second audio data). In other words, the audio data may be encoded in the wireless input signal. The wireless input signal 4A may originate from an external audio source 4 (e.g., an audio device (e.g., a spouse microphone device, a wireless TV audio transmitter, a music player, a car, a doorbell, a mobile phone, a smartwatch, and a wireless audio transmitter (e.g., a public wireless audio transmitter in an airport, train station, stadium, cinema, and / or arena))). The wireless input signal 4A may originate from one or more accessory devices 4.

[0072] The first hearing device 2 and the contralateral hearing device 30 can be configured to receive signals from other hearing devices of the first hearing device 2 and the contralateral hearing device 30.

[0073] Optionally, such as Figure 3As shown, the (first) hearing device 2 is configured to determine and send a delay control signal 28 to the contralateral hearing device 30. The delay control signal 28 may indicate the time offset and / or time delay obtained by the (first) hearing device 2. Effective synchronization between the (first) hearing device 2 and the contralateral hearing device 30 can be achieved using the delay control signal 28 obtained by the (first) hearing device 2.

[0074] The transceiver input signal 8A may include a delay control signal (e.g., a delay control signal 28 obtained by the (first) hearing device 2). The determination of the time delay can therefore be based on the delay control signal.

[0075] Optionally, such as Figure 3 As shown, the (first) hearing device 2 is configured to receive a contralateral input signal 30A from the contralateral hearing device 30. Therefore, the contralateral hearing device 30 can be configured to send the contralateral input signal 30A to the (first) hearing device 2. The contralateral input signal 30A may include or indicate a delay control signal 32 (e.g., a contralateral delay control signal). Determining the time delay in the (first) hearing device 2 can be based on the (contralateral) delay control signal 32.

[0076] Figure 4 The diagram illustrates wireless communication between hearing device 2 (e.g., a first hearing device 2A), contralateral hearing device 30 (e.g., a second hearing device), and accessory device 4. Accessory device 4 may operate, is, and / or functions as an audio device. The first hearing device 2 and the contralateral hearing device 30 (e.g., the second hearing device) optionally include antennas for converting one or more wireless input signals into antenna output signals. The wireless input signals include or represent audio data (e.g., first audio data and / or second audio data). In other words, the audio data may be encoded in the wireless input signals. The wireless input signals may originate from an external audio source (e.g., audio devices such as spouse microphone devices, wireless TV audio transmitters, music players, cars, doorbells, mobile phones, smartwatches, and wireless audio transmitters such as those found in airports, train stations, stadiums, cinemas, shopping malls, lectures, public wireless audio transmitters during religious services (e.g., in churches), and / or arenas). The (first) hearing device 2 and the contralateral hearing device 30 may include... Figures 1-3The interface and processor described herein. In other words, the hearing device / interface of each of the (first) hearing device 2 and the contralateral hearing device 30 can be configured for wireless communication with other hearing devices. The hearing device / interface of each of the (first) hearing device 2 and the contralateral hearing device 30 may optionally include an antenna for converting one or more wireless input signals (e.g., a first wireless input signal 4A and / or a second wireless input signal 4B) into an antenna output signal. The (first) hearing device 2 and the contralateral hearing device 30 can be configured to receive signals from other hearing devices of the (first) hearing device 2 and the contralateral hearing device 30 and / or from accessory device 4.

[0077] Optionally, such as Figure 4 As shown, the (first) hearing device 2 is configured to send a delay control signal 28 to the contralateral hearing device 30 and obtain a contralateral input signal 30A from the contralateral hearing device 30, as in combination with Figure 3 As described.

[0078] The use of the terms "first," "second," "third," and "fourth," "A," "B," and "C," etc., does not imply any particular order, but is included to identify individual elements. Furthermore, the use of the terms "first," "second," "third," and "fourth," "A," "B," and "C," etc., does not indicate any order or importance; rather, the terms "first," "second," "third," and "fourth," "A," "B," and "C," etc., are used to distinguish one element from another. Note that the terms "first," "second," "third," and "fourth," "A," "B," and "C," etc., here and elsewhere, are used solely for labelling purposes and are not intended to indicate any particular spatial or temporal order.

[0079] Furthermore, the marking of the first element does not imply the existence of the second element, and vice versa.

[0080] It should be understood that Figures 1-4 This includes some modules or operations shown in solid lines and some modules or operations shown in dashed lines. The modules or operations included in the solid lines are those included in broad example embodiments. The modules or operations included in the dashed lines are example embodiments that can be included in, form part of, or are part of, further modules or operations that are available in addition to the modules or operations of the example embodiments shown in solid lines. It should be understood that these operations need not be performed in the presented order. Furthermore, it should be understood that not all operations need to be performed. The exemplary operations can be performed in any order and in any combination.

[0081] It should be noted that the word "comprising" does not necessarily exclude the existence of other elements or steps besides those listed.

[0082] It should be noted that the words “a” or “an” preceding an element do not preclude the existence of multiple such elements.

[0083] It should also be noted that any reference numerals do not limit the scope of the claims, exemplary embodiments may be implemented at least in part by both hardware and software, and several “means,” “units,” or “devices” may be represented by the same item of hardware.

[0084] The various exemplary methods, apparatuses, and systems described herein are described within the general context of method steps implemented in one aspect by a computer program product including computer-executable instructions (e.g., program code) that execute in a networked environment by a computer. Computer-readable media may include removable and non-removable storage devices, including but not limited to read-only memory (ROM), random access memory (RAM), compact discs (CDs), digital versatile discs (DVDs), etc. Typically, program modules may include routines, programs, objects, components, data structures, etc., that perform specified tasks or implement specific abstract data types. Computer-executable instructions, associated data structures, and program modules represent examples of program code for performing steps of the methods disclosed herein. Specific sequences of such executable instructions or associated data structures represent examples of corresponding behaviors for implementing the functionality described in such steps or processes.

[0085] Although features have been shown and described, it should be understood that they are not intended to limit the claimed invention, and it will be apparent to those skilled in the art that various changes and modifications can be made without departing from the spirit and scope of the claimed invention. The specification and drawings should therefore be regarded in an illustrative rather than limiting sense. The claimed invention is intended to cover all alternatives, modifications, and equivalents.

[0086] List of labels

[0087] 2 Hearing devices

[0088] 2A First Hearing Device

[0089] 4 accessories and equipment

[0090] 4A wireless input signal

[0091] 6 microphones, first microphone

[0092] 6A microphone input signal, first microphone input signal

[0093] 8 transceivers

[0094] 8A transceiver input signal

[0095] 8B Delayed transceiver input signal

[0096] 10 processors

[0097] 12 Time Delay Determiner

[0098] 12A time delay

[0099] 13 delay units

[0100] 13A Delayed Transceiver Input Signal

[0101] 14 Output Signals

[0102] 15 Hearing Loss Compensator

[0103] 16 receivers

[0104] 18 wireless communication units

[0105] 18A antenna

[0106] 20 audio output signals

[0107] 26 memory

[0108] 28 Delay Control Signals

[0109] 30 pairs of hearing aids

[0110] 30A opposite side input signal

[0111] Delay control signals for 32 pairs of hearing aids

Claims

1. A hearing device, comprising an interface and a processor, wherein, The hearing device is configured as follows: Obtain a microphone input signal from the microphone of the hearing device; Obtain transceiver input signals from the transceiver of the interface; The processor is used to determine the time offset between the microphone input signal and the transceiver input signal; The processor is used to determine the time delay based on the time offset; The processor processes the transceiver input signal to provide an output signal, wherein processing the transceiver input signal includes: applying the time delay to the transceiver input signal to provide a delayed transceiver input signal; and The output signal is provided to the receiver of the hearing device to provide an audio output signal. The time delay is determined to align the audio output signal with the acoustic input signal.

2. The hearing device as described in claim 1, wherein, Determining the time delay includes: Determine whether the microphone input signal precedes the transceiver input signal; and In response to determining that the microphone input signal precedes the transceiver input signal, the time offset and / or the time delay are set to zero.

3. The hearing device as described in any one of claims 1-2, wherein, The hearing device is configured as follows: A first delay control signal is sent to the contralateral hearing device, the first delay control signal indicating the time offset and / or the time delay.

4. The hearing device as described in any one of claims 1-3, wherein, The transceiver input signal includes a transmitter delay control signal, and The time delay is determined based on the transmitter delay control signal.

5. The hearing device as described in any one of claims 1-4, wherein, The hearing device is configured to: obtain a contralateral input signal from the contralateral hearing device, the contralateral input signal including a contralateral delay control signal, and The time delay is determined based on the delay control signal on the other side.

6. The hearing device as described in any one of claims 1-5, wherein, The time delay is based on electrical delay, which includes one or more of receiver delay associated with the receiver and processing delay associated with the processor.

7. The hearing device as described in any one of claims 1-6, wherein, Determining the time offset between the microphone input signal and the transceiver input signal includes: Perform a cross-correlation function on the microphone input signal and the transceiver input signal.

8. The hearing device as described in any one of claims 1-7, wherein, The time delay T_D is given by the following formula: T_D = t_s – D_elec, Where t_s is the time offset, and D_elec is the electrical delay in the hearing device.

9. The hearing device as described in any one of claims 1-8, wherein, The hearing device is configured to: determine a confidence score, the confidence score indicating the confidence level of the time offset, and Specifically, determining the time delay based on the time offset includes: determining the time delay based on the time offset and the confidence score.

10. A hearing system, comprising a first hearing device and a second hearing device, wherein, The first hearing device is the hearing device as described in any one of claims 1-9.

11. A method of operating a hearing device, the hearing device comprising an interface and a processor, wherein, The method includes: Obtain a microphone input signal from the microphone of the hearing device; Obtain transceiver input signals from the transceiver of the interface; Determine the time offset between the microphone input signal and the transceiver input signal; Determine the time delay based on the time offset; Processing the transceiver input signal to provide an output signal, wherein processing the transceiver input signal includes: applying the time delay to the transceiver input signal to provide a delayed transceiver input signal; and The output signal is provided to the receiver of the hearing device to provide an audio output signal. The time delay is determined to align the audio output signal with the acoustic input signal.

Images