Hearing aid comprising an input unit associated with a plurality of sampling rates
By setting a frame duration alignment mechanism with different sampling rates in the hearing aid, the computational complexity problem caused by high sampling rates is solved, and efficient signal processing and computational resource optimization are achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- OTICON
- Filing Date
- 2025-12-10
- Publication Date
- 2026-06-12
AI Technical Summary
Existing hearing aids incur excessive computational costs when increasing the analog signal sampling rate, leading to increased computational complexity.
By setting the first sampling rate to be greater than or different from the second sampling rate, the duration of each first frame is the same as the duration of each second frame. The analysis filter bank and signal processing unit are used to process the digital signals with different sampling rates, thereby achieving the alignment and joint processing of frame durations.
While maintaining a high sampling rate, the computational complexity was reduced, enabling the effective combination and processing of signals with different sampling rates, thereby improving the computational efficiency and battery performance of the hearing aid.
Smart Images

Figure CN122205340A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of hearing aids. Specifically, it relates to a hearing aid comprising an input unit associated with multiple sampling rates, and related methods. Background Technology
[0002] A hearing aid is configured to receive multiple analog signals from a plurality of microphones, the analog signals being digitally sampled at a specific sampling rate. Increasing the sampling rate at which the analog signals are sampled results in a more accurate digital representation of the analog signals. However, higher sampling rates typically incur higher computational costs. Summary of the Invention
[0003] This invention provides a hearing aid and method that can support high sampling rates while ensuring reduced computational complexity.
[0004] hearing aids
[0005] A hearing aid is disclosed herein. The hearing aid includes an input unit configured to provide a first digitized signal associated with a first sampling rate and a second digitized signal associated with a second sampling rate. The first digitized signal includes a plurality of first frames, each containing a plurality of first sample points. The second digitized signal includes a plurality of second frames, each containing a plurality of second sample points. The hearing aid is configured to determine the first sampling rate as greater than (e.g., or different from) the second sampling rate such that the duration of each first frame is the same as the duration of each second frame, thereby enabling (e.g., allowing and / or achieving) a greater number of first sample points than the number of second sample points. In other words, the first sampling rate may be different from the second sampling rate such that the duration of each first frame is the same as the duration of each second frame. The hearing aid includes a first analysis filter bank and a second analysis filter bank. The first analysis filter bank is configured to provide a first frequency domain signal based on the first digitized signal, the first frequency domain signal being associated with a first frequency range and a second frequency range. For example, the frequency range of the first frequency domain signal includes both a first frequency range and a second frequency range. A second analysis filter bank is configured to provide a second frequency domain signal based on a second digitized signal, the second frequency domain signal being associated with a first frequency range. For example, the frequency range of the first frequency domain signal is (e.g., corresponding to) a first frequency range. The determination of a first sampling rate and a second sampling rate (e.g., such that the duration of each first frame is the same as the duration of each second frame) such that (e.g., allowing and / or enabling) the first frequency range of the first frequency domain signal contains the same frequency bands (e.g., frequency components) as the second frequency domain signal. The hearing aid includes a signal processing unit configured to determine a first processed signal based on the first frequency range of the first frequency domain signal and the second frequency domain signal. The hearing aid includes an output unit configured to output an audible signal to a user wearing the hearing aid based on the first processed signal.
[0006] Therefore, an improved hearing aid can be provided.
[0007] The advantage of this invention is that by setting the first sampling rate to be greater than (e.g., different from) the second sampling rate, such that the duration of each first frame (e.g., a specific first frame, such as a first main frame) is the same as the duration of each second frame (e.g., a specific second frame, such as a second main frame), even if the first sampling rate is greater than (e.g., different from) the second sampling rate, and since the first frequency range of the first frequency domain signal contains the same frequency band as the second frequency domain signal, the signal processing unit can still process (e.g., combine) a portion of the first digitized signal (e.g., the portion corresponding to the first frequency range of the first frequency domain signal) and the second digitized signal. In other words, the alignment of frame durations enables the combination of digitized signals associated with different sampling rates. Embodiments of this invention can achieve joint processing of the first digitized signal and the second digitized signal when they are associated with different sampling rates.
[0008] For example, the first sampling rate is greater than the second sampling rate. Typically, increasing the sampling rate of an audio signal leads to increased computational costs (e.g., requiring higher processing performance). Embodiments of the present invention, by determining the first processed signal based on a first frequency range of a first frequency domain signal and a second frequency domain signal, achieve a good balance between computational complexity (e.g., battery performance) and the ability to support high sampling rates.
[0009] In one or more exemplary hearing aids, a digitized signal can be interpreted as a signal sampled at a specific sampling rate or sampling frequency (e.g., a digitally sampled signal).
[0010] In one or more exemplary hearing aids, the input unit is configured to provide multiple digitized signals (e.g., a first digitized signal, a second digitized signal, a third digitized signal, a fourth digitized signal, etc.), each digitized signal being associated with a corresponding sampling rate. Some of these sampling rates may be the same. These sampling rates may also be different from each other.
[0011] For example, the input unit may also be configured to provide a third digitized signal associated with a third sampling rate. The third sampling rate may be the same as and different from the second sampling rate (e.g., when the first sampling rate is greater than the second sampling rate). The third sampling rate may also be the same as and different from the first sampling rate (e.g., when the second sampling rate is greater than the first sampling rate). For example, the input unit may also be configured to provide a fourth digitized signal associated with a fourth sampling rate. The fourth sampling rate may be the same as and different from the second sampling rate (e.g., when the first sampling rate is greater than the second sampling rate). The fourth sampling rate may also be the same as and different from the first sampling rate (e.g., when the second sampling rate is greater than the first sampling rate). The first sampling rate may be greater than the second sampling rate. The second sampling rate may also be greater than the first sampling rate.
[0012] In one or more exemplary hearing aids, each digitized signal includes multiple frames (e.g., a first frame, a second frame, a third frame, a fourth frame, etc.). For example, a first digitized signal includes multiple first frames, each containing a first main frame, a first sub-frame, a first third frame, a first fourth frame, etc. For example, a second digitized signal includes multiple second frames, each containing a second main frame, a second sub-frame, a second third frame, a second fourth frame, etc. For example, a third digitized signal includes multiple third frames, each containing a third main frame, a third sub-frame, a third third frame, a third fourth frame, etc. For example, a fourth digitized signal includes multiple fourth frames, each containing a fourth main frame, a fourth sub-frame, a fourth third frame, a fourth fourth frame, etc. For example, a first sampling rate differs from a second sampling rate, such that the duration of each first frame is the same as the duration of each second frame.
[0013] In one or more exemplary hearing aids, a first sampling rate and a second sampling rate are different, such that each first frame is temporally aligned with each corresponding second frame. For example, multiple first frames are temporally aligned with multiple corresponding second frames, multiple third frames, multiple fourth frames, etc. In other words, multiple first frames, multiple second frames, multiple third frames, multiple fourth frames, etc., can be temporally aligned with each other. For example, a first main frame, a first sub-frame, a first third frame, a first fourth frame, etc., are temporally aligned with a second main frame, a second sub-frame, a second third frame, a second fourth frame, etc. For example, a first main frame, a first sub-frame, a first third frame, a first fourth frame, etc., are temporally aligned with a third main frame, a third sub-frame, a third third frame, a third fourth frame, etc. For example, a first main frame, a first sub-frame, a first third frame, a first fourth frame, etc., are temporally aligned with a fourth main frame, a fourth sub-frame, a fourth third frame, a fourth fourth frame, etc. For example, a second main frame, a second sub-frame, a second third frame, a second fourth frame, etc., are temporally aligned with a third main frame, a third sub-frame, a third third frame, a third fourth frame, etc. For example, the second main frame, the second sub-frame, the second third frame, and the second fourth frame are aligned in time with the fourth main frame, the fourth sub-frame, the fourth third frame, and the fourth fourth frame, respectively.
[0014] For example, the first digitized signal and the second digitized signal can be considered as signals sampled at different sampling rates within the same duration. For example, the third digitized signal and the fourth digitized signal can be considered as signals sampled at a first sampling rate (e.g., when the second sampling rate is greater than the first sampling rate) or a second sampling rate (e.g., when the first sampling rate is greater than the second sampling rate).
[0015] For example, the first main frame, second main frame, third main frame, and fourth main frame are time-aligned. In other words, the first main frame, second main frame, third main frame, and fourth main frame are associated with the same set of time points, such as the first set of time points. Similarly, the first subframe, second subframe, third subframe, and fourth subframe are time-aligned. In other words, the first subframe, second subframe, third subframe, and fourth subframe are associated with the same set of time points, such as the second set of time points. For example, the first third frame, second third frame, third third frame, and fourth third frame are time-aligned. In other words, the first third frame, second third frame, third third frame, and fourth third frame are associated with the same set of time points, such as the third set of time points. Similarly, the first fourth frame, second fourth frame, third fourth frame, and fourth fourth frame are time-aligned. In other words, the first fourth frame, second fourth frame, third fourth frame, and fourth fourth frame are associated with the same set of time points, such as the fourth set of time points. The first time point set, the second time point set, the third time point set, and the fourth time point set can be different from each other. The duration associated with the first time point set, the second time point set, the third time point set, and the fourth time point set can be the same.
[0016] The advantage of this invention is that by aligning the first main frame and the second main frame in time, even if the first sampling rate and the second sampling rate are different, the signal processing unit can still process (e.g., combine) a portion of the first digitized signal (e.g., the portion corresponding to the first main frame) and a portion of the second digitized signal (e.g., the portion corresponding to the second main frame). In other words, the alignment of frame durations enables the combination of digitized signals associated with different sampling rates. For example, when a time frame of multiple digitized signals is converted to the frequency domain, a set of frequency bands corresponding to each digitized signal can be obtained. The frequency bands corresponding to each digitized signal have similar frequency content (e.g., similar frequency bands and / or frequency components in Hertz (Hz), and then the frequency bands corresponding to each digitized signal can be linearly combined, for example, to achieve spatial filtering.
[0017] For example, when one of a plurality of first frames has the same duration as a corresponding second frame in a plurality of second frames (e.g., frames with the same index) (e.g., the durations of the first frame and the corresponding second frame include start and end times), and when the first and second frames are converted to the frequency domain, the resulting frequency domain versions of the first and second frames contain the same frequency bands (e.g., the same frequency range), thus allowing these frequency bands to be combined in the resulting frequency domain versions of the first and second digitized signals. For example, only frequency bands up to half the sampling rate can be reconstructed. For example, when the first sampling rate is 30 kHz, the second sampling rate is 20 kHz, and the duration is an integer multiple of 0.1 milliseconds, the frequency content (e.g., frequency bands) up to 10 kHz in the resulting frequency domain versions of the first and second digitized signals will be identical.
[0018] For example, by aligning multiple first frames, multiple second frames, multiple third frames, multiple fourth frames, etc., in time, the signal processing unit can still combine them even if the first digitized signal, the second digitized signal, the third digitized signal, the fourth digitized signal, etc., are associated with different sampling rates.
[0019] In one or more exemplary hearing aids, when a first sampling rate is greater than a second sampling rate, the first master frame has higher frequency resolution (e.g., contains more sampling points) compared to the second master frame. In one or more exemplary hearing aids, when a second sampling rate is greater than a first sampling rate, the second master frame has higher frequency resolution (e.g., contains more sampling points) compared to the first master frame.
[0020] In one or more exemplary hearing aids, the frame duration can be expressed by the formula T = N / f s The calculation yields the result, where N represents the number of sampling points in the frame, and f s This represents the sampling rate. For example, frame duration (e.g., frame length) can be considered as the length of a frame. For instance, the length of a frame can be an integer multiple of the time interval between two sample points in that frame, where the time interval between two sample points is 1 / f. s (For example, ).
[0021] For example, the duration of each frame (e.g., the l-th frame) in a plurality of first frames can be expressed by the formula The calculation shows that, This represents the number of sampling points in the l-th frame among multiple first frames. This represents the first sampling rate. For example, the duration of each frame (e.g., the l-th frame) in a plurality of second frames can be expressed by the formula... The calculation shows that, This represents the number of sampling points in the l-th frame across multiple second frames. This represents the second sampling rate. For example, a hearing aid (e.g., an input unit) can determine the first and second sampling rates by solving (e.g., according to) the following formula (e.g., selecting from a set of sampling rates stored in the hearing aid's memory):
[0022]
[0023] in, and All are positive integers (e.g., In other words, the first sampling rate can be different from the second sampling rate, making
[0024] Embodiments of the present invention propose determining a first processed signal based on input signals digitized using different sampling rates. For example, when the duration (e.g., length) of each frame of each digitized signal is the same, these signals are allowed to be combined. To achieve this combination, the sampling rates of the individual digitized signals (which are different from each other) can be determined (e.g., selected) according to formula (1). To achieve this combination, the sampling rates of the individual digitized signals (which are different from each other) can also be determined (e.g., selected) by fixing the duration of each frame of each digitized signal to the same value. For example, when the sampling rates associated with the individual digitized signals are different from each other, and the duration of each frame of each digitized signal is fixed to the same value, each frame of any digitized signal contains a different number of sampling points compared to other digitized signals. For example, when the duration of each frame of each digitized signal is the same, the digitized signal associated with a higher sampling rate contains more sampling points per frame than the digitized signal associated with a lower sampling rate.
[0025] In one or more exemplary hearing aids, the first sampling rate can be set to 30 kHz, and the second sampling rate can be set to 20 kHz. The duration of each of the plurality of first frames and the plurality of second frames can be set to 0.1 milliseconds, in which case each first frame contains 3 sampling points, and each second frame contains 2 sampling points. In one or more exemplary hearing aids, the duration of each of the plurality of first frames and the plurality of second frames can be set to any integer multiple of 0.1 milliseconds. In other words, the minimum duration of each of the plurality of first frames and the plurality of second frames can be 0.1 milliseconds.
[0026] In one or more exemplary hearing aids, the first sampling rate can be set to 32kHz, and the second sampling rate can be set to 20kHz. The duration of each of the plurality of first frames and the plurality of second frames can be set to 0.25 milliseconds, in which case each first frame contains 8 sampling points, and each second frame contains 5 sampling points. In one or more exemplary hearing aids, the duration of each of the plurality of first frames and the plurality of second frames can be set to any integer multiple of 0.25 milliseconds. In other words, the minimum duration of each of the plurality of first frames and the plurality of second frames can be 0.25 milliseconds.
[0027] In one or more exemplary hearing aids, the first sampling rate can be set to 44.1 kHz, and the second sampling rate can be set to 32 kHz. The duration of each of the plurality of first frames and the plurality of second frames can be set to 10 milliseconds, in which case each first frame contains 441 sampling points, and each second frame contains 320 sampling points. In one or more exemplary hearing aids, the duration of each of the plurality of first frames and the plurality of second frames can be set to any integer multiple of 10 milliseconds. In other words, the minimum duration of each of the plurality of first frames and the plurality of second frames can be 10 milliseconds.
[0028] In one or more exemplary hearing aids, the frame duration is an integer multiple of the reciprocal of the greatest common divisor of a first sampling rate and a second sampling rate. The first sampling rate can be a non-integer value or an integer value. The second sampling rate can be a non-integer value or an integer value.
[0029] In one or more exemplary hearing aids, the first sampling rate and the second sampling rate are preset values. In one or more exemplary hearing aids, the first sampling rate and the second sampling rate may be determined by the hearing aid and / or an external device. For example, the first sampling rate and the second sampling rate may be determined by retrieving relevant values from the memory of the hearing aid and / or the external device.
[0030] In one or more exemplary hearing aids, an output unit is configured to provide a stimulus perceived by a user as an acoustic signal based on a first processed signal. The output unit may include an output transducer. The output transducer may include a receiver (e.g., a speaker) for providing the user with the stimulus as an acoustic signal (e.g., in an acoustic (air conduction-based) hearing aid).
[0031] The output unit may (additionally or alternatively) include (e.g., a wireless) transmitter for transmitting sound picked up by the hearing aid to another device, such as a remote communication partner (e.g., via a network, such as in telephone operation mode). In one or more exemplary hearing aids, the wireless transmitter is configured to transmit electromagnetic signals in a radio frequency range (e.g., 3 kHz to 300 GHz). The wireless transmitter may be configured to transmit electromagnetic signals in an optical frequency range (e.g., infrared light 300 GHz to 430 THz, or visible light, such as 430 THz to 770 THz).
[0032] In one or more exemplary hearing aids, the hearing aid includes a first analytical filter bank and a second analytical filter bank. For example, an input unit communicates with the first analytical filter bank and the second analytical filter bank. In one or more exemplary hearing aids, the first analytical filter bank is configured to provide a first frequency domain signal based on a first digitized signal. For example, the first analytical filter bank is configured to provide a time-frequency (TF) representation of the first digitized signal. In other words, the first frequency domain signal can indicate the time-frequency (TF) representation of the first digitized signal. In one or more exemplary hearing aids, the first frequency domain signal is associated with a first frequency range and a second frequency range.
[0033] In one or more exemplary hearing aids, a second analysis filter bank is configured to provide a second frequency domain signal based on a second digitized signal. For example, the second analysis filter bank is configured to provide a time-frequency (TF) representation of the second digitized signal. In other words, the second frequency domain signal can indicate the time-frequency (TF) representation of the second digitized signal. In one or more exemplary hearing aids, the second frequency domain signal is associated with a first frequency range. For example, the frequency range of the second frequency domain signal is a subset of the frequency range of the first frequency domain signal. In other words, the first sampling rate is greater than the second sampling rate.
[0034] In one or more exemplary hearing aids, the hearing aid may include multiple analysis filter banks, including a first analysis filter bank, a second analysis filter bank, a third analysis filter bank, a fourth analysis filter bank, etc. For example, the third analysis filter bank is configured to provide a third frequency domain signal based on a third digitized signal. For example, the fourth analysis filter bank is configured to provide a fourth frequency domain signal based on a fourth digitized signal. The third frequency domain signal may indicate the time-frequency (TF) representation of the third digitized signal. The fourth frequency domain signal may indicate the time-frequency (TF) representation of the fourth digitized signal.
[0035] In one or more exemplary hearing aids, the time-frequency (TF) representation of a signal (e.g., a digitized signal) may comprise an array or mapping of complex or real values corresponding to the signal over a specific time and frequency range. An analysis filter bank may be configured to filter the signal (e.g., a time-varying signal) and output multiple output signals (e.g., multiple time-varying output signals), each containing a distinct frequency range of the signal. In other words, the analysis filter bank may be configured to provide a frequency domain characterization of a signal (e.g., a digitized signal).
[0036] For example, the analysis filter bank can be configured to apply one or more of the following to a signal (e.g., a digitized signal): Discrete Fourier Transform (DFT) algorithm, Short Time Fourier Transform (STFT) algorithm, Fast Fourier Transform (FFT) algorithm, and any other suitable algorithm. In other words, the analysis filter bank can be configured to convert a time-varying signal into a (time-)frequency domain (time-varying) signal.
[0037] For example, from the minimum frequency f min up to the maximum frequency f max The frequency range may include a portion of the typical human audible frequency range (20 Hz to 20 kHz) (e.g., a portion of the 20 Hz to 12 kHz range). For example, the sampling rate f s (e.g., the first sampling rate and / or the second sampling rate) is greater than or equal to the maximum frequency f. max twice, that is, f s ≥2f max Each of the multiple digitized signals can be divided into NI (e.g., equal-width) frequency bands, where NI is, for example, greater than 5, greater than 10, greater than 50, greater than 100, or greater than 500, and at least some of these frequency bands are processed individually. The hearing aid can be configured to process each of the multiple digitized signals in NP different channels (NP≤NI). The channel width can be uniform or non-uniform (e.g., widening with increasing frequency), and can be overlapping or non-overlapping.
[0038] In one or more exemplary hearing aids, multiple analysis filter banks (e.g., a first analysis filter bank, a second analysis filter bank, a third analysis filter bank, a fourth analysis filter bank, etc.) are configured to provide corresponding multiple frequency domain signals (e.g., a first frequency domain signal, a second frequency domain signal, a third frequency domain signal, a fourth frequency domain signal, etc.) by dividing the corresponding multiple digitized signals (e.g., a first digitized signal, a second digitized signal, a third digitized signal, a fourth digitized signal, etc.) into a group of frequency bands (e.g., a first group of frequency bands, a second group of frequency bands, a third group of frequency bands, a fourth group of frequency bands, etc.).
[0039] In one or more exemplary hearing aids, a first analysis filter bank has a first frequency resolution. In other words, a first frequency domain signal is associated with a first set of frequency components. For example, a first portion of the first set of frequency components may be considered a first frequency range of the first frequency domain signal. In other words, the first frequency range of the first frequency domain signal may include the first portion of the first set of frequency components. For example, a second portion of the first set of frequency components may be considered a second frequency range of the first digitized signal. In other words, the second frequency range of the first frequency domain signal may include the second portion of the first set of frequency components. The frequency range of the first frequency domain signal may include both the first and second portions of the first set of frequency components.
[0040] In one or more exemplary hearing aids, a second analysis filter bank has a second frequency resolution. In other words, a second frequency domain signal is associated with a second set of frequency components. For example, this second set of frequency components can be considered as a first frequency range of a second digitized signal. In other words, the first frequency range of the second digitized signal can include the second set of frequency components. The first frequency range of the second digitized signal is the same as the first frequency range of the first digitized signal. In other words, the second set of frequency components can be the same as a first portion of the first set of frequency components. The frequency range of the second frequency domain signal can be considered as the second set of frequency components. For example, the second set of frequency components being the same as a first portion of the first set of frequency components specifically means that their frequency components are completely identical.
[0041] In one or more exemplary hearing aids, a third analysis filter bank has a third frequency resolution. In other words, a third frequency domain signal is associated with a third set of frequency components. For example, this third set of frequency components may be considered as a first frequency range of a third digitized signal. In other words, the first frequency range of the third digitized signal may include the third set of frequency components. The first frequency range of the third digitized signal is the same as the first frequency range of the first digitized signal (e.g., and the first frequency range of the second digitized signal). In other words, the third set of frequency components may be the same as a first portion of the first set of frequency components (e.g., and the second set of frequency components). The frequency range of the third frequency domain signal may be considered as the third set of frequency components.
[0042] In one or more exemplary hearing aids, a fourth analysis filter bank has a fourth frequency resolution. In other words, a fourth frequency domain signal is associated with a fourth set of frequency components. For example, this fourth set of frequency components may be considered as a first frequency range of a fourth digitized signal. In other words, the first frequency range of the fourth digitized signal may include the fourth set of frequency components. The first frequency range of the fourth digitized signal is the same as the first frequency range of the first digitized signal (e.g., the first frequency range of the second digitized signal and the first frequency range of the third digitized signal). In other words, the fourth set of frequency components may be the same as a first portion of the first set of frequency components (e.g., the second set of frequency components and the third set of frequency components). The frequency range of the fourth frequency domain signal can be considered as the fourth set of frequency components.
[0043] For example, the frequency resolution (e.g., first frequency resolution) of the first analysis filter group is the same as that of the second analysis filter group (e.g., second frequency resolution), the third analysis filter group (e.g., third frequency resolution), and the fourth analysis filter group (e.g., fourth frequency resolution). On the other hand, the first analysis filter group has more frequency bands than the second, third, and fourth analysis filter groups. In other words, the frequency range covered by the first analysis filter group (e.g., a frequency range including both the first and second frequency ranges) is greater than the frequency ranges covered by the second, third, and fourth analysis filter groups (e.g., a frequency range including only the first frequency range). For example, the frequency ranges covered by the first and second analysis filter groups differ, a difference related to their different sampling rates. The frequency resolution of each analysis filter group can be determined such that the frequency bands in the corresponding frequency bands of each analysis filter group whose frequencies are not higher than the minimum of the first and second sampling rates (e.g., the minimum of half of both) overlap with each other.
[0044] For example, for a first analysis filter bank corresponding to a first sampling rate of 30 kHz (e.g., receiving a signal sampled at 30 kHz), when a 192-point Fast Fourier Transform is performed on the digitized signal, it contains 96 frequency bands within a frequency range not exceeding half the first sampling rate (e.g., not exceeding 15 kHz). Alternatively, the first analysis filter bank may contain 97 frequency bands, where the first frequency band (e.g., belonging to a first frequency range) and the last frequency band (e.g., belonging to a second frequency range) of the first analysis filter bank are half-bandwidth real-valued frequency bands. For example, for a second analysis filter bank corresponding to a second sampling rate of 20 kHz (e.g., and / or a third and / or a fourth analysis filter bank), when a 128-point Fast Fourier Transform is performed on the digitized signal, it contains 64 frequency bands within a frequency range not exceeding half the second sampling rate (e.g., not exceeding 10 kHz). Alternatively, the second analysis filter bank may contain 65 frequency bands, where the first frequency band (e.g., belonging to a first frequency range) of the second analysis filter bank is a half-bandwidth real-valued frequency band. The first and second analysis filter banks can share the first 64 frequency bands.
[0045] For example, when the first digitized signal x1[n] is sampled at a first sampling rate When sampling is performed and the frame duration is any integer multiple of 0.1 milliseconds, the first digitized signal contains N1 = 3 first frames, where n represents the sampling point index. For example, when the second digitized signal x2[n] is sampled at a second sampling rate... When sampling is performed and its frame duration is the same as that of the first digitized signal x1[n], the second digitized signal contains N2 = 2 second frames. The first frequency domain signal obtained after performing a fast Fourier transform on the first digitized signal can be expressed by the formula... Given, where k represents the frequency band index. The second frequency domain signal obtained after performing a Fast Fourier Transform on the second digitized signal can be expressed by the formula. Given. For example, each index k corresponds to kf. s / N is the frequency band given; for the first digitized signal, And N = N1; for the second digitized signal, And N = N². As mentioned above, the first 64 frequency bands of the first and second analysis filter banks can be combined because the determination of the first and second sampling rates satisfies that the duration of each frame in N¹ first frames is the same as the duration of each frame in N² second frames, thus making the first 64 frequency bands of the first and second analysis filter banks correspond to the same time interval and duration. In other words, since the duration of each frame in multiple first frames and multiple second frames is exactly the same, the first 64 frequency bands obtained by the 192-point Fast Fourier Transform are completely consistent with the first 64 frequency bands obtained by the 128-point Fast Fourier Transform. For example, the 65th frequency band obtained by the 128-point Fast Fourier Transform cannot be combined with the 65th frequency band obtained by the 192-point Fast Fourier Transform because the former's 65th frequency band is a real-valued frequency band, while the latter's 65th frequency band is a complex-valued frequency band.
[0046] For example, multiple digitized signals can be linearly combined within a frequency range where the first and second analysis filter groups (e.g., and / or the third and / or fourth analysis filter groups) share a common frequency band and / or channel and / or frequency component. The first and second analysis filter groups may have the same frequency resolution, but they may contain different numbers of frequency bands and / or channels. For example, in this invention, the terms frequency band, frequency component, and channel are used interchangeably.
[0047] In one or more exemplary hearing aids, a signal processing unit is configured to determine a first dominant frequency domain signal based on a first frequency domain signal. In one or more exemplary hearing aids, the first dominant frequency domain signal is associated with a first frequency range. For example, the first dominant frequency domain signal is associated with a first portion of a first set of frequency components. In other words, the first frequency range of the first frequency domain signal may include the first portion of the first set of frequency components. The first frequency range (e.g., the first frequency range of the first dominant frequency domain signal and the first frequency domain signal) may be considered as a set of common frequency (CF) components. A set of common frequency components can be interpreted as a set of frequency components that are present in both the first and second frequency domain signals. A set of non-common frequency (NCF) components can be interpreted as a set of frequency components that are not present in both the first and second frequency domain signals, for example, a set of frequency components that are present only in one of the first and second frequency domain signals.
[0048] In one or more exemplary hearing aids, a signal processing unit includes a first signal processing unit configured to determine a first processed signal based on a first dominant frequency domain signal and a second frequency domain signal. In one or more exemplary hearing aids, the first signal processing unit is configured to combine the first dominant frequency domain signal with the second frequency domain signal. In other words, the first signal processing unit may be configured to combine a portion of the first frequency domain signal with the second frequency domain signal. For example, the first signal processing unit is configured to combine a portion of a first digitized signal (e.g., a portion associated with a first frequency range) with a second digitized signal (e.g., a second digitized signal associated with the same first frequency range). For example, the first signal processing unit is configured to combine a portion of the first digitized signal with the second digitized signal, the portion of the signal belonging to the same frequency range as the second digitized signal (e.g., the portion of the signal and the second digitized signal containing the same set of frequency components). In one or more exemplary hearing aids, the first signal processing unit is configured to combine a common frequency component of the first frequency domain signal with all frequency components of the second frequency domain signal. The common frequency component of the first frequency domain signal can be interpreted as all frequency components present in the second frequency domain signal.
[0049] In one or more exemplary hearing aids, a first signal processing unit may be configured to combine a first primary frequency domain signal, a second frequency domain signal, a third frequency domain signal, and a fourth frequency domain signal. For example, the first signal processing unit may be configured to combine a portion of a first digitized signal with the second, third, and fourth digitized signals, wherein the portion of the signal belongs to the same frequency range as the second, third, and fourth digitized signals. The first signal processing unit may be configured to determine a first processed signal based on the first primary frequency domain signal, the second frequency domain signal, the third frequency domain signal, and the fourth frequency domain signal.
[0050] For example, when the first sampling rate is 30 kHz and the second sampling rate is 20 kHz, the first signal processing unit is configured to combine the lowest 64 frequency bands of the 96 frequency bands of the first frequency domain signal with 64 frequency bands of the second frequency domain signal (e.g., and / or 64 frequency bands of the third and / or fourth frequency domain signals). For example, when the first sampling rate is 30 kHz and the second sampling rate is 20 kHz, the upper limit of the first frequency range can be 15 kHz, and the upper limit of the second frequency range can be 10 kHz. In this example, the upper limit of the frequency range of the common frequency component of the first and second frequency domain signals is 10 kHz.
[0051] In one or more exemplary hearing aids, determining the first processed signal includes applying multi-channel processing techniques to a first primary frequency domain signal and a second frequency domain signal. In one or more exemplary hearing aids, the multi-channel processing techniques include beamforming techniques.
[0052] In one or more exemplary hearing aids, a first signal processing unit is configured to determine a first processed signal by performing a linear combination of a first dominant frequency domain signal and a second frequency domain signal, thereby achieving spatial filtering. For example, the first signal processing unit is configured to determine the first processed signal by multiplying the first dominant frequency domain signal and the second frequency domain signal by a constant and then adding them together for a given frequency band.
[0053] In one or more exemplary hearing aids, determining a first processed signal includes applying multi-channel processing techniques to a first primary frequency domain signal, a second frequency domain signal, a third frequency domain signal, and a fourth frequency domain signal. A first signal processing unit may be configured to determine the first processed signal by performing a linear combination of the first primary frequency domain signal, the second frequency domain signal, the third frequency domain signal, and the fourth frequency domain signal. For example, spatial filtering may be performed on common frequency components of the multiple frequency domain signals (e.g., the first frequency domain signal, the second frequency domain signal, the third frequency domain signal, and the fourth frequency domain signal).
[0054] In one or more exemplary hearing aids, beamforming techniques include one or more of the following: Linearly Constrained Minimum Variance (LCMV) beamforming, Minimum Variance Distortionless Response (MVDR) beamforming, Generalized Sidelobe Cancellation (GSC) beamforming, and any other applicable beamforming techniques. Various variations of beamforming techniques are described in existing literature.
[0055] For example, by applying multi-channel processing technology to the first main frequency domain signal and the second frequency domain signal (e.g., the first main frequency domain signal, the second frequency domain signal, the third frequency domain signal, and the fourth frequency domain signal), spatial filtering of the sound in the environment where the hearing aid is located can be performed, thereby enhancing the target sound source among multiple sound sources in the wearer's environment.
[0056] For example, applying multi-channel processing techniques to a first primary frequency domain signal and a second frequency domain signal (e.g., a first primary frequency domain signal, a second frequency domain signal, a third frequency domain signal, and a fourth frequency domain signal) can include the detection (e.g., adaptive detection) of the source direction of a specific portion of a microphone signal or wireless signal. Multi-channel processing techniques can achieve spatial attenuation of background noise sources.
[0057] For example, minimum variance distortionless response beamforming can keep sound signals from the target direction (e.g., line of sight) unaffected while maximally attenuating sound signals from other directions. For instance, generalized sidelobe cancellation can be considered an equivalent implementation of minimum variance distortionless response beamforming, offering computational and numerical advantages over the original direct implementation.
[0058] For example, directional processing can be achieved by linearly combining multiple input signals. Therefore, computational complexity increases (e.g., linearly) with the number of frequency bands in the analyzed filter bank (e.g., the number of frequency components in the set of multiple frequency components to be combined). For example, applying this technique to the first primary frequency domain signal and the second frequency domain signal requires lower processing performance compared to applying multi-channel processing techniques to multiple frequency domain signals covering a first and a second frequency range (e.g., compared to performing directional processing on all frequency bands). In other words, embodiments of the invention can perform directional processing on only a subset of the full frequency range available for signal processing, thereby saving computational resources. In other words, computational complexity can be reduced (e.g., extending the battery life of hearing aids) by making only one of multiple digitized signals correspond to the highest sampling rate.
[0059] In one or more exemplary hearing aids, a signal processing unit is configured to determine a first sub-frequency domain signal based on a first frequency domain signal. In one or more exemplary hearing aids, the first sub-frequency domain signal is associated with a second frequency range. For example, the first sub-frequency domain signal is associated with a second portion of a first set of frequency components. The second frequency range (e.g., a second frequency range of the first sub-frequency domain signal) may contain a set of high-frequency (HF) components. For example, the first sub-frequency domain signal may be considered as a second frequency range of the first frequency domain signal. In other words, the first sub-frequency domain signal may be associated with a set of non-common frequency components, such as frequency components that are not present in the second frequency domain signal but are present in the first frequency domain signal. The set of non-common frequency components may correspond to the frequency components of a digitized signal sampled at the highest sampling rate.
[0060] In one or more exemplary hearing aids, the signal processing unit includes a second signal processing unit configured to determine a second processed signal based on a first sub-frequency domain signal (e.g., a second frequency range of the first frequency domain signal) and a first processed signal. In one or more exemplary hearing aids, the second signal processing unit is configured to combine a second portion (e.g., a non-common frequency component) of a first set of frequency components of the first frequency domain signal with a combined signal of a first portion (e.g., a common frequency component) of the first set of frequency components of the first frequency domain signal and a second set of frequency components (e.g., a common frequency component) of the second frequency domain signal. For example, combining the first sub-frequency domain signal with the first processed signal specifically includes splicing the second portion of the first set of frequency components with the combined signal of the first portion and the second set of frequency components. For example, combining the first sub-frequency domain signal with the first processed signal specifically includes generating a vector containing a combined signal of the common frequency component of the first frequency domain signal and the frequency components of the second frequency domain signal, as well as the non-common frequency components of the first frequency domain signal.
[0061] For example, the first processed signal can be considered as a combination of a first frequency range of a first frequency domain signal and a first frequency range of a second frequency domain signal. In other words, the first processed signal can be considered as a combination of a common frequency component of the first frequency domain signal and a common frequency component of the second frequency domain signal. Optionally, the first processed signal is a signal obtained by combining a first frequency range of the first frequency domain signal (e.g., a first portion of a first group of frequency components), a second frequency domain signal (e.g., a second group of frequency components), a third frequency domain signal (e.g., a third group of frequency components), and a fourth frequency domain signal (e.g., a fourth group of frequency components). For example, the second processed signal can be considered as a frequency domain signal that simultaneously covers both the first and second frequency ranges. The second processed signal can be a full-band signal.
[0062] In one or more exemplary hearing aids, a second signal processing unit is configured to determine a third processed signal based on a second processed signal. In one or more exemplary hearing aids, determining the third processed signal includes applying a single-channel processing technique to the second processed signal. For example, a single-channel processing technique can be interpreted as a signal processing technique applicable to a single channel, such as a processing technique applicable to signals across the entire frequency band. In one or more exemplary hearing aids, the single-channel processing technique includes one or more of the following: noise reduction technology, hearing loss compensation technology, voice activity detection (VAD) technology, self-voice detection (OVD) technology, feedback cancellation technology, and any other applicable single-channel processing techniques.
[0063] In one or more exemplary hearing aids, single-channel processing technology is applied to the entire frequency band of the third-processed signal, for example, the full frequency range of the third-processed signal. In other words, the third-processed signal may simultaneously cover a first frequency range (e.g., the first frequency range of the first frequency domain signal and the frequency range of the second frequency domain signal) and a second frequency range (e.g., the second frequency range of the first frequency domain signal). Single-channel processing technology may be applied simultaneously to the first and second frequency ranges of the third-processed signal.
[0064] One advantage of this invention is that by configuring the second signal processing unit to combine a first processed signal (e.g., a combination of the common frequency components of a first frequency domain signal and the common frequency components of a second frequency domain signal) and a first sub-frequency domain signal (e.g., the non-common frequency components of the first frequency domain signal), computational complexity can be reduced, for example, extending the battery life of the hearing aid. In other words, by configuring the second signal processing unit to combine a first frequency range signal (e.g., a signal with improved directionality) and a second frequency range signal (e.g., a signal containing only a portion of the frequency components of the first frequency domain signal, such as a set of non-common frequency components, and the second frequency range being obtained by a higher sampling rate), it is possible to output an audio signal with better clarity and perception while reducing computational complexity (extending the battery life of the hearing aid). Embodiments of this invention can improve sound quality through wider bandwidth processing, specifically by combining the first processed signal with the first sub-frequency domain signal.
[0065] For example, computational complexity increases or decreases depending on the sampling rate (i.e., the number of samples per second) of the multiple digitized signals. For instance, processing only the non-common frequency components of a subset of the multiple digitized signals, such as processing only the non-common frequency components of the digitized signal corresponding to the highest sampling rate, can significantly reduce computational load.
[0066] For example, when the first sampling rate is 30kHz and the second sampling rate is 20kHz, the second signal processing unit is configured to process 96 frequency bands. The second signal processing unit is configured to process 96 frequency bands because it needs to determine the second processed signal by combining a first sub-frequency domain signal (e.g., containing 32 frequency bands, i.e., non-common frequency components) with a first processed signal (e.g., containing 64 frequency bands, i.e., common frequency components). The second processed signal may contain 96 frequency components. For example, the first 64 frequency bands (i.e., frequency components) of the second processed signal are based on a linear combination of multiple digitized signals (e.g., a first digitized signal, a second digitized signal, a third digitized signal, and a fourth digitized signal), while the last 32 frequency bands (i.e., frequency components) of the second processed signal are based on the first digitized signal, which is the digitized signal corresponding to the highest sampling rate. For example, the 96 frequency bands (i.e., frequency components) of the second processed signal can be further processed using single-channel processing techniques to achieve (compressed) hearing loss compensation or noise reduction, ultimately obtaining a third processed signal. The signal after the third processing can contain 96 frequency components.
[0067] One advantage of this invention is that by determining the third processed signal based on the first processed signal (i.e., the common frequency components of multiple digitized signals) and the second processed signal (i.e., the non-common frequency components of the digitized signal corresponding to the highest sampling rate), sound quality can be improved while ensuring reduced computational costs. Since the second signal processing unit is configured to jointly process the common frequency components of multiple digitized signals, as well as the non-common frequency components of the digitized signal (or at least two digitized signals) corresponding to the highest sampling rate, the overall computational cost of the hearing aid running the signal processing algorithm is reduced, thereby saving battery power.
[0068] For example, increasing the sampling rate of an audio signal typically leads to increased computational costs. Embodiments of the present invention avoid excessive computational overhead that is unavoidable when the second signal processing unit is configured to process the non-common frequency components of the entire digitized signal provided by the input unit.
[0069] One advantage of this invention is that by determining the third processed signal based on the first and second processed signals, computational complexity can be reduced without affecting the speech clarity and auditory perception of the output signal. In other words, the third processed signal can be a signal with better speech clarity and auditory perception, such as having better directionality and stronger anti-interference capabilities.
[0070] In one or more exemplary hearing aids, the signal processing unit includes a synthesis filter configured to determine a final processed signal based on a third processed signal. In one or more exemplary hearing aids, the synthesis filter is configured to determine the final processed signal by converting the third processed signal (e.g., a frequency domain signal) into a time domain signal. The final processed signal may be a time domain signal. In one or more examples, the synthesis filter is configured to operate at the highest of a first sampling rate and a second sampling rate. The synthesis filter may be configured to operate at the first sampling rate. In other words, the synthesis filter may be configured to output a time-domain signal sampled at the first sampling rate as the final processed signal.
[0071] For example, when the first sampling rate is 30kHz and the second sampling rate is 20kHz, the signal after the third processing is converted into a 30kHz digital time-domain signal, thus retaining signal components with a frequency upper limit of 15kHz. The high-frequency components of the signal after the third processing can originate from a single digitized signal.
[0072] Optionally, when the hearing aid user does not need to listen to the portion of the first digitized signal corresponding to the non-common frequency components, the synthesis filter can be configured to operate at the lowest of the first and second sampling rates. The synthesis filter can operate at the second sampling rate. For example, the synthesis filter is configured to determine the final processed signal based on the first processed signal, specifically based on the common frequency components of multiple frequency domain signals (e.g., a first frequency domain signal, a second frequency domain signal, and one or more of a third and fourth frequency domain signal). In one or more exemplary hearing aids, the second processed signal can be used for signal analysis, such as for self-voice detection.
[0073] For example, when the synthesis filter bank is not configured to support the non-common frequency components of the signal sampled at the highest sampling rate, the hearing aid can only utilize these non-common frequency components during a specific processing step. This processing must be able to affect the common frequency components of the signal sampled at the highest sampling rate, as well as the signal sampled at the lowest sampling rate. Specifically, the aforementioned technical effect can be achieved by using the non-common frequency components of the signal sampled at the highest sampling rate, and the combined signal of the common frequency components of that signal with the frequency components of the signals corresponding to each lowest sampling rate, as input to the detector. The detector includes, but is not limited to, one or more of the following: music detectors, sound scene classifiers, voice activity detectors, ultrasonic detectors, and self-voice detectors.
[0074] For example, the output unit is configured to output an audible signal to the user based on the final processed signal.
[0075] In one or more exemplary hearing aids, the input unit includes a first analog-to-digital converter (ADC) and a second ADC. In one or more exemplary hearing aids, the first ADC is configured to digitize a first input signal at a first sampling rate to generate a first digitized signal. In one or more exemplary hearing aids, the second ADC is configured to digitize a second input signal at a second sampling rate to generate a second digitized signal. In one or more exemplary hearing aids, the input unit may further include a third ADC configured to digitize a third input signal at a third sampling rate to generate a third digitized signal. In one or more exemplary hearing aids, the input unit may further include a fourth ADC configured to digitize a fourth input signal at a fourth sampling rate to generate a fourth digitized signal.
[0076] In one or more exemplary hearing aids, an analog-to-digital conversion unit is configured to digitize an analog input signal (e.g., a first input signal, a second input signal, a third input signal, a fourth input signal) at a preset sampling rate.
[0077] For example, an analog input signal can be converted into a digital audio signal during analog-to-digital conversion, wherein the analog input signal is sampled at a predetermined sampling frequency or sampling rate f. s (f s For example, sampling in the range of 8kHz to 48kHz to obtain discrete time points t n (n = 1, ..., N) provides digital (e.g., audio) samples x n (n = 1, ..., N), each digital (e.g., audio) sample is passed through a predetermined number of bits N. b (N b For example, within the range of 1 to 48 bits (e.g., 24 bits), it represents the corresponding electrical input signal at t. n The value at time. Sampling frequency or sampling rate f s It can be adjusted according to the specific needs of the application. For example, each digital (e.g., audio) sample uses N. b quantization is performed on bits (e.g., causing digital samples to have...). (different possible values). For example, the numerical sample x n The time length is 1 / f s (for example, when f) s=50 microseconds at 20kHz). Multiple digital (e.g., audio) samples can be arranged in a time frame. A time frame may include 64 or 128 audio data samples. Other frame lengths may also be used depending on the application. For example, each of multiple input signals (e.g., including a first input signal, a second input signal, and one or more of the following: a third input signal and a fourth input signal) includes multiple digital samples arranged in a time frame. In other words, each of the multiple input signals includes multiple frames.
[0078] Optionally, multiple analog-to-digital conversion units (e.g., one or more of a first analog-to-digital conversion unit, a second analog-to-digital conversion unit, and a third analog-to-digital conversion unit and a fourth analog-to-digital conversion unit) may be integrated into an assistive device (e.g., a mobile phone, a computer, etc.). The hearing aid may be configured to receive from the assistive device a first digitized signal sampled at a first sampling rate, a second digitized signal sampled at a second sampling rate, and one or more of a third digitized signal and a fourth digitized signal sampled at a second sampling rate.
[0079] In one or more exemplary hearing aids, the input unit includes an analog-to-digital converter (ADC) configured to digitize a first input signal and a second input signal at a third sampling rate to generate a first master digitized signal and a second master digitized signal. In one or more exemplary hearing aids, the third sampling rate differs from the first and second sampling rates. In one or more exemplary hearing aids, the third sampling rate is higher than the first and second sampling rates. In one or more exemplary hearing aids, the ADC is configured to digitize multiple input signals (e.g., a first input signal, a second input signal, and one or more of a third input signal and a fourth input signal) at the third sampling rate to generate multiple master digitized signals (e.g., a first master digitized signal, a second master digitized signal, and one or more of a third master digitized signal and a fourth master digitized signal).
[0080] For example, the single analog-to-digital converter unit can be integrated into an assistive device (e.g., a mobile phone, a computer, etc.). The hearing aid can be configured to receive from the assistive device a first digitized signal associated with a first sampling rate, a second digitized signal associated with a second sampling rate, and one or more of a third digitized signal and a fourth digitized signal associated with the second sampling rate.
[0081] For example, an analog-to-digital converter (ADC) unit can be integrated into an auxiliary device, which is configured to transmit digital signals sampled at a first sampling rate or a second sampling rate through the auxiliary device.
[0082] In one or more exemplary hearing aids, each of a plurality of input signals (e.g., one or more of a first input signal, a second input signal, and a third input signal, a fourth input signal) may be sampled at a third sampling rate, and the analog-to-digital conversion unit is configured to output a corresponding plurality of digital sampled signals (e.g., a plurality of first digital sampled signals, a plurality of second digital sampled signals, and a plurality of third digital sampled signals, a plurality of fourth digital sampled signals). In one or more exemplary hearing aids, performing analog-to-digital conversion includes applying anti-aliasing filtering technology to each of the plurality of input signals. In other words, generating a plurality of master digitized signals (e.g., a plurality of filtered digital sampled signals) involves applying anti-aliasing filtering technology to each of the plurality of input signals. The hearing aid may be equipped with an anti-aliasing low-pass filter for each of the plurality of input signals.
[0083] In one or more exemplary hearing aids, when a third sampling rate is higher than a first sampling rate and a second sampling rate, the input unit is configured to apply a downsampling technique to a first master digitized signal and a second master digitized signal to generate a first digitized signal and a second digitized signal. For example, the input unit is configured to apply a downsampling technique to multiple master digitized signals (e.g., a first master digitized signal, a second master digitized signal, and one or more of a third master digitized signal and a fourth master digitized signal) to generate multiple digitized signals (e.g., a first digitized signal, a second digitized signal, and one or more of a third digitized signal and a fourth digitized signal).
[0084] For example, the third sampling rate is significantly higher than the first and second sampling rates. For example, applying downsampling techniques to each of a plurality of master digitized signals may include decimating each master digitized signal by a specified factor. For example, when the third sampling rate is 960 kHz and the first master digitized signal is decimated by 32 times, the input unit is configured to output a first digitized signal associated with the first sampling rate of 30 kHz. For example, when the third sampling rate is 960 kHz and the second master digitized signal is decimated by 48 times, the input unit is configured to output a second digitized signal associated with the second sampling rate of 20 kHz.
[0085] In one or more exemplary hearing aids, when a third sampling rate is lower than a first sampling rate and a second sampling rate, the input unit is configured to apply an upsampling technique to a first master digitized signal and a second master digitized signal to generate a first digitized signal and a second digitized signal. For example, the input unit is configured to apply an upsampling technique to multiple master digitized signals (e.g., one or more of a first master digitized signal, a second master digitized signal, and a third master digitized signal, a fourth master digitized signal) to generate multiple digitized signals (e.g., one or more of a first digitized signal, a second digitized signal, and a third digitized signal, a fourth digitized signal). For example, the third sampling rate is significantly lower than the first sampling rate and the second sampling rate. For example, applying an upsampling technique to each of the multiple master digitized signals may include interpolating each master digitized signal by a specified multiple.
[0086] In one or more exemplary hearing aids, the analog-to-digital conversion process may include sampling each of a plurality of input signals (e.g., a first input signal, a second input signal, a third input signal, etc.) at a higher or lower sampling rate to generate a plurality of corresponding digital sampled signals (e.g., a first digital sampled signal, a second digital sampled signal, a third digital sampled signal, etc.). In one or more exemplary hearing aids, the analog-to-digital conversion process may include applying a corresponding anti-aliasing low-pass filter technique to each of the plurality of digital sampled signals to generate a plurality of corresponding filtered digital sampled signals (e.g., a first filtered digital sampled signal, a second filtered digital sampled signal, a third filtered digital sampled signal, etc.). In one or more exemplary hearing aids, the analog-to-digital conversion process may include applying downsampling or upsampling techniques to each of the plurality of filtered digital sampled signals to generate a plurality of corresponding digitized signals (e.g., a first digitized signal, a second digitized signal, a third digitized signal, etc.).
[0087] In one or more exemplary hearing aids, at least one of a plurality of input signals may be sampled using at least two different sampling rates. For example, the hearing aid is configured to automatically switch between at least two sampling rates. In other words, an analog-to-digital converter (ADC) unit may be configured to switch between at least two sampling rates. The ADC unit may be configured to sample the signal using a sampling rate retrieved from the memory of the hearing aid and / or external device. The memory of the hearing aid and / or external device may store at least two sampling rates available for use by the ADC unit.
[0088] In one or more exemplary hearing aids, the first input signal includes a wireless signal or a microphone signal representing the ambient sound of the hearing aid. For example, the first input signal is a wireless signal. For example, the first input signal is a microphone signal (e.g., an electrical input signal). In one or more exemplary hearing aids, the second input signal includes a wireless signal or a microphone signal representing the ambient sound of the hearing aid. For example, the second input signal is a wireless signal. For example, the second input signal is a microphone signal (e.g., an electrical input signal). For example, both the first and second input signals are microphone signals. For example, both the first and second input signals are wireless signals. For example, the first input signal is a microphone signal and the second input signal is a wireless signal. For example, the first input signal is a wireless signal and the second input signal is a microphone signal.
[0089] In one or more exemplary hearing aids, the input unit includes one or more of a plurality of microphones and wireless receivers (e.g., or a plurality of wireless receivers).
[0090] In one or more exemplary hearing aids, the wireless signal may be a signal received by the hearing aid from an assistive device (e.g., a mobile phone, a lavalier microphone, etc.). For example, the wireless signal may be considered a digital audio signal, such as a digitally sampled streaming music signal. An analog-to-digital converter integrated in the hearing aid may be configured to resample the digital audio signal to a preset sampling rate, such as a first sampling rate or a second sampling rate. For example, the wireless signal may be a signal sampled at a high sampling rate, such as a music signal. For example, when the input signal is taken from an external microphone or the contralateral hearing aid paired with the hearing aid, the sampling rate of the input signal is preferably lower than the highest operating sampling rate supported by the hearing aid. In other words, audio streaming applications (e.g., music playback) can benefit from a high sampling rate. On the other hand, microphone signals used for beamforming (e.g., binaural microphone signals) do not require such a high sampling rate.
[0091] For example, multiple microphones are configured to output corresponding multiple electrical input signals representing sounds in the environment where the hearing aid is located. In other words, the input unit may include multiple input transducers (e.g., multiple microphones) configured to convert input sounds in the environment where the hearing aid is located into corresponding multiple electrical input signals. For example, multiple microphones are configured to acquire the corresponding multiple input signals. For example, the hearing aid is configured to acquire a first input signal among the multiple electrical input signals via a first microphone among the multiple microphones. For example, the hearing aid is configured to acquire a second input signal among the multiple electrical input signals via a second microphone among the multiple microphones. For example, the hearing aid is configured to acquire a third input signal among the multiple electrical input signals via a third microphone among the multiple microphones. For example, the hearing aid is configured to acquire a fourth input signal among the multiple electrical input signals via a fourth microphone among the multiple microphones.
[0092] The wireless receiver is configured to receive a wireless signal (e.g., a first input signal, a second input signal, a third input signal, a fourth input signal, etc.) that contains or represents sounds of the environment in which the hearing aid is located. For example, the wireless receiver is configured to output the wireless signal. In one or more exemplary hearing aids, the wireless receiver is configured to receive electromagnetic signals in a radio frequency band (e.g., 3 kHz to 300 GHz). In one or more exemplary hearing aids, the wireless receiver may be configured to receive electromagnetic signals in an optical frequency band (e.g., infrared light from 300 GHz to 430 THz, or visible light from 430 THz to 770 THz).
[0093] In one or more exemplary hearing aids, the input signal characterizes sounds emitted by the hearing aid user, other people, or other sound sources in the environment in which the hearing aid is located. For example, the input signal may characterize the user's speech. For example, the input signal may include one or more of the following: user speech, interference speech, echo, noise (e.g., ambient noise, continuous noise, intermittent noise, impulse noise, and / or low-frequency noise).
[0094] In one or more exemplary hearing aids, the output unit includes a digital-to-analog converter (DAC) configured to convert a processed signal (e.g., a digital signal) into an analog output signal for presentation to a user wearing the hearing aid. The output unit may be configured to output an audible signal based on the analog output signal. The analog output signal may be converted into an acoustic signal by an output transducer.
[0095] In one or more exemplary hearing aids, the hearing aid includes a "forward" (or "signal") path configured to process audio signals between the hearing aid's inputs and outputs. In one or more exemplary hearing aids, a signal processing unit is configured to apply one or more processing algorithms to multiple input signals (e.g., input signals in the forward path from the hearing aid's input to its output), such as a first input signal, a second input signal, and one or more of the following: a third input signal and a fourth input signal, etc. The signal processing unit may be located in the forward path. One or more processing algorithms may include a compression algorithm configured to amplify (e.g., attenuate) the signal according to the user's needs, such as compensating for the user's hearing impairment. Other processing algorithms may include frequency shifting, feedback control, etc. For example, the signal processing unit is configured to provide frequency-dependent gain and / or level-dependent compression and / or frequency shifting (with or without frequency compression) from one or more frequency ranges to one or more other frequency ranges, such as compensating for the user's hearing impairment. The signal processing unit may be configured to amplify multiple input signals and provide a processed signal.
[0096] Hearing aids may include an "analysis" path, which comprises functional components configured to analyze signals and / or control forward path processing. Some or all of the signal processing in the analysis path and / or forward path may be performed in the frequency domain, in which case the hearing aid includes appropriate analysis and synthesis filter banks. Some or all of the signal processing in the analysis path and / or forward path may be performed in the time domain.
[0097] Most sound sources (except for the user's own voice) are relatively small compared to the size of a hearing aid, such as the distance d between two microphones in a directional system. mic Located away from the user. Typical microphone distance in hearing aids is in the 10mm range. The minimum distance for sound sources of interest to the user (e.g., sound from the user's mouth or sound from an audio transmission device) is 0.1m (>10d). mic Level 1. For such a minimum distance, the hearing aid (e.g., a microphone) will be in the acoustic near field of the sound source, and the level difference of the sound signal incident on the corresponding microphone may be significant. Typical distances for communication partners are greater than 1m (>100d). mic The hearing aid (e.g., a microphone) will be in the acoustic far field of the sound source, and the level difference of the sound signal incident on the corresponding microphone will be insignificant. The arrival time difference of the sound incident along the microphone axis (e.g., in front of or behind a normal hearing aid) is ΔT = d mic / v sound =0.01 / 343[s] = 29μs, where v sound The speed of sound in air at 20°C is 343 m / s.
[0098] In one or more example hearing aids, the hearing aid includes an antenna and transceiver circuitry that enables the establishment of a wireless link to an entertainment device (e.g., a television), a communication device (e.g., a telephone), a wireless microphone, a separate (external) processing device, or another hearing aid. The hearing aid may be configured to wirelessly receive direct electrical input signals (e.g., wireless signals) from another device. Similarly, the hearing aid may be configured to wirelessly transmit direct electrical output signals (e.g., wireless signals) to another device. The direct electrical input or output signals may represent or include audio signals and / or control signals and / or information signals.
[0099] The wireless link established by the antenna and transceiver circuitry of the hearing aid can be of any type. The wireless link can be a near-field communication-based link, such as an inductive link based on inductive coupling between the antenna coils of the transmitter and receiver sections. The wireless link can also be based on far-field electromagnetic radiation. Preferably, the frequency used to establish the communication link between the hearing aid and another device is below 70 GHz, for example, in the range from 50 MHz to 70 GHz, or above 300 MHz, for example, in the ISM range above 300 MHz, or in the 900 MHz range, or in the 2.4 GHz range, or in the 5.8 GHz range, or in the 60 GHz range (ISM = Industrial, Scientific and Medical, such standardized ranges are defined, for example, by the International Telecommunication Union ITU). The wireless link can be based on standardized or proprietary technologies. The wireless link can be based on Bluetooth technology (e.g., Bluetooth Low Energy technology, such as LE Audio) or Ultra Wideband (UWB) technology.
[0100] In one or more example hearing aids, the hearing aid constitutes or may be part of a portable (i.e., configured to be wearable) device, such as a device that includes a local power source, such as a battery, or a rechargeable battery. The hearing aid may be a low-weight, easy-to-wear device, for example having a total weight of less than 100g, less than 20g, or less than 5g.
[0101] Hearing aids can be configured to operate in different modes, such as a normal mode and one or more specific modes, which may be user-selectable or automatically selected. Operating modes can be optimized for specific acoustic conditions or environments, such as communication modes like telephone modes. Operating modes may include low-power modes, where the hearing aid's functionality is reduced (e.g., for energy saving), such as disabling wireless communication and / or disabling specific features of the hearing aid.
[0102] Hearing aids may include multiple detectors configured to provide status signals relating to the hearing aid's current network environment (such as the current acoustic environment), and / or the current state of the user wearing the hearing aid, and / or the current state or operating mode of the hearing aid. Alternatively or additionally, one or more detectors may form part of an external device that communicates with the hearing aid (e.g., wirelessly). External devices may include, for example, another hearing aid, a remote control, an audio transmission device, a telephone (e.g., a smartphone), external sensors, etc.
[0103] One or more of a plurality of detectors can operate on a full-band signal (time domain). One or more of a plurality of detectors can operate on a band-split signal ((time-)frequency domain), for example, in a finite number of frequency bands.
[0104] Multiple detectors may include level detectors for estimating the current level of the signal in the forward path. Detectors may be configured to determine whether the current level of the signal in the forward path is above or below a given (L-) threshold. For example, the level detector operates on a full-band signal (time domain). For example, the level detector operates on a band-split signal ((time-)frequency domain). For example, the level detector is configured to estimate a gain amount within a given frequency band (e.g., frequency components). This gain amount may depend on the current level of the forward path signal (e.g., compression). For example, a single-channel processing technique may include a level detection technique (e.g., performed by the level detector).
[0105] Hearing aids may include a VAD (Voice Activity Detector) unit for estimating whether (or with what probability) an input signal (at a given time point) includes a speech signal. For example, the VAD unit may be configured to apply VAD technology to a first sub-frequency domain signal. The speech signal may include speech signals from humans. It may also include other forms of vocalization produced by the human speech system (such as singing). The VAD unit may be adapted to classify the user's current acoustic environment as a "voice" or "no-voice" environment. For example, this is advantageous because time periods including electrical microphone signals of human vocalizations (such as speech) in the user's environment can be identified and thus separated from time periods that include only (or primarily) other sound sources (such as artificially generated noise). The VAD unit may be configured to also detect the user's own speech as "voice." Alternatively, the VAD unit may be configured to exclude the user's own speech from the detection of "voice."
[0106] Hearing aids may include an OVD (Self-Voice Detector) unit for estimating whether (or with what probability) a particular input sound (such as speech) originates from the user of the hearing aid system. For example, the OVD unit may be configured to apply OVD technology to a first sub-frequency domain signal. The hearing aid is able to distinguish between the user's own voice and another person's voice, and possibly between the user's own voice and any non-voice sounds.
[0107] Multiple detectors may include motion detectors such as accelerometers. Motion detectors may be configured to detect movements of a user’s facial muscles and / or bones, such as those caused by speech or chewing (e.g., jaw movements), and provide detector signals indicating those movements.
[0108] The hearing aid may include a classification unit configured to classify the current situation based on input signals from (at least partially) a detector and possibly other inputs. In this specification, "current situation" may be defined by one or more of the following:
[0109] a) Physical environment (including the current electromagnetic environment, such as the presence of electromagnetic signals (including audio and / or control signals) that are planned or unplanned to be received by the hearing aid, or other properties of the current environment that are different from acoustics);
[0110] b) Current acoustic conditions (e.g., input level, feedback, etc.);
[0111] c) The user's current mode or state (e.g., movement, temperature, cognitive load, etc.);
[0112] d) The current mode or state of the hearing aid and / or another device communicating with the hearing aid (such as the selected program, the time elapsed since the last user interaction, etc.).
[0113] The classification unit may be based on or may include neural networks, such as recurrent neural networks, or trained neural networks.
[0114] In one or more example hearing aids, the hearing aid includes an acoustic (and / or mechanical) feedback control (such as suppression) or echo cancellation system. For example, the acoustic feedback control or echo cancellation system is configured to apply feedback cancellation techniques to a first sub-frequency domain signal. For example, adaptive feedback cancellation enables tracking of changes in the feedback path over time. It may be based on a linear time-invariant filter that estimates the feedback path, with filter weights updated over time. The filter update can be computed using a stochastic gradient algorithm, such as the least mean square (LMS) algorithm or the normalized LMS (NLMS) algorithm. For example, these algorithms minimize the error signal in terms of mean square, and NLMS further normalizes the filter update with respect to the square of the Euclidean norm of a reference signal.
[0115] In one or more example hearing aids, the hearing aid may also include other suitable functions for the application in question, such as compression, noise reduction, etc.
[0116] In one or more example hearing aids, the hearing aid includes a hearing instrument, such as a hearing instrument configured to be located at the hearing aid user's ear or wholly or partially in the ear canal.
[0117] use
[0118] On the one hand, the uses of the hearing aids described above, in detail in the Detailed Description section, are also provided. Use in systems comprising one or more hearing aids (e.g., hearing instruments) is also possible.
[0119] method
[0120] A method of operating a hearing aid is disclosed herein. The method includes providing a first digitized signal associated with a first sampling rate and a second digitized signal associated with a second sampling rate. The first digitized signal includes a plurality of first frames (e.g., including a first master frame), each first frame containing a plurality of first sample points. The second digitized signal includes a plurality of second frames (e.g., including a second master frame), each second frame containing a plurality of second sample points.
[0121] The method includes determining a first sampling rate greater than a second sampling rate such that the duration of each first frame is the same as the duration of each second frame, thereby making (e.g., implementing and / or allowing) the number of first sampling points greater than the number of second sampling points. In other words, the first sampling rate may be different from the second sampling rate, such that the duration of the first main frame is the same as the duration of the second main frame.
[0122] The method includes providing a first frequency domain signal based on a first digitized signal, the first frequency domain signal being associated with a first frequency range and a second frequency range. The method also includes providing a second frequency domain signal based on a second digitized signal, the second frequency domain signal being associated with the first frequency range. The determination of a first sampling rate and a second sampling rate such that (e.g., allows and / or causes) the first frequency range of the first frequency domain signal to contain the same frequency band as the second frequency domain signal.
[0123] The method includes determining a first processed signal based on a first frequency range of a first frequency domain signal and a second frequency domain signal. The method also includes outputting an audible signal to a user wearing a hearing aid based on the first processed signal.
[0124] When some or all of the structural features of the hearing aid described above or in the "Detailed Description" are appropriately replaced by the corresponding process, these structural features can be combined with the implementation of the method of the present invention, and vice versa. The implementation of the method of the present invention has the same advantages as the corresponding hearing aid.
[0125] Computer-readable media or data carrier
[0126] The present invention further provides a tangible computer-readable medium (data carrier) storing a computer program including program code (instructions), which, when the computer program is run on a data processing system (computer), causes the data processing system to perform (implement) at least some (such as most or all) of the steps of the methods described above, in detail in the "Detailed Description" and as defined in the claims.
[0127] By way of example, but not limitation, the aforementioned tangible computer-readable media may include RAM, ROM, EEPROM, CD-ROM or other optical disc storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to execute or store required program code in the form of instructions or data structures and is accessible by a computer. As used herein, disks include compact discs (CDs), laser discs, optical discs, digital multipurpose discs (DVDs), floppy disks, and Blu-ray discs, wherein these disks typically magnetically copy data while simultaneously being optically copied using lasers. Other storage media include those stored in DNA (e.g., in synthetic DNA strands). Combinations of the aforementioned disks should also be included within the scope of computer-readable media. In addition to being stored on tangible media, computer programs may also be transmitted via transmission media such as wired or wireless links or networks such as the Internet and loaded into data processing systems to run at locations other than tangible media.
[0128] Computer program
[0129] In addition, this application provides a computer program (product) including instructions that, when run by a computer, cause the computer to perform the steps of the methods (methods) described above, in detail in the "Detailed Description" section, and as defined in the claims.
[0130] Data processing system
[0131] In one aspect, the present invention further provides a data processing system, including a processor and program code, the program code causing the processor to perform at least some (such as most or all) of the steps of the methods described above, in detail in the "Detailed Description" section, and as defined in the claims.
[0132] Hearing aid system
[0133] On the other hand, hearing aids and hearing aid systems including assistive devices are provided, including those described above, described in detail in the "Detailed Description" section, and defined in the claims.
[0134] Hearing aid systems can be adapted to establish a communication link between a hearing aid and an assistive device so that information (e.g., control and status signals, possibly audio signals) can be exchanged or forwarded from one device to another. Hearing aid systems can be configured to perform the processing according to the invention, such as ultrasound reduction, entirely or partially in a separate audio processing device.
[0135] The auxiliary device may include a remote control, a smartphone, or other portable or wearable electronic device such as a smartwatch or may be composed of such devices.
[0136] The assistive device may consist of or include a remote control for controlling the functions and operation of the hearing aid. The remote control functionality is implemented in a smartphone, which may run an app that enables control of the audio processing device via the smartphone (the hearing aid includes a suitable wireless interface to the smartphone, such as Bluetooth or some other standardized or proprietary solution).
[0137] The assistive device may be constituted by or include an audio gateway device, which is adapted to receive multiple audio signals (e.g., from an entertainment device such as a TV or music player, from a telephone device such as a mobile phone, or from a computer such as a PC, a wireless microphone, etc.) and is adapted to select and / or combine appropriate signals (or combinations of signals) from the received audio signals to transmit to the hearing aid.
[0138] The assistive device may be composed of or may include another hearing aid. The hearing aid system may include two hearing aids adapted to implement a binaural hearing aid system, such as a binaural hearing aid system.
[0139] APP
[0140] On the other hand, the present invention also provides a non-transitory application called an APP. The APP includes executable instructions configured to run on an assistive device to implement a user interface for the hearing aid or hearing aid system described above, in detail in the "Detailed Description," and as defined in the claims. The APP can be configured to run on a mobile phone, such as a smartphone, or another portable device enabled to communicate with the hearing device or hearing aid system.
[0141] definition
[0142] In this specification, a hearing aid, such as a hearing instrument, refers to a device suitable for improving, enhancing, and / or protecting a user's hearing ability, which achieves this by receiving sound signals from the user's environment, generating corresponding audio signals, possibly modifying the audio signals, and providing the possibly modified audio signals as audible signals to at least one ear of the user. The audible signals may be provided, for example, as sound signals radiated into the user's outer ear, and / or as sound signals transmitted as mechanical vibrations through the bone structures of the user's head and / or through portions of the middle ear to the user's inner ear.
[0143] Hearing aids can be configured to be worn in any known manner, such as as a unit worn behind the ear (having a tube that directs radiated sound signals into the ear canal or having an output transducer, such as a speaker, arranged close to or within the ear canal), or as a unit wholly or partially arranged in the auricle and / or ear canal. Hearing aids may comprise a single unit or several units that communicate with each other (e.g., acoustically, electrically, or optically). The speaker may be housed within the housing along with other components of the hearing aid, or it may be an external unit (possibly combined with a flexible guiding element such as a dome-shaped element).
[0144] Hearing aids can be adapted to the specific needs of users, such as those with hearing loss. The configurable signal processing circuitry of a hearing aid can be adapted to apply frequency- and level-variable compression and amplification of the input signal. Customized frequency- and level-variable gain (amplification or compression) can be determined during the fitting process by the fitting system based on the user's hearing data, such as an audiogram, using basic fitting principles (e.g., speech adaptation). This frequency- and level-variable gain can be reflected, for example, in processing parameters, uploaded to the hearing aid via an interface to a programming device (fitting system), and used by a processing algorithm executed by the hearing aid's configurable signal processing circuitry (e.g., a signal processing unit).
[0145] A “hearing aid system” refers to a system that includes one or two hearing aids. A “binaural hearing aid system” refers to a system that includes two hearing aids and is adapted to work together to provide audible signals to both of a user’s ears. A hearing aid system or a binaural hearing aid system may also include one or more “assistive devices” that communicate with the hearing aids and influence and / or benefit from the functionality of the hearing aids. The aforementioned assistive devices may include at least one of the following: a remote control, a remote microphone, an audio gateway device, an entertainment device such as a music player, a wireless communication device such as a mobile phone (e.g., a smartphone), or a tablet computer, or another device, such as one that includes a graphical interface. Hearing aids, hearing aid systems, or binaural hearing aid systems may, for example, be used to compensate for hearing loss in persons with hearing impairments, enhance or protect the hearing ability of persons with normal hearing, and / or transmit electronic audio signals to persons. Hearing aids or hearing aid systems may, for example, be part of or interact with broadcasting systems, active ear protection systems, hands-free telephone systems, car audio systems, entertainment (e.g., television, music playback, or karaoke) systems, teleconferencing systems, classroom amplification systems, etc. Attached Figure Description
[0146] Various aspects of the invention will be best understood from the following detailed description taken in conjunction with the accompanying drawings. For clarity, these drawings are schematic and simplified, showing only the details necessary for understanding the invention while omitting other details. Throughout the specification, the same reference numerals are used for the same or corresponding parts. Features of each aspect may be combined with any or all features of other aspects. These and other aspects, features, and / or technical effects will be apparent from and illustrated in the following figures, wherein:
[0147] Figures 1A to 1B An exemplary first hearing aid according to the present invention is illustrated schematically;
[0148] Figures 2A to 2B An exemplary second hearing aid according to the present invention is illustrated schematically;
[0149] Figures 3A to 3B An exemplary third hearing aid according to the present invention is illustrated schematically;
[0150] Figures 4A to 4B An exemplary fourth hearing aid according to the present invention is illustrated schematically;
[0151] Figure 5 A flowchart illustrating an exemplary method according to the present invention is shown.
[0152] The further applicability of the invention will become apparent from the detailed description given below. However, it should be understood that while the detailed description and specific examples illustrate preferred embodiments of the invention, they are given for illustrative purposes only. Other embodiments of the invention will become apparent to those skilled in the art based on the following detailed description. Detailed Implementation
[0153] The detailed description below, taken in conjunction with the accompanying drawings, serves as a description of various different configurations. This detailed description includes specific details to provide a thorough understanding of several different concepts. However, it will be apparent to those skilled in the art that these concepts can be implemented without these specific details. Several aspects of the apparatus and method are described by various different blocks, functional units, modules, elements, circuits, steps, processes, algorithms, etc. (collectively, “elements”). Depending on the specific application, design constraints, or other reasons, these elements may be implemented using electronic hardware, computer programs, or any combination thereof.
[0154] Electronic hardware may include microelectromechanical systems (MEMS), (e.g., application-specific integrated circuits), microprocessors, microcontrollers, digital signal processors (DSPs), field-programmable gate arrays (FPGAs), programmable logic devices (PLDs), gating logic, discrete hardware circuits, printed circuit boards (PCBs) (e.g., flexible PCBs), and other suitable hardware configured to perform the various functions described in this specification, such as sensors for sensing and / or recording the physical properties of the environment, devices, users, etc. Computer programs should be interpreted broadly as instructions, instruction sets, code, code segments, program code, programs, subroutines, software modules, applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, programs, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description languages, or other names.
[0155] Figures 1A to 1B An exemplary first hearing aid 300 according to the present invention is illustrated schematically. Figure 1A The first hearing aid 300 includes an input unit 301, a signal processing unit 314, and an output unit 315.
[0156] exist Figure 1A In the illustrated embodiment, input unit 301 is configured to provide a first digitized signal 303AA associated with a first sampling rate f1 and a second digitized signal 303BA associated with a second sampling rate f2. The first digitized signal 303AA comprises a plurality of first frames, each containing a plurality of first sampling points. The second digitized signal 303BA comprises a plurality of second frames, each containing a plurality of second sampling points.
[0157] The hearing aid 300 (e.g., an input unit) is configured to determine a first sampling rate f1 that is greater than (e.g., different from) a second sampling rate f2, such that the duration of each first frame is the same as the duration of each second frame, thereby enabling (e.g., achieving and / or allowing) a greater number of first sample points than the number of second sample points. In other words, the first sampling rate f1 may be different from the second sampling rate f2, such that the duration of each first frame is the same as the duration of each second frame.
[0158] In one or more exemplary hearing aids, input unit 301 includes a plurality of microphones and a plurality of analog-to-digital conversion units. Figure 1A In the illustrated embodiment, the plurality of microphones includes a first microphone 302A and a second microphone 302B. Figure 1A In the illustrated embodiment, the plurality of analog-to-digital conversion units include a first analog-to-digital conversion unit 303A and a second analog-to-digital conversion unit 303B.
[0159] In one or more exemplary hearing aids, a first microphone 302A is configured to provide a first input signal 302AA. For example, the first input signal 302AA includes a microphone signal representing ambient sound in which the first hearing aid 300 is located. In other words, the first input signal 302AA can be considered as a microphone signal.
[0160] In one or more exemplary hearing aids, a second microphone 302B is configured to provide a second input signal 302BA. For example, the second input signal 302BA includes a microphone signal representing ambient sound in which the first hearing aid 300 is located. In other words, the second input signal 302BA can be considered as a microphone signal.
[0161] Optionally, the input unit 301 may include a wireless receiver configured to receive a first input signal 302AA and / or a second input signal 302BA. The first input signal 302AA may be a wireless signal. The second input signal 302BA may be a wireless signal. Both the first input signal 302AA and the second input signal 302BA may be wireless signals.
[0162] In one or more exemplary hearing aids, a first analog-to-digital converter (ADC) 303A is configured to digitize a first input signal 302AA at a first sampling rate f1 to generate a first digitized signal 303AA. In other words, the first ADC AD1 may be configured to provide the first digitized signal 303AA by sampling the first input signal 302AB at the first sampling rate f1. In one or more examples, a second ADC 303B is configured to digitize a second input signal 302BA at a second sampling rate f2 to generate a second digitized signal 303BA. In other words, the second ADC AD2 may be configured to provide the second digitized signal 303BA by sampling the second input signal 302BA at the second sampling rate f2. For example, the first sampling rate f1 is greater than the second sampling rate f2.
[0163] Optionally, the first hearing aid 300 may include a single analog-to-digital converter (ADC). Figure 1A(Not shown in the image), the analog-to-digital converter (ADC) unit is configured to digitize the first input signal 302AA and the second input signal 302BA using a third sampling rate to generate a first master digitized signal and a second master digitized signal. In other words, the single ADC unit can be configured to sample the first input signal 302AA and the second input signal 302BA at a third sampling rate. For example, the third sampling rate is different from the first sampling rate f1 and the second sampling rate f2. For example, when the third sampling rate is higher than the first sampling rate f1 and the second sampling rate f2, the input unit 301 is configured to apply downsampling techniques to the first master digitized signal and the second master digitized signal to generate a first digitized signal 303AA and a second digitized signal 303BA. For example, when the third sampling rate is lower than the first sampling rate f1 and the second sampling rate f2, the input unit 301 is configured to apply upsampling techniques to the first master digitized signal and the second master digitized signal to generate a first digitized signal 303AA and a second digitized signal 303BA.
[0164] Optionally, the first analog-to-digital converter (ADC) unit 303A and the second ADC unit 303B can be integrated into an assistive device (e.g., a mobile phone, a computer, etc.). The first hearing aid 300 can be configured to receive a first digitized signal 303AA sampled at a first sampling rate f1 and a second digitized signal 303BA sampled at a second sampling rate f2 from the assistive device. For example, the aforementioned single ADC unit can also be integrated into the assistive device.
[0165] In one or more exemplary hearing aids, a first hearing aid 300 includes a plurality of analysis filter groups, which include a first analysis filter group 306A and a second analysis filter group 306B. Optionally, an input unit 301 may include a first analysis filter group 306A and a second analysis filter group 306B. For example, the first analysis filter group 306A is configured to provide a first frequency domain signal 306AA based on a first digitized signal 303AA. The first frequency domain signal 306AA is associated with a first frequency range ΔF1 and a second frequency range ΔF2. The first analysis filter group 306A is associated with a first set of frequency components. For example, a first portion of the first set of frequency components may be considered as a first frequency range ΔF1 of the first frequency domain signal 306AA. For example, a second portion of the first set of frequency components may be considered as a second frequency range ΔF2 of the first frequency domain signal 306AA. In one or more exemplary hearing aids, a second analysis filter group 306B is configured to provide a second frequency domain signal 306BA based on a second digitized signal 303BA. The second frequency domain signal 306BA is associated with the first frequency range ΔF1. The second analysis filter bank FB2 is associated with the second set of frequency components. This second set of frequency components may be the same as the first portion of the first set of frequency components. The frequency range of the second frequency domain signal 306BA may be a subset of the frequency range of the first frequency domain signal 306AA. In other words, the first sampling rate f1 may be greater than the second sampling rate f2.
[0166] For example, signal processing unit 314 is configured to determine processed signal 314C based on first digitized input signal 303AA and second digitized input signal 303BA. For example, signal processing unit 314 is configured to determine processed signal 314C based on first frequency domain signal 306AA and second frequency domain signal 306BA.
[0167] In one or more exemplary hearing aids, output unit 315 includes digital-to-analog converter 316 configured to convert a processed signal 314C (e.g., a digital signal) into an analog output signal 316A for presentation to a user wearing the first hearing aid 300 via output unit OUT (e.g., an output transducer 318 such as a speaker).
[0168] In one or more exemplary hearing aids, output unit 315 is configured to output an audible signal 318A to a user wearing a first hearing aid 300 based on a processed signal 314C. Figure 1A In the illustrated embodiment, the output unit 315 is configured to output an audible signal 318A based on the analog output signal 316A. The analog output signal 316A can be converted into an acoustic signal by the output transducer 318.
[0169] Figure 1BA signal processing unit 314 of a first hearing aid 300 is shown. The signal processing unit 314 may include a first signal processing unit 314A and a second signal processing unit 314B.
[0170] In one or more exemplary hearing aids, signal processing unit 314 is configured to determine a first dominant frequency domain signal 306AAA based on a first frequency domain signal 306AA. For example, the first dominant frequency domain signal 306AAA is associated with a first frequency range ΔF1. In other words, the first dominant frequency domain signal 306AAA may characterize the signal of the first frequency domain signal 306AA within the first frequency range ΔF1. A second frequency domain signal 306BA may characterize itself within the first frequency range ΔF1, for example, having the same set of frequency components as the first frequency domain signal 306AA. The first frequency range ΔF1 may contain a common set of frequency components.
[0171] A first signal processing unit 314A (e.g., signal processing unit 314) is configured to determine a first processed signal 308 based on a first dominant frequency domain signal 306AAA (e.g., a first frequency range of the first frequency domain signal 306AA) and a second frequency domain signal 306BA. In one or more exemplary hearing aids, the first signal processing unit 314A is configured to determine the first processed signal 308 by applying a multi-channel processing technique to the first dominant frequency domain signal 306AAA and the second frequency domain signal 306BA. This multi-channel processing technique may include beamforming. In other words, the first signal processing unit 314A may be configured to combine the first dominant frequency domain signal 306AAA with the second frequency domain signal 306BA to achieve spatial filtering of ambient sound in which the first hearing aid 300 is located.
[0172] In one or more exemplary hearing aids, signal processing unit 314 is configured to determine a first sub-frequency domain signal 306AAB based on a first frequency domain signal 306AA. For example, the first sub-frequency domain signal 306AAB is associated with a second frequency range ΔF2. The first sub-frequency domain signal 306AB may characterize the signal of the first frequency domain signal 306AA within the second frequency range ΔF2, for example, corresponding to a second portion of a first set of frequency components. The second frequency range ΔF2 may contain a set of non-common frequency components.
[0173] In one or more exemplary hearing aids, a second signal processing unit 314B is configured to determine a second processed signal 310A based on a first sub-frequency domain signal 306AAB and a first processed signal 308.
[0174] For example, the second signal processing unit 314B includes a mixing unit 310 configured to determine a second processed signal 310A. The mixing unit 310 may be configured to combine a first processed signal 308 (e.g., a combination of the common frequency components of the first frequency domain signal 306AA and the common frequency components of the second frequency domain signal 306BA) with a first sub-frequency domain signal 306AAB (e.g., the non-common frequency components of the first frequency domain signal 306AA). For example, the mixing unit 310 may be considered a combining unit configured to combine (e.g., splice) the non-common frequency components of the first frequency domain signal 306AA with the combination of the common frequency components of the first frequency domain signal 306AA and the frequency components of the second frequency domain signal 306BA into a joint vector. The second processed signal 310A may be considered as this joint vector. For example, the second processed signal 310A is a frequency domain signal, such as a full-band signal.
[0175] For example, the second signal processing unit 314B is configured to determine the third processed signal 312A based on the second processed signal 310A. For example, the second signal processing unit 314B is configured to determine the third processed signal 312A by applying a single-channel processing technique to the second processed signal 310A. For example, the second signal processing unit 314B includes a single-channel processing unit 312 configured to apply a single-channel processing technique to the second processed signal 310A. This single-channel processing technique may include one or more of the following: noise reduction technique, hearing loss compensation technique, voice activity detection technique, self-voice detection technique, feedback cancellation technique, and any other applicable single-channel processing technique. The third processed signal 312A may be a frequency domain signal, for example, a full-band signal processed by one or more of the following: noise reduction, hearing loss compensation, voice activity detection, self-voice detection, and feedback cancellation.
[0176] In one or more exemplary hearing aids, signal processing unit 314 includes a synthesis filter 313 configured to determine a processed signal 314C based on a third processed signal 312A. For example, synthesis filter 313 is configured to determine processed signal 314C by converting the third processed signal 312A into a time-domain signal. Processed signal 314C may be a time-domain signal. For example, synthesis filter 313 is configured to operate at the higher of a first sampling rate f1 and a second sampling rate f2, for example, operating at the first sampling rate f1.
[0177] Figures 1A to 1BThe hearing aid shown may include a first microphone and a second microphone. The sampling rate (e.g., a first sampling rate f1) of the first input signal output by the first microphone is higher than the sampling rate of the second input signal output by the second microphone. The advantage of this invention is that by setting the sampling rate of the first input signal to be higher than that of the second input signal, the hearing aid can reduce computational complexity when operating in high sampling rate mode, thereby improving battery life.
[0178] Figures 2A to 2B An exemplary second hearing aid 500 according to the present invention is illustrated schematically. Figure 2A The second hearing aid 500 includes an input unit 501, a signal processing unit 514, and an output unit 515.
[0179] exist Figure 2A In the illustrated embodiment, input unit 501 is configured to provide a first digitized signal 503AA associated with a first sampling rate f1, a second digitized signal 503BA associated with a second sampling rate f2, and a third digitized signal 503CA associated with the second sampling rate f2. The first digitized signal 503AA comprises a plurality of first frames, each containing a plurality of first sampling points. The second digitized signal 503BA comprises a plurality of second frames, each containing a plurality of second sampling points. The third digitized signal 503CA comprises a plurality of third frames, each containing a plurality of third sampling points.
[0180] The hearing aid 500 (e.g., an input unit) is configured to determine a first sampling rate f1 that is greater than (e.g., different from) a second sampling rate f2, such that the duration of each first frame is the same as the duration of each second frame and each third frame, thereby enabling (e.g., achieving and / or allowing) a greater number of first sample points than the number of second and third sample points. In other words, the first sampling rate f1 may be different from the second sampling rate f2, such that the duration of each first frame is the same as the duration of each second frame and each third frame.
[0181] In one or more exemplary hearing aids, input unit 501 includes a plurality of microphones and a plurality of analog-to-digital conversion units. Figure 2A In the illustrated embodiment, the plurality of microphones includes a first microphone 502A, a second microphone 502B, and a third microphone 502C. Figure 2A In the illustrated embodiment, the plurality of analog-to-digital conversion units include a first analog-to-digital conversion unit 503A, a second analog-to-digital conversion unit 503B, and a third analog-to-digital conversion unit 503C.
[0182] In one or more exemplary hearing aids, a first microphone 502A is configured to provide a first input signal 502AA. For example, the first input signal 502AA includes a microphone signal representing ambient sound in which the second hearing aid 500 is located. In other words, the first input signal 502AA can be considered as a microphone signal.
[0183] In one or more exemplary hearing aids, a second microphone 502B is configured to provide a second input signal 502BA. For example, the second input signal 502BA includes a microphone signal representing the ambient sound of the environment in which the second hearing aid 500 is located. In other words, the second input signal 502BA can be considered as a microphone signal.
[0184] In one or more exemplary hearing aids, a third microphone 502C is configured to provide a third input signal 502CA. For example, the third input signal 502CA includes a microphone signal representing ambient sound in which the second hearing aid 500 is located. In other words, the third input signal 502CA can be considered as a microphone signal.
[0185] Optionally, the input unit 501 may include a wireless receiver configured to receive one or more of a first input signal 502AA, a second input signal 502BA, and a third input signal 502CA. The first input signal 502AA may be a wireless signal. The second input signal 502BA may be a wireless signal. The third input signal 502CA may be a wireless signal.
[0186] In one or more exemplary hearing aids, a first analog-to-digital converter (ADC) 503A is configured to digitize a first input signal 502AA using a first sampling rate f1 to generate a first digitized signal 503AA. In other words, the first ADC 503A can be configured to provide the first digitized signal 503AA by sampling the first input signal 502AA at the first sampling rate f1. In one or more examples, a second ADC 503B is configured to digitize a second input signal 502BA using a second sampling rate f2 to generate a second digitized signal 503BA. In other words, the second ADC 503B can be configured to provide the second digitized signal 503BA by sampling the second input signal 502BA at the second sampling rate f2. In one or more examples, a third ADC 503C is configured to digitize a third input signal 502CA using a second sampling rate f2 to generate a third digitized signal 503CA. In other words, the third analog-to-digital conversion unit 503C can be configured to provide a third digitized signal 503CA by sampling the third input signal 502CA at a second sampling rate f2. For example, the first sampling rate f1 is greater than the second sampling rate f2.
[0187] Optionally, the second hearing aid 500 may include a single analog-to-digital converter (ADC). Figure 2A (Not shown in the image), the analog-to-digital converter (ADC) unit is configured to digitize the first input signal 502AA, the second input signal 502BA, and the third input signal 502CA using a third sampling rate to generate a first master digitized signal, a second master digitized signal, and a third master digitized signal. In other words, the single ADC unit can be configured to sample the first input signal 502AA, the second input signal 502BA, and the third input signal 502CA at a third sampling rate. For example, the third sampling rate is different from the first sampling rate f1 and the second sampling rate f2. For example, when the third sampling rate is higher than the first sampling rate f1 and the second sampling rate f2, the input unit 501 is configured to apply downsampling techniques to the first master digitized signal, the second master digitized signal, and the third master digitized signal to generate a first digitized signal 503AA, a second digitized signal 503BA, and a third digitized signal 503CA. For example, when the third sampling rate is lower than the first sampling rate f1 and the second sampling rate f2, the input unit 501 is configured to apply upsampling technology to the first main digitized signal, the second main digitized signal and the third main digitized signal to generate the first digitized signal 503AA, the second digitized signal 503BA and the third digitized signal 503CA.
[0188] Optionally, the first analog-to-digital converter (ADC) unit 503A and the second ADC unit 503B can be integrated into an assistive device (e.g., a mobile phone, a computer, etc.). The second hearing aid 500 can be configured to receive from the assistive device a first digitized signal 503AA sampled at a first sampling rate f1, a second digitized signal 503BA sampled at a second sampling rate f2, and a third digitized signal 503CA sampled at a second sampling rate f2. For example, the aforementioned single ADC unit can also be integrated into the assistive device.
[0189] In one or more exemplary hearing aids, a second hearing aid 500 includes a plurality of analysis filter groups, including a first analysis filter group 506A, a second analysis filter group 506B, and a third analysis filter group 506C. Optionally, an input unit 501 may include the first analysis filter group 506A, the second analysis filter group 506B, and the third analysis filter group 506C. For example, the first analysis filter group 506A is configured to provide a first frequency domain signal 506AA based on a first digitized signal 503AA. The first frequency domain signal 506AA is associated with a first frequency range ΔF1 and a second frequency range ΔF2. The first analysis filter group 506A is associated with a first set of frequency components. For example, a first portion of the first set of frequency components may be considered as the first frequency range ΔF1 of the first frequency domain signal 506AA. For example, a second portion of the first set of frequency components may be considered as the second frequency range ΔF2 of the first frequency domain signal 506AA.
[0190] In one or more exemplary hearing aids, a second analysis filter bank 506B is configured to provide a second frequency domain signal 506BA based on a second digitized signal 503BA. The second frequency domain signal 506BA is associated with a first frequency range ΔF1. The second analysis filter bank 506B is associated with a second set of frequency components. In one or more exemplary hearing aids, a third analysis filter bank 506C is configured to provide a third frequency domain signal 506CA based on a third digitized signal 503CA. The third frequency domain signal 506CA is associated with the first frequency range ΔF1. The third analysis filter bank 506C is associated with a third set of frequency components. The second and third sets of frequency components may be identical to a first portion of the first set of frequency components. The second set of frequency components may be identical to the third set of frequency components. The frequency ranges of the second frequency domain signal 506BA and the third frequency domain signal 506CA may be subsets of the frequency range of the first frequency domain signal 506AA. In other words, the first sampling rate f1 may be greater than the second sampling rate f2.
[0191] For example, signal processing unit 514 is configured to determine processed signal 514C based on first digitized input signal 503AA, second digitized input signal 503BA, and third digitized input signal 503CA. For example, signal processing unit 514 is configured to determine processed signal 514C based on first frequency domain signal 506AA, second frequency domain signal 506BA, and third frequency domain signal 506CA.
[0192] In one or more exemplary hearing aids, output unit 515 includes digital-to-analog converter 516 configured to convert a processed signal 514C (e.g., a digital signal) into an analog output signal 516A to be presented to a user wearing a second hearing aid 500 via output unit 515 (e.g., an output transducer 518 such as a speaker).
[0193] In one or more exemplary hearing aids, output unit 515 is configured to output an audible signal 518A to a user wearing a second hearing aid 500 based on a processed signal 514C. Figure 2A In the illustrated embodiment, the output unit 515 is configured to output an audible signal 518A based on an analog output signal 516A. The analog output signal 516A can be converted into an acoustic signal by the output transducer 518.
[0194] Figure 2B A signal processing unit 514 of a second hearing aid 500 is shown. The signal processing unit 514 may include a first signal processing unit 514A and a second signal processing unit 514B.
[0195] In one or more exemplary hearing aids, signal processing unit 514 is configured to determine a first dominant frequency domain signal 506AAA based on a first frequency domain signal 506AA. For example, the first dominant frequency domain signal 506AAA is associated with a first frequency range ΔF1. In other words, the first dominant frequency domain signal 506AAA may characterize the signal of the first frequency domain signal 506AA within the first frequency range ΔF1. A second frequency domain signal 506BA may characterize its own signal within the first frequency range ΔF1, for example, having the same set of frequency components as the first frequency domain signal 506AA. A third frequency domain signal 506CA may characterize its own signal within the first frequency range ΔF1, for example, having the same set of frequency components as the first frequency domain signal 506AA. The first frequency range ΔF1 may contain a common set of frequency components.
[0196] A first signal processing unit 514A (e.g., signal processing unit 514) is configured to determine a first processed signal 508 based on a first dominant frequency domain signal 506AAA (e.g., a first frequency range of the first frequency domain signal 506AA), a second frequency domain signal 506BA, and a third frequency domain signal 506CA. In one or more exemplary hearing aids, the first signal processing unit 514A is configured to determine the first processed signal 508 by applying multi-channel processing techniques to the first dominant frequency domain signal 506AAA, the second frequency domain signal 506BA, and the third frequency domain signal 506CA.
[0197] Multi-channel processing technology may include beamforming technology. In other words, the first signal processing unit 514A may be configured to combine the first main frequency domain signal 506AAA, the second frequency domain signal 506BA, and the third frequency domain signal 506CA to achieve spatial filtering of the ambient sound of the second hearing aid 500.
[0198] In one or more exemplary hearing aids, signal processing unit 514 is configured to determine a first sub-frequency domain signal 506AAB based on a first frequency domain signal 506AA. For example, the first sub-frequency domain signal 506AAB is associated with a second frequency range ΔF2. The first sub-frequency domain signal 506AAB may characterize the signal of the first frequency domain signal 506AA within the second frequency range ΔF2, for example, corresponding to a second portion of a first set of frequency components. The second frequency range ΔF2 may contain a set of non-common frequency components.
[0199] In one or more exemplary hearing aids, a second signal processing unit 514B is configured to determine a second processed signal 510A based on a first sub-frequency domain signal 506AAB and a first processed signal 508.
[0200] For example, the second signal processing unit 514B includes a mixing unit 510 for determining the second processed signal 510A. This mixing unit 510 can be configured to combine the first processed signal 508 (i.e., a combination signal of the common frequency components of the first frequency domain signal 506AA, the second frequency domain signal 506BA, and the third frequency domain signal 506CA) with a first sub-frequency domain signal 506AAB (i.e., the non-common frequency components of the first frequency domain signal 506AA). For example, the mixing unit can be considered a combining unit configured to combine (e.g., splice) the non-common frequency components of the first frequency domain signal 506AA with the combination signal of the common frequency components of the first frequency domain signal 506AA and the frequency components of the second frequency domain signal 506BA into a joint vector. The second processed signal 510A can be considered as this joint vector. For example, the second processed signal 510A is a frequency domain signal, such as a full-band signal.
[0201] For example, the second signal processing unit 514B is configured to determine the third processed signal 512A based on the second processed signal 510A. For example, the second signal processing unit 514B determines the third processed signal 512A by applying a single-channel processing technique to the second processed signal 510A. For example, the second signal processing unit 514B includes a single-channel processing unit 512 configured to apply a single-channel processing technique to the second processed signal 510A. The single-channel processing technique may include one or more of the following: noise reduction technique, hearing loss compensation technique, voice activity detection technique, self-voice detection technique, feedback cancellation technique, and any other applicable single-channel processing technique. The third processed signal 512A may be a frequency domain signal, such as a full-band signal processed by one or more of the following: noise reduction, hearing loss compensation, voice activity detection, self-voice detection, and feedback cancellation.
[0202] In one or more exemplary hearing aids, signal processing unit 514 includes a synthesis filter 513 configured to determine a processed signal 514C based on a third processed signal 512A. For example, synthesis filter 513 determines the processed signal 514C by converting the third processed signal 512A into a time-domain signal. The processed signal 514C may be a time-domain signal. For example, synthesis filter 513 is configured to operate at the higher of a first sampling rate f1 and a second sampling rate f2, such as operating at the first sampling rate f1. The third processed signal 512A may be synthesized into a time-domain signal sampled at the first sampling rate f1.
[0203] Figures 2A to 2B The hearing aid shown may include a first microphone, a second microphone, and a third microphone. The sampling rate (e.g., a first sampling rate f1) of the first input signal output by the first microphone is higher than the sampling rates of the second input signal output by the second microphone and the third input signal output by the third microphone. The advantage of this invention is that by setting the sampling rate of the first input signal to be higher than that of the second and third input signals, the hearing aid can reduce computational complexity when operating in high sampling rate mode, thereby improving battery life.
[0204] For example, the common frequency components of the first frequency domain signal 506AA, the second frequency domain signal 506BA, and the third frequency domain signal 506CA can be combined with each other, and the combination range can cover components with an upper frequency limit of f2 / 2 (i.e., components below the Nyquist frequency), thereby achieving directional processing. For components with frequencies between f2 / 2 and f1 / 2, the processed signal 514C is generated based solely on the first input signal 502AA (i.e., the first digitized signal 503AA and the first frequency domain signal 506AA). For components with an upper frequency limit of f2 / 2, the processed signal 514C is generated based on the first input signal 502AA (e.g., the first digitized signal 503AA and the first frequency domain signal 506AA), the second input signal 502BA (e.g., the second digitized signal 503BA and the second frequency domain signal 506BA), and the third input signal 502CA (e.g., the third digitized signal 503CA and the third frequency domain signal 506CA).
[0205] Figures 3A to 3B An exemplary third hearing aid 700 according to the present invention is illustrated schematically. Figure 3A The third hearing aid 700 includes an input unit 701, a signal processing unit 714, and an output unit 715.
[0206] exist Figure 3A In the illustrated embodiment, input unit 701 is configured to provide a first digitized signal 703AA associated with a first sampling rate f1, a second digitized signal 703BA associated with a second sampling rate f2, and a third digitized signal 703CA associated with the second sampling rate f2. The first digitized signal 703AA comprises a plurality of first frames, each containing a plurality of first sampling points. The second digitized signal 703BA comprises a plurality of second frames, each containing a plurality of second sampling points. The third digitized signal 703CA comprises a plurality of third frames, each containing a plurality of third sampling points.
[0207] The hearing aid 700 (e.g., an input unit) is configured to determine a first sampling rate f1 that is greater than (e.g., different from) a second sampling rate f2, such that the duration of each first frame is the same as the duration of each second frame and each third frame, thereby enabling (e.g., achieving and / or allowing) a greater number of first sample points than the number of second and third sample points. In other words, the first sampling rate f1 may be different from the second sampling rate f2, such that the duration of each first frame is the same as the duration of each second frame and each third frame.
[0208] In one or more exemplary hearing aids, the input unit 701 includes a plurality of microphones, a wireless receiver 702A (e.g., a wireless transceiver), and a plurality of analog-to-digital conversion units. Figure 3AIn the illustrated embodiment, the plurality of microphones includes a first microphone 702B and a second microphone 702C. Figure 3A In the illustrated embodiment, the plurality of analog-to-digital conversion units include a first analog-to-digital conversion unit 703A, a second analog-to-digital conversion unit 703B, and a third analog-to-digital conversion unit 703C.
[0209] In one or more exemplary hearing aids, a wireless receiver 702A is configured to receive a first input signal 702AA. For example, the first input signal 702AA contains a wireless signal representing ambient sound in which the second hearing aid 500 is located. In other words, the first input signal 702AA can be considered a wireless signal. Figure 3A In the embodiment shown, the first input signal 702AA is a streaming audio signal, such as a music signal.
[0210] In one or more exemplary hearing aids, a first microphone 702B is configured to provide a second input signal 702BA. For example, the second input signal 702BA includes a microphone signal representing ambient sound in which the third hearing aid 700 is located. In other words, the second input signal 702BA can be considered as a microphone signal.
[0211] In one or more exemplary hearing aids, a second microphone 702C is configured to provide a third input signal 702CA. For example, the third input signal 702CA includes a microphone signal representing the ambient sound of the environment in which the third hearing aid 700 is located. In other words, the third input signal 702CA can be considered as a microphone signal.
[0212] In one or more exemplary hearing aids, a first analog-to-digital converter (ADC) 703A is configured to digitize a first input signal 702AA using a first sampling rate f1 to generate a first digitized signal 703AA. In other words, the first ADC 703A can be configured to provide the first digitized signal 703AA by sampling the first input signal 702AA at the first sampling rate f1. The first input signal 702AA may be a signal that has already been digitally sampled using a sampling rate different from the first sampling rate f1. The first ADC 703A can be configured to resample the first input signal 702AA so that the first digitized signal is associated with the first sampling rate f1. In one or more examples, a second ADC 703B is configured to digitize a second input signal 702BA using a second sampling rate f2 to generate a second digitized signal 703BA. In other words, the second ADC 703B can be configured to provide the second digitized signal 703BA by sampling the second input signal 702BA at the second sampling rate f2. In one or more examples, the third analog-to-digital converter 703C is configured to digitize the third input signal 702CA using a second sampling rate f2 to generate a third digitized signal 703CA. In other words, the third analog-to-digital converter 703C can be configured to provide the third digitized signal 703CA by sampling the third input signal 702CA at a second sampling rate f2. For example, a first sampling rate f1 is greater than the second sampling rate f2.
[0213] Optionally, the third hearing aid 700 may include a single analog-to-digital converter (ADC). Figure 3A(Not shown in the image), the analog-to-digital converter (ADC) unit is configured to digitize the first input signal 702AA, the second input signal 702BA, and the third input signal 702CA using a third sampling rate to generate a first master digitized signal, a second master digitized signal, and a third master digitized signal. In other words, the single ADC unit can be configured to sample the first input signal 702AA, the second input signal 702BA, and the third input signal 702CA at a third sampling rate. For example, the third sampling rate is different from the first sampling rate f1 and the second sampling rate f2. For example, when the third sampling rate is higher than the first sampling rate f1 and the second sampling rate f2, the input unit 701 is configured to apply downsampling techniques to the first master digitized signal, the second master digitized signal, and the third master digitized signal to generate a first digitized signal 703AA, a second digitized signal 703BA, and a third digitized signal 703CA. For example, when the third sampling rate is lower than the first sampling rate f1 and the second sampling rate f2, the input unit 701 is configured to apply upsampling technology to the first main digitized signal, the second main digitized signal and the third main digitized signal to generate the first digitized signal 703AA, the second digitized signal 703BA and the third digitized signal 703CA.
[0214] In one or more exemplary hearing aids, a third hearing aid 700 includes a plurality of analysis filter groups, comprising a first analysis filter group 706A, a second analysis filter group 706B, and a third analysis filter group 706C. Optionally, an input unit 701 may include the first analysis filter group 706A, the second analysis filter group 706B, and the third analysis filter group 706C. For example, the first analysis filter group 706A is configured to provide a first frequency domain signal 706AA based on a first digitized signal 703AA. The first frequency domain signal 706AA is associated with a first frequency range ΔF1 and a second frequency range ΔF2. The first analysis filter group 706A is associated with a first set of frequency components. For example, a first portion of the first set of frequency components may be considered as the first frequency range ΔF1 of the first frequency domain signal 706AA. For example, a second portion of the first set of frequency components may be considered as the second frequency range ΔF2 of the first frequency domain signal 706AA. In one or more exemplary hearing aids, a second analysis filter bank 706B is configured to provide a second frequency domain signal 706BA based on a second digitized signal 703BA. The second frequency domain signal 706BA is associated with a first frequency range ΔF1. The second analysis filter bank 706B is associated with a second set of frequency components.
[0215] In one or more exemplary hearing aids, a third analysis filter bank 706C is configured to provide a third frequency domain signal 706CA based on a third digitized signal 703CA. The third frequency domain signal 706CA is associated with a first frequency range ΔF1. The third analysis filter bank 706C is associated with a third set of frequency components. The second and third sets of frequency components may be identical to a first portion of the first set of frequency components. The second set of frequency components may be identical to the third set of frequency components. The frequency ranges of the second frequency domain signal 706BA and the third frequency domain signal 706CA may be subsets of the frequency range of the first frequency domain signal 706AA. The frequency range of the second frequency domain signal 706BA may be a subset of the frequency range of the first frequency domain signal 706AA. The frequency range of the third frequency domain signal 706CA may be a subset of the frequency range of the first frequency domain signal 706AA. In other words, a first sampling rate f1 may be greater than a second sampling rate f2.
[0216] For example, the signal processing unit 714 is configured to determine the processed signal 714C based on the first digital input signal 703AA, the second digital input signal 703BA, and the third digital input signal 703CA.
[0217] In one or more exemplary hearing aids, output unit 715 includes digital-to-analog converter 716 configured to convert a processed signal 714C (e.g., a digital signal) into an analog output signal 716A to be presented to a user wearing a third hearing aid 700 via output unit 715 (e.g., an output transducer 718 such as a speaker).
[0218] In one or more exemplary hearing aids, output unit 715 is configured to output an audible signal 718A to a user wearing a third hearing aid 700 based on a processed signal 714C. Figure 3A In the illustrated embodiment, the output unit 715 is configured to output an audible signal 718A based on an analog output signal 716A. The analog output signal 716A can be converted into an acoustic signal by the output transducer 718.
[0219] Figure 3B A signal processing unit 714 of a third hearing aid 700 is shown. The signal processing unit 714 may include a first signal processing unit 714A and a second signal processing unit 714B.
[0220] In one or more exemplary hearing aids, a first signal processing unit 714A of the signal processing unit 714 is configured to determine a first processed signal 708 based on a second frequency domain signal 706BA and a third frequency domain signal 706CA. In one or more exemplary hearing aids, the first signal processing unit 714A determines the first processed signal 708 by applying multi-channel processing techniques to the second frequency domain signal 706BA and the third frequency domain signal 706CA.
[0221] Optionally, the signal processing unit 714 is configured to determine a first dominant frequency domain signal 706AAA based on a first frequency domain signal 706AA (e.g., a first frequency range of the first frequency domain signal 706AA). For example, the first dominant frequency domain signal 706AAA is associated with a first frequency range ΔF1. In other words, the first dominant frequency domain signal 706AAA can characterize the signal of the first frequency domain signal 706AA within the first frequency range ΔF1. The first frequency range ΔF1 may contain a set of common frequency components, for example, these frequency components are simultaneously present in the frequency sets of the second frequency domain signal 706BA and the third frequency domain signal 706CA. For example, the first signal processing unit 714A is configured to determine a first processed signal 708 based on the first dominant frequency domain signal 706AAA, the second frequency domain signal 706BA, and the third frequency domain signal 706CA. For example, the first signal processing unit 714A determines the first processed signal 708 by applying multi-channel processing techniques to the first dominant frequency domain signal 706AAA, the second frequency domain signal 706BA, and the third frequency domain signal 706CA.
[0222] Multi-channel processing technology may include beamforming technology. For example, the first signal processing unit 714A may be configured to combine the second frequency domain signal 706BA and the third frequency domain signal 706CA to achieve spatial filtering of ambient sounds in the environment where the third hearing aid 700 is located. The first input signal 702AA (e.g., a wireless signal, a streaming music signal) may not participate in beamforming processing. Optionally, the first signal processing unit 714A may be configured to combine the second frequency domain signal 706BA, the third frequency domain signal 706CA, and the first main frequency domain signal 706AAA. In this case, the first input signal 702AA (e.g., a wireless signal, a streaming music signal) can participate in beamforming processing. For example, combining the second frequency domain signal 706BA, the third frequency domain signal 706CA, and the first main frequency domain signal 706AAA can ensure that the user can hear both ambient sounds and streaming music signals clearly.
[0223] In one or more exemplary hearing aids, signal processing unit 714 is configured to determine a first sub-frequency domain signal 706AAB based on a first frequency domain signal 706AA. For example, the first sub-frequency domain signal 706AAB is associated with a second frequency range ΔF2. The first sub-frequency domain signal 706AAB may characterize the signal of the first frequency domain signal 706AA within the second frequency range ΔF2, for example, corresponding to a second portion of a first set of frequency components. The second frequency range ΔF2 may contain a set of non-common frequency components.
[0224] The second frequency domain signal 706BA can characterize itself within the first frequency range ΔF1, for example, it has the same set of frequency components as the first frequency domain signal 706AA.
[0225] In one or more exemplary hearing aids, a second signal processing unit 714B is configured to determine a second processed signal 710A based on a first sub-frequency domain signal 706AAB and a first processed signal 708.
[0226] For example, the second signal processing unit 714B includes a mixing unit 710 for determining the second processed signal 710A. This mixing unit 710 can be configured to combine the first processed signal 708 (i.e., a combination signal of the common frequency components of the second frequency domain signal 706BA and the third frequency domain signal 706CA) with a first sub-frequency domain signal 706AAB (i.e., the non-common frequency components of the first frequency domain signal 706AA). For example, the mixing unit can be considered a combining unit configured to combine (e.g., splice) the non-common frequency components of the first frequency domain signal 706AA with the frequency component combination signal of the second frequency domain signal 706BA and the third frequency domain signal 706CA into a joint vector. The second processed signal 710A can be considered as this joint vector. For example, the second processed signal 710A is a frequency domain signal, such as a full-band signal.
[0227] For example, the second signal processing unit 714B is configured to determine the third processed signal 712A based on the second processed signal 710A. For example, the second signal processing unit 714B determines the third processed signal 712A by applying a single-channel processing technique to the second processed signal 710A. For example, the second signal processing unit 714B includes a single-channel processing unit 712 configured to apply a single-channel processing technique to the second processed signal 710A. The single-channel processing technique may include one or more of the following: noise reduction technique, hearing loss compensation technique, voice activity detection technique, self-voice detection technique, feedback cancellation technique, and any other applicable single-channel processing technique. The third processed signal 712A may be a frequency domain signal, such as a full-band signal processed by one or more of the following: noise reduction, hearing loss compensation, voice activity detection, self-voice detection, and feedback cancellation.
[0228] In one or more exemplary hearing aids, signal processing unit 714 includes a synthesis filter 713 configured to determine a processed signal 714C based on a third processed signal 712A. For example, synthesis filter 713 determines processed signal 714C by converting the third processed signal 712A into a time-domain signal. Processed signal 714C may be a time-domain signal. For example, synthesis filter 713 is configured to operate at the higher of a first sampling rate f1 and a second sampling rate f2, such as operating at the first sampling rate f1.
[0229] Figures 3A to 3B The hearing aid shown may include a first microphone, a second microphone, and a wireless receiver. The sampling rate (e.g., a first sampling rate f1) of the first input signal received by the wireless receiver is higher than the sampling rates of the second and third input signals output by the two microphones, respectively.
[0230] Figures 3A to 3B This can correspond to an exemplary scenario: a hearing aid user is listening to a streaming audio signal, such as a music signal. Playing music at a higher sampling rate helps improve the sound quality of the music signal. It is more advantageous to set the channel receiving the streaming audio signal to the first sampling rate f1 (i.e., the higher of the two sampling rates) than to sample the input signal (706BA, 706CA) output by the microphone at a first sampling rate f1.
[0231] For example, embodiments of the present invention can be applied to audio streaming application scenarios, such as music streaming playback scenarios. Setting the sampling rate of the wirelessly received audio signal to be higher than the sampling rate of the microphone signal can demonstrate technical advantages.
[0232] The advantage of this invention lies in that by setting the sampling rate of the first input signal 702AA (e.g., a streaming audio signal) to be higher than that of the second input signal 702BA and the third input signal 702CA (e.g., a microphone signal), the hearing aid can reduce computational complexity when operating in high sampling rate mode, thereby improving battery life while ensuring the sound quality of the music signal. An embodiment of this invention achieves an advantageous effect: the common frequency components of the microphone signal (sampled at a second sampling rate f2) are combined in the first signal processing unit, while the non-common frequency components of the streaming audio signal are further combined with the common frequency components of the microphone signal in the second signal processing unit, ultimately allowing the user to simultaneously obtain both the streaming audio signal and the microphone ambient signal.
[0233] This invention supports adaptive switching of non-common frequency channels. In other words, during music streaming, the non-common frequency channel is used to transmit the non-common frequency components of the wireless signal; when no music is playing, this channel can be switched to one of the microphone channels. In other words, the non-common frequency channel can be used to transmit digitized signals with a sampling rate lower than that of the streaming wireless signal (e.g., music signal), rather than transmitting the streaming wireless signal itself.
[0234] Figures 4A to 4B An exemplary fourth hearing aid 900 according to the present invention is illustrated schematically. Figure 4A The fourth hearing aid 900 includes an input unit 901, a signal processing unit 914, and an output unit 915.
[0235] exist Figure 4A In the illustrated embodiment, input unit 901 is configured to provide a first digitized signal 903AA and a second digitized signal 903BA, both of which are associated with the same sampling rate f1. Optionally, input unit 901 may be configured to provide at least two digitized signals, all of which are associated with the same sampling rate f1. The sampling rate f1 is higher than the synthesis filter of the fourth hearing aid 900 (e.g., Figure 4B The highest sampling rate supported by the synthesis filter (913) in the system.
[0236] For example, the sampling rate f1 can be equal to 20kHz, 21kHz, 22kHz, 23kHz, 24kHz, 25kHz, 26kHz, 27kHz, 28kHz, 29kHz, 30kHz, 31kHz, 32kHz, 33kHz, 34kHz, 35kHz, 36kHz, 37kHz, 38kHz, 39kHz, 40kHz, 41kHz, 42kHz, 44kHz, or 44.1kHz. For example, the sampling rate f1 can be greater than 20kHz, 24kHz, 30kHz, 32kHz, or 44.1kHz. For example, the range of the sampling rate f1 can be from 8kHz to 48kHz.
[0237] In one or more exemplary hearing aids, the input unit 901 includes a plurality of microphones and a plurality of analog-to-digital conversion units. Figure 4A In the illustrated embodiment, the plurality of microphones includes a first microphone 902A and a second microphone 902B. Figure 4A In the illustrated embodiment, the plurality of analog-to-digital conversion units include a first analog-to-digital conversion unit 903A and a second analog-to-digital conversion unit 903B.
[0238] In one or more exemplary hearing aids, a first microphone 902A is configured to provide a first input signal 902AA. For example, the first input signal 902AA includes a microphone signal representing ambient sound in which the fourth hearing aid 900 is located. In other words, the first input signal 902AA can be considered as a microphone signal.
[0239] In one or more exemplary hearing aids, a second microphone 902B is configured to provide a second input signal 902BA. For example, the second input signal 902BA includes a microphone signal representing ambient sound in which the fourth hearing aid 900 is located. In other words, the second input signal 902BA can be considered as a microphone signal.
[0240] Optionally, the input unit 901 may include a wireless receiver (e.g., Figures 3A to 3B The wireless receiver 702A is configured to receive a first input signal 902AA and / or a second input signal 902BA. The first input signal 902AA can be a wireless signal. The second input signal 902BA can be a wireless signal. Both the first input signal 902AA and the second input signal 902BA can be wireless signals.
[0241] In one or more exemplary hearing aids, a first analog-to-digital converter 903A and a second analog-to-digital converter 903B are configured to use the same sampling rate f1 to digitize a first input signal 902AA and a second input signal 902BA, respectively, to generate a first digitized signal 903AA and a second digitized signal 903BA.
[0242] For example, a first analog-to-digital converter (ADC) 903A is configured to digitize a first input signal 902AA using a sampling rate f1 to generate a first digitized signal 903AA. In other words, the first ADC 903A can be configured to provide the first digitized signal 903AA by sampling the first input signal 902AA at a sampling rate f1. In one or more examples, a second ADC 903B is configured to digitize a second input signal 902BA using a sampling rate f1 to generate a second digitized signal 903BA. In other words, the second ADC 903B can be configured to provide the second digitized signal 903BA by sampling the second input signal 902BA at a sampling rate f1. For example, Figure 4A The sampling rate f1 and Figures 1A to 3B The first sampling rate f1 in the sample is the same as the sampling rate of the same size.
[0243] Optionally, the fourth hearing aid 900 may include a single analog-to-digital converter (ADC). Figure 4A (not shown in the image), the analog-to-digital conversion unit is configured to use another sampling rate (e.g., ...). Figures 1A to 3BThe third sampling rate mentioned above is used to digitize the first input signal 902AA and the second input signal 902BA to generate a first master digitized signal and a second master digitized signal. In other words, this single analog-to-digital converter unit can be configured to sample the first input signal 902AA and the second input signal 902BA at another sampling rate. For example, this other sampling rate is different from the sampling rate f1. For example, when this other sampling rate (e.g., significantly) is higher than the sampling rate f1, the input unit 901 is configured to apply downsampling techniques to the first master digitized signal and the second master digitized signal to generate a first digitized signal 903AA and a second digitized signal 903BA. For example, when this other sampling rate (e.g., significantly) is lower than the sampling rate f1, the input unit 901 is configured to apply upsampling techniques to the first master digitized signal and the second master digitized signal to generate a first digitized signal 903AA and a second digitized signal 903BA.
[0244] Optionally, the first analog-to-digital converter (ADC) unit 903A and the second ADC unit 903B can be integrated into an assistive device (such as a mobile phone, computer, etc.). The fourth hearing aid 900 can be configured to receive a first digitized signal 903AA and a second digitized signal 903BA from the assistive device, both of which are sampled at a sampling rate f1. For example, the aforementioned single ADC unit can also be integrated into the assistive device.
[0245] For example, the wireless signal may be a digitally sampled signal associated with a sampling rate different from the sampling rate f1. The analog-to-digital conversion unit (e.g., the first analog-to-digital conversion unit 903A, the second analog-to-digital conversion unit 903B, and / or the aforementioned single analog-to-digital conversion unit) may be configured to resample the wireless signal (e.g., the first input signal 902AA and / or the second input signal 902BA) so that the resulting digitized signal (e.g., the first digitized signal 903AA and / or the second digitized signal 903BA) is associated with the sampling rate f1.
[0246] In one or more exemplary hearing aids, a fourth hearing aid 900 includes a plurality of analysis filter banks, including a first analysis filter bank 906A and a second analysis filter bank 906B. Optionally, an input unit 901 may include the first analysis filter bank 906A and the second analysis filter bank 906B. For example, the first analysis filter bank 906A is configured to generate a first frequency domain signal 906AA based on a first digitized signal 903AA. The first frequency domain signal 906AA may be associated with a first frequency range ΔF1 and a second frequency range ΔF2. The first analysis filter bank 906A may correspond to a set of first frequency components. For example, a first portion of the set of first frequency components may constitute a first frequency range ΔF1 of the first frequency domain signal 906AA. For example, a second portion of the set of first frequency components may constitute a second frequency range ΔF2 of the first frequency domain signal 906AA.
[0247] In one or more exemplary hearing aids, a second analysis filter bank 906B is configured to generate a second frequency domain signal 906BA based on a second digitized signal 903BA. The second frequency domain signal 906BA may be associated with a first frequency range ΔF1 and a second frequency range ΔF2. The second analysis filter bank 906B may correspond to a set of second frequency components. For example, a first portion of this set of second frequency components may constitute the first frequency range ΔF1 of the second frequency domain signal 906BA. For example, a second portion of this set of second frequency components may constitute the second frequency range ΔF2 of the second frequency domain signal 906BA. The first portion of the first set of frequency components is consistent with the first portion of the second set of frequency components. The frequency band in the first frequency domain signal 906AA corresponding to the first frequency range ΔF1 is the same as the frequency band in the second frequency domain signal 906BA corresponding to the first frequency range ΔF1. The second portion of the first set of frequency components is consistent with the second portion of the second set of frequency components. The frequency band in the first frequency domain signal 906AA corresponding to the second frequency range ΔF2 is the same as the frequency band in the second frequency domain signal 906BA corresponding to the second frequency range ΔF2. The first frequency domain signal 906AA and the second frequency domain signal 906BA correspond to the same frequency range (e.g., including both the first and second frequency ranges).
[0248] The signal processing unit 914 is configured to generate a processed signal 914C based on a first digitized input signal 903AA and a second digitized input signal 903BA. For example, the signal processing unit 914 is configured to generate a processed signal 914C based on a first frequency domain signal 906AA and a second frequency domain signal 906BA.
[0249] In one or more exemplary hearing aids, output unit 915 includes digital-to-analog converter 916 configured to convert a processed signal 914C (e.g., a digital signal) into an analog output signal 916A to be transmitted to the wearer of a fourth hearing aid 900 via output unit 915 (e.g., output transducer 918 such as a speaker).
[0250] In one or more exemplary hearing aids, output unit 915 is configured to output an audible signal 918A to the wearer of a fourth hearing aid 900 based on a processed signal 914C. Figure 4A In the illustrated embodiment, output unit 915 generates an audible signal 918A based on analog output signal 916A. Analog output signal 916A can be converted into an acoustic signal by output transducer 918.
[0251] Figure 4B A signal processing unit 914 of a fourth hearing aid 900 is shown. The signal processing unit 914 may include a first signal processing unit 914A and a second signal processing unit 914B.
[0252] In one or more exemplary hearing aids, signal processing unit 914 is configured to generate a first dominant frequency domain signal 906AAA based on a first frequency domain signal 906AA. For example, the first dominant frequency domain signal 906AAA is associated with a first frequency range ΔF1. In other words, the first dominant frequency domain signal 906AAA can characterize the signal of the first frequency domain signal 906AA within the first frequency range ΔF1.
[0253] In one or more exemplary hearing aids, signal processing unit 914 is configured to generate a second dominant frequency domain signal 906BBB based on a second frequency domain signal 906BA. For example, the second dominant frequency domain signal 906BBB is associated with a first frequency range ΔF1. In other words, the second dominant frequency domain signal 906BBB can characterize the signal of the second frequency domain signal 906BA within the first frequency range ΔF1.
[0254] In one or more exemplary hearing aids, a first signal processing unit 914A is configured to generate a first processed signal 908 based on a first dominant frequency domain signal 906AAA and a second dominant frequency domain signal 906BBB. In one or more exemplary hearing aids, the first signal processing unit 914A generates the first processed signal 908 by applying multi-channel processing technology to the first dominant frequency domain signal 906AAA and the second dominant frequency domain signal 906BBB. The multi-channel processing technology may include beamforming technology. In other words, the first signal processing unit 914A can combine the first dominant frequency domain signal 906AAA with the second dominant frequency domain signal 906BBB to achieve spatial filtering of the ambient sound of the fourth hearing aid 900.
[0255] In one or more exemplary hearing aids, signal processing unit 914 is configured to generate a first sub-frequency domain signal 906AAB based on a first frequency domain signal 906AA. For example, the first sub-frequency domain signal 906AAB is associated with a second frequency range ΔF2. The first sub-frequency domain signal 906AAB may characterize the signal of the first frequency domain signal 906AA within the second frequency range ΔF2, for example, corresponding to a second portion of a first group of frequency components. In one or more exemplary hearing aids, signal processing unit 914 is configured to generate a second sub-frequency domain signal 906BAA based on a second frequency domain signal 906BA. For example, the second sub-frequency domain signal 906BAA is associated with a second frequency range ΔF2. The second sub-frequency domain signal 906BAA may characterize the signal of the second frequency domain signal 906BA within the second frequency range ΔF2, for example, corresponding to a second portion of a second group of frequency components.
[0256] In one or more exemplary hearing aids, a second signal processing unit 914B is configured to generate a second processed signal 910A based on a first processed signal 908 and one or more of a first sub-frequency domain signal 906AAB and a second sub-frequency domain signal 906BAA.
[0257] For example, a second processed signal 910A can be generated based on the first processed signal 908 and the first sub-frequency domain signal 906AAB. Alternatively, a second processed signal 910A can be generated based on the first processed signal 908 and the second sub-frequency domain signal 906BAA. Finally, a second processed signal 910A can be generated based on the first processed signal 908, the first sub-frequency domain signal 906AAB, and the second sub-frequency domain signal 906BAA.
[0258] For example, the second signal processing unit 914B generates a second processed signal 910A by combining the first processed signal 908 with one or more of the first sub-frequency domain signal 906AAB and the second sub-frequency domain signal 906BAA. For example, when generating the second processed signal 910A based on the first processed signal 908, the first sub-frequency domain signal 906AAB, and the second sub-frequency domain signal 906BAA, the second signal processing unit 914B can sum (e.g., add) the first sub-frequency domain signal 906AAB and the second sub-frequency domain signal 906BAA to generate a combined second frequency range signal (e.g.,...). Figure 4B (Not shown in the image). For example, when a second processed signal 910A is generated based on the first processed signal 908, the first sub-frequency domain signal 906AAB, and the second sub-frequency domain signal 906BAA, the second signal processing unit 914B can apply gains to the first sub-frequency domain signal 906AAB and the second sub-frequency domain signal 906BAA respectively to generate a combined second frequency range signal (e.g., ...). Figure 4B(Not shown in the image). For example, the combined second frequency range signal can be obtained by linearly combining the first sub-frequency domain signal 906AAB and the second sub-frequency domain signal 906BAA.
[0259] In one or more exemplary hearing aids, a second signal processing unit 914B generates a second processed signal 910A based on a first processed signal 908 (e.g., a combined first frequency range signal) and a combined second frequency range signal. For example, the second signal processing unit 914B includes a mixing unit 912 for generating the second processed signal 910A.
[0260] For example, when generating a second processed signal 910A based on a first processed signal 908, a first sub-frequency domain signal 906AAB, and a second sub-frequency domain signal 906BAA, a second signal processing unit 914B (e.g., a mixing unit 912) can generate the second processed signal 910A based on the first processed signal 908 and a combined second frequency range signal. In other words, the second signal processing unit 914B (e.g., a mixing unit 912) can concatenate the first processed signal 908 with the combined second frequency range signal into a joint vector, which represents the second processed signal 910A. For example, the second signal processing unit 914B (e.g., a mixing unit 912) can combine the first processed signal 908 with one or more of the first sub-frequency domain signals 906AAB and 906BAA. For example, the second signal processing unit 914B (e.g., a mixing unit 912) can concatenate the first processed signal 908 with the first sub-frequency domain signal 906AAB into a joint vector, which represents the second processed signal 910A. For example, the second signal processing unit 914B (e.g., the mixing unit 912) can concatenate the first processed signal 908 and the second sub-frequency domain signal 906BAA into a joint vector, which represents the second processed signal 910A. For example, the second processed signal 910A is a frequency domain signal, such as a full-band signal. One advantage of this invention is that by performing simple operations (e.g., addition and / or gain application) on the combined second frequency range signal, computational complexity can be reduced, and battery power consumption (e.g., energy consumption) can be decreased.
[0261] In one or more exemplary hearing aids, a second signal processing unit 914B generates a third processed signal 912A based on a second processed signal 910A. For example, the second signal processing unit 914B generates the third processed signal 912A by applying a single-channel processing technique to the second processed signal 910A. The single-channel processing technique may include one or more of the following: noise reduction technique, hearing loss compensation technique, voice activity detection technique, self-voice detection technique, feedback cancellation technique, and any other applicable single-channel processing technique. The third processed signal 912A may be a frequency domain signal, such as a full-band signal processed by one or more of the following: noise reduction, hearing loss compensation, voice activity detection, self-voice detection, and feedback cancellation.
[0262] In one or more exemplary hearing aids, signal processing unit 914 includes a synthesis filter 913 configured to generate a processed signal 914C based on a third processed signal 912A. For example, synthesis filter 913 generates processed signal 914C by converting the third processed signal 912A into a time-domain signal. Processed signal 914C may be a time-domain signal. For example, synthesis filter 913 is configured to operate at the highest of a first sampling rate f1 and a second sampling rate f2. Optionally, synthesis filter 913 is configured to operate at the lowest of the first sampling rate f1 and the second sampling rate f2. For example, synthesis filter may be configured to output a time-domain processed signal sampled at either the first or second sampling rate.
[0263] For example, the second signal processing unit 914B may be configured to generate a third processed signal 912A by applying single-channel processing techniques to the frequency range supported by the synthesis filter 913. For example, the second signal processing unit 914B may be configured to generate a third processed signal 912A by applying single-channel processing techniques to a second processed signal 910A (e.g., a full-band signal with a frequency range of ΔF1+ΔF2). For example, the second signal processing unit 914B may be configured to generate a third processed signal 912A by applying single-channel processing techniques to the portion of the second processed signal 910A corresponding to the first frequency range ΔF1. For example, audibility-related single-channel processing techniques (e.g., hearing loss compensation techniques and / or feedback cancellation techniques) may be applied only to the portion of the second processed signal 910A intended to be presented to the user (e.g., the first frequency range ΔF1 of the second processed signal 910A). For example, a single-channel detector and / or single-channel detection technology (such as noise reduction technology, voice activity detection technology, self-voice detection technology) can be applied to the second processed signal 910A, for example, to the full-band signal.
[0264] Figures 4A to 4B In the hearing aid shown, all input signals are sampled using a high sampling rate (e.g., higher than 10 ... Figures 1A to 3B The first signal processing unit 906A can process only a portion of the channels output by the analysis filter banks 906A and 906B (e.g., for directional processing), such as processing only the frequency components belonging to the first frequency range of the multiple frequency domain signals. The second signal processing unit 914B can process the frequency components within the second frequency range of at least two of the multiple frequency domain signals by summing the frequency components corresponding to the second frequency range of the at least two signals, or by applying gain to the components of the at least two signals within the second frequency range. The second signal processing unit 914B can process the frequency components within the second frequency range of at least two of the multiple frequency domain signals by either summing the frequency components corresponding to the second frequency range of the at least two signals or by applying gain to the components of the at least two signals within the second frequency range. One advantage of this invention is that by performing simple operations (e.g., summation, gain application) on a high-frequency channel (e.g., a frequency band corresponding to the second frequency range), computational complexity can be reduced, and battery power consumption (e.g., power consumption) can be decreased. Another advantage of this invention is that by processing only a subset of the high-frequency bands (e.g., frequency components corresponding to the second frequency range) of multiple input signals, computational complexity and battery power consumption can be reduced while ensuring that the fourth hearing aid 900 operates at a high sampling rate.
[0265] Figure 5 An exemplary flowchart of a hearing aid operation method 100 according to the present invention is shown.
[0266] Method 100 includes step S102: providing a first digitized signal associated with a first sampling rate and a second digitized signal associated with a second sampling rate. The first digitized signal includes a plurality of first frames (e.g., including a first main frame), each first frame including a plurality of first sample points. The second digitized signal includes a plurality of second frames (e.g., including a second main frame), each second frame including a plurality of second sample points. Method 100 further includes: determining the first sampling rate to be higher than the second sampling rate, and making the duration of each first frame the same as the duration of each second frame, thereby making the number of first sample points greater than the number of second sample points. In other words, the first sampling rate and the second sampling rate are different, but the duration of the first main frame is the same as the duration of the second main frame.
[0267] The method includes step S104: generating a processed signal based on a first digitized input signal and a second digitized input signal (e.g., a portion thereof). The method includes step S106: outputting an audible signal to the hearing aid wearer based on the processed signal.
[0268] When appropriately replaced by a corresponding process, the structural features of the apparatus described above, in detail in the "Detailed Description" section, and as defined in the claims can be combined with the steps of the method of the present invention.
[0269] Unless explicitly stated otherwise, the singular forms “a” and “the” used herein include the plural forms (i.e., meaning “at least one”). It should be further understood that the terms “having,” “comprising,” and / or “including” as used in the specification indicate the presence of features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or combinations thereof. It should be understood that, unless explicitly stated otherwise, when an element is referred to as “connected” or “coupled” to another element, it may be a direct connection or coupling to the other element, or there may be intermediate inserting elements. The term “and / or” as used herein includes any and all combinations of one or more of the listed related items. Unless explicitly stated otherwise, the steps of any method disclosed herein do not necessarily have to be performed in the exact order disclosed.
[0270] It should be understood that references to "an embodiment," "an embodiment," "an aspect," or "may" in this specification mean that a particular feature, structure, or characteristic described in connection with that embodiment is included in at least one embodiment of the invention. Furthermore, particular features, structures, or characteristics may be suitably combined in one or more embodiments of the invention. The foregoing description is provided to enable those skilled in the art to implement the various aspects described herein. Various modifications will be apparent to those skilled in the art.
[0271] The claims are not limited to the aspects shown herein, but encompass the full scope consistent with the language of the claims, wherein, unless expressly stated, an element referred to in the singular does not mean "one and only one," but rather "one or more." Unless expressly stated, the term "some" means one or more.
[0272] The method and examples of hearing aids according to the present invention are proposed by the following:
[0273] Item 1. A hearing aid, comprising:
[0274] The input unit is configured to provide a first digitized signal associated with a first sampling rate and a second digitized signal associated with a second sampling rate; the first digitized signal includes a plurality of first frames, the plurality of first frames including a first main frame; the second digitized signal includes a plurality of second frames, the plurality of second frames including a second main frame; wherein the first sampling rate is different from the second sampling rate, and the duration of the first main frame is the same as the duration of the second main frame;
[0275] The signal processing unit is configured to generate a processed signal based on the first digitized signal and the second digitized signal;
[0276] The output unit is configured to output an audible signal to a user wearing a hearing aid based on the processed signal.
[0277] Item 2. The hearing aid according to Item 1, wherein the hearing aid includes a first analysis filter bank and a second analysis filter bank; the first analysis filter bank is configured to generate a first frequency domain signal based on the first digitized signal, the first frequency domain signal being associated with a first frequency range and a second frequency range; the second analysis filter bank is configured to generate a second frequency domain signal based on the second digitized signal, the second frequency domain signal being associated with the first frequency range.
[0278] Item 3. The hearing aid according to Item 2, wherein the signal processing unit is configured to generate a first dominant frequency domain signal based on the first frequency domain signal, the first dominant frequency domain signal being associated with the first frequency range.
[0279] Item 4. The hearing aid according to Item 3, wherein the signal processing unit includes a first signal processing unit configured to generate a first processed signal based on the first main frequency domain signal and the second frequency domain signal.
[0280] Item 5. The hearing aid according to Item 4, wherein generating the first processed signal includes applying multi-channel processing technology to the first main frequency domain signal and the second frequency domain signal.
[0281] Item 6. The hearing aid according to Item 5, wherein the multi-channel processing technology includes beamforming technology.
[0282] Item 7. The hearing aid according to any one of items 2 to 6, wherein the signal processing unit is configured to generate a first sub-frequency domain signal based on the first frequency domain signal, the first sub-frequency domain signal being associated with the second frequency range.
[0283] Item 8. The hearing aid according to Item 7, wherein the signal processing unit includes a second signal processing unit configured to generate a second processed signal based on the first sub-frequency domain signal and the first processed signal.
[0284] Item 9. The hearing aid according to Item 8, wherein the second signal processing unit is configured to generate a third processed signal based on the second processed signal; wherein generating the third processed signal includes applying a single-channel processing technique to the second processed signal.
[0285] Item 10. The hearing aid according to Item 9, wherein the single-channel processing technology includes one or more of the following technologies: noise reduction technology, hearing loss compensation technology, voice activity detection (VAD) technology, self-voice detection (OVD) technology, feedback cancellation technology, and any other applicable single-channel processing technology.
[0286] Item 11. The hearing aid according to any one of items 9 to 10, wherein the signal processing unit includes a synthesis filter configured to generate the processed signal based on the third processed signal.
[0287] Item 12. The hearing aid according to any one of items 1 to 11, wherein the input unit includes a first analog-to-digital conversion unit and a second analog-to-digital conversion unit; the first analog-to-digital conversion unit is configured to digitize a first input signal using the first sampling rate to generate the first digitized signal; and the second analog-to-digital conversion unit is configured to digitize a second input signal using the second sampling rate to generate the second digitized signal.
[0288] Item 13. The hearing aid according to any one of items 1 to 11, wherein the input unit includes an analog-to-digital conversion unit configured to digitize the first input signal and the second input signal using a third sampling rate to generate a first master digitized signal and a second master digitized signal; wherein the third sampling rate is different from both the first sampling rate and the second sampling rate.
[0289] Item 14. The hearing aid according to Item 13, wherein when the third sampling rate is higher than the first sampling rate and the second sampling rate, the input unit is configured to apply downsampling technology to the first master digitized signal and the second master digitized signal to generate the first digitized signal and the second digitized signal.
[0290] Item 15. The hearing aid according to any one of items 13 to 14, wherein when the third sampling rate is lower than the first sampling rate and the second sampling rate, the input unit is configured to apply an upsampling technique to the first master digitized signal and the second master digitized signal to generate the first digitized signal and the second digitized signal.
[0291] Item 16. The hearing aid according to any one of items 12 to 15, wherein the first sampling rate is 30 kHz and the second sampling rate is 20 kHz.
[0292] Item 17. The hearing aid according to any one of items 12 to 15, wherein the first sampling rate is 32 kHz and the second sampling rate is 20 kHz.
[0293] Item 18. The hearing aid according to any one of items 12 to 15, wherein the first sampling rate is 44.1 kHz and the second sampling rate is 32 kHz.
[0294] Item 19. The hearing aid according to any one of items 12 to 18, wherein the first input signal includes a wireless signal or a microphone signal representing the ambient sound of the hearing aid.
[0295] Item 20. The hearing aid according to any one of items 12 to 19, wherein the second input signal includes a wireless signal or a microphone signal representing the ambient sound of the hearing aid.
[0296] Item 21. A method of operating a hearing aid, the method comprising:
[0297] A first digitized signal associated with a first sampling rate and a second digitized signal associated with a second sampling rate are provided; the first digitized signal comprises a plurality of first frames, the plurality of first frames including a first main frame; the second digitized signal comprises a plurality of second frames, the plurality of second frames including a second main frame; wherein the first sampling rate is different from the second sampling rate, and the duration of the first main frame is the same as the duration of the second main frame;
[0298] Based on the first digitized signal and the second digitized signal, a processed signal is generated;
[0299] Based on the processed signal, an audible signal is output to the user wearing the hearing aid.
[0300] Item 22. A hearing aid, comprising:
[0301] An input unit is configured to provide a first digitized signal and a second digitized signal; the first digitized signal and the second digitized signal are associated with the same sampling rate, which is higher than the highest sampling rate supported by the synthesis filter of the hearing aid.
[0302] The signal processing unit is configured to generate a processed signal based on the first digitized signal and the second digitized signal;
[0303] The output unit is configured to output an audible signal to a user wearing a hearing aid based on the processed signal.
[0304] Item 23. The hearing aid according to Item 22, wherein the hearing aid includes a first analysis filter bank and a second analysis filter bank; the first analysis filter bank is configured to generate a first frequency domain signal based on the first digitized signal; the second analysis filter bank is configured to generate a second frequency domain signal based on the second digitized signal; both the first frequency domain signal and the second frequency domain signal are associated with a first frequency range and a second frequency range.
[0305] Item 24. The hearing aid according to Item 23, wherein the signal processing unit is configured to generate a first dominant frequency domain signal based on the first frequency domain signal and to generate a second dominant frequency domain signal based on the second frequency domain signal; both the first dominant frequency domain signal and the second dominant frequency domain signal are associated with the first frequency range.
[0306] Item 25. The hearing aid according to Item 24, wherein the signal processing unit includes a first signal processing unit configured to generate a first processed signal based on the first main frequency domain signal and the second main frequency domain signal.
[0307] Item 26. The hearing aid according to Item 25, wherein generating the first processed signal includes applying multi-channel processing technology to the first main frequency domain signal and the second main frequency domain signal.
[0308] Item 27. The hearing aid according to Item 26, wherein the multi-channel processing technology includes beamforming technology.
[0309] Item 28. The hearing aid according to any one of items 23 to 27, wherein the signal processing unit is configured to generate a first sub-frequency domain signal based on the first frequency domain signal and to generate a second sub-frequency domain signal based on the second frequency domain signal; both the first sub-frequency domain signal and the second sub-frequency domain signal are associated with the second frequency range.
[0310] Item 29. The hearing aid according to Item 28, wherein the signal processing unit includes a second signal processing unit configured to generate a second processed signal based on the first processed signal and one or more of the first sub-frequency domain signal and the second sub-frequency domain signal.
[0311] Item 30. The hearing aid according to Item 29, wherein the second signal processing unit is configured to generate a third processed signal based on the second processed signal; wherein generating the third processed signal includes applying a single-channel processing technique to the second processed signal.
[0312] Item 31. The hearing aid according to Item 30, wherein the single-channel processing technology includes one or more of the following technologies: noise reduction technology, hearing loss compensation technology, voice activity detection (VAD) technology, self-voice detection (OVD) technology, feedback cancellation technology, and any other applicable single-channel processing technology.
[0313] Item 32. The hearing aid according to Item 30, wherein the signal processing unit includes a synthesis filter configured to generate the processed signal based on the third processed signal.
[0314] Item 33. The hearing aid according to any one of items 22 to 32, wherein the input unit includes a first analog-to-digital conversion unit and a second analog-to-digital conversion unit; the first analog-to-digital conversion unit and the second analog-to-digital conversion unit are configured to use the same sampling rate to digitize the first input signal and the second input signal, respectively, to generate the first digitized signal and the second digitized signal.
[0315] Item 34. The hearing aid according to any one of items 22 to 32, wherein the input unit includes an analog-to-digital conversion unit configured to digitize the first input signal and the second input signal using a different sampling rate to generate a first master digitized signal and a second master digitized signal; wherein the other sampling rate is different from the sampling rate.
[0316] Item 35. The hearing aid according to Item 34, wherein when the other sampling rate is higher than the sampling rate, the input unit is configured to apply a downsampling technique to the first master digitized signal and the second master digitized signal to generate the first digitized signal and the second digitized signal.
[0317] Item 36. The hearing aid according to any one of items 34 to 35, wherein when the other sampling rate is lower than the sampling rate, the input unit is configured to apply an upsampling technique to the first master digitized signal and the second master digitized signal to generate the first digitized signal and the second digitized signal.
[0318] Item 37. The hearing aid according to any one of items 33 to 36, wherein the sampling rate is greater than or equal to one or more of the following: 20 kHz, 24 kHz, 30 kHz, 32 kHz, 44.1 kHz.
[0319] Item 38. The hearing aid according to any one of items 33 to 37, wherein the first input signal includes a wireless signal or a microphone signal representing the ambient sound of the hearing aid.
[0320] Item 39. The hearing aid according to any one of items 33 to 38, wherein the second input signal includes a wireless signal or a microphone signal representing the ambient sound of the hearing aid.
[0321] Item 40. A method of operating a hearing aid, the method comprising:
[0322] A first digitized signal and a second digitized signal are provided; the first digitized signal and the second digitized signal are associated with the same sampling rate, which is higher than the highest sampling rate supported by the hearing aid;
[0323] Based on the first digitized signal and the second digitized signal, a processed signal is generated;
[0324] Based on the processed signal, an audible signal is output to the user wearing the hearing aid.
Claims
1. A hearing aid, comprising: The input unit is configured to provide a first digitized signal associated with a first sampling rate and a second digitized signal associated with a second sampling rate; The first digital signal includes multiple first frames, each of which includes multiple first sampling points; the second digital signal includes multiple second frames, each of which includes multiple second sampling points. The hearing aid is configured to determine the first sampling rate as higher than the second sampling rate, such that the duration of each first frame is the same as the duration of each second frame, thereby making the number of first sampling points greater than the number of second sampling points. A first analysis filter bank is configured to generate a first frequency domain signal based on the first digitized signal, the first frequency domain signal being associated with a first frequency range and a second frequency range; The second analysis filter bank is configured to generate a second frequency domain signal based on the second digitized signal, the second frequency domain signal being associated with the first frequency range; The determination of the first sampling rate and the second sampling rate is such that the first frequency range of the first frequency domain signal and the second frequency domain signal contain the same frequency band; and The signal processing unit is configured to generate a first processed signal based on a first frequency range of the first frequency domain signal and the second frequency domain signal; The output unit is configured to output an audible signal to a user wearing a hearing aid based on the first processed signal.
2. The hearing aid according to claim 1, wherein, Generating the first processed signal involves applying multi-channel processing technology to a first frequency range of the first frequency domain signal and the second frequency domain signal.
3. The hearing aid according to claim 2, wherein, The multi-channel processing technology includes beamforming technology.
4. The hearing aid according to claim 1, wherein, The signal processing unit is configured to generate a second processed signal based on a first frequency range of the first frequency domain signal and the first processed signal.
5. The hearing aid according to claim 4, wherein, The signal processing unit is configured to generate a third processed signal based on the second processed signal, wherein generating the third processed signal includes applying a single-channel processing technique to the second processed signal.
6. The hearing aid according to claim 5, wherein, The single-channel processing technology includes one or more of the following technologies: noise reduction technology, hearing loss compensation technology, voice activity detection technology, self-voice detection technology, feedback cancellation technology, and any other suitable single-channel processing technology.
7. The hearing aid according to claim 6, wherein, The signal processing unit includes a synthesis filter configured to generate a processed signal based on the third processed signal, and the output unit is configured to output the audible signal to a user wearing a hearing aid based on the processed signal.
8. The hearing aid according to claim 1, wherein, The input unit is configured as follows: The first input signal is digitized using the first sampling rate to generate the first digitized signal; and The second input signal is digitized using the second sampling rate to generate the second digitized signal.
9. The hearing aid according to claim 8, wherein, The first input signal includes a wireless signal or a microphone signal representing the ambient sound of the hearing aid.
10. The hearing aid according to claim 8, wherein, The second input signal includes a wireless signal or a microphone signal representing the ambient sound of the hearing aid.
11. The hearing aid according to claim 1, wherein, The hearing aid is configured to determine the first sampling rate as higher than the second sampling rate according to the following formula: in, This represents the number of first sampling points in the l-th frame among the plurality of first frames. Represents the first sampling rate. This represents the number of second sampling points in the l-th frame among the plurality of second frames. This represents the second sampling rate.
12. The hearing aid according to claim 1, wherein, The duration of each first frame and each second frame is an integer multiple of the reciprocal of the greatest common divisor of the first sampling rate and the second sampling rate.
13. The hearing aid according to claim 1, wherein, The first sampling rate is 30 kHz, and the second sampling rate is 20 kHz.
14. The hearing aid according to claim 1, wherein, The first sampling rate is 32kHz, and the second sampling rate is 20kHz.
15. The hearing aid according to claim 1, wherein, The first sampling rate is 44.1 kHz, and the second sampling rate is 32 kHz.