Hearing device with adaptive auricle restoration function

Abstract

A hearing device and a related method are disclosed, the hearing device comprising a first shell; a second shell; a wire connecting the first shell and the second shell; a main microphone group arranged in the first shell; an auxiliary microphone in the second shell for providing an auxiliary microphone input signal; an auricle restorer for providing an auricle output based on the first auricle input and the second auricle input, the auricle restorer comprising a first filter for providing a first mixer input, a second filter for providing a second mixer input and a first mixer for providing a first mixer output based on the first mixer input and the second mixer input; an input mixer for providing an input mixer output based on the auricle output and the auxiliary mixer input; a processor for processing the input mixer output and providing an electrical output signal based on the input mixer output; and a receiver for converting the electrical output signal into an audio output signal.

Description

Technical Field

[0001] The present disclosure relates to hearing devices and related methods, including methods of operating a hearing device. In particular, a hearing device having an in-ear microphone and one or more behind-the-ear microphones and related methods are disclosed. Background Art

[0002] For hearing device designers, spatial perception and the ability to perceive spatial cues play an important role in the ability of hearing device users to understand speech and are critical in complex listening environments. On the other hand, feedback and instability in hearing aids remain a challenge for hearing device designers and engineers, especially when the microphone and receiver are placed close to each other, such as in MaRIE (microphone and receiver in the ear) hearing devices. Summary of the invention

[0003] Therefore, there is a need for hearing devices and methods with improved spatial perception and hearing device stability.

[0004] A hearing device is disclosed, the hearing device comprising: a first housing, the first housing being optionally configured as a rear-ear housing worn behind the auricle of a user; a second housing being optionally configured as an earphone housing worn in or at the ear canal of the user; and a wire connecting the first housing and the second housing. The hearing device comprises: a main microphone group arranged in the first housing, the main microphone group comprising a main first microphone for providing a main first microphone input signal, and a main second microphone for optionally providing a main second microphone input signal; optionally, an auxiliary microphone arranged in the second housing, the auxiliary microphone for providing an auxiliary microphone input signal; and an auricle restorer, the auricle restorer for providing an auricle output based on a first auricle input and a second auricle input, wherein the first auricle input is based on the main first microphone input signal, and the second auricle input is based on the main second microphone input signal. The auricle restorer comprises a first filter for providing a first mixer input based on the first auricle input, a second filter for providing a second mixer input based on the second auricle input, and a first mixer for providing a first mixer output based on the first mixer input and the second mixer input. The hearing device comprises: an input mixer for providing an input mixer output based on an auricle output and / or an auxiliary mixer input, wherein the auxiliary mixer input is based on an auxiliary microphone input signal; a processor for processing the input mixer output and providing an electrical output signal based on the input mixer output; and a receiver for converting the electrical output signal into an audio output signal. The auricle restorer optionally comprises an auricle controller. The first mixer optionally comprises a first auricle filter for filtering the first mixer input and / or a second auricle filter for filtering the second mixer input. The auricle controller can be configured to control one or both of the first auricle filter and the second auricle filter, for example, based on the auxiliary mixer input. The auricle restorer optionally comprises a third auricle filter for providing a first auricle output based on the first mixer output from the first mixer, and wherein the auricle output is based on the first auricle output.

[0005] In addition, a method of operating a hearing device is disclosed, the hearing device comprising: a first shell configured as a rear-ear shell worn behind the user's auricle; a second shell configured as an earphone shell worn in or at the user's ear canal; a wire connecting the first shell and the second shell; a main microphone group arranged in the first shell, the main microphone group including a main first microphone and / or a main second microphone; an auxiliary microphone arranged in the second shell; an auricle restorer, an input mixer; a processor; and a receiver, the method comprising: obtaining a main first microphone input signal with the main first microphone; obtaining a main second microphone input signal with the main second microphone; obtaining an auxiliary microphone input signal with the auxiliary microphone; providing an auricle output based on the first auricle input and / or the second auricle input, wherein the first auricle input is optionally based on the main first microphone input signal and the second auricle input is optionally based on the main second microphone input signal. Providing the auricle output includes providing a first mixer input based on the first auricle input, providing a second mixer input based on the second auricle input, and providing a first mixer output based on the first mixer input and the second mixer input. The method includes providing an input mixer output based on an auricle output and an auxiliary mixer input, wherein the auxiliary mixer input is optionally based on an auxiliary microphone input signal; processing the input mixer output to provide an electrical output signal; and converting the electrical output signal into an audio output signal. In the method, providing the auricle output optionally includes, for example, controlling one or both of a first auricle filter and a second auricle filter of an auricle restorer based on the auxiliary mixer input, and filtering the first mixer output to provide a first auricle output, and wherein the auricle output is based on the first auricle output.

[0006] An important advantage of the hearing device is that it may improve the spatial perception of the hearing device with a more personalized head-related transfer function (HRTF) and higher stability. Thus, while spatial cues are preserved to a higher degree, the risk of feedback in the hearing device is reduced, thereby providing an improved hearing device. Hearing device Hearing device Hearing device Hearing device Furthermore, the present disclosure provides an improved user experience by improving speech intelligibility and feedback reduction.

[0007] An advantage of the present disclosure is that the hearing device does not need to be initialized. Furthermore, the adaptive mix provides an optimized balance between in-ear microphone (MIE) and pinna restoration in many, if not all, cases, thereby improving the performance of current fixed MIE mixes.

[0008] Furthermore, the present disclosure provides a hearing device with improved robustness due to the adaptive MIE mixing (which is self-stabilizing), and thus is likely to increase stable gain, fit well with current system designs, and reduce inter-subject variability (adaptive signal matching makes the mixing behavior more consistent). BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The above and other features and advantages of the present invention will become apparent to those skilled in the art through the following detailed description of exemplary embodiments thereof with reference to the accompanying drawings, in which:

[0010] Figure 1 schematically illustrates an exemplary hearing device,

[0011] Figure 2 schematically illustrating an exemplary auricle restorer for a hearing device,

[0012] Figure 3 schematically illustrating an exemplary auricle restorer for a hearing device,

[0013] Figure 4 schematically illustrating an exemplary auricle restorer for a hearing device,

[0014] Figure 5 schematically shows an exemplary input mixer for a hearing instrument, and

[0015] Figure 6 is a flow chart of an exemplary method according to the present disclosure.

[0016] Reference numerals list

[0017] 2.2A, 2B, 2C hearing aids

[0018] 4First Shell

[0019] 6 Second shell

[0020] 8-wire

[0021] 10 Main First Microphone

[0022] 10A Main first microphone input signal

[0023] 12 Primary Secondary Microphones

[0024] 12A Main Second Microphone Input Signal

[0025] 14 Auxiliary microphone

[0026] 14A auxiliary microphone input signal

[0027] 16, 16A, 16B auricle restorer, auricle repair module

[0028] 18 auricle output

[0029] 20 First auricle input

[0030] 22 Second auricle input

[0031] 24-input mixer

[0032] 26 input mixer output, IMO

[0033] 28 Auxiliary mixer input, SMI

[0034] 30 processors

[0035] 32 electrical output signals

[0036] 34 Receivers

[0037] 36 Feedback Elimination Module

[0038] 38 Main first feedback elimination signal

[0039] 40 Main Second Feedback Cancellation Signal

[0040] 42 Auxiliary feedback elimination signal

[0041] 44 Main First Feedback Eliminator

[0042] 46 Main Second Feedback Eliminator

[0043] 48 Auxiliary Feedback Eliminator

[0044] 50 auxiliary filters

[0045] 52 First filter

[0046] 52A First mixer input

[0047] 54 Second filter

[0048] 54A Second mixer input

[0049] 56First mixer

[0050] 56A 1st mixer output, FMO

[0051] 58 Ear Controller

[0052] 60 First Pinna Filter

[0053] 62 Second pinna filter

[0054] 64 first delay unit, first delay element

[0055] 65 First Control Adder

[0056] 66 Third pinna filter

[0057] 68 First Pinna Output, FPO

[0058] 70 third delay unit, third delay element

[0059] 71 Third control adder

[0060] 72 First input adder

[0061] 74 First main input

[0062] 76 Second main input

[0063] 78 First input filter

[0064] 78A first output

[0065] 80 Second input filter

[0066] 80A second output, SO

[0067] 82 Third input filter

[0068] 82A third output

[0069] 84 Second input adder

[0070] 84A Second adder output

[0071] 100 Ways to Operate Hearing Devices

[0072] 102 Get the main first microphone input signal

[0073] 104 Get the main second microphone input signal

[0074] 106 Obtaining the second microphone input signal

[0075] 108 Providing an auricle output based on the first auricle input and the second auricle input

[0076] 108A provides a first mixer input based on the first auricle input

[0077] 108B provides a second mixer input based on the second pinna input

[0078] 108C provides a first mixer input based on the first mixer input and the second mixer input.

[0079] out

[0080] 108D controls the first auricle filter and the second auricle filter of the auricle restorer

[0081] One or Both

[0082] 108E filters the first mixer output to provide a first auricle output

[0083] 110 provides an input mixer output based on the pinna output and the auxiliary mixer input

[0084] 112 Provides auxiliary mixer input based on auxiliary microphone input signal

[0085] 114 processes the mixer output to provide an electrical output signal

[0086] 116 Convert the electrical output signal into an audio output signal

[0087] e1 first auricle control signal

[0088] e3 third auricle control signal DETAILED DESCRIPTION

[0089] Various exemplary embodiments and details will be described below with reference to the accompanying drawings when relevant. It should be noted that the drawings may or may not be drawn to scale, and elements of similar structure or function are represented by similar reference numerals in all drawings. It should also be noted that the drawings are only for the convenience of illustrating the embodiments. They are not intended to be an exhaustive description of the present invention or as a limitation on the scope of the present invention. In addition, the illustrated embodiments do not need to have all aspects or advantages shown. The aspects or advantages described in conjunction with a specific embodiment are not necessarily limited to that embodiment and can be practiced in any other embodiment, even if not so described or not so explicitly described.

[0090] A hearing device is disclosed. The hearing device may be configured to be worn at an ear of a user and may be a hearable device or a hearing aid, wherein a processor is configured to compensate for a hearing loss of the user.

[0091] The hearing device may be of the Microphone and Receiver in the Ear (MaRIE) type. The hearing device may be a combined BTE and MaRIE type hearing device. The hearing device may be part of a binaural hearing system. Hence, the hearing device may be a binaural hearing device.

[0092] The hearing device comprises a first shell, which is optionally configured as a behind-the-ear shell to be worn behind the pinna of a user, and a second shell, which is optionally configured as an earphone shell to be worn in and / or at the ear canal of the user.

[0093] The hearing device comprises a wire connecting the first housing and the second housing. The wire comprises a plurality of conductors, for example three, four, five, six or even eight or more conductors, for electrically connecting the electrical components of the first housing to the electrical components of the second housing.

[0094] The hearing device comprises a main microphone group arranged in a first housing, the main microphone group comprising a main first microphone for providing a main first microphone input signal also denoted as x_1_1, and optionally a main second microphone for providing a main second microphone input signal also denoted as x_1_2. The main first microphone may be denoted as a front BTE (behind the ear) microphone and the main second microphone may be denoted as a rear BTE (behind the ear) microphone. The main microphone group may comprise a main third microphone for providing a main third microphone input signal also denoted as x_1_3.

[0095] The hearing device comprises an auxiliary microphone (also referred to as an auxiliary first microphone) arranged in the second housing for providing an auxiliary microphone input signal also referred to as x_2 or x_2_1. The auxiliary microphone may be denoted as an in-ear microphone. The hearing device may comprise a plurality of auxiliary microphones arranged in the second housing. For example, an auxiliary second microphone (also referred to as an ear canal microphone) may be arranged in the second housing for receiving sound in the ear canal in order to reduce an occlusion effect.

[0096] The hearing device comprises an auricle restorer for providing an auricle output based on a first auricle input and a second auricle input. The first auricle input is based on a main first microphone input signal. For example, the main first microphone input signal can be directly fed as the first auricle input, or the main first microphone input signal can be subjected to feedback cancellation, for example, with a main first feedback canceller, and the feedback-canceled main first microphone input signal can be fed to the auricle restorer as the first auricle input. The second auricle input is based on a main second microphone input signal. For example, the main second microphone input signal can be directly fed as the second auricle input, or the main second microphone input signal can be subjected to feedback cancellation, for example, with a main second feedback canceller, and the feedback-canceled main second microphone input signal can be fed to the auricle restorer as the second auricle input.

[0097] The pinna restorer optionally includes a first filter for providing a first mixer input based on a first pinna input, and a second filter for providing a second mixer input based on a second pinna input. The first filter and / or the second filter may be a constant filter and may be optionally configured to adjust the corresponding first and second pinna inputs so as to best present them to the subsequent first mixer of the pinna restorer. The adjustment may include one or more of calibration offset, microphone position effect compensation, signal alignment, microphone matching, and even an entire fixed directivity diagram (e.g., encoding the channel response of a non-adaptive MaRIE solution). In one or more exemplary hearing devices, the first pinna input may be provided as a first mixer input and / or the second pinna input may be provided as a second mixer, i.e., the first filter and / or the second filter may be omitted.

[0098] The pinna restorer comprises a first mixer for providing a first mixer output based on a first mixer input and a second mixer input. The pinna output is based on the first mixer output. In one or more exemplary hearing devices / pinna restorers, the first mixer output forms the pinna output.

[0099] The auricle restorer may be a multi-channel auricle restorer. In other words, the first filter and / or the second filter of the auricle restorer may be a multi-channel filter, such as a filter bank.

[0100] The first mixer may be a multi-channel mixer.

[0101] The hearing device includes an input mixer for providing an input mixer output based on an auricle output and an auxiliary mixer input. The auxiliary mixer input is based on an auxiliary microphone input signal. For example, the auxiliary microphone input signal can be directly fed as an auxiliary mixer input. In one or more example hearing devices, the auxiliary microphone input signal can be subjected to feedback elimination and / or filtering, for example, with an auxiliary feedback canceller and / or an auxiliary filter, and the feedback eliminated and / or filtered auxiliary microphone input signal can be fed to the auricle restorer as an auxiliary mixer input. The auxiliary filter can be a constant filter and can be optionally configured to adjust the auxiliary microphone input signal or the feedback eliminated auxiliary microphone input signal so as to best present it to the subsequent input mixer. The adjustment can include one or more of calibration offset, microphone position effect compensation, signal alignment, microphone matching, and even an entire fixed directivity diagram (e.g., encoding the channel response of a non-adaptive MaRIE solution).

[0102] The hearing device comprises a processor for processing an input mixer output and providing an electrical output signal based on the input mixer output, and a receiver for converting the electrical output signal into an audio output signal. The processor may be configured to compensate for a hearing loss of a user of the hearing device.

[0103] In one or more exemplary hearing devices, the pinna restorer includes an auricle controller, and the first mixer includes one or more of a first pinna filter for filtering the first mixer input and a second pinna filter for filtering the second mixer input. The pinna controller is optionally configured to control one or both of the first pinna filter and the second pinna filter, for example based on an auxiliary mixer input. In other words, an auxiliary mixer input that is very close to an individual's pinna response can be used to adjust the first pinna filter and / or the second pinna filter. Therefore, the first pinna filter can be an adaptive filter and / or the second pinna filter can be an adaptive filter. The first mixer includes a first input adder that adds the filtered first mixer input and the filtered second mixer input.

[0104] The auricle restorer may include a third auricle filter for providing a first auricle output based on a first mixer output from the first mixer. In other words, the first mixer output may be fed to the third auricle filter and filtered with the third auricle filter, and the filtered first mixer output forms the first auricle output. The third auricle filter may be an adaptive filter. Therefore, direction-independent regulation can be effectively achieved by adjusting the third auricle filter. The auricle output may be based on the first auricle output. For example, the first auricle output may form or constitute the auricle output.

[0105] The pinna restorer may be an adaptive pinna restorer. In other words, the pinna restorer may include one or more adaptive pinna filters.

[0106] In one or more example hearing devices, controlling one or both of the first pinna filter and the second pinna filter based on the auxiliary mixer input comprises determining a first pinna control signal, wherein determining the first pinna control signal optionally comprises applying a first delay to the auxiliary mixer input. The first pinna control signal is optionally fed to the first pinna filter, which is an adaptive filter for adjusting filter coefficients of the first pinna filter, e.g., based on the first pinna control signal. The first pinna control signal is optionally fed to the second pinna filter, which is an adaptive filter for adjusting filter coefficients of the second pinna filter, e.g., based on the first pinna control signal.

[0107] The first delay may be in the range of 0.1 ms to 3 ms. In one or more example hearing devices, the first delay is in the range of 0.2 ms to 1.5 ms. The first delay may be less than 1.2 ms, such as in the range of 0.3 ms to 1.0 ms.

[0108] In one or more example hearing devices, controlling the second pinna filter based on the auxiliary mixer input comprises determining a second pinna control signal, wherein determining the second pinna control signal optionally comprises applying a second delay to the auxiliary mixer input. The second pinna control signal is optionally fed to the second pinna filter, which is an adaptive filter for adjusting filter coefficients of the second pinna filter, e.g., based on the second pinna control signal.

[0109] In one or more exemplary hearing devices, controlling one or both of the first pinna filter and the second pinna filter is based on the first mixer output. In other words, the first pinna control signal and / or the second pinna control signal may be based on the first mixer output FMO. The first pinna control signal may be based on the auxiliary mixer input. In one or more exemplary hearing devices, the first pinna control signal PCS_1 is given by:

[0110] PCS_1 = DSMI_1-FMO,

[0111] Where DSMI_1 is the auxiliary microphone input with the first delay D1 and FMO is the first mixer output.

[0112] In one or more example hearing devices, the pinna controller is configured to control the third pinna filter based on the auxiliary mixer input.

[0113] In one or more example hearing devices, controlling the third pinna filter based on the auxiliary mixer input comprises determining a third pinna control signal, wherein determining the third pinna control signal optionally comprises applying a third delay to the auxiliary mixer input.

[0114] The third delay may be less than 15 ms. In one or more example hearing devices, the third delay is in the range of 0.1 ms to 3 ms, such as in the range of 0.2 ms to 1.5 ms. The third delay may be less than 1.2 ms, such as in the range of 0.3 ms to 1.0 ms.

[0115] In one or more example hearing devices, the third delay is greater than or longer than the first delay. The difference between the third delay and the first delay may be at least 0.1 ms, such as in the range of 0.1 ms to 1.2 ms. In one or more example hearing devices, the difference between the third delay and the first delay is 0.2 ms, 0.3 ms, 0.4 ms, 0.5 ms, 0.6 ms, 0.7 ms, 0.8 ms, 0.9 ms or 1.0 ms.

[0116] In one or more exemplary hearing devices, the first delay matches a processing delay of the first pinna filter. In one or more exemplary hearing devices, the third delay matches a sum of processing delays of the first pinna filter, an adder of the first mixer and the third pinna filter.

[0117] In one or more exemplary hearing devices, controlling the third pinna filter is based on the first pinna output. For example, the third pinna control signal from the pinna controller to the third pinna filter may be based on the first pinna output as the output of the third pinna filter. The third pinna control signal from the pinna controller to the third pinna filter may be based on an auxiliary mixer input that is optionally delayed with a third delay in a third delay unit. Therefore, the third pinna control signal is optionally fed to the third pinna filter, which is an adaptive filter for adapting the filter coefficients of the third pinna filter, for example, based on the third pinna control signal. In other words, the third pinna control signal may be based on the first pinna output FPO. The third pinna control signal may be based on the auxiliary mixer input. In one or more exemplary hearing devices, the third pinna control signal PCS_3 is given by:

[0118] PCS_3 = DSMI_3-FPO,

[0119] Where DSMI_3 is the auxiliary microphone input with the third delay D3 and FPO is the first pinna output.

[0120] In one or more example hearing devices, the hearing device includes a feedback cancellation system configured to apply feedback cancellation to one or more of a main first microphone input signal, a main second microphone input signal, and an auxiliary microphone input signal. The feedback cancellation system may include a feedback cancellation module for providing one or more feedback cancellation signals, the feedback cancellation signal including one or more of a main first feedback cancellation signal for the main first microphone input signal, a main second feedback cancellation signal for the main second microphone input, and an auxiliary feedback cancellation signal for the auxiliary microphone input signal. Depending on the selected feedback cancellation configuration, the feedback cancellation system may include one or more of a main first feedback canceller, a main second feedback canceller, and an auxiliary feedback canceller. The feedback cancellation signals are fed to the main first feedback canceller for feedback cancellation of the main first microphone input signal, the main second feedback canceller for feedback cancellation of the main second microphone input signal, and the auxiliary feedback canceller for feedback cancellation of the auxiliary microphone input signal, respectively. In one or more example hearing devices, feedback cancellation is applied only to the auxiliary microphone input signal.

[0121] In one or more example hearing devices, the input mixer includes a first input adder for providing an input mixer output based on a first main input and a second main input. The first main input may be based on an auricle output and the second main input may be based on an auxiliary mixer input. The input mixer output may be given as a sum or a linear combination of the first main input and the second main input.

[0122] In one or more example hearing devices, the input mixer comprises a first input filter for providing a first main input based on a first output of the first input filter.

[0123] In one or more example hearing devices, the input mixer includes a second input filter for providing a second main input based on a second output of the second input filter. Optionally, the second input filter receives the auxiliary mixer input and filters the auxiliary mixer input to provide a second output of the second input filter. The second input filter may be a fixed filter or an adaptive filter. The second output of the second input filter may be used as or form the second main input.

[0124] In one or more example hearing devices, the input mixer includes a second input adder for providing a second adder output based on the pinna output and / or the second output of the second input filter. The second adder output may be given as a difference between the pinna output and the second output of the second input filter. The second adder output may be fed to the second input filter as an adaptive control signal. The second adder output may be an input to the first input filter, i.e. the first input filter may filter the second adder output to form the first output / first main input.

[0125] In one or more example hearing devices, the input mixer includes a third input filter for providing a second main input based on a second output of the second input filter. Thus, the second main input may be based on the auxiliary mixer input. The third input filter may filter the second output of the second input filter and provide a second main input as a third output of the third input filter, i.e., the third input filter may filter the second output to form a third output / second main input. The third input filter may be a fixed filter or an adaptive filter. In one or more example hearing devices, the third input filter is an all-pass filter.

[0126] In one or more example hearing devices, the input mixer is configured to control the first input filter based on the input mixer output. In other words, the input mixer output may be fed as a control signal to the first input filter.

[0127] In one or more example hearing devices, the input mixer is configured to control the second input filter based on the pinna input and / or the second output of the second input filter, for example, the difference between the pinna input and the second output of the second input filter. In other words, the first adder output, for example based on the pinna input and / or the second output, can be fed to the second input filter as a control signal for adjusting the second input filter.

[0128] The hearing device / pinna restoration performs pinna restoration (PR) and uses the BTE microphone input signals (front such as the main first microphone input signal and rear such as the main second microphone input signal) to approximate the pinna response. The calibrated MIE signal Xm (also denoted in the present disclosure as the auxiliary mixer input, which is very close to the individual pinna response) can be used to adjust the PR. By adjusting the first pinna filter (denoted as W f ) and / or a second pinna filter (denoted as W r ) can adjust the directivity pattern (e.g., by minimizing the first pinna control signal, also denoted as e1). By adjusting the third pinna filter (denoted as W p ) can effectively accomplish direction-independent adjustment (e.g., by minimizing a third pinna control signal also denoted as e3). In the pinna restorer, a first delay unit optionally configured with a first delay D1 and a third delay unit optionally configured with a third delay D3 can achieve optimal time alignment of the adaptive pinna filters.

[0129] In one or more example hearing devices, the auxiliary mixer input (MIE signal Xm) is filtered through a second input filter (also denoted as W m ) is matched to the pinna output (PO) in the input mixer. MIE matching can be accomplished by an adaptive filter, for example by minimizing the second adder output, see e.g. Figure 3 In other words, the second input filter may be an adaptive filter.

[0130] In one or more example hearing devices, the auxiliary mixer input (MIE signal Xm) is matched to the pinna output (PO) in the input mixer via a second input filter that is a fixed filter (e.g., where the second input filter has been matched with one or more delays (e.g., a third delay D3 applied in the pinna restorer)).

[0131] Under normal conditions (when PR is stable), the feedback on the pinna output is smaller than the feedback on the MIE channel (auxiliary mixer input). Therefore, adapting the MIE channel to PR has an inherent tendency to reduce feedback and can be considered self-stabilizing.

[0132] In one or more example hearing devices, the input mixer takes matching signals from the auxiliary mixer input (from the second output of the second input filter) and the pinna restorer (pinna output) and computes a mix of the two channels that can be phase aligned and have an effective gain sum of 1 (otherwise, feedback can be minimized simply by muting both channels) to avoid a degraded solution.

[0133] In one or more example input mixers, the input mixer output IMO (see also Figure 3 ) is given by:

[0134] IMO=IF3(SO)+IF1(PO-SO),

[0135] Where IF3 is the filter function of the third input filter (optionally an all-pass filter), SO is the second output from the second input filter, which applies the filter function IF2 to the auxiliary mixer input SMI, IF1 is the filter function of the first input filter (optionally adaptive, e.g., with a phase response matched to the third input filter), and PO is the pinna output. IF1 (PO-SO) also represents the second adder output.

[0136] The second output SO of the second input filter can be given as:

[0137] SO=IF2(SMI),

[0138] where IF2 is the optional adaptive filter function of the second input filter and SMI is the auxiliary mixer input.

[0139] The first input filter of the input mixer can be implemented by an odd-length linear phase FIR filter, but other forms such as warped FIR filters are also possible. The first input filter of the input mixer implemented by an odd-length linear phase FIR filter implies that the third input filter becomes an integer number of samples delayed. The first input filter of the input mixer can be a frequency-dependent filter, for example so that different frequencies can obtain different mixtures of SO and PI.

[0140] In one or more example input mixers, a non-adaptive mixer may be used, however, an adaptive mixer in the input mixer may compensate for variations in the feedback path and may therefore provide superior performance.

[0141] In one or more example input mixers where the first input filter is adaptive, the first input filter uses standard LMS updates to minimize the power of the input mixer output IMO. When feedback distortion dominates (power SO > PI), the first input filter automatically adjusts the pinna input PI. On the other hand, for example, if distortion from microphone noise or wind noise dominates in the BTE channel (power SO < PI), the first input filter adjusts the second output based on the auxiliary microphone input signal. In the absence of a clear benefit, unbiased adaptation of the first input filter may apply a 50 / 50 mixing result, which provides a 3 dB reduction for uncorrelated noise.

[0142] Disclosed are methods of operating a hearing device, such as the methods disclosed herein. The hearing device includes: a first housing, which is optionally configured as a behind-the-ear housing to be worn behind a user's pinna; a second housing, which is optionally configured as an earbud housing to be worn in or at the user's ear canal; a wire connecting the first housing and the second housing; a primary microphone set disposed in the first housing, the primary microphone set including a primary first microphone and a primary second microphone; an auxiliary microphone disposed in the second housing; a pinna restorer, an input mixer; a processor; and a receiver. The method includes obtaining a primary first microphone input signal with the primary first microphone; obtaining a primary second microphone input signal with the primary second microphone; obtaining an auxiliary microphone input signal with the auxiliary microphone; and providing a pinna output based on a first pinna input and / or a second pinna input. The first pinna input is based on the primary first microphone input signal and the second pinna input is based on the primary second microphone input signal, wherein providing the pinna output includes providing a first mixer input based on the first pinna input, providing a second mixer input based on the second pinna input, and providing a first mixer output based on the first mixer input and the second mixer input. The method includes providing an input mixer output based on the pinna output and an auxiliary mixer input, wherein the auxiliary mixer input is based on the auxiliary microphone input signal; processing the input mixer output to provide an electrical output signal; and converting the electrical output signal to an audio output signal. In the method, providing the pinna output optionally includes controlling one or both of a first pinna filter and a second pinna filter of the pinna restorer based on the auxiliary mixer input, and optionally filtering the first mixer output to provide a first pinna output, and wherein the pinna output is based on the first pinna output. The first mixer output may be used, for example, to constitute the first pinna output.

[0143] It should be noted that the features described with respect to the hearing device also apply to the method, and vice versa.

[0144] In one or more exemplary hearing devices, the first pinna filter may be fixed or frozen, for example, based on a control signal from an auricle controller. In other words, the pinna controller may be configured to activate and / or deactivate adaptation in the first pinna filter. In one or more exemplary hearing devices, the pinna controller may be configured to freeze the first pinna filter, for example, based on determining that the first pinna filter has converged to a satisfactory level, such as based on a convergence parameter satisfying (e.g., being greater than or less than) a convergence threshold.

[0145] In one or more exemplary hearing devices, the second pinna filter may be fixed or frozen, for example, based on a control signal from a pinna controller. In other words, the pinna controller may be configured to activate and / or deactivate adaptation in the second pinna filter. In one or more exemplary hearing devices, the pinna controller may be configured to freeze the second pinna filter, for example, based on determining that the second pinna filter has converged to a satisfactory level, such as based on a convergence parameter satisfying (e.g., being greater than or less than) a convergence threshold.

[0146] In one or more exemplary hearing devices, the third pinna filter may be fixed or frozen, for example, based on a control signal from an auricle controller. In other words, the pinna controller may be configured to activate and / or deactivate adaptation in the third pinna filter. In one or more exemplary hearing devices, the pinna controller may be configured to freeze at the third pinna filter, for example, based on determining that the third pinna filter has converged to a satisfactory level, such as based on a convergence parameter satisfying (e.g., being greater than or less than) a convergence threshold.

[0147] In one or more exemplary hearing devices, the first input filter may be fixed or frozen, for example, based on a control signal. In other words, the hearing device may be configured to activate and / or deactivate adaptation in the first input filter. In one or more exemplary hearing devices, the pinna controller may be configured to freeze at the first input filter, for example, based on determining that the first input filter has converged to a satisfactory level, such as based on a convergence parameter satisfying (e.g., being greater than or less than) a convergence threshold.

[0148] Thus, the pinna controller may be configured to selectively adjust and / or freeze one or more of the first pinna filter, the second pinna filter, the third pinna filter, and the first input filter. In one or more exemplary hearing devices, the first pinna filter and the second pinna filter may be adjusted when the third filter is frozen. In one or more exemplary hearing devices, the first pinna filter and the second pinna filter may be frozen, while the third filter is adjusted, for example, in a suitable situation or other controlled environment.

[0149] Figure 1 An exemplary hearing device is shown. The hearing device 2 includes a first housing 4 configured as a rear-ear housing worn behind the auricle of a user, a second housing 6 configured as an earphone housing worn in or at the ear canal of a user, and a wire 8 connecting the first housing 4 and the second housing 6. The hearing device 2 includes: a main microphone group arranged in the first housing 4, the main microphone group including a main first microphone 10 for providing a main first microphone input signal 10A, and a main second microphone 12 for providing a main second microphone input signal 12A; an auxiliary microphone 14 arranged in the second housing 6, the auxiliary microphone 14 for providing an auxiliary microphone input signal 14A; and an auricle restorer 16 for providing an auricle output 18 based on a first auricle input 20 and a second auricle input 22. The first auricle input 20 is based on the main first microphone input signal 10A and the second auricle input 22 is based on the main second microphone input signal 12A.

[0150] The hearing device 2 comprises an input mixer 24 for providing an input mixer output 26 based on the pinna output 18 and an auxiliary mixer input 28, wherein the auxiliary mixer input 28 is based on the auxiliary microphone input signal 14A; a processor 30 for processing the input mixer output 26 and providing an electrical output signal 32 based on the input mixer output 26; and a receiver 34 for converting the electrical output signal 32 into an audio output signal.

[0151] The hearing device 2 optionally comprises a feedback cancellation module 36 for providing respective feedback cancellation signals 38, 40, 42 to respective primary first feedback cancellers 44, primary second feedback cancellers 46 and auxiliary feedback cancellers 48. The primary first feedback canceller 44 applies feedback cancellation to the primary first microphone input signal 10A, the primary second feedback canceller 46 applies feedback cancellation to the primary second microphone input signal 12A, and the auxiliary feedback canceller 48 applies feedback cancellation to the auxiliary microphone input signal 14A. The output of the auxiliary feedback canceller 48 is fed to an auxiliary filter 50 to provide an auxiliary mixer input 28 which is fed to the input mixer 24 and the pinna restorer 16.

[0152] Figure 2 An example pinna restorer 16 is shown. The pinna restorer 16 includes a first filter 52 for providing a first mixer input 52A based on a first pinna input 20, for example, from a main first feedback canceller 44. The pinna restorer 16 includes a second filter 54 for providing a second mixer input 54A based on a second pinna input 22, for example, from a main second feedback canceller 46. The pinna restorer 16 includes a first mixer 56 for providing a first mixer output 56A based on the first mixer input 52A and the second mixer input 54A. The first mixer 56 includes a pinna controller 58, a first pinna filter 60 for filtering the first mixer input 52A, and a second pinna filter 62 for filtering the second mixer input 54A, the pinna controller 58 being configured to control one or both of the first pinna filter 60 and the second pinna filter 62 based on the auxiliary mixer input 28 and the first mixer output 56A. The pinna controller 58 may be configured to determine a first pinna control signal e1, which is optionally shown as an error signal between the auxiliary mixer input 28 delayed by the first delay D1 in a first delay unit 64 of the pinna controller 58 and the first mixer output 56A. In other words, determining the first pinna control signal e1 includes applying the first delay D1 to the auxiliary mixer input 28. The first control adder 65 provides the first pinna control signal e1 as a difference between the output of the first delay unit 64 (the auxiliary mixer input delayed by the first delay D1) and the first mixer output 56A. The first pinna filter and / or the second pinna filter are adjusted according to the first pinna control signal.

[0153] The pinna restorer 16 optionally comprises a third pinna filter 66 for providing a first pinna output 68 based on the first mixer output 56A from the first mixer 56, and wherein the pinna output 18 is based on the first pinna output 68. Figure 2As shown, the first pinna output 68 can form or constitute the pinna output 18. The pinna controller 58 can be configured to control the third pinna filter 66 based on the auxiliary mixer input 28 and the first pinna output 68 / pinna output 18. For example, the pinna controller 58 can be configured to determine a third pinna control signal e3, which is optionally as shown an error signal between the auxiliary mixer input 28 delayed by the third delay D3 in a third delay unit 70 of the pinna controller 58 and the first pinna output 68. In other words, determining the third pinna control signal e3 includes applying the third delay D3 to the auxiliary mixer input 28. The third control adder 71 provides the third pinna control signal e3 as a difference between the output of the third delay unit 70 (the auxiliary mixer input delayed by the third delay D3) and the first pinna output 68 / pinna output 18. The third pinna filter is adjusted according to the third pinna control signal.

[0154] Figure 3 An example pinna restorer 16A is shown. The pinna restorer 16A includes a first filter 52 for providing a first mixer input 52A based on a first pinna input 20, for example, from a main first feedback canceller 44. The pinna restorer 16 includes a second filter 54 for providing a second mixer input 54A based on a second pinna input 22, for example, from a main second feedback canceller 46. The pinna restorer 16 includes a first mixer 56 for providing a first mixer output 56A based on the first mixer input 52A and the second mixer input 54A. The first mixer 56 includes a pinna controller 58, a first pinna filter 60 for filtering the first mixer input 52A, and a second pinna filter 62 for filtering the second mixer input 54A, the pinna controller 58 being configured to control one or both of the first pinna filter 60 and the second pinna filter 62 based on the auxiliary mixer input 28 and the first mixer output 56A. The pinna controller 58 may be configured to determine a first pinna control signal e1, which is optionally as shown an error signal between the auxiliary mixer input 28 delayed by the first delay D1 in a first delay unit 64 of the pinna controller 58 and the first mixer output 56A. In other words, determining the first pinna control signal e1 comprises applying the first delay D1 to the auxiliary mixer input 28. The first control adder 65 provides the first pinna control signal e1 as a difference between the output of the first delay unit 64 (the auxiliary mixer input delayed by the first delay D1) and the first mixer output 56A. The first pinna filter and / or the second pinna filter are adjusted according to the first pinna control signal.

[0155] The pinna restorer 16A optionally comprises a third pinna filter 66, which is a fixed filter for providing a first pinna output 68 based on the first mixer output 56A from the first mixer 56, and wherein the pinna output 18 is based on the first pinna output 68. The filter coefficients of the third pinna filter may be set during adjustment, i.e. not adjusted during normal use of the hearing device. Figure 3 As shown, the first auricle output 68 can form or constitute the auricle output 18.

[0156] Figure 4 An example pinna restorer 16B is shown. The pinna restorer 16B includes a first filter 52 for providing a first mixer input 52A based on a first pinna input 20, for example, from a primary first feedback canceller 44. The pinna restorer 16B includes a second filter 54 for providing a second mixer input 54A based on a second pinna input 22, for example, from a primary second feedback canceller 46. The pinna restorer 16A includes a first mixer 56 for providing a first mixer output 56A based on the first mixer input 52A and the second mixer input 54A. The first input filter 52 and the second input filter 54 may provide at least a portion of fixed pinna restoration.

[0157] The pinna restorer 16B comprises a third pinna filter 66 for providing a first pinna output 68 based on the first mixer output 56A from the first mixer 56, and wherein the pinna output 18 is based on the first pinna output 68. Figure 2 As shown, the first pinna output 68 may form or constitute the pinna output 18. The pinna controller 58 may be configured to control the third pinna filter 66 based on the auxiliary mixer input 28 and the first pinna output 68 / pinna output 18. The first mixer 56 includes the pinna controller 58 configured to determine a third pinna control signal e3, which is optionally as shown an error signal between the auxiliary mixer input 28 and the first pinna output 68 delayed by a third delay D3 in a third delay unit 70 of the pinna controller 58. In other words, determining the third pinna control signal e3 includes applying the third delay D3 to the auxiliary mixer input 28. The third control adder 71 provides the third pinna control signal e3 as a difference between the output of the third delay unit 70 (the auxiliary mixer input delayed by the third delay D3) and the first pinna output 68 / pinna output 18. The third pinna filter is adjusted according to the third pinna control signal.

[0158] Figure 5An exemplary input mixer 24 is shown. The input mixer 24 includes a first input adder 72 for providing an input mixer output 26 based on a first main input 74 and a second main input 76, wherein the first main input 74 is based on the pinna output 18 and the second main input 76 is based on the auxiliary mixer input 28. The input mixer 24 includes a first input filter 78 for providing the first main input 74 as a first output 78A of the first input filter 78. The input mixer 24 includes a second input filter 80 for providing a second main input 76 based on a second output 80A of the second input filter 80. Figure 3 As shown, the second output 80A is optionally filtered by a third input filter 82 to provide a third output 82A forming the second main input 76, which is fed to the first input adder 72. The input mixer 24 includes a second input adder 84 to provide a second adder output 84A forming the input of the first input filter 78 by determining the difference between the pinna output 18 and the second output 80A. The second adder output 84A of the second input adder 84 is fed to the second input filter 80 to control the second input filter 80 as an adaptive filter. In other words, the input mixer 24 is configured to control the second input filter 80 based on the pinna input 18 and / or the second output 80A of the second input filter 80.

[0159] Furthermore, the first adder output 72A / input mixer output 26 is optionally fed to the first input filter 78 to control the first input filter 78 as an adaptive filter. In other words, the input mixer 24 is configured to control the first input filter 76 based on the input mixer output 26. In one or more example hearing devices, the first input filter may be fixed, for example, when or when one or more of the first pinna filter, the second pinna filter, and the third pinna filter are adjusted.

[0160] Figure 61 is a flow chart of an exemplary method of operating a hearing device. The hearing device includes: a first housing configured as a behind-the-ear housing worn behind an auricle of a user; a second housing configured as an earphone housing worn in or at an ear canal of a user; a wire connecting the first housing and the second housing; a primary microphone group disposed in the first housing, the primary microphone group including a primary first microphone and a primary second microphone; an auxiliary microphone disposed in the second housing; an auricle restorer; an input mixer; a processor; and a receiver. The method 100 comprises obtaining 102 a primary first microphone input signal with a primary first microphone; obtaining 104 a primary second microphone input signal with a primary second microphone; obtaining 106 an auxiliary microphone input signal with an auxiliary microphone; and providing 108 an auricle output based on a first auricle input and a second auricle input, wherein the first auricle input is based on the primary first microphone input signal and the second auricle input is based on the primary second microphone input signal, wherein providing 108 the auricle output comprises providing 108A a first mixer input based on the first auricle input, providing 108B a second mixer input based on the second auricle input, and providing 108C a first mixer output based on the first mixer input and the second mixer input.

[0161] The method 100 comprises providing 110 an input mixer output based on an auricle output and an auxiliary mixer input, wherein the auxiliary mixer input is based on an auxiliary microphone input signal, i.e. the method optionally comprises providing 112 an auxiliary mixer input based on the auxiliary input microphone input signal. The method comprises processing 114 the input mixer output to provide an electrical output signal; and converting 116 the electrical output signal into an audio output signal. In the method 100, providing 108 an auricle output comprises controlling 108D one or both of a first auricle filter and a second auricle filter of a pinna restorer based on the auxiliary mixer input, and optionally filtering the first mixer output 108E with a third auricle filter to provide a first auricle output, and wherein the auricle output is based on the first auricle output.

[0162] The use of the terms "first", "second", "third", and "fourth", "primary", "auxiliary", "tertiary", etc. does not imply any particular order, but rather the terms are included to identify the various elements. Furthermore, the use of the terms "first", "second", "third", and "fourth", "primary", "auxiliary", "tertiary", etc. does not indicate any order or importance, but rather "first", "second", "third", and "fourth", "primary", "auxiliary", "tertiary", etc. are used to distinguish one element from another. It should be noted that the terms "first", "second", "third", and "fourth", "primary", "auxiliary", "tertiary", etc. used herein and elsewhere are used for labeling purposes only and are not intended to indicate any particular spatial or temporal order.

[0163] Furthermore, the marking of a first element does not imply the presence of a second element, and vice versa.

[0164] It will be appreciated that the drawings include some modules or operations shown in solid lines and some modules or operations shown in dashed lines. The modules or operations included in the solid lines are the modules or operations included in the broadest example embodiment. The modules or operations included in the dashed lines are example embodiments that may be included in, or are part of, the modules or operations in the solid line example embodiments, or are additional modules or operations that may be taken in addition to the modules or operations in the solid line example embodiments. It will be appreciated that these operations need not be performed in the order presented.

[0165] Furthermore, it should be understood that not all operations need to be performed. The exemplary operations may be performed in any order and in any combination.

[0166] It should be noted that the word "comprising" does not necessarily exclude the presence of other elements or steps than those listed.

[0167] It should be noted that the word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements.

[0168] It should also be noted that any reference signs do not limit the scope of the claims, that exemplary embodiments may be implemented at least partially by hardware and software, and that multiple "devices," "units," or "means" may be represented by the same item of hardware.

[0169] The various exemplary methods, apparatuses, and systems described herein are described in the general context of method step processes, which can be implemented in one aspect by a computer program product embodied in a computer-readable medium containing computer-executable instructions, such as program code, executed by a computer in a network environment. Computer-readable media may include removable and non-removable storage devices, including but not limited to read-only memory (ROM), random access memory (RAM), compact disk (CD), digital versatile disk (DVD), etc. In general, program modules may include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. Computer executable instructions, related data structures, and program modules represent examples of program codes for executing the steps of the methods disclosed herein. A specific sequence of such executable instructions or related data structures represents an example of corresponding actions for implementing the functions described in such steps or processes.

[0170] Although features have been shown and described, it should be understood that they are not intended to limit the claimed invention, and it will be apparent to those skilled in the art that various changes and modifications may be made without departing from the scope and spirit of the claimed invention. Accordingly, the specification and drawings are to be regarded as illustrative rather than restrictive. The claimed invention is intended to encompass all alternatives, modifications, and equivalents.

Claims

1. A hearing device, comprising: a first housing configured as a behind-the-ear housing worn behind an auricle of a user; a second housing configured as an earphone housing to be worn in or at an ear canal of a user; A wire connecting the first shell and the second shell; a main microphone group disposed in the first housing, the main microphone group comprising a main first microphone for providing a main first microphone input signal and a main second microphone for providing a main second microphone input signal; an auxiliary microphone disposed in the second housing, the auxiliary microphone being used to provide an auxiliary microphone input signal; An auricle restorer for providing an auricle output based on a first auricle input and a second auricle input, wherein the first auricle input is based on the main first microphone input signal and the second auricle input is based on the main second microphone input signal, the auricle restorer comprising: a first filter for providing a first mixer input based on the first pinna input, a second filter for providing a second mixer input based on the second pinna input, and a first mixer for providing a first mixer output based on the first mixer input and a second mixer input; an input mixer for providing an input mixer output based on the pinna output and an auxiliary mixer input, wherein the auxiliary mixer input is based on the auxiliary microphone input signal; a processor for processing the input mixer output and providing an electrical output signal based on the input mixer output; and a receiver for converting the electrical output signal into an audio output signal, Features: The pinna restorer comprises an auricle controller, the first mixer comprises a first pinna filter for filtering the first mixer input, and a second pinna filter for filtering the second mixer input, the pinna controller is configured to control one or both of the first pinna filter and the second pinna filter based on the auxiliary mixer input, and the pinna restorer comprises a third pinna filter for providing a first pinna output based on the first mixer output from the first mixer, and wherein the pinna output is based on the first pinna output.

2. The hearing device according to claim 1, wherein Controlling one or both of the first pinna filter and the second pinna filter based on the auxiliary mixer input comprises determining a first pinna control signal, wherein determining the first pinna control signal comprises applying a first delay to the auxiliary mixer input.

3. The hearing device according to claim 1, wherein: One or both of the first pinna filter and the second pinna filter are controlled based on the first mixer output.

4. The hearing device according to claim 1, wherein: The pinna controller is configured to control the third pinna filter based on the auxiliary mixer input.

5. The hearing device according to claim 4, wherein Controlling the third pinna filter based on the auxiliary mixer input comprises determining a third pinna control signal, wherein determining the third pinna control signal comprises applying a third delay to the auxiliary mixer input.

6. The hearing device according to claim 4, wherein: The third pinna filter is controlled based on the first pinna output.

7. The hearing device according to claim 1, wherein: The hearing device comprises a feedback canceller configured to apply feedback cancellation to one or more of the primary first microphone input signal, the primary second microphone input signal and the auxiliary microphone input.

8. The hearing device according to claim 1, wherein: The input mixer comprises a first input adder for providing the input mixer output based on a first main input and a second main input, wherein the first main input is based on the pinna output and the second main input is based on the auxiliary mixer input.

9. The hearing device according to claim 8, wherein: The input mixer comprises a first input filter for providing the first main input based on a first output of the first input filter; and wherein the input mixer comprises a second input filter for providing the second main input based on a second output of the second input filter.

10. The hearing device according to claim 9, wherein The input mixer is configured to control the first input filter based on the input mixer output.

11. The hearing device according to claim 9, wherein: The input mixer is configured to control the second input filter based on the pinna input and / or the second output of the second input filter.

12. A method of operating a hearing device, the hearing device comprising: a first housing configured as a behind-the-ear housing worn behind an auricle of a user; a second housing configured as an earphone housing to be worn in or at an ear canal of a user; A wire connecting the first shell and the second shell; a main microphone group disposed in the first housing, the main microphone group comprising a main first microphone and a main second microphone; an auxiliary microphone disposed in the second housing; Auricular restorer, input mixer; processor; and a receiver, the method comprising: obtaining a main first microphone input signal using the main first microphone; obtaining a primary second microphone input signal using the primary second microphone; obtaining an auxiliary microphone input signal using the auxiliary microphone; Providing an auricle output based on a first auricle input and a second auricle input, wherein the first auricle input is based on the primary first microphone input signal and the second auricle input is based on the primary second microphone input signal, wherein providing the auricle output comprises: providing a first mixer input based on the first pinna input, providing a second mixer input based on the second pinna input, and providing a first mixer output based on the first mixer input and the second mixer input; providing an input mixer output based on the pinna output and an auxiliary mixer input, wherein the auxiliary mixer input is based on the auxiliary microphone input signal; processing the input mixer output to provide an electrical output signal; and converting the electrical output signal into an audio output signal, Features: Providing an auricle output comprises: controlling one or both of a first auricle filter and a second auricle filter of the auricle restorer based on the auxiliary mixer input, and The first mixer output is filtered to provide a first pinna output, and wherein the pinna output is based on the first pinna output.

Images