Hearing device with in-ear microphone and related method
Patent Information
- Application Number
- CN202110928574.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-08-14
- Filing Date
- 2021-08-13
- Publication Date
- 2025-02-21
- Estimated Expiration
- 2041-08-13
Smart Images

Figure CN114079848B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a hearing device and related methods including methods of operating a hearing device. In particular, a hearing device having both an in-ear microphone and one or more behind-the-ear microphones and related methods are disclosed. Background Art
[0002] For hearing device designers, spatial perception and the ability to perceive spatial cues plays an important role in the ability of hearing device users to understand speech and is essential in complex listening environments. On the other hand, feedback and instability in hearing aids continue to be a challenge for hearing device designers and engineers, especially when the microphone and receiver are placed close to each other, such as in MaRie (in-ear microphone and receiver) hearing devices. Summary of the invention
[0003] Therefore, there is a need for hearing devices and methods having improved spatial perception and stability of the hearing device.
[0004] The present invention discloses a hearing device, which includes: a first shell, which is optionally configured as a rear-ear shell worn behind the user's auricle; a second shell, which is optionally configured as an earpiece shell worn in or at the user's ear canal; and a wire connecting the first shell and the second shell. The hearing device includes a primary microphone group arranged in the first shell, the primary microphone group includes a primary first microphone for providing a primary first microphone input signal, and a primary second microphone for optionally providing a primary second microphone input signal. The hearing device includes: a secondary microphone, which is arranged in the second shell, for providing a secondary microphone input signal; a mixing module, which is used to provide a mixer output based on a primary mixer input and a secondary mixer input, wherein the primary mixer input is based on the primary first microphone input signal and / or the primary second microphone input signal, and the secondary mixer input is based on the secondary microphone input signal; a processor, which is used to process the mixer output and provide an electrical output signal based on the mixer output; and a receiver, which is used to convert the electrical output signal into an audio output signal. The mixing module is optionally configured to mix a primary first component of the primary mixer input and a secondary first component of the secondary mixer input to provide a first component of the mixer output.
[0005] In addition, a method for operating a hearing device, the hearing device comprising: a first shell configured as a behind-the-ear shell worn behind a user's auricle; a second shell configured as an earpiece shell worn in or at the user's ear canal; a wire connecting the first shell and the second shell; a primary microphone group arranged in the first shell, the primary microphone group comprising a primary first microphone and a primary second microphone; a secondary microphone arranged in the second shell; a mixing module; a processor; and a receiver, the method comprising: obtaining a primary first microphone input signal through the primary first microphone; obtaining a primary second microphone input signal through the primary second microphone; obtaining a secondary microphone input signal through the secondary microphone; providing a primary mixer input based on the primary first microphone input signal and / or the primary second microphone input signal; providing a secondary mixer input based on the secondary microphone input signal; mixing the primary first component of the primary mixer input and the secondary first component of the secondary mixer input to provide a first component of a mixer output; processing the mixer output to provide an electrical output signal; and converting the electrical output signal into an audio output signal.
[0006] An important advantage of the hearing device is that it provides improved spatial perception in a hearing device with increased stability. Thus, the risk of feedback in the hearing device is reduced, while spatial cues are preserved to a higher degree, which in turn provides an improved hearing device.
[0007] Furthermore, the present invention provides an improved user experience by improving speech intelligibility and reducing feedback. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] The above and other features and advantages will become apparent to those skilled in the art from the following detailed description of exemplary embodiments thereof with reference to the accompanying drawings, in which:
[0009] Figure 1 An exemplary hearing device is schematically shown;
[0010] Figure 2 An exemplary hearing device is schematically shown;
[0011] Figure 3 An exemplary hearing device is schematically shown; and
[0012] Figure 4 is a flow chart of an exemplary method according to the present invention.
[0013] Reference numerals list
[0014] 2, 2A, 2B, 2C Hearing equipment
[0015] 4. First shell
[0016] 6 Second shell
[0017] 8 Wires
[0018] 10 Primary First Microphone
[0019] 10A Primary 1st microphone input signal
[0020] 12 Primary Second Microphone
[0021] 12A Primary Second Microphone Input Signal
[0022] 14 Secondary Microphone
[0023] 14A Secondary microphone input signal
[0024] 16, 16A, 16B mixed modules
[0025] 17A First Linear Combiner
[0026] 17B Second linear combiner
[0027] 17C Nth Linear Combiner
[0028] 18 Mixer Outputs
[0029] 18A The first component of the mixer output
[0030] 18B The second component of the mixer output
[0031] 20 Primary mixer input
[0032] 20A Primary mixer input primary first component
[0033] 20B Primary second component of primary mixer input
[0034] 22 Secondary mixer inputs
[0035] 22A Secondary first component of secondary mixer input
[0036] 22B Secondary second component of the secondary mixer input
[0037] 24 Processors
[0038] 26 Electrical output signal
[0039] 28 Receiver
[0040] 30 Primary Hybrid Filter
[0041] 30A Primary Gain Unit
[0042] 32 Secondary Hybrid Filters
[0043] 32A Secondary Gain Unit
[0044] 33A Filtered primary mixer input
[0045] 33B Filtered secondary mixer input
[0046] 34 Adder
[0047] 36, 37 Primary Preprocessor
[0048] 36A First filter
[0049] 36B Second filter
[0050] 36C Adder
[0051] 38 Secondary Preprocessor
[0052] 40 Primary filter bank
[0053] 40A Primary 1st filter bank
[0054] 40B Primary Second Filter Bank
[0055] 42 Secondary filter bank
[0056] 44 Hybrid Controller
[0057] 46 Wire
[0058] 48 Wire
[0059] 50 Wire
[0060] 52 Control signal
[0061] 100 How to operate hearing aids
[0062] 102 Get the primary first microphone input signal
[0063] 104 Get the primary second microphone input signal
[0064] 106 Get secondary microphone input signal
[0065] 108 provides a primary mixer input based on the primary first microphone input signal and the primary second microphone input signal
[0066] 110 Provides secondary mixer input based on secondary microphone input signal
[0067] 112 Mixing primary mixer input and secondary mixer input
[0068] 112A Mixing the primary first component of the primary mixer input and the secondary first component of the secondary mixer input
[0069] 112B Mixing the primary second component of the primary mixer input and the secondary second component of the secondary mixer input
[0070] 114 Processing the mixer output to provide an electrical output signal
[0071] 116 Convert the electrical output signal into an audio output signal DETAILED DESCRIPTION
[0072] Various exemplary embodiments and details will be described below with reference to the accompanying drawings when relevant. It should be noted that the drawings may be drawn to scale or not to scale, and elements of similar structure or function are represented by the same reference numerals throughout the drawings. It should also be noted that these drawings are intended only to facilitate the description of the embodiments. They are not intended to serve as an exhaustive description of the invention or to limit the scope of the invention. In addition, the illustrated embodiments do not need to have all the aspects or advantages shown. The aspects or advantages described in conjunction with a specific embodiment are not necessarily limited to that embodiment, and may also be applied in any other embodiment even if not illustrated or even if not explicitly described.
[0073] The present invention discloses a hearing device. The hearing device may be configured to be worn at an ear of a user and may be a wearable device or a hearing aid, wherein a processor is configured to compensate for hearing loss of the user.
[0074] The hearing device may be of the Microphone and Receiver in the Ear (MaRIE) type. The hearing device may be a combined BTE and MaRIE type hearing device. The hearing device may be part of a binaural hearing system. Thus, the hearing device may be a binaural hearing device
[0075] The hearing device comprises a first shell configured as a behind-the-ear shell worn behind an auricle of a user and a second shell configured as an earpiece shell worn in and / or at an ear canal of a user.
[0076] The hearing device comprises an electrical wire connecting the first housing and the second housing. The electrical wire comprises a plurality of conductors, for example three, four, five, six or even eight or more conductors, for electrically connecting the electrical components of the first housing to the electrical components of the second housing.
[0077] The hearing device comprises a primary microphone set arranged in a first housing, the primary microphone set comprising a primary first microphone for providing a primary first microphone input signal (also denoted as x_1_1), and optionally comprising a primary second microphone for providing a primary second microphone input signal (also denoted as x_1_2). The primary first microphone may be denoted as a front BTE (behind the ear) microphone and the primary second microphone may be denoted as a rear BTE (behind the ear) microphone. The primary microphone set may comprise a primary third microphone for providing a primary third microphone input signal (also denoted as x_1_3).
[0078] The hearing device comprises a secondary microphone, also denoted as secondary first microphone, arranged in the second housing for providing a secondary microphone input signal, also denoted as x_2 or x_2_1. The secondary microphone may be denoted as an in-ear microphone. The hearing device may comprise a plurality of secondary microphones arranged in the second housing. For example, a secondary second microphone, also denoted as an ear canal microphone, may be arranged in the second housing for receiving sound in the ear canal to reduce an occlusion effect.
[0079] The hearing device comprises a mixing module for providing a mixer output based on a primary mixer input and a secondary mixer input. The primary mixer input is optionally based on a primary first microphone input signal and / or a primary second microphone input signal, and the secondary mixer input is based on a secondary microphone input signal or signals.
[0080] In one or more exemplary hearing devices, the hearing device comprises a primary preprocessor connected to the respective primary first microphone and the primary second microphone for preprocessing the primary first microphone input signal and the primary second microphone input signal to provide a primary mixer input. The primary preprocessor may comprise a first filter and / or a second filter for filtering the primary first microphone input signal and / or the primary second microphone input signal before adding the (optionally filtered) primary first microphone input signal and the (optionally filtered) primary second microphone input signal in an adder of the first preprocessor. The first filter of the primary preprocessor may be an auricle restoration filter, i.e. a filter configured to perform pinna-restoration of the primary first microphone input signal. The second filter of the primary preprocessor may be an auricle restoration filter, i.e. a filter configured to perform pinna-restoration of the primary second microphone input signal.
[0081] In one or more exemplary hearing devices, the hearing device comprises a secondary pre-processor connected to the secondary microphone for pre-processing a secondary microphone input signal to provide a secondary mixer input.
[0082] The hearing device comprises a processor for processing the mixer output. The processor provides an electrical output signal to the processor based on the mixer output (fed as processor input). The processor may be configured for hearing compensation of a user's hearing loss. The processor may be a multi-channel processor. In other words, the processor input may be a multi-channel input, where each channel or (frequency) component is processed in parallel.
[0083] The hearing device comprises a receiver for converting the electrical output signal into an audio output signal.
[0084] The mixing module is configured to mix the primary mixer input and the secondary mixer input to provide a mixer output. In one or more exemplary hearing devices, the mixing module is configured to mix the primary first component of the primary mixer input and the secondary first component of the secondary mixer input to provide a first component of the mixer output. The mixing module is configured to mix the primary first component of the primary mixer input and the secondary first component of the secondary mixer input to provide a first component of the mixer output.
[0085] The primary first component of the primary mixer input and the secondary first component of the secondary mixer input may be broadband components.
[0086] The primary first component of the primary mixer input and the secondary first component of the secondary mixer input may be components of a first frequency band or a first frequency window. In one or more exemplary hearing devices / methods, the center frequency of the first frequency band / frequency window is less than 1 kHz or even less than 400 Hz. The center frequency of the first frequency band / frequency window may be in the range of 400 Hz to 2 kHz or greater than 2 kHz, for example greater than 3 kHz.
[0087] In a hearing device, mixing a primary mixer input and a secondary mixer input to provide a mixer output may include applying a primary mixing filter or a primary gain / coefficient to the primary mixer input. The primary mixing filter may be a time domain filter or a frequency domain filter. In other words, the mixing module may include a primary filter and / or a primary gain unit for receiving and processing the primary mixer input.
[0088] In the hearing device, mixing the primary mixer input and the secondary mixer input to provide the mixer output may include applying a secondary mixer combiner or a secondary gain / coefficient to the secondary mixer input. The secondary mixing filter may be a time domain filter or a frequency domain filter. In other words, the mixing module may include a secondary filter and / or a secondary gain unit for receiving and processing the secondary mixer input.
[0089] In the hearing device, mixing the primary mixer input and the secondary mixer input may include adding an output from the primary mixing filter / primary gain unit and an output from the secondary mixing filter / secondary gain unit. In other words, the mixing module may include an adder (single channel or multi-channel) connected to the primary mixing filter / primary gain unit and the secondary mixing filter / secondary gain unit for providing the adder output as the mixer output.
[0090] The mixing module may be a multi-channel mixing module configured to perform mixing of a plurality of components / channels. In one or more exemplary hearing devices, the mixing module may optionally be configured to mix a primary second component of a primary mixer input and a secondary second component of a secondary mixer input to provide a second component of a mixer output. The mixing module may optionally be configured to mix a primary second component of a primary mixer input and a secondary second component of a secondary mixer input to provide a second component of a mixer output. The primary second component of the primary mixer input and the secondary second component of the secondary mixer input may be components of a second frequency band or a second frequency window, for example, different from the first frequency band / frequency window.
[0091] In one or more exemplary hearing devices and / or methods, mixing a primary first component of a primary mixer input (also denoted as x_p_1) and a secondary first component x_s_1 of a secondary mixer input comprises applying a first linear combination to the primary first component and the secondary first component to provide a first component of a mixer output. In other words, the first component y_1 of the mixer output may be represented as:
[0092] y_1=a_1*x_p_1+b_1*x_s_1,
[0093] Where a_1 is the primary coefficient and b_1 is the secondary coefficient. A first linear combination, also denoted LC_1, can be defined by the primary coefficient a_1 and the secondary coefficient b_1.
[0094] The primary coefficient a_1 of the first linear combination may be greater than 0. The secondary coefficient b_1 of the first linear combination may be greater than 0. In one or more exemplary hearing devices and / or methods, the primary coefficient a_1 may be in a range between 0 and 1. In one or more exemplary hearing devices and / or methods, the secondary coefficient b_1 may be in a range between 0 and 1.
[0095] In one or more exemplary hearing devices, the primary coefficient a_1 may be in the range between 0.1 and 0.9, and / or the secondary coefficient b_1 may be in the range between 0.1 and 0.9. The secondary coefficient b_1 may be greater than 0.5 or less than 0.5.
[0096] In one or more exemplary hearing devices, the mixing module is configured to mix a primary second component of a primary mixer input (also denoted x_p_2) and a secondary second component of a secondary mixer input (also denoted x_s_2) to provide a second component of a mixer output (also denoted y_2).
[0097] The primary second component of the primary mixer input and the secondary second component of the secondary mixer input may be components of a second frequency band or a second frequency window. In one or more exemplary hearing devices / methods, the center frequency of the second frequency band / frequency window is less than 1 kHz or even less than 400 Hz. The center frequency of the second frequency band / frequency window may be in the range of 400 Hz to 2 kHz or greater than 2 kHz, for example, greater than 3 kHz. The second frequency band / frequency window may be different from the first frequency band / frequency window.
[0098] In one or more exemplary hearing devices, mixing the primary second component of the primary mixer input and the secondary second component of the secondary mixer input includes applying a second linear combination to the primary second component and the secondary second component to provide a second component of the mixer output. In other words, the second component y_2 of the mixer output can be expressed as:
[0099] y_2=a_2*x_p_2+b_2*x_s_2,
[0100] Where a_2 is the primary coefficient and b_2 is the secondary coefficient. A second linear combination, also denoted LC_2, may be defined by the primary coefficient a_2 and the secondary coefficient b_2. The second linear combination may be different from the first linear combination. Different linear combinations or different mixes of the primary mixer input and the secondary mixer of different components, for example in different frequency bands, may further optimize the spatial perception of the hearing device user, since feedback and instability are typically frequency dependent. Thus, the present invention allows for increased use of secondary microphones (high coefficients) in frequency bands with low feedback, which may improve spatial perception. Furthermore, low secondary coefficients may be used in frequency bands with severe feedback challenges.
[0101] In one or more exemplary hearing devices, the primary coefficient a_2 may be in the range between 0.1 and 0.9, and / or the secondary coefficient b_2 may be in the range between 0.1 and 0.9. The secondary coefficient b_2 may be greater than or less than 0.5. The secondary coefficient b_2 may be different from the secondary coefficient b_1.
[0102] In one or more exemplary hearing devices, the secondary coefficient b_1 is greater than 0.5, for example in the range of 0.55 to 0.95, and the secondary coefficient b_2 is less than 0.5, for example in the range of 0.05 to 0.45.
[0103] In one or more exemplary hearing devices, the mixing module is configured to mix a primary third component (also denoted x_p_3) of a primary mixer input and a secondary third component (also denoted x_s_3) of a secondary mixer input to provide a third component (also denoted y_3) of a mixer output.
[0104] The primary third component of the primary mixer input and the secondary third component of the secondary mixer input may be components of a third frequency band or a third frequency window. In one or more exemplary hearing devices / methods, the center frequency of the third frequency band / frequency window is less than 1 kHz or even less than 400 Hz. The center frequency of the third frequency band / frequency window may be in the range of 400 Hz to 2 kHz or greater than 2 kHz, for example, greater than 3 kHz. The third frequency band / frequency window may be different from the first frequency band / frequency window and / or different from the second frequency band / frequency window.
[0105] In one or more exemplary hearing devices, mixing the primary third component of the primary mixer input and the secondary third component of the secondary mixer input includes applying a third linear combination to the primary third component and the secondary third component to provide a third component of the mixer output. In other words, the third component y_3 of the mixer output can be expressed as:
[0106] y_3=a_3*x_p_3+b_3*x_s_3,
[0107] Where a_3 is a primary coefficient and b_3 is a secondary coefficient. A third linear combination, also denoted LC_3, may be defined by the primary coefficient a_3 and the secondary coefficient b_3. The third linear combination may be different from the first linear combination.
[0108] In one or more exemplary hearing devices, the primary coefficient a_3 may be in the range between 0.1 and 0.9 and / or the secondary coefficient b_3 may be in the range between 0.1 and 0.9. The secondary coefficient b_3 may be greater than 0.5. The secondary coefficient b_3 may be different from the secondary coefficient b_1 and / or different from the secondary coefficient b_2.
[0109] In one or more exemplary hearing devices, the secondary coefficient b_1 is greater than 0.5, for example in the range of 0.55 to 0.95, and / or the secondary coefficient b_2 is less than 0.5, for example in the range of 0.05 to 0.45.
[0110] Exemplary coefficients of an exemplary hearing device AG are listed in the following table, where LC_1 is a linear combination of a first component with a first center frequency f_1, LC_2 is a linear combination of a second component with a second center frequency f_2, and LC_3 is a linear combination of a third component with a third center frequency f_3.
[0111]
[0112] Table 1
[0113] Furthermore, an important advantage of the present invention is that the linear combination / hybrid filter can be individually set during adaptation and configured for a specific hearing device user. Thus, an improved hearing device operation / listening experience is provided. In particular, a hearing device with improved directionality is provided.
[0114] In one or more exemplary hearing devices, the mixing module is configured to mix the primary components x_p_i of the primary mixer input and the secondary components x_s_i of the primary mixer input to provide components y_i of the mixer output, for example, by applying a linear combination LC_i=(a_i, b_i), where i is the index of the i-th component of the respective mixer input, mixer output, and the linear combination defined by the primary and secondary coefficients. In other words, the mixer output components y_i, i=1 to N (N is the number of components / bands) can be expressed as:
[0115] y_i=a_i*x_p_i+b_i*x_i
[0116] In one or more exemplary hearing devices, a_i and bi_i are complementary, ie a_i+b_i=1, at least for one or more of i=1, 2, ..., N, eg all.
[0117] In one or more exemplary hearing devices, one or more primary coefficients a_i, eg, for i=1, 2 or 3, may be 0 and / or one or more secondary coefficients b_i, eg, for i=1, 2 or 3, may be 1.
[0118] In one or more exemplary hearing devices, one or more (e.g., all) of the primary coefficients a_i, e.g., for i=1, 2, and 3, may be in the range of 0.1 to 0.9 and / or less than 0.5. Thus, the primary coefficient a_1 may be in the range of 0.1 to 0.9 and / or less than 0.5. The primary coefficient a_2 may be in the range of 0.1 to 0.9 and / or less than 0.5. The primary coefficient a_3 may be in the range of 0.1 to 0.9 and / or less than 0.5.
[0119] In one or more exemplary hearing devices, one or more (e.g., all) of the secondary coefficients b_i, e.g., for i=1, 2, and 3, may be in the range of 0.1 to 0.9 and / or greater than 0.5. Thus, the secondary coefficient b_1 may be in the range of 0.1 to 0.9 and / or greater than 0.5. The secondary coefficient b_2 may be in the range of 0.1 to 0.9 and / or greater than 0.5. The secondary coefficient b_3 may be in the range of 0.1 to 0.9 and / or greater than 0.5.
[0120] The number i of frequency bands / components may be greater than five, for example greater than fifteen.
[0121] In one or more exemplary hearing devices, the hearing device comprises a mixing controller configured to apply a mixing scheme in a mixing module based on a control parameter. The control parameter may be indicative of an instability in the hearing device. The control parameter may be indicative of feedback and / or howling in the hearing device.
[0122] In one or more exemplary hearing devices, the hybrid controller is configured to determine the control parameter based on one or more of the primary first microphone input signal, the primary second microphone input signal, the secondary (first) microphone input signal and the electrical output signal. In other words, the control parameter may be fed to the hybrid controller (e.g., from a processor) or determined in the hybrid controller.
[0123] In one or more exemplary hearing devices, the control parameter is based on one or more coefficients, such as primary coefficients and / or secondary coefficients. In one or more exemplary hearing devices, the control parameter is based on one or more gains applied in one or more compressors of the processor or a change in one or more gains applied in one or more compressors of the processor.
[0124] In one or more exemplary hearing devices, the control parameter is based on one or more operating parameters of the hearing device processing, such as one or more gains, a program identifier, one or more feedback cancellation parameters or other parameters indicative of instabilities in the hearing device processing.
[0125] In one or more exemplary hearing devices, the control parameter is based on one or more maximum stable gains, eg a maximum stable gain per frequency band or frequency window.
[0126] In one or more exemplary hearing devices, applying the mixing scheme in the mixing module comprises increasing an amount of the primary first component in the mixer output in response to detecting a control parameter indicating an increased risk of instability of the hearing device or in response to detecting a control parameter indicating a large or increasing feedback in the hearing device.
[0127] In one or more exemplary hearing devices, applying the mixing scheme in the mixing module includes reducing the amount of the secondary first component in the mixer output in response to detecting a control parameter indicating an increased risk of instability of the hearing device or in response to detecting a control parameter indicating a large or increased feedback in the hearing device. Reducing the amount of the secondary first component in the mixer output may include reducing a secondary coefficient or gain b_1 of the secondary first component applied to the secondary mixer input.
[0128] In one or more exemplary hearing devices, applying the mixing scheme in the mixing module includes applying the first mixing scheme in the mixing module based on a determination that a first mixing criterion is met. Thus, the mixing controller can be configured to determine whether the first mixing criterion is met. The first mixing criterion can be based on one or more control parameters. For example, the first mixing scheme can be applied based on a determination that a program identifier used as a control parameter indicates a first program to be applied in the processor.
[0129] In one or more exemplary hearing devices, applying the mixing scheme in the mixing module includes applying a second mixing scheme in the mixing module based on a determination that a second mixing criterion is met. Thus, the mixing controller can be configured to determine whether the second mixing criterion is met. The second mixing criterion can be based on one or more control parameters. For example, the second mixing scheme can be applied based on a determination that a program identifier used as a control parameter indicates a second program applied in the processor. The first mixing scheme can be different from the second mixing scheme.
[0130] The mixing controller may be configured to determine a control parameter (eg, based on the electrical output signal and / or the secondary microphone input signal), and to determine a mixing scheme based on the control parameter.
[0131] In one or more exemplary hearing devices, mixing the primary first component of the primary mixer input and the secondary first component of the secondary mixer input comprises applying a primary first filter (e.g., in the time domain) to the primary first component and / or applying a secondary first filter (e.g., in the time domain) to the secondary first component. In one or more exemplary hearing devices, mixing the primary first component of the primary mixer input and the secondary first component of the secondary mixer input comprises adding the filtered primary first component and the filtered secondary first component to provide a mixer output.
[0132] In one or more exemplary hearing devices, mixing the primary first component of the primary mixer input and the secondary first component of the secondary mixer input includes applying a primary first filter (eg, in the time domain) to the primary first component and adding the filtered primary first component and the secondary first component to provide a mixer output.
[0133] In one or more exemplary hearing devices, mixing the primary first component of the primary mixer input and the secondary first component of the secondary mixer input includes applying a secondary first filter (eg, in the time domain) to the secondary first component and adding the filtered primary first component and the secondary first component to provide a mixer output.
[0134] The present invention also discloses a method for operating a hearing device. The hearing device comprises: a first shell configured as a rear-ear shell worn behind the auricle of a user; a second shell configured as an earpiece shell worn in or at the ear canal of a user; a wire connecting the first shell and the second shell; a primary microphone group disposed in the first shell, the primary microphone group comprising a primary first microphone and a primary second microphone; a secondary microphone disposed in the second shell; a mixing module; a processor; and a receiver. The method comprises obtaining a primary first microphone input signal through the primary first microphone; obtaining a primary second microphone input signal through the primary second microphone; and obtaining a secondary microphone input signal through the secondary microphone.
[0135] The method includes providing a primary mixer input based on a primary first microphone input signal and a primary second microphone input signal. In the method, providing the primary mixer input may include preprocessing, such as filtering and / or adding the primary first microphone input signal and the primary second microphone input signal (e.g., by a primary preprocessor). Filtering the primary first microphone input signal and the primary second microphone input signal may include performing pinna restoration of the primary first microphone input signal (e.g., by a first filter of the primary preprocessor) and / or the secondary second microphone input signal (e.g., by a secondary filter of the primary preprocessor).
[0136] The method includes providing a secondary mixer input based on a secondary microphone input signal. In the method, providing the secondary mixer input may include preprocessing (e.g., filtering) the secondary (first) microphone input signal (e.g., by a secondary preprocessor). The filtered secondary microphone input signal may be used as the secondary mixer input.
[0137] The method comprises mixing a primary first component of a primary mixer input and a secondary first component of a secondary mixer input to provide a first component of a mixer output; processing the mixer output to provide an electrical output signal; and converting the electrical output signal to an audio output signal.
[0138] It should be noted that features described with respect to the hearing device also apply to the method and vice versa.
[0139] Figure 1An exemplary hearing device is shown. The hearing device 2, 2A comprises: a first housing 4, configured as a behind-the-ear housing worn behind the pinna of a user; a second housing 6, configured as an earpiece housing worn in or at the ear canal of a user; and a wire 8 connecting the first housing 4 and the second housing 6. The hearing device 2, 2A comprises a primary microphone set 10, 12 arranged in the first housing 4, the primary microphone set comprising a primary first microphone 10 for providing a primary first microphone input signal 10A and a primary second microphone 12 for providing a primary second microphone input signal 12A. The hearing device 2, 2A comprises a secondary microphone 14 arranged in the second housing 6 for providing a secondary microphone input signal 14A.
[0140] The hearing device 2 , 2A comprises a mixing module 16 providing a mixer output 18 based on a primary mixer input 20 , optionally based on the primary first microphone input signal 10A and / or the primary second microphone input signal 12A, and a secondary mixer input 22 based on the auxiliary microphone input signal 14A.
[0141] The hearing device 2 , 2A comprises a processor 24 for processing the mixer output 18 and providing an electrical output signal 26 based on the mixer output 18 , and a receiver 28 for converting the electrical output signal 26 into an audio output signal.
[0142] In the hearing device 2, the mixing module 16 comprises a primary mixing filter 30 and a secondary mixing filter 32 for filtering the broadband primary mixer input 20 and the broadband secondary mixer input 22 in the time domain, respectively. The filtered primary mixer input 33A and the filtered secondary mixer input 33B are fed to an adder 34 of the mixing module 16 to form the mixer output 18. Thus, the mixing module 16 is configured to mix the broadband primary first component of the primary mixer input 20 and the secondary first component of the secondary mixer input 22 to provide the broadband first component of the mixer output 18.
[0143] In the hearing device 2A, the mixing module 16A comprises a primary gain unit 30A and a secondary gain unit 32A for applying respective gains or coefficients of the first linear combination to the broadband primary mixer input 20 and the broadband secondary mixer input 22, respectively, in the time domain. The outputs of the gain units 30A and 32A are fed to an adder 34 of the mixing module 16 to form the mixer output 18. Thus, the mixing module 16A is configured to mix the broadband primary first component of the primary mixer input 20 and the secondary first component of the secondary mixer input 22 by applying the first linear combination to the broadband primary first component as the primary mixer input 20 and the broadband secondary first component as the secondary mixer input 22 to provide the broadband first component as the mixer output 18 to provide the broadband first component of the mixer output 18. In other words, the primary gain unit 30A applies the primary coefficient a_1 as the primary gain to the primary mixer input 20, and the secondary gain unit 32A applies the secondary coefficient b_1 as the secondary gain to the secondary mixer input 22. The primary coefficient a_1 may be in the range of 0.1 to 0.9 and / or the secondary coefficient b_1 may be in the range of 0.1 to 0.9.
[0144] The hearing device 2, 2A may comprise a primary preprocessor 36 for forming a primary mixer input 20 based on a primary first microphone input signal 10A and / or a primary second microphone input signal 12A. In the primary preprocessor 36, a first filter 36A optionally filters the primary first microphone input signal 10A, while a second filter 36B optionally filters the primary second microphone input signal 12A. The (optionally filtered) primary first microphone input signal 10A and the (optionally filtered) primary second microphone input signal 12A are fed to an adder 36C to form the primary mixer input 20 as the sum of the (optionally filtered) primary first microphone input signal 10A and the (optionally filtered) primary second microphone input signal 12A. The first filter 36A and the second filter 36B may be pinna restoration filters.
[0145] The hearing device 2 and / or the hearing device 2A may include a secondary preprocessor 38 that forms a secondary mixer input 22 based on the secondary microphone input signal 14A. The secondary microphone input signal 14A may be fed as a secondary mixer input to the respective mixing module 16, 16A. In the secondary preprocessor 38, a filter and / or delay 36A optionally filters and / or delays the secondary microphone input signal 14A to provide the secondary mixer input 22, for example, to match the secondary mixer input 22 with the primary mixer input 20.
[0146] The hearing device 2 and / or the hearing device 2A optionally comprises a mixing controller 44 configured to apply a mixing scheme in the mixing module 16, 16A, for example, based on a control parameter indicating instability of the hearing device 2, 2A. The control parameter may be fed directly from the processor 24 to the mixing controller, as indicated by the dashed conductor 46. Alternatively or in combination, the mixing controller 44 may be configured to determine the control parameter, for example, based on one or more operating parameters from the processor 24 as indicated by the dashed conductor 46 and / or one or both of the electrical output signal 26 and the secondary microphone input signal 14A as indicated by respective dashed conductors 48, 50. The control parameter may indicate feedback and / or howling in the hearing device. In one or more exemplary hearing devices, the primary first microphone input signal 10A and / or the primary second microphone input signal 12A (in filtered form thereof) are fed to the mixing controller 44 to determine the control parameter based on the primary first microphone input signal 10A and / or the primary second microphone input signal 12A. The primary mixer input 20 and / or the secondary mixer input 22 may be fed to the hybrid controller 44 to determine control parameters based on one or both of these inputs 20, 22. In other words, the control parameters may be fed to the hybrid controller 44 (e.g., from the processor 24) or determined in the hybrid controller 44.
[0147] The mixing controller 44 controls the mixing modules 16, 16A, for example, by setting filter coefficients or coefficients of the mixing filters 30, 32 or gain units 30A, 32A, respectively, using control signals 52.
[0148] Figure 2 A hearing device with a multi-band mixing module is shown. The hearing device 2B comprises a primary filter bank 40 providing a multi-band primary mixer input, which comprises N components of the primary mixer input, wherein the N components of the primary mixer input comprise a primary first component 20A and a primary second component 20B of the primary mixer input based on microphone input signals 10A and 12A. The hearing device 2B comprises a secondary filter bank 42 providing a multi-band secondary mixer input, which comprises N components of the secondary mixer input (N may be greater than 5 or greater than 15), wherein the N components of the secondary mixer input comprise a secondary first component 22A and a secondary second component 22B of the secondary mixer input based on microphone input signal 14A.
[0149] The mixing module 16B includes a first linear combiner 17A configured to mix the primary first component 20A and the secondary first component 22A by applying a first linear combination defined by the primary coefficient a_1 and the secondary coefficient b_1 to each component 20A, 22A to provide a first component 18A of the mixer output. The mixing module 16B includes a second linear combiner 17B configured to mix the primary second component 20B and the secondary second component 22B by applying a second linear combination defined by the primary coefficient a_2 and the secondary coefficient b_2 to each component 20B, 22B to provide a second component 18B of the mixer output. The mixing module 16B may include an Nth linear combiner, which includes an Nth linear combiner 17C configured to mix the corresponding N primary and secondary components to provide an Nth component of the mixer output. The second linear combination is different from the first linear combination.
[0150] The hearing device 2B optionally comprises a mixing controller 44 configured to apply a mixing scheme in the mixing module 16B, e.g. based on a control parameter indicating instability of the hearing device 2B. The control parameter may be fed directly from the processor 24 to the mixing controller, as indicated by dashed line 46. Alternatively or in combination, the mixing controller 44 may be configured to determine the control parameter, e.g. based on one or more operating parameters from the processor 24 as indicated by dashed line conductor 46 and / or one or both of the electrical output signal 26 and the secondary microphone input signal 14A as indicated by respective dashed line conductors 48, 50. The mixing controller 44 optionally controls the mixing module 16B, e.g. by setting the linear combinations / coefficients of the linear combiners 17A, 17B, ..., 17C using a control signal 52. The control parameter may be indicative of feedback and / or howling in the hearing device. In one or more exemplary hearing devices, the primary first microphone input signal 10A and / or the primary second microphone input signal 12A (in filtered form thereof) are fed to a mixing controller 44 to determine control parameters based on the primary first microphone input signal 10A and / or the primary second microphone input signal 12A. The primary mixer input 20 and / or the secondary mixer input 22 may be fed to the mixing controller 44 to determine control parameters based on one or both of these inputs 20, 22. In other words, the control parameters may be fed to the mixing controller 44 (e.g., from the processor 24) or determined in the mixing controller 44.
[0151] The mixing controller 44 controls the mixing module 16B, for example, by setting the linear combinations / coefficients of the linear combiners 17A, 17B with the control signals 52 .
[0152] Figure 3A hearing device with a multi-band primary preprocessor 37 and a multi-band mixing module 16B is shown. The hearing device 2C comprises a primary first filter bank 40A for providing a multi-band primary first microphone input signal, the signal comprising N components fed to the multi-band preprocessor 37. The hearing device 2C comprises a primary second filter bank 40B for providing a multi-band primary second microphone input signal, the signal comprising N components fed to the multi-band preprocessor 37. The first filter 36A, the second filter 36B and the adder 36C of the preprocessor 37 are multi-band implementations to provide a multi-band primary mixer input. Thus, multi-band pinna restoration and multi-band mixing are provided, which in turn can increase the user experience by improving directional cues and reducing howling and / or feedback.
[0153] Figure 4 1 is a flow chart of an exemplary method of operating a hearing device. The hearing device includes: a first housing configured as a behind-the-ear housing worn behind a user's auricle; a second housing configured as an earpiece housing worn in or at the user's ear canal; a wire connecting the first housing and the second housing; a primary microphone group arranged in the first housing, the primary microphone group including a primary first microphone and a primary second microphone; a secondary microphone arranged in the second housing; a mixing module; a processor; and a receiver. The method 100 includes: obtaining 102 a primary first microphone input signal, such as a primary first microphone input signal 10A, using the primary first microphone; obtaining 104 a primary second microphone input signal, such as a primary second microphone input signal 12A, using the primary second microphone; and obtaining 106 a secondary microphone input signal, such as a secondary microphone input signal 14A, using the secondary microphone. Method 100 includes: providing 108 a primary mixer input based on a primary first microphone input signal and a primary second microphone input signal; providing 110 a secondary mixer input based on a secondary microphone input signal; mixing 112 the primary mixer input and the secondary mixer input, which includes mixing 112A a primary first component of the primary mixer input and a secondary first component of the secondary mixer input to provide a first component of a mixer output and optionally mixing 112B a primary second component of the primary mixer input and a secondary second component of the secondary mixer input to provide a second component of the mixer output; processing 114 the mixer output to provide an electrical output signal; and converting 116 the electrical output signal into an audio output signal.
[0154] The use of the terms "first", "second", "third", and "fourth", "primary", "secondary", "tertiary", etc. does not imply any particular order, but rather are used to identify individual elements. Furthermore, the use of the terms "first", "second", "third", and "fourth", "primary", "secondary", "tertiary", etc. does not denote any order or importance, but rather the terms "first", "second", "third", and "fourth", "primary", "secondary", "tertiary", etc. are used to distinguish one element from another. Please note that the terms "first", "second", "third", and "fourth", "primary", "secondary", "tertiary", etc. used here and elsewhere are used for labeling purposes only and are not intended to indicate any particular spatial or temporal ordering.
[0155] In addition, the reference of a first element does not imply the presence of a second element, and vice versa.
[0156] Understandably, Figures 1 to 4 Including some modules or operations shown with solid lines and some modules or operations shown with dotted lines. The modules or operations included in the solid lines are the modules or operations included in the most extensive example embodiments. The modules or operations included in the dotted lines are exemplary embodiments, which may be included in the modules or operations of the solid line exemplary embodiments, or are a part thereof, or are other modules or operations that can be adopted in addition to the modules or operations of the solid line exemplary embodiments. It should be understood that these operations do not need to be performed in the order presented. In addition, it should be understood that not all operations need to be performed. The exemplary operations can be performed in any order and in any combination.
[0157] It should be noted that the word “comprising” does not necessarily exclude the presence of other elements or steps than those listed.
[0158] It should be noted that the word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements.
[0159] It should also be noted that any reference signs do not limit the scope of the claims, that exemplary embodiments may be implemented at least partially by hardware and software, and that several "means," "units," or "devices" may be represented by the same item of hardware.
[0160] The various exemplary methods, devices, and systems described herein are described in the general context of method step processes, which in one aspect can be implemented by a computer program product, which is contained in a computer-readable medium, including computer-executable instructions, such as program code, executed by a computer in a networked environment. Computer-readable media may include removable and non-removable storage devices, including but not limited to read-only memory (ROM), random access memory (RAM), compact disk (CD), digital versatile disk (DVD), etc. In general, program modules may include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. Computer executable instructions, related data structures, and program modules represent examples of program codes for performing the method steps disclosed herein. A specific sequence of such executable instructions or associated data structures represents an example of corresponding actions for implementing the functions described in such steps or processes.
[0161] Although specific features have been shown and described, it should be understood that they are not intended to limit the claimed invention, and it will be apparent to those skilled in the art that various changes and modifications may be made without departing from the scope of the claimed invention. Accordingly, the specification and drawings are to be regarded as illustrative rather than restrictive. The claimed invention is intended to cover all alternatives, modifications and equivalents.
Claims
1. A hearing device comprising: A first housing configured as a rear-ear housing worn behind an auricle of a user; a second housing configured as an earpiece housing to be worn in or at the ear canal of a user; An electric wire connecting the first shell and the second shell; a primary microphone group, arranged in the first housing, the primary microphone group comprising a primary first microphone for providing a primary first microphone input signal and a primary second microphone for providing a primary second microphone input signal; a secondary microphone, disposed in the second housing, for providing a secondary microphone input signal; a mixing module for providing a mixer output based on a primary mixer input and a secondary mixer input, wherein the primary mixer input is based on the primary first microphone input signal and the primary second microphone input signal, and the secondary mixer input is based on the secondary microphone input signal; a processor for processing the mixer output and providing an electrical output signal based on the mixer output; and a receiver for converting the electrical output signal into an audio output signal, wherein the mixing module is configured to mix a primary first component of the primary mixer input and a secondary first component of the secondary mixer input to provide a first component of the mixer output, and wherein the hearing device comprises a mixing controller configured to apply a mixing scheme in the mixing module based on a control parameter indicative of an instability in the hearing device, Characterized in that applying the mixing scheme in the mixing module includes: increasing the amount of the primary first component in the mixer output and / or decreasing the amount of the secondary first component in the mixer output in response to detecting the control parameter indicating an increased risk of instability of the hearing device, Therein, the control parameter is fed directly from the processor to the hybrid controller, or the control parameter is determined by the hybrid controller based on one or more operating parameters from the processor.
2. The hearing device according to claim 1, wherein Mixing a primary first component of the primary mixer input and a secondary first component of the secondary mixer input includes applying a first linear combination to the primary first component and the secondary first component to provide a first component of the mixer output.
3. The hearing device according to claim 2, wherein: The primary coefficient and the secondary coefficient of the first linear combination are both greater than 0.
4. The hearing device according to claim 2, wherein: The mixing module is configured to mix a primary second component of the primary mixer input and a secondary second component of the secondary mixer input to provide a second component of the mixer output.
5. The hearing device according to claim 4, wherein Mixing the primary second component of the primary mixer input and the secondary second component of the secondary mixer input includes applying a second linear combination to the primary second component and the secondary second component to provide a second component of the mixer output.
6. The hearing device according to claim 5, wherein: The second linear combination is different from the first linear combination.
7. The hearing device according to any one of claims 1 to 6, wherein: The mixing controller is configured to determine the control parameter based on the electrical output signal and the secondary microphone input signal, and to determine the mixing scheme based on the control parameter.
8. The hearing device according to any one of claims 1 to 7, wherein: Mixing the primary first component of the primary mixer input and the secondary first component of the secondary mixer input includes applying a primary first filter to the primary first component, applying a secondary first filter to the secondary first component, and adding the filtered primary first component and the filtered secondary first component to provide the mixer output.
9. A method of operating a hearing device, the hearing device comprising: A first housing configured as a rear-ear housing worn behind an auricle of a user; a second housing configured as an earpiece housing to be worn in or at the ear canal of a user; A wire connecting the first housing and the second housing; a primary microphone group arranged in the first housing, the primary microphone group including a primary first microphone and a primary second microphone; a secondary microphone disposed in the second housing; Hybrid modules; Hybrid controller; processor; and a receiver, the method comprising: obtaining a primary first microphone input signal through the primary first microphone; obtaining a primary second microphone input signal through the primary second microphone; obtaining a secondary microphone input signal through the secondary microphone; providing a primary mixer input based on the primary first microphone input signal and the primary second microphone input signal; providing a secondary mixer input based on the secondary microphone input signal; mixing a primary first component of the primary mixer input and a secondary first component of the secondary mixer input in the mixing module to provide a first component of a mixer output; applying a mixing scheme in the mixing module based on a control parameter indicative of an instability in the hearing device; processing the mixer output to provide an electrical output signal; and converting the electrical output signal into an audio output signal, The method is characterized in that applying the mixing scheme in the mixing module comprises: increasing the amount of the primary first component in the mixer output and / or decreasing the amount of the secondary first component in the mixer output in response to detecting the control parameter indicating an increased risk of instability of the hearing device, Therein, the control parameter is fed directly from the processor to the hybrid controller, or the control parameter is determined by the hybrid controller based on one or more operating parameters from the processor.
Citation Information
Patent Citations
A hearing aid with improved localization
EP2806660A1