Headphone Audio Controller

A real-time audio controller for headphones adjusts EQ and recognition modes based on measured transfer functions, addressing user variability to achieve consistent sound delivery across different users.

JP2024545331AActive Publication Date: 2024-12-05BOSE CORP
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2024538202
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2021-12-27
Filing Date
2022-09-26
Publication Date
2024-12-05
Estimated Expiration
2042-09-26

AI Technical Summary

Technical Problem

Existing headphones often fail to provide a consistent listening experience across different users due to variations in user anatomy and fitting, leading to deviations from the intended sound profile in equalization and recognition modes.

Method used

An audio controller is calculated in real-time based on an audio transfer function measured between the headphone's acoustic transducer and its feedback microphone, customizing the EQ and recognition modes for individual users by accounting for variations in anatomy and fitting.

Benefits of technology

The solution provides a more uniform and consistent listening experience across a larger population of users by tailoring the EQ and recognition modes to individual user characteristics, aligning with the intended sound profile designed by the manufacturer.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024545331000001_ABST
    Figure 2024545331000001_ABST
Patent Text Reader

Abstract

A method and related computer program product and system for determining an audio controller for headphones configured to use an acoustic transducer to generate sound delivered to a user's ear and including a feedback microphone configured to sense the sound generated by the acoustic transducer. A first audio transfer function between the acoustic transducer and the feedback microphone is measured. With the feedback controller applied, a second audio transfer function between the acoustic transducer and the feedback microphone is determined. The audio controller is calculated based on both the first audio transfer function and the second audio transfer function.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] (CROSS REFERENCE TO RELATED APPLICATIONS) This application claims priority to U.S. Patent Application No. 17 / 562,142, filed December 27, 2021.

[0002] The present invention relates to a headphone audio controller. [Background technology]

[0003] The present disclosure relates to controlling audio headphones.

[0004] Headphones can be controlled to provide a specifically equalized sound. Headphones with active noise reduction (ANR) may include a transparency or recognition mode in which external sounds are sensed by an external microphone and played back to the user. Such headphones can also be controlled to provide a desired transmission sound profile. Summary of the Invention [Means for solving the problem]

[0005] Aspects and examples are directed to determining an audio controller for one or both of a headphone equalization (EQ) mode and a headphone recognition mode. The controller is calculated during use (on the fly) based at least in part on an audio transfer function measured between the headphone's acoustic transducer and a microphone sensing the transducer output (e.g., a feedback microphone in an ANR headphone), and further based on this same transfer function, but determined with the feedback controller turned on. As a result, the EQ and recognition mode controller is customized for a particular user, and no action needs to be taken by the user or any other user. This provides a more consistent listening experience across a large population of users.

[0006] All examples and features mentioned below can be combined in any technically possible manner.

[0007] In one aspect, a method of determining an audio controller for headphones configured to use an acoustic transducer to generate sound delivered to a user's ear and including a feedback microphone configured to sense sound generated by the acoustic transducer includes measuring a first audio transfer function between the acoustic transducer and the feedback microphone, determining a second audio transfer function between the acoustic transducer and the feedback microphone with the feedback controller applied, and calculating an audio controller based on both the first audio transfer function and the second audio transfer function.

[0008] Some examples include one of the above and / or the following features, or any combination thereof. In one example, measuring the first audio transfer function includes providing an audio signal configured to operate an acoustic transducer to generate sound, sensing the sound using a feedback microphone, and calculating the first audio transfer function based on the audio signal and the sensed sound. In some examples, determining the second audio transfer function includes measuring an audio transfer function between the acoustic transducer and the feedback microphone with a feedback controller applied. In one example, measuring an audio transfer function between the acoustic transducer and the feedback microphone with a feedback controller applied includes providing an audio signal configured to operate an acoustic transducer to generate sound, sensing the sound using a feedback microphone, and calculating the second audio transfer function based on the audio signal, the sensed sound, and the feedback controller.

[0009] Some examples include one of the above and / or the following features, or any combination thereof. In some examples, determining the second audio transfer function includes calculating the second audio transfer function based on both the first audio transfer function and a feedback controller. In one example, the audio controller includes an equalization (EQ) controller. In one example, the audio controller includes a controller for a headphone use recognition mode in which sounds outside the headphones are reproduced by an acoustic transducer.

[0010] Some examples include one of the above and / or the following features, or any combination thereof. In some examples, the method further includes providing a power spectrum measured for a microphone placed in the person's ear canal and providing a power spectrum measured for a microphone placed on the person's head. In some examples, the power spectrum is measured for a plurality of different people. A compilation or sort of averages of values ​​from this data set can then be used in the headphones. In one example, the audio controller calculation is further based on both the measured power spectrum for the microphone placed in the person's ear canal and the measured power spectrum for the microphone placed on the person's head. In one example, the audio controller calculation is further based on a third audio transfer function between the acoustic transducer and the microphone placed in the person's ear canal.

[0011] Some examples include one of the above and / or the following features, or any combination thereof. In some examples, the method further includes providing a third audio transfer function between a first position of the feedback microphone in the person's ear canal and a second position on the person's head. In one example, the method further includes providing a fourth audio transfer function between the acoustic transducer and the first position of the feedback microphone in the person's ear canal. In one example, the second, third, and fourth audio transfer functions are each calculated by providing an audio signal to the acoustic transducer, sensing the converted sound with a microphone, and calculating a transfer function based on the audio signal and the sensed sound. In some examples, the audio transfer functions are measured in real time for a user. As described further below, in some examples, data derived from measurements made on multiple people in a controlled environment is used with the measured transfer functions to calculate one or both of the recognition mode and the EQ audio controller.

[0012] Some examples include one of the above and / or the following features, or any combination thereof. In one example, the method further includes providing first and second constant values. In one example, the first and second constant values ​​are calculated based on both the third and fourth audio transfer functions. In one example, the first and second constant values ​​are calculated based on both the third and fourth audio transfer functions at a plurality of different fittings of the headphones to a plurality of different people. In one example, the first and second constant values ​​represent frequency dependent complex quantities.

[0013] In another aspect, a computer program product having a non-transitory computer readable medium including encoded computer program logic, which when executed on headphones configured to use an acoustic transducer to generate sound that is delivered to an ear of a user and including a feedback microphone configured to sense the sound generated by the acoustic transducer, causes the headphones to measure a first audio transfer function between the acoustic transducer and the feedback microphone, determine a second audio transfer function between the acoustic transducer and the feedback microphone with a feedback controller applied, and calculate an audio controller based on both the first audio transfer function and the second audio transfer function.

[0014] Some examples include one of the above and / or the following features, or any combination thereof. In one example, the audio controller comprises at least one of an equalization (EQ) controller and a controller for a headphone aware use mode in which sound outside the headphones is reproduced by an acoustic transducer. In one example, a first audio transfer function is measured by providing an audio signal configured to operate the acoustic transducer to generate sound, sensing the sound with a feedback microphone, and calculating the first audio transfer function based on the audio signal and the sensed sound, and further, a second audio transfer function is calculated based on both the first audio transfer function and the feedback controller. In one example, the computer program product further includes providing a power spectrum measured for a microphone disposed in an ear canal of the person and providing a power spectrum measured for a microphone disposed on a head of the person, where the calculation of the audio controller is further based on the power spectrum measured for the microphone disposed in the ear canal of the person, the power spectrum measured for the microphone disposed on the head of the person, and a third audio transfer function between the acoustic transducer and the microphone disposed in the ear canal of the person.

[0015] Various aspects of at least one example are discussed below with reference to the accompanying drawings, which are not intended to be drawn to scale. These drawings are included to provide illustration and further understanding of the various aspects and examples, and are incorporated in and constitute a part of this specification, but are not intended as a definition of the limitations of the invention. In the drawings, identical or nearly identical components shown in various figures may be labeled with similar letters or numbers. For clarity, not all components may be labeled in all figures. In the drawings: [Brief description of the drawings]

[0016] [Figure 1] FIG. [Diagram 2] FIG. 1 is a block diagram of an embodiment of a headphone. [Diagram 3] FIG. 1 is a schematic diagram of a person wearing headphones. [Figure 4] 1 is a flowchart illustrating a method for calculating an audio controller. [Diagram 5] 13 is a plot of the log standard deviation of ⅓ octave smoothed recognition mode insertion gain for an ANR earphone with and without an exemplary audio controller. [Figure 6] 13 is a plot of the log standard deviation of ⅓ octave smoothed EQ mode insertion gain for an ANR earphone with and without an exemplary audio controller. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] The system, method, and device embodiments described herein are not limited in their application to the details of construction and arrangement of components set forth in the following description or illustrated in the accompanying drawings. The systems, methods, and devices may be implemented in other embodiments and may be practiced or carried out in various ways. The specific embodiments are provided herein for illustrative purposes only and are not intended to be limiting. In particular, functions, components, elements, and features discussed in connection with any one or more embodiments are not intended to be excluded from a similar role in any other embodiments.

[0018] Examples disclosed herein can be combined with other examples in any manner consistent with at least one of the principles disclosed herein, and further, references to "an example," "some examples," "an alternate example," "various examples," "one example," and the like are not necessarily mutually exclusive and are intended to indicate that a particular feature, structure, or characteristic being described may be included in at least one example. Appearances of such terms in this specification do not necessarily all refer to the same example.

[0019] Additionally, the phrases and terms used herein are for descriptive purposes only and should not be considered limiting. Any reference to computer program products, systems and methods examples, components, elements, acts, or functions referred to in the singular herein may also encompass embodiments including the plural, and any reference to any example, component, element, act, or function referred to in the plural herein may also encompass examples including only the singular. Thus, singular or plural references are not intended to limit the disclosed systems or methods, their components, acts, or elements. The use of "including," "comprising," "having," "containing," "involving," and variations thereof herein are meant to encompass the items listed below and their equivalents, as well as other items. References to "or" may be construed as inclusive, such that all terms described with "or" can refer to either the singular, plural, and all terms of the described term.

[0020] The present disclosure is directed, in part, to determining an audio controller for headphones, such as on-ear, over-ear, or in-ear headphones. The audio controller can be one or both of a headphone equalization (EQ) and a headphone recognition mode controller. The controller is calculated during use of the headphones, using existing headphone components and processing. The calculation is based at least in part on an audio transfer function measured between an acoustic transducer of the headphones and a microphone sensing the transducer output (e.g., a feedback microphone in an ANR headphone, where the feedback microphone is typically located between the transducer and the user's eardrum). The calculation is further based on this same transfer function, but determined with the feedback controller turned on. This determination can be calculated based on the measured transfer function. The result of this real-time controller calculation is that the EQ and recognition mode controller are customized for a particular user based on a single measured audio transfer function during use of the headphones. This provides a more consistent listening experience across a large population of users of the subject headphones.

[0021] In one example, a first audio transfer function is determined by operating an acoustic transducer of a headphone and sensing sound with a feedback microphone. The first audio transfer function is calculated based on an audio signal provided to the transducer and based on the sensed sound. A second audio transfer function is determined by measuring an audio transfer function between the acoustic transducer and the feedback microphone, but this time with a headphone feedback controller applied. In one example, the second transfer function is calculated based on the audio signal, the sensed sound, and the feedback controller. In one example, the second audio transfer function is determined by calculating based on both the first audio transfer function and the feedback controller.

[0022] In a more specific example, the calculation of the audio controller is based on data obtained during the design of the controller calculation scheme. Such data can be measured in a laboratory or another controlled environment across multiple fittings of different people and headphones used on both ears for each person. Measuring on different people provides data for many different ear shapes. In one example, this data includes a measured power spectrum of a microphone placed in the ear canal (close to the eardrum) and a separate measured power spectrum of a microphone placed on the person's head in a position that does not interfere with the headphones. A data set can be created by placing microphones at the ears of a human subject and placing microphones on the subject's head. Measurements are taken with and without headphones.

[0023] In one example, there are three measurements made in a laboratory, with two sound sources for the measurements. One measurement uses the driver in the headphones to measure the transfer function from the driver to the feedback microphone and the canal microphone while wearing the headset. The other two measurements are made by playing sound through speakers in a measurement room. This is done both with and without the headset worn. For EQ, only the driver measurement and the open room noise measurement are used. In the recognition mode, all three are used, since the response of the external (feedforward) microphone when the headset is worn is required.

[0024] In one example, the test data is represented by two constant values, which may be derived as described further below.

[0025] The present disclosure relates to a headphone audio device. Some non-limiting examples of the present disclosure describe a type of headphone known as an earphone. An earphone generally includes an electroacoustic transducer for generating sound and is configured to deliver sound directly to the ear canal of a user. An earphone can be wireless or wired. In the non-limiting examples described herein, the earphone includes one or more feedback microphones that sense the sound generated by the transducer. Examples also include a feedforward (external) microphone that senses external sounds outside the housing. The feedback and feedforward microphones can be used for functions such as active noise reduction (ANR), where external sounds are cancelled so that they cannot be heard, and transparent mode operation, where external sounds are played back for the user. Aspects of other types of earphones and headphones not included in the present disclosure are not shown or described.

[0026] Headphones usually refer to devices worn around, on, or in the ear and radiate acoustic energy directly or indirectly into the ear canal. Headphones are sometimes referred to as earphones, earpieces, headsets, earbuds, or sports headphones and can be wired or wireless. Headphones contain a driver (acoustic transducer) that converts electronic audio signals into acoustic energy. The driver may or may not be housed in an ear cup or housing configured to sit on the head or on the ear, or to be inserted directly into the user's ear canal. A headphone may be a single standalone unit, one for each ear, or one of a pair of headphones (each containing at least one acoustic driver). One of the headphones may be mechanically connected to the other of the headphones, for example, by a headband and / or by leads that carry audio signals to an acoustic driver in the headphones. The headphones may include components that wirelessly receive audio signals. The headphones may include components of an ANR system, which may include an internal microphone in the headphone housing and an external microphone that picks up sounds outside the housing. The headphones may also include other features, such as an additional microphone for an ANR system, or one or more microphones used to pick up the user's voice.

[0027] One or more of the systems and methods described herein may be used in various implementations and combinations in a wide variety of headphones in various form factors. One such form factor is an earbud. Another is an on-ear or over-ear headphone.

[0028] Although a specific implementation of headphones primarily serving the purpose of acoustically outputting audio has been presented in some detail, it should be noted that the presentation of such a specific implementation is intended to facilitate understanding through the provision of an example and should not be construed as limiting either the scope of the disclosure or the claims.

[0029] In some embodiments, the headphones include an electroacoustic transducer configured to generate sound for a user, a housing to hold the transducer, and a feedback microphone configured to detect sound within the housing before the sound reaches the eardrum. A processor system of the headphones is programmed to effect a method for determining an audio controller, such as an equalization (EQ) controller and a recognition mode controller.

[0030] FIG. 1 is a perspective view of a wireless in-ear earphone 10. The earphone is a non-limiting example of a headphone device. The earphone 10 includes a body or housing 12 that houses the active components of the earphone. The housing 12 houses an electro-acoustic transducer (audio driver) 14 that generates sound via a movable diaphragm 16. The housing 12 includes a front housing portion 22 and a rear housing portion 23. The diaphragm 16 is driven to create sound pressure in a front housing cavity 18. Sound is also generated in a rear housing cavity 20. The sound pressure exits the front housing portion 22 and is directed out of the cavity 18 via a sound outlet 24. An internal microphone 32 is located inside the housing 12. An exemplary microphone 32 is located within the housing portion 12 as shown in FIG. 1. An external microphone 34 is configured to sense sound outside the housing 12. An exemplary external microphone 34 is disposed inside the housing and is acoustically coupled to the external environment via a housing opening 36 that allows environmental sounds to reach the microphone 34. The exemplary internal microphone 32 is used as a feedback microphone for active noise reduction (ANR), and the external microphone 34 is used as a feedforward microphone for ANR and / or for transparent mode operation, in which environmental sounds are sensed and played back to the user so that the user can hear others speaking so that they are more aware of the external environment. The earphone also typically includes a flexible tip (not shown) that engages with the neck 25 of the housing portion 22 to help direct sound into the ear canal. It should be noted that the details of the earphone 10 and its operation are well known in the art and will not be described further herein. It should also be noted that the details of the earphone 10 are exemplary embodiments of headphones and are not intended to limit the scope of the present disclosure, as the present audio controller can be used in various types and designs of miniature earphones and earbuds, as well as other headphones.

[0031] The earphones 10 also include a processor 30. In some examples, the processor 30 is configured to process the output of the microphones 32 and 34. As will be apparent to one skilled in the art, in some examples, the processor is used to perform other processing necessary for the earphones to function, such as processing digital sound files played by the earphones. In one example, the processor is configured to calculate and then apply the audio controllers disclosed herein. The use of EQ and recognition mode audio controllers is known in the art.

[0032] In some examples, the processor is programmed to calculate the EQ controller and / or the recognition mode controller based on an audio transfer function between the transducer 14 and the feedback microphone 32. The transfer function is determined both when the ANR feedback controller is applied and when it is not applied.

[0033] FIG. 2 is a block diagram of an embodiment of a headphone device 60. In one example, the device 60 is an earphone, but this is not a limitation of the present disclosure as the disclosure also applies to other types of headphones as described herein. The device 60 includes a processor 66 that receives audio data from an external source via a wireless transceiver 68. The processor 66 also receives the output of a feedback microphone(s) 70 and a feedforward microphone(s) 72. The processor 66 outputs the audio data that is converted to an analog signal that is provided to an audio driver 64. The exemplary device 60 includes a memory with instructions that, when executed by the processor, accomplish the calculation and application of the audio controller, as well as other processing described herein. In some examples, the device 60 is configured to store a computer program product using a non-transitory computer-readable medium, which includes computer program logic encoded thereon that, when executed on the headphone device (e.g., by the processor), causes the headphone device to determine the audio controller as described herein. It should be noted that the details of the wearable audio device 60 are exemplary embodiments of headphones and are not intended to limit the scope of the present disclosure. Because the present audio controller techniques can be used in earphones and headphones of various types and designs, it should also be noted that aspects of headphone device 60 that do not involve the present audio controller techniques are not shown in FIG.

[0034] Headphones are typically designed with a control scheme that aims to provide a pre-set, manufacturer-designed audio response both when music is being played and when using either the awareness or transparency modes. An equalization audio controller is designed to help achieve a desired target curve equalization (EQ) so that, at least ideally, the reproduced sound has a desired spectral response. A transparency mode controller is used to help achieve a desired transparent sound reproduction. The controller is typically designed to accurately reproduce the sensed external sound. In some instances, one or both of these audio controllers are stored in the device memory and applied by the device controller. Audio controllers and their use in headphones are well known in the field of audio engineering.

[0035] However, when headphones are actually used, the user's anatomy (such as the anatomy of the ear) and the manner in which the headphones are worn create a high degree of variability in the sound actually delivered by a person, and thus, very few, if any, people actually receive the target sound profile intended by the designed and installed EQ and awareness (transparency) mode audio controller.

[0036] In the audio control system and method, one or both of the EQ audio controller and the transparency audio controller are calculated and applied in real time while the headphones are in use. As a result, the user experience is closer to that intended by the headphone manufacturer, even taking into account user-to-user variability. In some examples, the calculation of the audio controller is based on an audio transfer function measured while the headphones are in use by the user. This transfer function is between the headphone acoustic transducer or driver and one or more headphone microphones that receive the driver output. In ANR headphones, this microphone can be a feedback microphone that is placed between the driver and the user's eardrum. In one example, in earphones, this feedback microphone is typically located in a nozzle where sound is delivered directly into the ear canal. Audio transfer functions and their calculations are well known in the audio field and will not be described in detail. Also, the application of the audio controller by the processor of the headphones will not be described in detail, since it is widely used in headphones in general.

[0037] 3 is a schematic diagram of a user's head 80 useful for understanding a headphone audio controller. A right headphone 86 is positioned on, above, or in a right ear 82 having an ear canal 83. A left headphone 88 is positioned on, above, or in a left ear 84 having an ear canal 85. A microphone 90 is also shown positioned on the user's head 80 in a position that does not interfere with the headphones. The placement of the headphones and microphone(s) is useful for aspects of the audio controller, as further described below.

[0038] In the example shown in FIG. 4, a method 100 of determining an audio controller for a headphone device is accomplished using an existing headphone control and sound delivery system, such as the processor 66, feedback (or other) microphone 70, and driver 64 of FIG. 2. In step 102, an audio transfer function between the acoustic transducer 64 and the microphone 70 is measured. As known in the art, audio transfer function measurements in some examples are based on a known audio signal being used to drive the transducer, the reception of the resulting sound by the microphone, and a calculation of a transfer function between the driver and the microphone. In the method 100, in step 104, a second audio transfer function is determined, this time applying a feedback controller for the existing headphone ANR system. At least one measurement is required, and other measurements can be calculated with knowledge of the feedback controller. Feedback controllers are used in headphones with ANR and are well known in the art, so will not be described further herein. In step 106, the relevant audio controller(s) (either an EQ controller or one or both of a transparency mode controller) are calculated based on both the first and second transfer functions.

[0039] In an exemplary recognition mode controller Kaw, assuming a negligible direct sound path with passive insertion gain and effective ANR, and the power spectrum Scc of a microphone placed in the ear canal is equal to the power spectrum Scc,open ("open" means that no headphones are worn during measurement), the recognition mode controller (called a "semi-custom" or "sc" controller) can be represented by the following equation (1):

[0040]

number

[0041] The transfer function subscript annotation standard is from the second subscript to the first subscript. Thus, Gsd is the transfer function from the driver to the feedback microphone. Regarding the power spectra, they generally refer to measurements when the headset is worn, unless the subscript includes "open", which means measurements when the headset is not worn. Srr is the measurement of the reference microphone when the headset is worn. Regarding the controllers, Kaw is the recognition mode controller and Keq is the audio controller. In some cases, the absolute value of the controllers is defined. This is because their phase generally does not matter, unless unwanted phase is added. In other words, they should be minimum phase. For music, this is well known. However, for the recognition mode controller, this fact depends on the total noise reduction (passive + feedback + feedforward) being sufficient such that the direct noise reaching the ear is very low and that what is heard by the ear when the recognition mode controller is turned on is completely dominated by the signal coming from Kaw. This is generally the case for many ANR headsets.

[0042] An exemplary semi-custom EQ controller may be represented by equation (2) below:

[0043]

number

[0044] Thus, by measuring the transfer function between the transducer and one or more microphones of the headphones (both with and without the ANR feedback controller applied), the recognition mode and EQ controller can be calculated and applied on the fly while the headphones are in use.

[0045] The recognition mode and EQ controller may operate more uniformly across multiple users if modified to take into account data measured from multiple subjects at multiple fittings of the headphones, as described above in connection with the laboratory data. Since there is no way to obtain open-ear information from users in the field, appropriate test data can be used in place of open-ear information. In some examples, Gsd is used to estimate the relationship Sss,open / Srr,open (where Sss,open is the power spectrum expected at the feedback microphone if it was still left in the same position in the ear canal when the earphones were removed. Since the feedback microphone is removed with the headset, Sss,open is an estimate of what it would be in such an imagined situation). In one example, Sss,open is estimated from Gsd based on the average transfer matrix of the portion of the ear blocked by the earphone, the matrix being estimated from laboratory data. In one example, the constants α and β are used to represent frequency-dependent complex quantities derived from laboratory data. These constants are determined based on Gsd and the transfer function (Gp1p2) between an external reference microphone (on the user's head) and a microphone in the ear canal at the location of the feedback microphone of the inserted earphone. In one example, Gsd, Gcd and Scc,open are measured and Gp1p2 is estimated based on these three measurements.

[0046] In one example, the constant value can be derived as follows:

[0047] If the reference microphone is called #1 and the feedback microphone is called #2, the transfer function from 1 to 2 for external noise is G p1p2 It is called, namely, (a):

[0048]

number

[0049] From simple modelling, we can assert (b) below.

[0050]

number

[0051] In addition, from laboratory data, we can estimate (c) below.

[0052]

number

[0053] Next, to solve for the best α and β, a and c are combined to derive (d).

[0054]

number

[0055] G p1p2 Some phase is added to the right-hand expression in (d) to remove the fringe absolute values. Possible examples are to give zero phase at all frequencies, or to calculate the minimum phase that matches the magnitude. The result is that for all fits to the laboratory data, p1p2 It is.

[0056] Although ideally every fitting should have a different α and β, each one is selected for use with the headphones, this can be achieved by developing the best fit to the data on average.

[0057] Here, (b) is rearranged to obtain (e).

[0058]

number

[0059] Using this formula (e) for all the fits, we obtain a matrix equation of the type Ax=b

[0060] Then, the pseudoinverse of A is used to solve the best least mean squares fit. x=A † b

[0061] Or, for the above equation, using all the fitting on the laboratory data:

[0062]

number

[0063] This gives an optimized solution that on average performs best across the entire population.

[0064] Taking into account the laboratory data in this manner leads to a modified or "enhanced" recognition mode and EQ controller, described in equations (3) and (4), respectively. Note that the desired controller shape is calculated for each frequency based on the controller design.

[0065]

number

[0066] The theoretical "optimal" or "opt" controller includes a microphone in the ear canal and therefore cannot be implemented for headphone users. The optimal controller is useful in understanding the semi-custom and enhanced controllers disclosed herein. The optimal recognition mode and EQ controller equations are set forth in equations (5) and (6), respectively.

[0067]

number

[0068]

number

[0069] 5 shows the standard deviation of the total insertion gain (in dB) for earphones with and without the exemplary semi-custom and enhanced recognition mode controllers described in equations (1) and (2) (referred to as "ensemble mode"), demonstrating the improved performance using either of these recognition mode controllers from about 700 Hz to about 7 kHz.

[0070] 6 shows the standard deviation of the total insertion gain (in dB) for earphones with and without the exemplary semi-custom and enhanced EQ mode controllers described in equations (3) and (4) (referred to as "ensemble mode"), demonstrating the improved performance using either of these EQ mode controllers from about 300 Hz to about 5 kHz.

[0071] The subject audio controller determination and application can improve both the EQ and recognition mode usage of the headphones. The calculation of the controller(s) is based on real-time measurements of an audio transfer function between the headphone's audio transducer and one or more microphones of the headphones configured to receive the transducer output. Thus, the controller(s) is at least partially customized for a particular user of the headphones and the current usage of the headphones. As a result, the recognition mode and / or EQ performance of the headphones is appreciably closer to the desired design target performance. Thus, the headphones provide closer to standard performance across different users compared to headphones with preset recognition modes and EQ controllers.

[0072] Note that this approach to determining the audio controller is not limited to the presence of a feedback loop for the EQ mode, as long as there is a suitable microphone in the headset. For the recognition mode, the need to remove all direct noise from the outside may be unlikely if no feedback loop is present, but only a feedforward loop with passive sound attenuation may potentially be sufficient.

[0073] Also, note that the present disclosure can use multiple microphones, including outside the headset (for recognition mode), either simply adding them or using them in an array fashion to have directional recognition mode / listening, as well as multiple feedback microphones.

[0074] Furthermore, the present EQ and recognition mode controller can be injected in two places: at the driver (disturbance injection) or before the feedback controller (command injection). Both can be used with complementary filters in place.

[0075] Elements of the figures are shown and described as individual elements of block diagrams. These elements may be implemented as one or more of analog or digital circuits. Alternatively, or additionally, these elements may be implemented with one or more microprocessors executing software instructions. The software instructions may include digital signal processing instructions. Operations may be performed by analog circuitry or by a microprocessor executing software that performs the equivalent of an analog operation. Signal lines may be implemented as separate analog or digital signal lines, as separate digital signal lines with appropriate signal processing capable of processing the separate signals, and / or as elements of a wireless communication system.

[0076] When a process is depicted or suggested in a block diagram, the steps may be performed by one element or by multiple elements. The steps may be performed collectively or at different times. The elements performing the activities may be physically the same or in close proximity to each other, or may be physically separate. An element may perform more activities than one block. The audio signal may be encoded or unencoded and may be transmitted in either digital or analog form. Conventional audio signal processing equipment and operations may be omitted from the drawings.

[0077] The examples of the systems and methods described herein include computer components and computer-implemented steps that will be apparent to those skilled in the art. For example, it should be understood by those skilled in the art that the computer-implemented steps can be stored as computer-executable instructions on a computer-readable medium, such as, for example, a hard disk, an optical disk, a flash ROM, a non-volatile ROM, and a RAM. Furthermore, it should be understood by those skilled in the art that the computer-executable instructions can be executed on various processors, such as, for example, a microprocessor, a digital signal processor, a gate array, and the like. For ease of description, not all steps or elements of the systems and methods are described herein as part of a computer system, but those skilled in the art will recognize that each step or element can have a corresponding computer system or software component. Thus, such computer systems and / or software components are enabled by describing their corresponding steps or elements (i.e., their functionality) and are within the scope of the present disclosure.

[0078] The functions, methods, and / or components of the methods and systems disclosed herein according to various aspects and embodiments may be implemented or performed in a digital signal processor (DSP) and / or other circuitry, analog or digital, suitable for performing signal processing and other functions according to the aspects and embodiments disclosed herein. Additionally or alternatively, a microprocessor, logic controller, logic circuit, field programmable gate array(s) (FPGA), application specific integrated circuit (ASIC), general purpose computing processor(s), microcontroller(s), etc., or any combination thereof, may be suitable and may include analog or digital circuit components and / or other components for any particular implementation.

[0079] The functions and components disclosed herein may operate in the digital domain, the analog domain, or a combination of the two, with particular embodiments including analog-to-digital converters (ADCs) and / or digital-to-analog converter(s) (DACs) where appropriate, despite the lack of illustration of ADCs or DACs in the various figures. Additionally, the functions and components disclosed herein may operate in the time domain, the frequency domain, or a combination of the two, with particular embodiments including various forms of Fourier or similar analysis, fitting, and / or transformation to accommodate processing in the various domains.

[0080] Any suitable hardware and / or software, including firmware and the like, may be configured to run or implement components of the aspects and embodiments disclosed herein, and various implementations of the aspects and embodiments may include components and / or functionality in addition to those disclosed. Various implementations may include stored instructions in digital signal processors and / or other circuitry to enable the circuitry to perform, at least in part, the functions described herein.

[0081] Having described several aspects of at least one embodiment, it will be appreciated that various changes, modifications, and improvements will readily occur to those skilled in the art. Such changes, modifications, and improvements are intended to be part of this disclosure and within the scope of the invention. Accordingly, the foregoing description and drawings are by way of example only, with the scope of the invention to be determined from proper construction of the appended claims and their equivalents. [Explanation of symbols]

[0082] 10. Wireless in-ear earphones 12. Housing 14 Electroacoustic transducer 16 Movable diaphragm 18 Front housing cavity 20 Rear housing cavity 22 Front housing part 23 Rear housing part 24 sound exit 25 Neck 30 processors 32 Internal microphone 34 External microphone 36 Housing opening 60 Headphone Devices 64 Audio Driver 66 processors 68 Radio Transceiver 70 Feedback Microphone 72 Feedforward microphone 80 head 82 Right ear 83 External auditory canal 84 Left Ear 85 External auditory canal 86 Right Headphone 88 Left Headphone 90 Microphone

Claims

1. 1. A method for determining an audio controller for headphones configured to use an acoustic transducer to generate sound delivered to an ear of a user, the method comprising: Measuring a first audio transfer function between the acoustic transducer and the feedback microphone; determining a second audio transfer function between the acoustic transducer and the feedback microphone with a feedback controller applied; calculating the audio controller based on both the first audio transfer function and the second audio transfer function; The method includes:

2. 2. The method of claim 1, wherein measuring the first audio transfer function comprises providing an audio signal configured to operate the acoustic transducer to generate sound, sensing the sound using the feedback microphone, and calculating the first audio transfer function based on the audio signal and the sensed sound.

3. The method of claim 1 , wherein determining the second audio transfer function comprises measuring an audio transfer function between the acoustic transducer and the feedback microphone with a feedback controller applied.

4. 4. The method of claim 3, wherein measuring an audio transfer function between the acoustic transducer and the feedback microphone with a feedback controller applied comprises providing an audio signal configured to operate the acoustic transducer to generate sound, sensing the sound using the feedback microphone, and calculating the second audio transfer function based on the audio signal, the sensed sound, and the feedback controller.

5. The method of claim 1 , wherein determining the second audio transfer function comprises calculating the second audio transfer function based on both the first audio transfer function and the feedback controller.

6. The method of claim 5 , wherein the audio controller includes an equalization (EQ) controller.

7. The method of claim 5 , wherein the audio controller includes a controller for a headphone use mode in which sounds external to the headphones are reproduced by the acoustic transducer.

8. 10. The method of claim 1, further comprising: providing a power spectrum measured for a microphone placed in an ear canal of the person; and providing a power spectrum measured for a microphone placed on the person's head.

9. 9. The method of claim 8, wherein the calculations of the audio controller are further based on both the measured power spectrum for a microphone placed in the person's ear canal and the measured power spectrum for a microphone placed on the person's head.

10. The method of claim 9 , wherein the calculation of the audio controller is further based on a third audio transfer function between an acoustic transducer and a microphone disposed in the person's ear canal.

11. 10. The method of claim 1, further comprising providing a third audio transfer function between a first position of a feedback microphone in the person's ear canal and a second position on the person's head.

12. The method of claim 11 , further comprising providing a fourth audio transfer function between the acoustic transducer and the first location of a feedback microphone in the person's ear canal.

13. The method of claim 12 further comprising providing first and second constant values.

14. The method of claim 13 , wherein the first and second constant values ​​are calculated based on both the third and fourth audio transfer functions.

15. 15. The method of claim 14, wherein the first and second constant values ​​are calculated based on both the third and fourth audio transfer functions at a plurality of different fittings of the headphones to a plurality of different people.

16. The method of claim 13 , wherein the first and second constant values ​​represent frequency-dependent complex quantities.

17. 1. A computer program product having a non-transitory computer readable medium including computer program logic encoded thereon, the computer program logic, when executed on headphones configured to use an acoustic transducer to generate sound that is delivered to an ear of a user, the headphones including a feedback microphone configured to sense sound generated by the acoustic transducer, causing the headphones to: measuring a first audio transfer function between the acoustic transducer and the feedback microphone; determining, with a feedback controller applied, a second audio transfer function between the acoustic transducer and the feedback microphone; calculating an audio controller based on both the first audio transfer function and the second audio transfer function; Computer program products.

18. 20. The computer program product of claim 17, wherein the audio controller comprises at least one of an equalization (EQ) controller and a controller for a headphone use mode in which sounds external to the headphones are reproduced by the acoustic transducer.

19. 20. The computer program product of claim 18, wherein the first audio transfer function is measured by providing an audio signal configured to operate the acoustic transducer to generate sound, sensing the sound with the feedback microphone, and calculating the first audio transfer function based on the audio signal and the sensed sound, and further wherein the second audio transfer function is calculated based on both the first audio transfer function and the feedback controller.

20. 20. The computer program product of claim 19, further comprising: providing a measured power spectrum for a microphone disposed in the person's ear canal; and providing a measured power spectrum for a microphone disposed on the person's head, wherein the audio controller calculations are further based on the measured power spectrum for a microphone disposed in the person's ear canal, the measured power spectrum for a microphone disposed on the person's head, and a third audio transfer function between an acoustic transducer and a microphone disposed in the person's ear canal.

Citation Information

Patent Citations

  • Earphone noise reduction method and system and storage medium

    CN112637724A

  • Canal type earphone mic and acoustic system

    JP2015126267A

  • Compensation of own voice occlusion

    US20200304936A1