Audio device with recognition mode auto leveller
The recognition mode auto-leveler in ANR devices dynamically adjusts noise cancellation and audio boost to address the challenge of acoustic isolation, ensuring users remain aware of their environment and enjoy immersive audio.
Patent Information
- Application Number
- JP2024534093
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-12-06
- Filing Date
- 2022-12-06
- Publication Date
- 2024-12-05
- Estimated Expiration
- 2042-12-06
AI Technical Summary
Active noise reduction (ANR) devices create acoustic isolation, which can be undesirable in situations where users need to be aware of ambient sounds, and the amount of noise reduction and audio boost must adapt to changing ambient noise levels.
A recognition mode auto-leveler that adjusts noise cancellation and audio boost based on sound pressure levels, using a combination of processing systems to balance user experience by managing ambient noise and source audio signals.
Enables users to maintain awareness of their surroundings while enjoying immersive audio, adapting to varying noise conditions for a balanced user experience.
Smart Images

Figure 2024545104000001_ABST
Abstract
Description
[Technical field]
[0001] Claiming priority This application claims priority to U.S. Provisional Patent Application No. 63 / 286,659, filed December 7, 2021, and U.S. Patent Application No. 18 / 062,108, filed December 6, 2022, each of which is incorporated by reference in its entirety herein.
[0002] The present disclosure relates generally to active noise reduction (ANR) devices that provide enhanced awareness mode functionality. [Background technology]
[0003] Acoustic devices such as headphones may include active noise reduction (ANR) functionality that blocks at least a portion of ambient noise from reaching the user's ears. Thus, ANR devices create an acoustic isolation effect that at least partially isolates the user from the environment. To mitigate the effects of such isolation, some acoustic devices with ANR functionality may include a "awareness mode" that sends ambient sounds to the user's ears along with the source audio being played on the acoustic device. Summary of the Invention
[0004] All embodiments and features mentioned below can be combined in any technically possible manner.
[0005] Systems and approaches directed to active noise reduction devices with enhanced awareness mode capabilities are disclosed. Some implementations provide a method that includes receiving an ambient noise signal from a microphone associated with a wearable audio device, determining a gain value based on a sound pressure level (SPL) of the ambient noise signal, generating a gain-adjusted ambient noise signal by applying the gain value to the ambient noise signal, generating a total external microphone signal by adding the gain-adjusted ambient noise signal to a noise-reduced ambient signal, generating an extended audio signal by selectively adjusting a source audio signal based on the gain-adjusted ambient noise signal, and combining the extended audio signal with the total external microphone signal to output to an acoustic transducer.
[0006] In an additional particular implementation, a wearable audio device is provided that includes an acoustic transducer and a microphone and a signal processing system that performs the following operations: receiving an ambient noise signal from the microphone associated with the wearable audio device; determining a gain value based on a sound pressure level of the ambient noise signal; generating a gain-adjusted ambient noise signal by applying the gain value to the ambient noise signal; generating a total external microphone signal by adding the gain-adjusted ambient noise signal to a noise-reduced ambient signal; generating an augmented audio signal by selectively adjusting a source audio signal based on the gain-adjusted ambient noise signal; and combining the augmented audio signal with the total external microphone signal to the acoustic transducer.
[0007] In a further implementation, the method includes obtaining a source audio signal and an ambient noise signal, comparing the ambient noise signal to a predefined hearing threshold, generating an effective noise signal in response to the comparison, generating an enhanced audio signal by selectively adjusting a sound pressure level of the source audio signal based on the effective noise signal, and driving an acoustic transducer of headphones using the enhanced audio signal.
[0008] In yet another approach, a method includes receiving an ambient noise signal from a microphone associated with the wearable audio device, determining a gain value based on a sound pressure level of the ambient noise signal, generating a gain adjusted ambient noise signal by applying the gain value to the ambient noise signal, generating a total external microphone signal by adding the gain adjusted ambient noise signal to a noise reduced ambient signal, generating an augmented audio signal by selectively adjusting a source audio signal based on a noise control signal, and combining the augmented audio signal with the total external microphone signal and outputting it to an acoustic transducer.
[0009] Implementations may include one or any combination of the following features.
[0010] In various implementations, a signal-to-noise ratio (SNR) is determined from the source audio signal and the gain-adjusted ambient noise signal, and generating the enhanced audio signal includes selectively adjusting the source audio signal based on the SNR.
[0011] In some cases, generating the noise control signal includes generating a residual sound component based on the SPL of the ambient noise signal, and adding the residual sound component to the gain adjusted ambient noise signal.
[0012] In a particular case, the gain value is determined using a lookup table having a correspondence between SPL and gain value, the lookup table including a first SPL threshold below which the gain value is set to 1, a second SPL threshold above which the gain value is set to 0, and an SPL range between the first and second SPL thresholds, where the gain value varies between 1 and 0.
[0013] In some examples, generating the enhanced audio signal includes selectively adjusting the SPL for each of a plurality of different frequency bands of the source audio signal.
[0014] In another example, the method further includes determining a signal-to-noise ratio (SNR) from the source audio signal and the gain adjusted ambient noise signal, where determining the SNR includes determining a sub-SNR for each of the different frequency bands, where selectively adjusting the SPL of each different frequency band of the source audio signal is based on the associated sub-SNR, and generating the enhanced audio signal includes selectively adjusting the source audio signal based on the SNR or according to a model of perceptual masking. In some aspects, selectively adjusting the SPL of each different frequency band of the source audio signal is based on the associated sub-SNRs combined in a weighted manner with the sub-SNRs for the lower frequency bands.
[0015] In some examples, the different frequency bands of the audio signal include a low frequency band, a mid frequency band, and a high frequency band.
[0016] In some aspects, the SPL of the low frequency band is increased in response to the SNR meeting a first threshold, the SPL of the low and mid frequency bands is increased in response to the SNR meeting a second threshold, and the SPL of the low, mid, and high frequency bands is increased in response to the SNR meeting a third threshold, the third threshold being greater than the second threshold, the second threshold being greater than the first threshold.
[0017] In certain aspects, comparing the ambient noise signal to the hearing threshold includes comparing an energy level from each of a predefined set of frequency bands between the ambient noise signal and the hearing threshold.
[0018] In other cases, generating the effective noise signal includes determining a maximum between the ambient noise signal and the hearing threshold for each of different frequency bands of a predefined set of frequency bands, and providing the effective noise signal using the maximum for each of the predefined set of frequency bands.
[0019] Two or more features described in this disclosure, including features described in this Summary section, may be combined to form implementations not specifically described herein.
[0020] The details of one or more implementations are set forth in the accompanying drawings and the description below. Other features, objects, and advantages will become apparent from the description and drawings, and from the claims. [Brief description of the drawings]
[0021] [Figure 1] FIG. 1 is a block diagram of a wearable audio device having a recognition mode and an audio leveling feature that provides audio leveling according to various implementations. [Diagram 2] 1 is a block diagram of a recognition mode audio device according to various implementations. [Diagram 3] 1 illustrates a hear-through characteristic graph according to various implementations. [Figure 4] FIG. 1 is a block diagram of an expander employed in a wearable audio device, according to various implementations. [Diagram 5] 1 is a block diagram of an enhancement expander utilized in a recognition mode audio device, according to various implementations. [Figure 6] 1 illustrates an example form factor of a recognition mode audio device according to various implementations.
[0022] It should be noted that the drawings of the various implementations are not necessarily to scale. The drawings are intended to depict only typical aspects of the disclosure, and therefore should not be considered as limiting the scope of the implementations. In the drawings, like numbering represents like elements between the drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0023] Various implementations describe a solution that allows the use of active noise reduction (ANR) in an acoustic device while allowing the user to be aware of ambient sounds, referred to herein as an "awareness mode." Wearable ANR devices, such as ANR headphones, are used to provide a potentially immersive listening experience by reducing the impact of environmental noises and sounds near the user (referred to herein as "ambient noise"). However, by blocking the impact of ambient noise, ANR devices can generate acoustic isolation from the environment, which may be undesirable in some conditions. For example, a user waiting at an airport may want to be aware of flight announcements while using ANR headphones. In another example, while using ANR headphones to cancel out cabin noise during a flight, the user may want to be able to communicate with flight attendants without having to remove the headphones.
[0024] Various technical challenges exist with recognition mode audio devices, including the fact that the type and amount of ambient noise may change while the device is in use. To provide a balanced user experience, the amount of noise reduction may need to be increased or decreased to keep the ambient noise at a desired level. In addition, as the ambient noise level increases, the source audio content may need to be boosted to compensate for the excess ambient noise reaching the user's ears. The approach described herein addresses these and other technical challenges by providing a recognition mode auto-leveler that automatically adjusts both the amount of noise cancellation and the amount of boost to provide a balanced user experience.
[0025] It is understood that the solutions disclosed herein are intended to be applicable to a wide variety of ANR-based wearable audio devices, i.e., devices that are at least partially worn by a user near at least one of the user's ears and structured to provide ANR functionality for at least one of the ears. The ANR processing may include either or both of feedback-based ANR and feedforward-based ANR. Exemplary wearable audio devices may include headphones, two-way communication headsets, earphones, earbuds, hearing aids, audio glasses, wireless headsets (also known as "earsets"), and ear protectors.
[0026] Furthermore, the solutions disclosed herein are applicable to wearable audio devices that provide two-way audio communication, one-way audio communication (i.e., acoustic output of audio electronically provided by another device), or no communication. Furthermore, what is disclosed herein is applicable to wearable audio devices that are connected to other devices wirelessly, connected to other devices via electrically and / or optically conductive cables, or not connected to any other devices. These teachings are applicable to wearable audio devices having a physical structure configured to be worn near either one or both ears of a user, including, but not limited to, headphones with one or two earpieces, over-the-head headphones, behind-the-neck headphones, headsets with a communication microphone (e.g., a boom microphone), in-ear or behind-ear hearing aids, wireless headsets (i.e., earsets), audio glasses, a single earphone or a pair of earphones, as well as hats, helmets, clothing, or any physical structure incorporating one or two earpieces to enable audio communication and / or ear protection. The presentation of specific implementations is intended to facilitate understanding through the use of examples and should not be construed as limiting either the scope of the disclosure or the applicability of the claims.
[0027] FIG. 1 illustrates an exemplary implementation of an ANR-based audio device ("audio device") 10 that provides an automatic leveler for adaptively managing recognition mode functionality. As illustrated, the audio device 10 receives and processes a source audio signal 18 and an ambient noise signal 16. The source audio signal 18 may include any type of audio content, such as streaming music, telephone communications, audio feeds from audiovisual sources, streaming podcasts, audio recordings, and the like. The ambient noise signal 16 may include any type of environmental noise, for example, captured by an ANR feedforward (i.e., external) microphone or any other microphone or array of microphones adapted to capture ambient noise near the user. In some implementations, the audio device 10 includes (1) a first processing system 12 that adaptively sends some or all of the ambient noise signal 16, the resulting signal referred to herein as a "total external microphone signal" 34, and (2) a second processing system 14 that adaptively boosts the source audio signal 18 to generate an enhanced noise signal 36. The first processing system 12 and the second processing system 14 work together to adaptively implement an auto-leveler that provides a balanced user experience under changing ambient noise conditions. In the example device 10 shown in FIG. 1, the generated total external microphone signal 34, the extended noise signal 36, and the feedback back signal 33 (ANR feedback filter K fb 32 and the associated ANR feedback (produced by microphone 31) are combined and output to acoustic transducer 20. As a result, audio device 10 enables the user to achieve a desired balance of ambient awareness, auditory comfort, and media enjoyment.
[0028] In some exemplary approaches, the first processing system 12 may include an ANR filter (K nc) 22 and a modulator 24 that generates a gain adjusted ambient noise signal 25 via a pass-through signal path 23. In some approaches, the amount of gain applied to the ambient noise signal 16 via the pass-through signal path 23 is based on the sound pressure level (SPL) of the ambient noise signal 16. In the illustrated example, the gain adjusted ambient noise signal 25 is filtered through a filter K fb A pass-through filter (K ) that shapes the external microphone signal to work in concert with the feedback-based ANR provided by aw In some embodiments, the nucleic acid is further processed by K aw 26 equalizes the spectrum of the ambient noise signal 16 so that the signal 16 sounds natural, for example, as if it were unobstructed and the user were not wearing a headset. aw 26 also ensures that stability criteria are met for any acoustic path from the driver 20 to the external microphone that receives the ambient noise signal 16 .
[0029] The resulting noise reduced ambient signal 17 and gain adjusted ambient noise signal 25 are combined to produce a total external microphone signal 34 .
[0030] 2 illustrates an exemplary modulator 24 for generating a gain adjusted ambient noise signal 25, which includes a variable gain amplifier 48 that adjusts the ambient noise signal 16 based on a calculated gain value 46. In some approaches, the gain value 46 is determined using (1) an energy calculator 40 that measures the SPL of the ambient noise signal 16, for example using A-weighting, (2) a gain lookup table 42 that determines a gain level based on the corresponding SPL, and (3) a filter 44 that generates the gain value 46, for example, by smoothing the gain level obtained from the lookup table. The filter 44 controls the trajectory of the gain signal to ensure that the recognition mode signal does not jump up and down rapidly, allowing for smooth changes with a long time constant.
[0031] In some implementations, the modulator 24 can be configured to control the amplifier 48 according to one or more threshold conditions. The threshold conditions can be preset or set in response to user input. In some implementations, if the modulator 24 determines that the ambient noise signal 16 is below a certain threshold, the gain value 46 controls the amplifier 48 such that the gain of the pass-through signal path 23 is substantially equal to 1. This allows the user to hear the surrounding sounds with little or no attenuation. In some implementations, if the modulator 24 determines that the ambient noise signal 16 is equal to or above a certain threshold, the gain value 46 can be configured to control the amplifier 48 such that the overall gain of the pass-through signal path 23 is less than 1 and the output of the ANR filter 22 (FIG. 1) provides an attenuation of the ambient noise signal 16 at the ear. This allows the user to recognize environmental noises and sounds when the noise is below the threshold, but utilizes the ANR capabilities of the device 10 when the noise is above the threshold to prevent loud sounds, such as vehicle sounds, sirens, or machine sounds, from becoming uncomfortably loud.
[0032] FIG. 3 shows an exemplary graph illustrating the level of the gain-adjusted ambient signal 25 as a function of the ambient noise signal 16. In this case, the gain-adjusted ambient signal 25 is controlled by the modulator 24, which changes the amount of the gain-adjusted ambient signal 25 based on two threshold levels 64, 66 of the ambient noise signal 16. When the ambient noise signal 16 is below the first threshold 64, the gain-adjusted ambient signal 25 is sent with substantially no reduction applied to the ambient noise signal 16 (e.g., the gain value is set to 1). When the ambient noise signal 16 is above the first threshold 64 but below the second threshold 66, the gain-adjusted ambient signal 25 is held at a substantially constant level, i.e., as the ambient noise signal 16 is increased, the gain is reduced to maintain a substantially constant sound pressure level at the ear (e.g., the gain value varies between 1 and 0). When the ambient noise signal 16 is above the second threshold 66, the gain-adjusted ambient signal 25 is set to a minimum (e.g., the gain value is set to 0). It should be noted that in an alternative approach, curve 62 may be achieved with a compressor in which the slope between first threshold 64 and second threshold 66 may be greater than zero.
[0033] Aspects relating to the first processing system 12 are further described in U.S. Patent Application Publication No. 2019 / 0130928, entitled "Compressive Hear-Through In Personal Acoustic Devices," published May 2, 2019, the entire contents of which are incorporated herein by reference.
[0034] As noted herein, in certain implementations, one purpose of the first processing system 12 is to determine the amount of ambient noise that should be transmitted to the listener. In an alternative approach to that described in Figures 1 and 2, rather than (or in addition to) controlling the gain value 46 in the pass-through path 23, a feed-forward filter K nc 22 and / or feedback filter K fb 32. By reducing the noise cancelling signal in this way, the amount of noise reduction can be controlled by varying K aw26 does not need to overcome all active noise reduction components, only the small passive noise reduction component(s).
[0035] 1 and 2, in addition to generating the total external microphone signal 34, the first processing system 12 also outputs a noise control signal 27 to the second processing system 14. In a particular approach, the second processing system 14 automatically adjusts the SPL of the source audio signal 18 based at least in part on a comparison of the SPL of the source audio signal 18 and the ambient noise signal 16 (or a signal derived therefrom) to generate the expanded audio signal 36. In this way, when the ambient noise becomes louder, the audio output of the audio device 10 is automatically adjusted to be louder. When the ambient noise changes, for example to a quieter environment having a lower SPL, the volume of the audio output is reduced. In various approaches, the noise control signal 27 is utilized to reflect how much ambient noise is present in the environment and to determine how much SPL expansion should be applied to the source audio signal 18. In some cases, the second processing system 14 also includes an equalizer (Keq) 28 that first processes the source audio signal 18, for example, to adjust the frequency response to hit some target at the ear after being processed by the system.
[0036] In some examples, the noise control signal 27 is based on the gain adjusted ambient noise signal 25 generated by the modulator 24. In the exemplary modulator 24 shown in FIG. 2, the noise control signal 27 is a combination of the gain adjusted ambient noise signal 25 and K TIG 50 and the residual sound component (RSC) 52 generated by K TIG50 is a filter that attenuates the external sound to model the residual sound that reaches the ear even with the total ANR. In this case, the gain adjusted ambient noise signal 25 is zero and the noise reduced ambient signal 17 is non-zero. Thus, the sum, i.e., total external microphone signal 34, does not equal zero. Thus, RSC 52 provides the SPL that would be received at the ear when the sound is actually loud outside and the total external microphone signal 34 is essentially blocked. In other approaches, rather than being implemented as a filter, K TIG 50 can simply be implemented as a scalar gain to provide RSC52.
[0037] FIG. 4 illustrates an exemplary embodiment of the expander 30 in which a signal-to-noise ratio (SNR) calculator 70 is utilized to generate a side-chain input 74 for controlling the adaptive audio expander 72. In certain cases, the SNR calculator 70 receives both the source audio signal 18 and the noise control signal 27 (possibly including at least in part the gain-adjusted ambient noise signal 25), calculates an SNR value, and outputs a side-chain input 74. The side-chain input 74 may consist of the calculated SNR value itself or a value derived from the SNR value. The SNR calculator 70 may include any system for evaluating the source audio signal against the noise signal and outputting a side-chain value 74, which may include, for example, a ratio, a difference, one or more derived values, etc. Nevertheless, the adaptive audio expander 72 uses the side-chain input 74 to control the expansion of the source audio signal 18, i.e., in generating the expanded audio signal 36. In certain cases, the higher the SNR value, the more SPL boost is provided by the adaptive audio expander 72.
[0038] In the above implementation, the noise control signal 27 includes, at least in part, the gain adjusted ambient noise signal 25. In an alternative approach, rather than using the gain adjusted ambient noise signal 25 to calculate an SNR value (FIG. 1), the noise control signal 27 can include calculated values that capture or predict one or more spectral characteristics of the ambient noise signal 16. In certain cases, the SPL or other information derived from the ambient noise signal 16 and / or the total external microphone signal 34 can be analyzed, for example, by a signal processor using a table of pre-calculated metrics, a machine learning system that evaluates the acoustic environment, etc., to generate one or more spectral characteristic values. The resulting value(s) can then be sent directly to the adaptive audio expander 72, which can utilize the value(s) to adaptively boost the source audio signal 18. Thus, the noise control signal 27 can include any type of information or signal that captures, predicts, forecasts, etc., the amount of ambient noise in the environment.
[0039] According to various implementations, the amount or type of SPL expansion provided by the expander 30 may be based on a number of factors. In some cases, the expansion is based on a threshold level of the sidechain input 74. In certain cases, different amounts of boost in SPL are applied to any number of different frequency bands. In one example, different boosts are applied to the low (i.e., low frequencies), mid (i.e., mid frequencies), and / or high (i.e., high frequencies) bands. In one example, the low frequency band refers to lower frequencies below 100 Hz, the mid frequency band refers to frequencies between 100 Hz and 4 kHz, and the high frequency band refers to higher frequencies above 4 kHz. According to various implementations, the SPL boost applied to the low band frequencies is greater than the SPL boost applied to the mid band frequencies, which is greater than the SPL boost applied to the high band frequencies.
[0040] In some cases, the SPL of the low frequency band is increased in response to the SNR satisfying a first threshold, the SPL of the low and mid frequency bands is increased in response to the SNR satisfying a second threshold, and the SPL of the low, mid and high frequency bands is increased in response to the SNR satisfying a third threshold, the third threshold being greater than the second threshold, and the second threshold being greater than the first threshold.
[0041] Table 1 provides exemplary SPL boost values in dB applied to music audio based on frequency range. Music has a constant SPL of 70 dB estimated at the user's ear. Ambient noise (derived from noise control signal 27) increases from 50 dB to 65 dB in 5 dB increments. Since there is no or substantially no feedback path, the SPL boost applied for each frequency range does not result in an increase (or a substantial increase) in the estimated music SPL at the user's ear. The increase and decrease of SPL is controlled independently for each frequency range. As shown in Table 1, the SPL of low-band frequencies is boosted more than the SPL of mid-band frequencies, which are boosted more than the SPL of high-band frequencies. Correspondingly, when the ambient noise decreases (i.e., the SNR increases) from, for example, 65 dB to 50 dB, the SPL of low-band frequencies decreases more than the SPL of mid-band frequencies, which are reduced more than the SPL of high-band frequencies. Additionally, some limitations can be placed on the maximum allowable gain in each band.
[0042] [Table 1]
[0043] In some approaches, sub-SNRs are determined for different frequency bands from the ambient noise signal and the gain adjusted ambient noise signal by the SNR calculator 70. Thus, for example, sub-SNRs may be determined for a low band, a mid band, and a high band to generate three side chain input values 74. The SPL of each different frequency band of the source audio signal 18 is then selectively adjusted by the adaptive audio expander 72 based on the associated sub-SNR.
[0044] Related aspects for implementing an expander are described in U.S. Patent Application Publication No. 2020 / 0143790, entitled “Ambient Volume Control in Open Audio Devices,” published May 7, 2020, the contents of which are incorporated by reference in their entirety into this specification.
[0045] Referring to FIG. 5, an enhancement expander 80 for generating an enhanced audio signal 38 from a source audio signal 18 is shown. In this approach, the SNR calculator 70 utilizes an effective noise signal 86 generated by a comparator 82 to determine the sidechain input 74 to the audio expander 72. In a particular approach, the comparator 82 compares the energy level of the ambient noise signal 16 with the audiogram of a predefined hearing threshold 84 of the user and uses the maximum of the two as the effective noise signal 86. By using the predefined hearing threshold 84, the user hears the content only if it is loud enough (i.e., depending on the frequency) and the sound is not masked by the noise (again depending on the frequency). Thus, hearing loss or masking by ambient sounds are equivalent and the same method can be used to ensure that the listener perceives the full spectrum of sounds.
[0046] In some cases, the comparator 82 compares the energy levels across a predefined set or range of frequency bands. In certain cases where predefined frequency bands are compared, the maximum value of each comparison of the predefined set of frequency bands is combined to provide the effective noise signal 86. In other cases where predefined frequency bands are compared, the maximum value of each comparison of the predefined set of frequency bands can be used to determine a sub-SNR by the SNR calculator 70. The resulting sub-SNR can be used by the audio expander 72 to control the expansion of individual frequency bands. (In various cases, the maximum value is the maximum value of the signal either within a given range or across the entire domain.)
[0047] It will be appreciated that the reinforcement expander 80 may be implemented separately from the first processing system 12 (FIG. 1) or may be integrated with the first processing system 12. When the expander 80 is integrated with the first processing system 12, the ambient noise signal 16 may include a gain adjusted ambient noise signal 25, or other noise control signal 27 derived from the ambient noise signal 16. When implemented separately, the ambient noise signal 16 may be obtained, for example, from any external microphone.
[0048] It should be understood that device 10 as shown and described according to various implementations may be structured to be worn by a user to provide audio output proximate at least one of the user's ears. Device 10 may have any of a number of form factors, such as configurations incorporating a single earpiece to provide audio to only one of the user's ears, other configurations incorporating a pair of earpieces to provide audio to both of the user's ears, and other configurations incorporating one or more standalone speakers to provide audio to the user's surrounding environment.
[0049] 6 is a block diagram of an embodiment of an in-ear wearable audio device 100 having two earphones 112A and 112B, each configured to transmit sound toward a user's ear. (Reference numerals labeled "A" or "B" indicate a correspondence with a particular one of the two earphones and identified functions. However, for simplicity, letter designations are omitted from the following description, e.g., earpiece 112 refers to either or both of earpiece 112A and earpiece 112B.) Each earpiece 112 includes a case 114 that defines a cavity 116 that houses an electroacoustic transducer 128 for outputting audio signals to the user. In addition, at least one inner microphone 118 is also disposed within the cavity 116. In an implementation in which the wearable audio device 100 is wearable on the ear, an ear coupling 120 (e.g., an ear tip or an ear cushion) attached to the case 114 surrounds an opening to the cavity 116. A passageway 122 is formed through the ear coupling 120 and communicates with the cavity 116 at an opening. In various implementations, one or more exterior microphones 124 are positioned on the case 112 in a manner that allows acoustic coupling to the environment outside the case.
[0050] Audio output by the transducer 128, including both the source audio signal and the total external microphone signal, is implemented by an audio processing system 130, which incorporates the first and second processing systems 12, 14 described herein. The audio processing system 130 may be integrated into one or both earpieces 112 or may be implemented by an external system. If the audio processing system 130 is implemented by an external system, each earpiece 112 may be coupled to the audio processing system 130 in either a wired or wireless configuration. In various implementations, the audio processing system 130 may include hardware, firmware, and / or software to provide various features to support operation of the wearable audio device 100, including providing, for example, power, amplification, input / output, network interface, user control functions, ANR, signal processing, data storage, data processing, voice detection, etc.
[0051] In implementations including ANR to enhance the audio signal, the inner microphone 118 may function as a feedback microphone and the outer microphone 124 may function as a feedforward microphone. In such implementations, each earphone 112 may utilize ANR circuitry in communication with the inner microphone 118 and the outer microphone 124. The ANR circuitry receives the internal signal generated by the inner microphone 118 and the external signal generated by the outer microphone 124 and performs ANR processing on the corresponding earphone 112. This process includes providing a signal to an electroacoustic transducer (e.g., a speaker) 128 disposed within the cavity 116 to generate an anti-noise acoustic signal that reduces or substantially prevents sound from one or more acoustic noise sources external to the earphone 112 from being heard by the user.
[0052] It will be understood that one or more of the functions of the described systems may be implemented as hardware and / or software, and that the various components may include communication paths connecting the components by any conventional means (e.g., wired and / or wireless connections). For example, one or more non-volatile devices (e.g., centralized or distributed devices such as flash memory devices) may store and / or execute the programs, algorithms, and / or parameters of one or more of the described systems of devices. Also, the functionality or portions thereof, and various modifications thereof (hereinafter "functionality") described herein may be implemented at least in part via a computer program product (e.g., a computer program tangibly embodied in an information carrier, such as one or more non-transitory machine-readable media, for execution by or for controlling the operation of one or more data processing devices (e.g., programmable processors, computers, multiple computers, and / or programmable logic components, etc.).
[0053] The computer program may be written in any form of programming language, including compiled or interpreted languages, and it may be arranged in any form, including as a stand-alone program or as a module, component, subroutine or other unit suitable for use in a computing environment. The computer program may be arranged to be executed on one computer or on multiple computers at one site, or may be distributed across multiple sites and interconnected by a network.
[0054] Actions associated with carrying out all or a portion of the functions may be performed by one or more programmable processors executing one or more computer programs to carry out the functions. All or a portion of the functions may be implemented as special purpose logic circuitry, such as field programmable gate arrays (FPGAs) and / or application-specific integrated circuits (ASICs). Processors suitable for executing computer programs include, by way of example, both general purpose and special purpose microprocessors, as well as any one or more processors of any kind of digital computer. In general, a processor may receive instructions and data from a read-only memory, a random access memory, or both. The components of a computer include a processor for executing instructions and one or more memory devices for storing instructions and data.
[0055] It should be noted that while the implementations described herein utilize a microphone system to collect input signals, it is understood that any type of sensor, e.g., accelerometer, thermometer, optical sensor, camera, etc., may be utilized separately or in addition to the microphone system to collect input signals.
[0056] Additionally, actions associated with implementing all or a portion of the functionality described herein may be performed by one or more networked computing devices that may be connected via a network, e.g., one or more wired and / or wireless networks, such as a local area network (LAN), a wide area network (WAN), a personal area network (PAN), an Internet-connected device and / or network, and / or cloud-based computing (e.g., cloud-based servers).
[0057] In various implementations, electronic components described as "coupled" may be linked via conventional wired and / or wireless means such that the electronic components can communicate data with one another. Furthermore, subcomponents within a given component may be considered to be linked via conventional paths, although not necessarily illustrated.
[0058] Although multiple implementations have been described, it is understood that additional modifications may be made without departing from the scope of the inventive concepts described herein, and thus, other implementations are within the scope of the following claims. [Explanation of symbols]
[0059] 10 Devices 12 First Processing System 14 Second Processing System 16 Ambient Noise Signal 17 Noise reduction ambient signal 18 source audio signals 20 Acoustic Transducer 20 Drivers 21 Noise Reduction Path 22 ANR Filter 23 Pass-Through Signal Path 24 Modulator 25 Ambient Noise Signal 26 Pass-through filter (Kaw) 27 Noise Control Signal 28 Equalizer (Keq) 30 Expander 31 ANR Feedback Microphone 33 Feedback back signal 34 total external microphone signals 36 Extended Audio Signals 38 Extended Audio Signals 40 Energy Calculator 42 Gain Lookup Table 44 Filters 46 Gain Value 48 Amplifier 52 Residual sound component (RSC) 62 curve 64 First Threshold 66 Second Threshold 70 SNR Calculator 72 Adaptable Audio Expander 74 Side Chain Input 80 Expander 82 Comparator 84 Hearing Threshold 86 Effective noise signal 100 In-ear wearable audio devices 112 Earpiece 114 cases 116 Cavity 118 Internal Microphone 120 Ear Coupling Aisle 122 124 Outside Microphone 128 Electroacoustic Transducer 130 Audio Processing System
Claims
1. 1. A method comprising: receiving an ambient noise signal from a microphone associated with a wearable audio device; determining a gain value based on a sound pressure level (SPL) of the ambient noise signal; generating a gain adjusted ambient noise signal by applying the gain value to the ambient noise signal; generating a total external microphone signal by adding the gain adjusted ambient noise signal to a noise reduced ambient signal; generating an enhanced audio signal by selectively adjusting a source audio signal based on the gain adjusted ambient noise signal; and combining the extended audio signal with the total external microphone signal and outputting the combined extended audio signal to an acoustic transducer.
2. determining a signal-to-noise ratio (SNR) from the source audio signal and the gain adjusted ambient noise signal; The method of claim 1 , wherein generating the enhanced audio signal comprises selectively adjusting the source audio signal based on the SNR.
3. 2. The method of claim 1 , wherein adjusting the source audio signal to generate the enhanced audio signal is based on combining the gain adjusted ambient noise signal and a residual sound component, the residual sound component being based on the SPL of the ambient noise signal.
4. The gain value is determined using a lookup table having a correspondence between SPL and gain value, the lookup table comprising: a first SPL threshold below which the gain value is set to unity; a second SPL threshold above which the gain value is set to zero; 2. The method of claim 1, further comprising an SPL range between the first SPL threshold and the second SPL threshold, the gain value varying between 1 and 0.
5. The method of claim 1 , wherein generating the enhanced audio signal comprises selectively adjusting an SPL for each of a plurality of different frequency bands of the source audio signal.
6. determining a signal-to-noise ratio (SNR) from the source audio signal and the gain adjusted ambient noise signal; determining the SNR includes determining a sub-SNR for each of the different frequency bands; The method of claim 5 , wherein selectively adjusting the SPL of each of the different frequency bands of the source audio signal is based on an associated sub-SNR.
7. The method of claim 5 , wherein the different frequency bands of the audio signal include a low frequency band, a mid frequency band, and a high frequency band.
8. the SPL of the low frequency band is increased in response to the SNR meeting a first threshold; the SPL for the low frequency band and the mid frequency band is increased in response to the SNR meeting a second threshold; the SPL for the low frequency band, the mid frequency band, and the high frequency band is increased in response to the SNR satisfying a third threshold; the third threshold is greater than the second threshold, and the second threshold is greater than the first threshold; The method of claim 7.
9. A wearable audio device, comprising: An acoustic transducer; A microphone and 1. A signal processing system that performs the following operations: receiving an ambient noise signal from a microphone associated with a wearable audio device; determining a gain value based on a sound pressure level (SPL) of the ambient noise signal; generating a gain adjusted ambient noise signal by applying the gain value to the ambient noise signal; generating a total external microphone signal by adding the gain adjusted ambient noise signal to a noise reduced ambient signal; generating an enhanced audio signal by selectively adjusting a source audio signal based on the gain adjusted ambient noise signal; and a signal processing system that includes combining the extended audio signal with the total external microphone signal and outputting it to an acoustic transducer.
10. determining a signal-to-noise ratio (SNR) from the source audio signal and the gain adjusted ambient noise signal; 10. The device of claim 9, wherein generating the enhanced audio signal comprises selectively adjusting the source audio signal based on the SNR.
11. 10. The device of claim 9, wherein adjusting the source audio signal to generate the enhanced audio signal is based on combining the gain adjusted ambient noise signal and a residual sound component, the residual sound component being based on the SPL of the ambient noise signal.
12. The gain value is determined using a lookup table having a correspondence between SPL and gain value, the lookup table comprising: a first SPL threshold below which the gain value is set to unity; a second SPL threshold above which the gain value is set to zero; 10. The device of claim 9, further comprising an SPL range between the first SPL threshold and the second SPL threshold, where the gain value varies between 1 and 0.
13. determining a signal-to-noise ratio (SNR) from the source audio signal and the gain adjusted ambient noise signal; determining the SNR includes determining a sub-SNR for each of the different frequency bands; 10. The device of claim 9, wherein selectively adjusting the SPL of each of the different frequency bands of the source audio signal is based on an associated sub-SNR.
14. the different frequency bands of the audio signal include a low frequency band, a mid frequency band, and a high frequency band; the SPL of the low frequency band is increased in response to the SNR meeting a first threshold; the SPL for the low frequency band and the mid frequency band is increased in response to the SNR meeting a second threshold; the SPL for the low frequency band, the mid frequency band, and the high frequency band is increased in response to the SNR satisfying a third threshold; The device of claim 13 , wherein the third threshold is greater than the second threshold, and the second threshold is greater than the first threshold.
15. 1. A method comprising: obtaining a source audio signal and an ambient noise signal; comparing said ambient noise signal with a predefined hearing threshold; generating an effective noise signal in response to said comparing; generating an enhanced audio signal by selectively adjusting a sound pressure level of the source audio signal based on the effective noise signal; and driving an acoustic transducer of a headphone using the augmented audio signal.
16. determining a signal-to-noise ratio (SNR) based on the source audio signal and the useful noise signal; The method of claim 15 , wherein generating the enhanced audio signal comprises selectively adjusting the sound pressure level of the source audio signal based on the SNR.
17. 17. The method of claim 16, wherein comparing the ambient noise signal to the hearing threshold comprises comparing an energy level from each of a predefined set of frequency bands between the ambient noise signal and the hearing threshold.
18. generating the useful noise signal determining, for each of the different frequency bands of the predefined set of frequency bands, a maximum value between the ambient noise signal and the hearing threshold; 20. The method of claim 17, comprising using a maximum value in each of the predefined set of frequency bands to provide the useful noise signal.
19. the source audio signal includes a low frequency band, a mid frequency band, and a high frequency band; the SPL of the low frequency band is increased in response to the SNR meeting a first threshold; the SPL for the low frequency band and the mid frequency band is increased in response to the SNR meeting a second threshold; the SPL for the low frequency band, the mid frequency band, and the high frequency band is increased in response to the SNR satisfying a third threshold; The method of claim 16 , wherein the third threshold is greater than the second threshold, and the second threshold is greater than the first threshold.
20. generating the enhanced audio signal, determining a sub-signal-to-noise ratio (sub-SNR) for each different frequency band for the source audio signal and the useful noise signal; 16. The method of claim 15, comprising selectively increasing a sound pressure level (SPL) of different frequency bands of the audio signal based on the sub-SNR.
Citation Information
Patent Citations
Signal processor, signal processing method and program
JP2015173369A
Apparatus and method for improving the perceived quality of sound reproduction through a combination of active noise cancellation and perceived noise compensation.
JP2015515202A
Context-based ambient sound enhancement and acoustic noise cancellation
JP2020197712A
An audio device with adaptive auto-gain
US20200184944A1
Output sound control device, output sound control method, and program
WO2020255601A1
Cited By
Noise reduction and audio enhancement system of wearable hearing aid device
CN121662066A
