Active noise reduction with impulse detection and suppression.

Abstract

The apparatus includes noise-reducing headphones having one or more microphones and an acoustic transducer, the one or more microphones configured to generate an input signal; and a controller including one or more processing devices, the controller is configured to process the input signal through one or more noise-reducing filters to generate a noise-reducing signal, compare the input signal with an estimate of the ambient noise to determine whether the energy of the input signal is greater than the estimate of the ambient noise, and if the energy of the input signal is greater than the estimate of the ambient noise by a predetermined amount, suppress changes in the noise-reducing signal, and generate an output signal that at least partially includes the noise-reducing signal, the acoustic transducer is configured to generate an acoustic output in accordance with the output signal.

Description

[Technical Field]

[0001] The present disclosure relates generally to acoustic devices such as headphones that may include active noise reduction (ANR) functionality that blocks at least a portion of ambient noise from reaching a user's ears, and specifically to acoustic devices with ANR functionality that detects and suppresses ANR responses to impulse sounds. Summary of the Invention [Means for solving the problem]

[0002] Two or more of the features described in this disclosure, including the features described in this Summary section, may be combined to form implementations not specifically described herein.

[0003] According to one aspect, an apparatus includes noise-reducing headphones having one or more microphones and an acoustic transducer, the one or more microphones configured to generate an input signal based on captured ambient sound; and a controller including one or more processing devices, the controller processes the input signal through one or more noise-reducing filters to generate a noise-reducing signal configured to reduce the effect of the input signal, compares the input signal with an estimate of the ambient noise to determine whether the energy of the input signal is greater than the estimate of the ambient noise, and if the energy of the input signal is greater than the estimate of the ambient noise by a predetermined amount, suppresses changes in the noise-reducing signal, and generates an output signal at least partially including the noise-reducing signal, the acoustic transducer being configured to generate an acoustic output in accordance with the output signal.

[0004] In one example, the output signal is a weighted combination of the noise reduction signal and the pass-through signal.

[0005] In one example, comparing the input signal to the estimate of the ambient noise includes comparing the energy of the input signal to an ambient noise signal generated by a first low-pass filter, the first low-pass filter being configured such that the ambient noise signal is an estimate of the ambient noise present in the captured ambient sound.

[0006] In one example, the ambient noise signal is delayed in time relative to the input signal.

[0007] In one example, the energy of the input signal is determined by the output of a second low-pass filter, the second low-pass filter providing stronger smoothing to the input signal than the first low-pass filter.

[0008] In one example, comparing the energy of the input signal further includes determining whether a difference between the output of the second low-pass filter and the ambient noise signal satisfies a threshold condition.

[0009] In one example, comparing the energy of the input signal further includes determining whether a ratio between the output of the second low-pass filter and the ambient noise signal satisfies a threshold condition.

[0010] In one example, suppressing the noise reduction signal includes temporarily ceasing to increase the magnitude of the noise reduction signal.

[0011] In one example, temporarily stopping increasing the magnitude of the noise-reduced signal includes temporarily stopping adjusting a variable gain filter in a pass-through processing chain that generates the pass-through signal, and the output signal is a weighted combination of the noise-reduced signal and the pass-through signal.

[0012] In one example, suppressing the noise reduction signal includes adjusting a rate at which the noise reduction signal is adjusted in response to the input signal.

[0013] According to another aspect, one or more non-transitory machine-readable storage devices having encoded thereon computer-readable instructions for causing one or more processing devices to perform a method, the method including: receiving an input signal from one or more microphones based on captured ambient sound; processing the input signal through one or more noise reduction filters to generate a noise-reduced signal configured to reduce an effect of the input signal; comparing the input signal with an estimate of the ambient noise to determine whether the energy of the input signal is greater than the estimate of the ambient noise, wherein if the energy of the input signal is greater than the estimate of the ambient noise by a predetermined amount, suppressing changes in the noise-reduced signal; and generating an output signal to an acoustic transducer, the output signal at least partially including the noise-reduced signal, such that the acoustic transducer generates an acoustic output in accordance with the output signal.

[0014] In one example, the output signal is a weighted combination of the noise reduction signal and the pass-through signal.

[0015] In one example, comparing the input signal to the estimate of the ambient noise includes comparing the energy of the input signal to an ambient noise signal generated by a first low-pass filter, the first low-pass filter configured such that the ambient noise signal is an estimate of the ambient noise present in the captured ambient sound.

[0016] In one example, the ambient noise signal is delayed in time relative to the input signal.

[0017] In one example, the energy of the input signal is determined by the output of a second low-pass filter, the second low-pass filter providing stronger smoothing to the input signal than the first low-pass filter.

[0018] In one example, comparing the energy of the input signal further includes determining whether a difference between the output of the second low-pass filter and the ambient noise signal satisfies a threshold condition.

[0019] In one example, comparing the energy of the input signal further includes determining whether a ratio between the output of the second low-pass filter and the ambient noise signal satisfies a threshold condition.

[0020] In one example, suppressing the noise reduction signal includes temporarily ceasing to increase the magnitude of the noise reduction signal.

[0021] 20. The one or more non-transitory machine-readable storage devices of claim 18, wherein temporarily stopping increasing the magnitude of the noise-reduced signal includes temporarily stopping adjusting a variable gain filter in a pass-through processing chain that generates the pass-through signal, and the output signal is a weighted combination of the noise-reduced signal and the pass-through signal.

[0022] 12. The one or more non-transitory machine-readable storage devices of claim 11, wherein suppressing the noise reduction signal comprises adjusting a rate at which the noise reduction signal is adjusted in response to the input signal.

[0023] According to another aspect, a method includes receiving an input signal representing sound captured by a microphone of active noise reduction (ANR) headphones; processing a portion of the input signal with one or more processing devices to determine a noise level in the input signal; determining that the noise level satisfies a first threshold condition; comparing the input signal to an estimate of ambient noise to determine whether the energy of the input signal is greater than the energy of the estimate of ambient noise by a predetermined amount; generating an output signal in response to determining that the noise level satisfies the first threshold condition and that the energy of the input signal is not greater than the energy of the estimate of ambient noise by the predetermined amount, wherein ANR processing on the input signal is automatically controlled to limit the loudness level of the output signal; generating an output signal in response to determining that the energy of the input signal is greater than the estimate of ambient noise by the predetermined amount, wherein ANR processing on the input signal is not automatically controlled to limit the loudness level of the output signal; and driving an acoustic transducer of the ANR headphones using the output signal.

[0024] In one example, the step of generating an output signal, wherein ANR processing on an input signal is automatically controlled to limit the loudness level of the output signal, includes generating an output signal, wherein ANR processing on an input signal is automatically controlled to limit the loudness level of the output signal to a level lower than or substantially equal to a predefined target loudness level of the output signal.

[0025] In one example, the predefined target loudness level is the sound pressure level at the ear of a user of ANR headphones.

[0026] The details of one or more implementations are set forth in the accompanying drawings and the description below. Other features, objects, and advantages will be apparent from the description and drawings, and from the claims. [Brief explanation of the drawings]

[0027] [Figure 1] FIG. 1 is a diagram showing an example of an in-ear active noise reduction (ANR) headphone. [Figure 2] FIG. 1 is a block diagram of an exemplary configuration of an ANR device. [Figure 3A] FIG. 1 is a block diagram of an example implementation of an ANR device in which a variable pass-through path is placed in parallel with an ANR path in a feed-forward signaling path. [Figure 3B] FIG. 1 is a block diagram of an example implementation of a binaural ANR system in which the variable gain of a pass-through path in parallel with the ANR path for each ear is controlled by a coprocessor based on estimates of the noise level at both ears. [Figure 3C] FIG. 1 is a block diagram of an example implementation of an ANR device in which multiple variable pass-through paths are arranged in parallel with an ANR path in a feed-forward signaling path. [Figure 4A] FIG. 1 is a block diagram of an exemplary implementation of an impulse detector. [Figure 4B] FIG. 1 is a block diagram of an exemplary implementation of an impulse detector. [Figure 5A] 1 is a plot of an acoustic cough signal and the resulting impulse detection flag. [Figure 5B] 1 is a plot of the detected signal and the ambient noise signal resulting from an acoustic cough signal. [Figure 5C] 1 is a plot of the signal-to-noise ratio and impulse detection threshold for a detected signal resulting from an acoustic cough signal and an ambient noise signal. [Figure 6A] 10 is a plot of the acoustic signal of case closure and the resulting impulse detection flag. [Figure 6B] 1 is a plot of the detected signal and the ambient noise signal resulting from a cough case closure signal. [Figure 6C] 10 is a plot of the signal-to-noise ratio and impulse detection threshold of the detection signal resulting from the acoustic signal of the case closure and the ambient noise signal. [Figure 7A] 1 is a plot of a pink noise acoustic signal and the resulting impulse detection flag. [Figure 7B] 1 is a plot of the detected signal and the ambient noise signal resulting from a pink noise acoustic signal. [Figure 7C] 1 is a plot of the signal-to-noise ratio and impulse detection threshold for a detected signal and an ambient noise signal resulting from a pink noise acoustic signal. [Figure 8] 1 is a flowchart of an exemplary process for suppressing a noise reduction signal output from one or more noise reduction filters in response to an impulse acoustic input to a microphone, such as a feedforward microphone. DETAILED DESCRIPTION OF THE INVENTION

[0028] The present disclosure relates to the use of active noise reduction (ANR) in acoustic devices to simultaneously allow a user to perceive ambient sounds up to a threshold amount and suppress the ANR response to fast transient sounds (also referred to herein as impulses).

[0029] The techniques described herein, in some examples, enable the implementation of an ANR signaling path in parallel with a variable hear-through or pass-through signaling path, with the gain of the pass-through signaling path being controllable or adjustable based on threshold conditions or ambient noise. For example, a device implementing the present technology may be configured to pass ambient sounds up to a threshold level (possibly using some ANR processing in parallel), but enable or gradually increase ANR processing when the loudness of the ambient sounds exceeds the threshold. In some cases, this may improve the overall usage experience, for example, by helping a user avoid excessive acoustic isolation in low-noise environments while still providing ANR functionality when the noise exceeds the threshold.

[0030] Additionally, the techniques described herein can suppress ANR responses to rapid transient sounds. Noises such as applause, the clanging of silverware, the clicking of a case lid, coughing, and door slamming can all be characterized as these types of impulses. Any ANR response to an impulse will almost inevitably be slower than the impulse that triggered it, meaning the user will hear both the impulse and the delayed, brief noise reduction that follows, which can be noticeable and distracting. To avoid this type of behavior, the ANR response to an impulse can be suppressed by comparing the input signal (e.g., from a feedforward microphone) with an estimate of the ambient noise to determine whether a rapid increase in signal energy occurs. If such an increase occurs, it can be determined that ANR processing can be suppressed (e.g., temporarily frozen) to prevent an undesirable ANR response to the impulse.

[0031] By way of background, ANR devices, such as active noise reduction (ANR) headphones, are being used to potentially provide an immersive listening experience by reducing the impact of ambient noise and sounds. However, by blocking the impact of ambient noise, ANR devices can create acoustic isolation from the environment, which may be undesirable in some conditions. For example, a user waiting at an airport may want to be aware of flight announcements while using ANR headphones. In another example, a user may want to use ANR headphones to cancel out cabin noise during a flight, while still being able to communicate with flight attendants without having to remove the headphones.

[0032] Additionally, some headphones offer a feature commonly referred to as "talk-through" or "monitor," in which an external microphone is used to detect external sounds that the user wants to hear. For example, the external microphone can detect sounds in the voice band or some other frequency band of interest and enable signals in the corresponding frequency band to be sent through the headphones. Some other headphones allow multi-mode operation; in "hear-through" mode, the ANR function may be switched off or at least reduced across at least a range of frequencies, allowing a relatively broadband of ambient sounds to reach the user. However, in some cases, a user may want to be aware of ambient sounds up to a threshold and have ANR processing begin only when the ambient sounds exceed the threshold. In addition, a user may want some control over the amount of ambient sound that passes through the ANR device.

[0033] Active noise reduction (ANR) devices can include configurable digital signal processors (DSPs) that can be used to implement various signal transmission topologies and filter configurations. Examples of such DSPs are described in U.S. Pat. Nos. 8,073,150 and 8,073,151, which are incorporated herein by reference in their entireties. U.S. Pat. No. 9,082,388, also incorporated herein by reference in its entirety, describes an acoustic implementation of in-ear active noise reduction (ANR) headphones, as shown in FIG. 1. The headphones 100 include a feedforward microphone 102, a feedback microphone 104, an output transducer 106 (sometimes referred to as an electroacoustic transducer or an acoustic transducer), and a noise reduction circuit (not shown) coupled to both microphones and the output transducer to provide an anti-noise signal to the output transducer based on signals detected by both microphones. An additional input to the circuit (not shown in FIG. 1) provides an additional audio signal, such as music or a communication signal, for playback through the output transducer 106 independent of the noise reduction signal. The additional input may be a wired or wireless (e.g., Bluetooth) connection to an audio source.

[0034] The term headphones is used interchangeably herein with the term headset and includes various types of personal acoustic devices, such as in-ear, around-ear, or over-ear headsets, earphones, and hearing aids. A headset or headphones can include an earbud or earcup for each ear. The earbuds or earcups may be physically tethered to each other, for example, by a cord, an overhead bridge or headband, or a behind-the-head retention structure. In some implementations, the earbuds or earcups of a headphone may be connected to each other via a wireless link.

[0035] Various signaling topologies can be implemented in ANR devices to enable functions such as audio equalization, feedback noise cancellation, and feedforward noise cancellation. For example, as seen in the example block diagram of ANR device 200 in FIG. 2 , the signaling topology can include a feedforward signaling path 110 that drives output transducer 106 to generate an anti-noise signal (e.g., using feedforward compensator 112) to reduce the effect of noise signals picked up by feedforward microphone 102. In another example, the signaling topology can include a feedback signaling path 114 that drives output transducer 106 to generate an anti-noise signal (e.g., using feedback compensator 116) to reduce the effect of noise signals picked up by feedback microphone 104. The signaling topology can also include an audio path 118 that includes circuitry (e.g., equalizer 120) for processing an input audio signal 108, such as music or a communication signal, for playback through output transducer 106. In some implementations, the feedforward compensator 112 may include an ANR signaling path arranged in parallel with the pass-through path. An example of such a configuration is described in U.S. Patent No. 10,096,313, the entire contents of which are incorporated herein by reference.

[0036] In some implementations, the output of the output transducer 106 may be adjusted according to the desired final volume or loudness at the ear, such that the amount of overall attenuation provided by the ANR device (e.g., obtained by controlling one or both of the ANR signal path and the pass-through signal path) increases and decreases as the ambient noise level increases and decreases, respectively. For example, when the ambient sound level does not meet a threshold condition (e.g., below the threshold level), the ambient sound may be allowed to pass to the ear with little or no attenuation. On the other hand, when the ambient sound level meets the threshold condition (e.g., above the threshold level), the ambient sound may be attenuated, possibly progressively (i.e., with more attenuation as the environment becomes noisier).

[0037] 3A is a block diagram of an exemplary implementation of an ANR device 300, in which a variable pass-through path is arranged in parallel with the ANR path in a feed-forward signal transmission path to provide the variable attenuation described above. Specifically, the device 300 includes an ANR filter 305 (also referred to as KAW) arranged in parallel with the combination of a pass-through filter 310 (also referred to as KAW) and a detector filter 315 (also referred to as a side-chain filter Kd). The detector filter 315 monitors a signal captured using the FF microphone 102 and can be used to control the input to the pass-through filter (e.g., using a variable gain amplifier (VGA) or compressor 320). In some implementations, the input to the detector filter 315 can be pre-processed, for example, to make the detector filter 315 more sensitive to certain types of signals. For example, the side-chain filter can be configured to make the detector filter more sensitive to perceptually weighted voice-band noise level changes. The output of the detector filter 315 may be used to adjust the VGA 320 , which applies a gain to the input signal provided to the pass-through filter 310 .

[0038] In some implementations, the detector filter 315 may include a frequency weighting filter (e.g., an A-weighting filter and / or a filter representing a head-related transfer function (HRTF)). The detector filter 315 may also include a level generator that converts the output of the frequency weighting filter to a signal level, which is then compared to a threshold level (e.g., a user-defined or predetermined level). The detector filter 315 may also include a signal generator configured to generate a control signal that controls the gain of the VGA 320. In some implementations, the signal generator may be configured to generate the control signal according to target attack and decay rate dynamics. The "attack rate" is defined as the rate at which the attenuation increases. In some implementations, the target attack rate is less than 100 dB per second (in terms of overall insertion gain), such as approximately 10 dB / second. The "decay rate" or "release rate" is defined as the rate at which the attenuation decreases. In some implementations, the decay rate is more than two times faster than the attack rate. In some implementations, a combination of a low threshold (e.g., an insertion gain of less than 80 dBA) and a low attack rate (e.g., less than 100 dB / sec) may be used for a comfortable usage experience in various scenarios of daily life.

[0039] In some implementations, the detector filter 315 may be configured to control the VGA or compressor 320 according to a threshold condition. The threshold condition may be preset or set in response to user input. In some implementations, if the detector filter 315 determines that the ambient noise level is below a certain threshold, the output of the detector filter 315 controls the compressor or VGA 320 so that the gain of the pass-through signal path is substantially equal to 1. This allows the user to hear ambient sounds with substantially little or no attenuation. In some implementations, if the detector filter determines that the ambient noise level is equal to or greater than a certain threshold, the output of the filter 315 may be configured to control the compressor or VGA 320 so that the overall gain of the pass-through signal path is less than 1 and the output of the ANR filter 305 provides noise attenuation at the ear. This allows the user to recognize environmental noises and sounds when the noise is below the threshold, but utilize the ANR functionality of the headset when the noise exceeds the threshold to prevent loud sounds, such as from vehicles, sirens, or machinery, from becoming uncomfortably loud.

[0040] While the example of FIG. 3A shows a VGA placed only in the pass-through signal path, other variations are possible. For example, a VGA may be placed in the ANR path in addition to, or instead of, VGA 320 placed in the pass-through signal path. In some implementations, a VGA placed in a signal path (e.g., the ANR path or the pass-through path) may be controlled to adjust a weight associated with the corresponding path. For example, the VGA gain may be set substantially equal to 0, causing the weight associated with the corresponding path to be substantially equal to 0. In some implementations, one or more additional parameters associated with the VGA (or the corresponding path in general) may be adjusted to control one or more characteristics of the corresponding path. For example, the response speed of the VGA (which may also be referred to as the compressor attack time and release time, corresponding to whether compression is gradually increased or decreased, respectively) may be adjusted to provide either a rapid response or a relatively gradual response to changing noise levels. In some implementations, this can dictate how quickly the ANR device adjusts the gain when the noise level meets a threshold condition and / or how quickly the ANR device reduces or restores the gain to a predetermined level (e.g., 1) when the noise level no longer meets the threshold condition. In some implementations, the response rate can be adjusted based on the target attack rate so that the ANR process responds smoothly to increases in noise level. In some implementations, the target attack rate can be less than 100 dB / second.

[0041] In some implementations, the outputs of the ANR path and the pass-through path are combined (e.g., in a weighted combination) to generate a feedforward signal 325 that at least partially drives the acoustic transducer 106. In some implementations, the feedforward signal 325 may be combined with a feedback signal 330 and / or one or more other signals 335. The signals 335 may include, for example, a media signal derived from the audio input 108 or signals from one or more other microphones or audio sources.

[0042] In some implementations, the gain controls of the VGA or compressor 320 in each of the two separate earbuds or earcups are matched to avoid, for example, having substantially unequal noise reduction in the two earbuds / earcups of headphones. Figure 3B is a block diagram of an example implementation of a binaural ANR system 350 in which the variable gain of a pass-through path located in parallel to the ANR path for each ear is controlled based on estimates of the noise level at both ears. Specifically, the implementation shown in Figure 3B includes a coprocessor 360 that receives input from a noise estimator module 355 located in each of the two earbuds or earcups 352a and 352b (collectively 352) and matches the gain controls of the corresponding VGA or compressor 320 in the two earbuds or earcups 352. In some implementations, the coprocessor 360 is located in one of the earbuds or earcups 352. In some implementations, the coprocessor 360 may be located in a device external to the headphones, such as in the device that is the source of the acoustic media being played through the headphones. The coprocessor may include one or more processing devices configured to analyze the input received from the noise estimator 355 and generate a gain control signal for the VGA 320.

[0043] In some implementations, the noise estimator 355 comprises one or more digital filters configured to generate a signal that provides an estimate of the noise at the corresponding earbud or earcup 352 location. For example, the noise estimator 355 may include a front-end weighting filter that emphasizes the portion of the spectrum that is most indicative of how loud a sound is perceived to be. In some implementations, the response of the front-end weighting filter approximates A-weighting divided by a head-related transfer function (HRTF) (or another function that accounts for the effects of the user's head presence / orientation) to relate the noise signal measured at the headphone ear microphone to the diffuse field. Other front-end weighting filters, such as B- or C-weighting, are possible, or more sophisticated loudness models may be used. In some implementations, the front-end weighting filter may be used to compensate for hardware effects (e.g., microphone sensitivity). In some implementations, the front-end weighting filter may include multiple cascaded filters, each accounting for / compensating for separate effects (e.g., head presence / orientation effects, hardware effects, and / or A-weighting). The output of the weighting filter may be an AC signal representing the relative loudness perceived at the corresponding ear. Such output may then be post-processed (e.g., by rectification and then low-pass filtering) before being provided to coprocessor 360 as an estimate of the noise level at the corresponding ear.

[0044] 3A and 3B may be implemented as part of a multi-band system with two or more parallel paths, each with its own VGA 320 and pass-through filter KAW 310, all arranged in parallel with the KAWNR 305. An example of such a device is shown in FIG. 3C, which shows a multi-band version of the device of FIG. 3A. Specifically, FIG. 3C is a block diagram of an exemplary implementation of an ANR device 375 in which multiple variable pass-through paths are arranged in parallel with the ANR path in the feed-forward signaling path. Each path includes a corresponding pass-through filter (one of 310a, ..., and 310n (collectively 310)), a corresponding detector filter (one of 315a, ..., and 315n (collectively 315)), and a corresponding VGA (one of 320a, ..., and 320n (collectively 320)). Each pass-through filter 310 passes a different portion of the desired pass-through spectrum (filtered using one of the corresponding band-pass filters 380a, ..., and 380n) so that the overall desired "perceptual" response is achieved when all VGAs 320 have unity gain. In some implementations, various parameters of the different parallel paths may be configured separately. For example, a particular parallel path may be configured to have unique attack and release rates, compression ratios, and / or thresholds appropriate for the corresponding frequency band. In some implementations, one or more parameters, such as thresholds and compression ratios, may be common across multiple parallel paths, but the corresponding attack and release rates may be different. This may allow for frequency-specific fine-tuning of the ANR device's response. For example, the device may be configured to have a fast response to high-frequency noise spikes, but a relatively slow response to low-frequency noise. In some implementations, the parameters of the different paths may be user-adjustable.

[0045] In some implementations, the components of the feedforward signal path 110 may be adjusted in various ways to generate the feedforward signal 325. Such methods of adjustment, as well as plots illustrating some example variations in ANR processing in the feedforward signal path 110 based on different threshold conditions, are provided in U.S. Pat. No. 11,087,776, which is incorporated herein by reference in its entirety.

[0046] In certain examples, the response of the ANR pathway may be briefly suppressed to avoid responding to a detected impulse (i.e., a rapid transient signal characterized by a sudden increase in noise and a corresponding sudden decrease, typically within 1-2 ms). To suppress the ANR response to an impulse, it is first necessary to distinguish between the impulse and ambient noise (i.e., noise that should ideally be filtered out, such as the low-frequency rumble of aircraft noise or the sound of a passing motorcycle). To accomplish this, the detector filter 315 may be further configured to compare the energy in each sample (i.e., the sample under test) with an estimated energy of ambient noise. The ambient noise may be estimated by characterizing the energy in adjacent samples. If the energy of the sample under test is greater than the energy of adjacent samples by a predetermined amount, it may be concluded that a large spike in energy has occurred, indicating an impulse. Of course, impulses that are not greater than the ambient noise may occur; in these cases, the impulse is likely to be imperceptible above the ambient noise and should not interfere with the ANR gain. (Although described with reference to detector filter 315, it should be understood that impulse detection may be performed at any suitable location within the topology.)

[0047] The energy in adjacent samples may be estimated in various ways. In one example, a buffer of samples may be stored and their respective values ​​averaged. The buffer of samples may include samples before the sample under test, samples after the sample under test, or both. In either case, it is typically useful, although not necessary, to exclude the sample under test itself from the average, as this would tend to skew the average value relative to the measured sample under test. In an alternative example, rather than using a buffer of samples, an exponential moving average may be used to average the current sample with a weighted average of the previous samples.

[0048] Alternatively, rather than operating in the time domain, the input signal may be transformed into the frequency domain (e.g., via a DFT or other suitable frequency transform). An ambient noise estimate may be determined from examining the average power at the resulting frequencies, or the average power in a subset of frequency bins of interest. This average power may be updated (e.g., by an exponential moving average) for each successive frame of frequency bins (i.e., for each new sample), or may be calculated independently for each frame. Any given bin or set of bins that exceeds the calculated ambient noise may be flagged as an impulse. However, these methods are relatively memory intensive and computationally expensive.

[0049] In an alternative example shown in FIG. 4A , two low-pass filters can be used in parallel paths. The low-pass filters in the two paths can operate to smooth the input signal at different rates. For example, low-pass filter 402 can apply stronger smoothing to the input signal than low-pass filter 404, resulting in a signal representing an estimate of the ambient noise. (Accordingly, in this example, the output of this low-pass filter 402 is referred to as ambient noise signal 406.) More specifically, the output of low-pass filter 404 can, in some examples, be optimized similarly to an exponential moving average to provide an approximate average value of samples within a sliding window. Furthermore, in various examples, the output of low-pass filter 402 can be scaled and / or otherwise processed to optimize it to appropriately represent the ambient noise. In these examples, ambient noise signal 406 is not simply the output of low-pass filter 402, but rather the cumulative output of the processing performed to estimate the ambient noise. In contrast, the output of low-pass filter 404 can be smoothed relatively quickly and operate as an envelope detector to characterize the peak values ​​of the input signal. This filter functions to stretch the impulse to make it easier to capture an estimate of the peak and compare it to the ambient noise estimate. The output of this filter 404 is referred to as the detected signal 408. Similarly, the detected signal 408 may be the result of additional processing to characterize the energy of the sample under test to aid in detecting the impulse. Furthermore, in some examples, the low pass filter 404 may be omitted, and the input signal may be used directly for comparison with the ambient noise signal 406. For purposes of this disclosure, in examples in which the low pass filter 404 is omitted, the input signal will be the detected signal 408.

[0050] In general, any suitable low-pass filters can be used for low-pass filters 402 and 404. Furthermore, different cutoff frequencies can be selected for low-pass filters 402 and 404 to achieve different smoothing characteristics. For example, the cutoff frequency of low-pass filter 402 can be set to 5 Hz and the cutoff frequency of low-pass filter 404 can be set to 100 Hz, although other suitable cutoff frequencies can be used. In various examples, the input signal can alternatively be filtered using an FIR Hilbert transform or a whitening filter, which can help remove any spectral shape of the environmental noise to provide more robust impulse detection (although these examples may require more processing power than is typically available).

[0051] Because the ambient noise signal 406 represents an estimate of the ambient noise, the presence of an impulse may be detected by comparing the detection signal 408 to the ambient noise signal 406. The comparison of the detection signal 408 to the ambient noise signal 406 may be accomplished in one of a variety of ways. In one example, the difference between the detection signal 408 and the ambient noise signal 406 may be found by a difference module 410, the output of which is input to a comparator 412, which compares the difference between the signals to a threshold. If the difference between the signals is greater than the threshold, the input signal may be flagged as likely to contain an impulse, or at least the start of a new sustained noise. In an alternative example, rather than finding the difference between the detection signal 408 and the ambient noise signal 406, the ratio of the two signals may be found and compared to a threshold to determine whether the ratio indicates an impulse. (This method is similar to comparing the signal-to-noise ratio of the two signals to a threshold.) Other suitable methods of comparing the detection signal 408 to the ambient noise signal 406 that provide some indication of how loud the detection signal 408 is relative to the ambient noise signal 406 are contemplated herein.

[0052] 4B, to better represent the ambient noise, the output of the low pass filter 402 can be delayed by a predetermined amount (e.g., 2 ms) using a delay 414 to prevent the sample under test from affecting the ambient noise signal 406 to which it is compared. In other words, by applying a delay, the ambient noise signal represents the ambient noise present before the current sample and therefore better represents the ambient noise to which the signal is to be compared. Typically, such a delay is useful for capturing all but very fast energy impulses that can be captured without such a delay.

[0053] 4A and 4B, the input signal applied to low-pass filter 402 and low-pass filter 404 may be the absolute value (e.g., a rectified version) of the feedforward microphone 102 output. This is to prevent naturally oscillating audio signals from corrupting the average value of the ambient noise and to ensure that the detected signal 408 and the ambient noise signal 406 have the same sign when compared. Furthermore, it should be understood that additional processing (e.g., a high-pass filter) may be performed on the input signal before it is received at low-pass filters 402 and 404 so that impulses can be more reliably detected or for any other suitable reason.

[0054] In response to the output of the comparator 412 indicating that an impulse may be present, the ANR response that would have resulted from the feedforward microphone output sample containing the detected impulse can be suppressed. However, if the output of the comparator 412 does not indicate that an impulse may be present, the ANR output is not suppressed; instead, the system follows parameters to apply ANR according to a threshold condition or some other metric, as described above. If the flagged sample is not an impulse but the start of a new, sustained noise (e.g., an approaching motorcycle), the initial sample containing the new, sustained noise will be higher than the ambient noise and therefore initially flagged as an impulse. However, as the ambient noise continues, the ambient noise signal rapidly increases to the level of the detected signal, meaning that the comparison of the two signals only temporarily exceeds the threshold condition. The time constant of the ANR filter is typically such that the delay is not noticeable to the user.

[0055] To further improve the performance of the impulse detection, each sample that exceeds the threshold can be zeroed or otherwise processed so that the detected impulse does not affect the ambient noise signal 406. In other words, during the delay implemented by the delay unit 414, the detected energy of the impulse can be removed so that the detected impulse does not affect the background noise measurement for future samples.

[0056] To demonstrate the operation of impulse detection, FIGS. 5-7 depict various recorded speech signals, the output detection signal 408 and the ambient noise signal 406, and the calculated signal-to-noise ratio between the two. FIG. 5A shows the input speech signal of a person coughing at fairly regular intervals (approximately 1-second intervals). FIG. 5B shows the detection signal 408 and the ambient noise signal 406 delayed by 2 ms. As shown, the ambient noise signal 406 uses a greater amount of smoothing so that sharp peaks in the input signal are not captured. Furthermore, to the extent that peaks in the input signal are captured, they are delayed by 2 ms, so that the discrepancy between the captured peaks in the detection signal 408 is compared to the ambient noise that existed before the onset of the cough. As a result, as shown in FIG. 5C, the peak at the onset of the cough is sufficient to generate a large difference between the detection signal 408 and the ambient noise signal 406, thus triggering the detection flag (shown in FIG. 5A) and suppressing the ANR response. Note that in this example, the detection flag is held high for a predetermined period of time after the SNR exceeds the 15 dB threshold to ensure that the full duration of the ANR responds to the impulse.

[0057] Similarly, Figures 6A-6C show the output of the feedforward microphone 102 in response to periodic closure of the case. Figure 6B shows the detected signal 408 and the resulting ambient noise signal 406, which, like the cough signal in Figure 5A, results in an initial peak in the detected signal that exceeds a predetermined threshold and is sufficient to generate the SNR in Figure 6C that sets a flag to suppress the ANR response.

[0058] In contrast, FIG. 7A shows an audio signal resulting from a phone that begins playing pink noise at approximately the 0.75 second mark and is then rocked back and forth near the feedforward microphone 102. As shown, at the initial onset of the pink noise audio signal, a spike in the detected signal 408 relative to the ambient noise signal 406 (FIG. 7B) records an SNR that triggers suppression of the ANR response in FIG. 7C. However, subsequent changes in the audio signal resulting from rocking the phone back and forth do not produce a difference between the detected signal 408 and the ambient noise signal 406 that is large enough to exceed the SNR threshold. This demonstrates that although the initial onset of new, persistent ambient noise triggers and briefly delays the ANR response, the ambient noise signal 406 can quickly adapt, allowing the ANR response to reduce the ambient noise as desired.

[0059] ANR suppression can be performed in any number of suitable ways, depending in part on the implementation of the ANR / pass-through system. In one example, an interrupt signal can be generated that temporarily freezes the adjusting VGA 320, so that the ANR response is held constant until a period of time has passed during which an adjustment resulting from an impulse is made. Alternatively, the response time of the VGA 320 associated with the signal path can be adjusted, for example, as described with reference to FIG. 3A. The response speed of the VGA 320 can be modified so that the ANR adjusts relatively slowly in response to the sample under test, making the ANR change less noticeable or imperceptible to the user. For purposes of this disclosure, suppressing the ANR response should be understood to mean reducing the ANR response relative to how it would occur during normal operation in response to an impulse (i.e., without intervention from impulse detection). Thus, holding the ANR response constant once an impulse is detected or slowing the response to an impulse are both considered to "suppress" the ANR response.

[0060] Depending on the topology of the ANR system, suppressing the ANR response may involve adjusting or holding constant a VGA at the input or output of the ANR filter. Additionally, adjustments can be made to the ANR filter itself, such as adjusting its adaptation rate so that it does not adapt to the incoming impulse, or so that it adapts very slowly. Other suitable methods of suppressing the ANR response, such as filtering input samples from the ANR filter input, are contemplated and are within the scope of this disclosure.

[0061] Furthermore, in an alternative example, rather than suppressing the entire ANR response, the ANR response can be adjusted to mitigate the effects of overloading the transducer 106 in response to a large input signal. Large input signals tend to clip the microphone, which in turn generates audible transients in the voltage signal applied to the transducer. Large inputs also tend to result in a large ANR response that overloads the transducer 106. Overloading of the transducer 106 can be mitigated by reducing the ANR filter gain in certain portions of the frequency range (e.g., very high or low frequencies). Other means of mitigating transducer overload are also possible and, like the example of suppressing the ANR output, depend in part on the topology of the ANR / pass-through system.

[0062] The impulse detection described in this disclosure may be further employed to control the operation of a device such as headset 100. For example, a digital signal processor may be further programmed to monitor an impulse detection flag for a set of impulses corresponding to a pre-defined user input. As an example, the digital signal processor may be programmed to consider two separate impulses approximately ½ second apart as a user command, such as pausing a track or skipping to the next track. This is provided merely as an example of the types of impulses that may be considered user commands. In general, it will be beneficial to select impulses that a user can easily generate, for example, by clicking their tongue, and that are unlikely to occur except as an intentional command.

[0063] FIG. 8 is a flow chart of an exemplary process 800 for suppressing a noise reduction signal output from one or more noise reduction filters in response to an impulse acoustic input to a microphone, such as a feedforward microphone.

[0064] At least a portion of process 800 may be implemented using one or more processing devices, such as a DSP, as described in U.S. Patent Nos. 8,073,150 and 8,073,151, which are incorporated by reference herein in their entireties. In some implementations, process 800 may be implemented in a device that includes signal paths substantially similar to those shown in FIGS. 3-4.

[0065] In step 802, an input signal is received from one or more microphones based on the captured ambient sound. The microphones may be, for example, feedforward microphones, such as feedforward microphone 102. In step 804, the input signal is processed through one or more noise reduction filters (e.g., ANR filters) to generate a noise-reduced signal, the noise-reduced signal configured to reduce the effect of the input signal.

[0066] In step 806, the input signal is compared with the ambient noise estimate to determine whether the energy of the input signal is greater than the ambient noise estimate. The ambient noise estimate can be estimated in various ways. For example, a buffer of samples can be stored, and each averaged value or an exponential moving average can be used to average the current sample with a weighted average as in the previous example. Alternatively, the input signal can be transformed into the frequency domain, and the power of bins or a subset of bins can be averaged to determine the ambient noise estimate. In yet another example, a low-pass filter, such as that shown in Figures 4A and 4B, can be used to smooth the input signal and form and estimate the ambient noise.

[0067] The energy of the input signal (which may itself be output from a low-pass filter such as shown in Figures 4A and 4B) may be compared to an estimate of the ambient energy, for example, by finding the difference or ratio between the energy of the input signal and the estimated ambient energy.

[0068] If, in step 808, it is determined that the energy of the input signal is greater than the estimate of the ambient noise by a predetermined amount, then the noise reduction signal is suppressed. The result of the comparison in step 806 may be compared to a threshold to determine whether it indicates an impulse (or at least the onset of a sustained noise). If the comparison exceeds the threshold, action may be taken to suppress the noise reduction signal.

[0069] ANR suppression can be accomplished in any number of suitable ways, depending in part on the implementation of the ANR / pass-through system. In the example of FIGS. 3-4, an interrupt signal can be generated that temporarily freezes the adjustment of the variable gain amplifier, so that the ANR response is held constant until a period of time has passed during which the impulse-induced adjustment occurs. Alternatively, the response time of the VGA 320 associated with the signal path can be adjusted, for example, as described with reference to FIG. 3A. The response rate of the VGA 320 can be modified so that the ANR adjusts relatively slowly in response to the sample under test, making the ANR change less noticeable or imperceptible to the user.

[0070] Furthermore, depending on the topology of the ANR system, suppressing the ANR response may also involve adjusting or holding constant a VGA at the input or output of the ANR filter. Additionally, adjustments can be made to the ANR filter itself, such as adjusting its adaptation rate so that it does not adapt to the incoming impulse. Other suitable methods of suppressing the ANR response, such as filtering input samples from the ANR filter input, are contemplated and are within the scope of this disclosure.

[0071] In step 810, an output signal is generated for the acoustic transducer, the output signal including at least in part the noise reduction signal, such that the acoustic transducer generates an acoustic output in accordance with the output signal.

[0072] The functionality or portions thereof, and various modifications thereof (hereinafter "functionality") described herein may be implemented, at least in part, via a computer program product, e.g., a computer program tangibly embodied in one or more information-bearing media, such as one or more non-transitory machine-readable media or storage devices, for execution by or to control the operation of one or more data processing devices, e.g., programmable processors, computers, multiple computers, and / or programmable logic components.

[0073] The computer program may be written in any form of programming language, including compiled or interpreted languages, and it may be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. A computer program may be deployed to run on one computer, on multiple computers at one site, or distributed across multiple sites and interconnected by a network.

[0074] The operations associated with implementing all or a portion of the functionality may be performed by one or more programmable processors executing one or more computer programs to realize the functionality of the calibration process. All or a portion of the functionality may be implemented as special purpose logic circuitry, such as an FPGA and / or an ASIC (Application Specific Integrated Circuit).

[0075] Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read-only memory or a random-access memory or both. Elements of a computer include a processor for executing instructions and one or more memory devices for storing instructions and data.

[0076] Elements of different implementations described herein may be combined to form other embodiments not specifically described above. Elements may be removed from the structures described herein without adversely affecting the operation of the structures described herein. Furthermore, various separate elements may be combined into one or more individual elements to achieve the functions described herein. [Explanation of symbols]

[0077] 100 headphones 102 Feedforward Microphone 104 Feedback Microphone 106 Output Transducer 108 Input Audio Signal 110 Feedforward Signal Path 112 Feedforward Compensator 114 Feedback Signaling Pathways 116 Feedback Compensator 118 Audio Path 120 Equalizer 200 ANR devices 300 ANR devices 305 ANR filter 310 Pass-Through Filter 315 Detector Filter 320 VGA 325 Feedforward Signal 330 Feedback Signal 335 Signal 350 Binaural ANR System 352 ear cup 355 Noise Estimator 360 coprocessor 375 ANR Device 380 Bandpass Filter 402 Low-pass filter 404 filter 406 Ambient Noise Signal 408 Detection Signal 410 Diff Module 412 Comparator 414 Delay 416 Absolute Value

Claims

1. 1. An apparatus comprising: Noise-reducing headphones comprising one or more microphones and an acoustic transducer, the one or more microphones configured to generate an input signal based on captured ambient sound; a controller including one or more processing devices, said controller comprising: processing the input signal through one or more noise reduction filters to generate a noise reduction signal configured to reduce an effect of the input signal; comparing the input signal with the estimate of ambient noise to determine if the energy of the input signal is greater than the estimate of ambient noise, and inhibiting the change in the noise reduction signal if the energy of the input signal is greater than the estimate of ambient noise by a predetermined amount; 10. An apparatus configured to generate an output signal that includes, at least in part, the noise reduction signal, the acoustic transducer configured to generate an acoustic output in accordance with the output signal.

2. The apparatus of claim 1 , wherein the output signal is a weighted combination of the noise reduction signal and a pass-through signal.

3. 2. The apparatus of claim 1, wherein comparing the input signal with an estimate of ambient noise comprises comparing the energy of the input signal with an ambient noise signal generated by a first low-pass filter, the first low-pass filter being configured such that the ambient noise signal is an estimate of the ambient noise present in the captured ambient sound.

4. The apparatus of claim 1 , wherein the ambient noise signal is delayed in time relative to the input signal.

5. 4. The apparatus of claim 3, wherein the energy of the input signal is determined by the output of a second low-pass filter, the second low-pass filter providing stronger smoothing to the input signal than the first low-pass filter.

6. 6. The apparatus of claim 5, wherein comparing the energy of the input signal further comprises determining whether a difference between the output of the second low pass filter and the ambient noise signal meets a threshold condition.

7. 6. The apparatus of claim 5, wherein comparing the energy of the input signal further comprises determining whether a ratio between the output of the second low pass filter and the ambient noise signal satisfies a threshold condition.

8. The apparatus of claim 1 , wherein suppressing the noise reduction signal comprises temporarily ceasing to increase the magnitude of the noise reduction signal.

9. 9. The apparatus of claim 8, wherein temporarily stopping increasing the magnitude of the noise-reduced signal comprises temporarily stopping adjusting a variable gain filter in a pass-through processing chain that generates a pass-through signal, and wherein the output signal is a weighted combination of the noise-reduced signal and the pass-through signal.

10. The apparatus of claim 1 , wherein suppressing the noise reduction signal comprises adjusting a rate at which the noise reduction signal is adjusted in response to the input signal.

11. One or more non-transitory machine-readable storage devices encoded with computer-readable instructions for causing one or more processing devices to perform a method, the method comprising: receiving an input signal from one or more microphones based on the captured ambient sound; processing the input signal through one or more noise reduction filters to generate a noise reduction signal configured to reduce an effect of the input signal; comparing the input signal with the estimate of ambient noise to determine if the energy of the input signal is greater than the estimate of ambient noise, and inhibiting changes to the noise reduction signal if the energy of the input signal is greater than the estimate of ambient noise by a predetermined amount; generating an output signal to an acoustic transducer, the output signal including at least in part the noise reduction signal, such that the acoustic transducer generates an acoustic output in accordance with the output signal.

12. The one or more non-transitory machine-readable storage devices of claim 11 , wherein the output signal is a weighted combination of the noise-reduced signal and a pass-through signal.

13. 12. The one or more non-transitory machine-readable storage devices of claim 11, wherein comparing the input signal with an estimate of ambient noise includes comparing the energy of the input signal with an ambient noise signal generated by a first low-pass filter, the first low-pass filter configured such that the ambient noise signal is an estimate of the ambient noise present in the captured ambient sound.

14. The one or more non-transitory machine-readable storage devices of claim 11 , wherein the ambient noise signal is delayed in time relative to the input signal.

15. 14. The one or more non-transitory machine-readable storage devices of claim 13, wherein the energy of the input signal is determined by an output of a second low-pass filter, the second low-pass filter providing stronger smoothing to the input signal than the first low-pass filter.

16. 16. The one or more non-transitory machine-readable storage devices of claim 15, wherein comparing the energy of the input signal further comprises determining whether a difference between the output of the second low-pass filter and the ambient noise signal meets a threshold condition.

17. 16. The one or more non-transitory machine-readable storage devices of claim 15, wherein comparing the energy of the input signal further comprises determining whether a ratio between the output of the second low-pass filter and the ambient noise signal satisfies a threshold condition.

18. 16. The one or more non-transitory machine-readable storage devices of claim 15, wherein suppressing the noise reduction signal comprises temporarily ceasing to increase the magnitude of the noise reduction signal.

19. 20. The one or more non-transitory machine-readable storage devices of claim 18, wherein temporarily stopping increasing the magnitude of the noise-reduced signal comprises temporarily stopping adjusting a variable gain filter in a pass-through processing chain that generates a pass-through signal, and wherein the output signal is a weighted combination of the noise-reduced signal and the pass-through signal.

20. 12. The one or more non-transitory machine-readable storage devices of claim 11, wherein suppressing the noise reduction signal comprises adjusting a rate at which the noise reduction signal is adjusted in response to the input signal.

21. 1. A method comprising: receiving an input signal representing sound captured by a microphone of an active noise reduction (ANR) headphone; processing a portion of the input signal with one or more processing devices to determine a noise level in the input signal; determining that the noise level satisfies a first threshold condition; comparing the input signal with the estimate of ambient noise to determine whether the energy of the input signal is greater than the energy of the estimate of ambient noise by a predetermined amount; generating an output signal in response to determining that the noise level satisfies the first threshold condition and that the energy of the input signal is not greater than the energy of the estimate of the ambient noise by the predetermined amount, wherein ANR processing on the input signal is automatically controlled to limit the loudness level of the output signal; generating an output signal in response to determining that the energy of the input signal is greater than the estimate of the ambient noise by the predetermined amount, wherein ANR processing on the input signal is not automatically controlled to limit the loudness level of the output signal; and driving an acoustic transducer of the ANR headphone using the output signal.

22. generating an output signal, wherein ANR processing on the input signal is automatically controlled to limit the loudness level of the output signal, comprising:

22. The method of claim 21, comprising generating an output signal, wherein ANR processing on the input signal is automatically controlled to limit the loudness level of the output signal to a level below or substantially equal to a predefined target loudness level of the output signal.

23. 23. The method of claim 22, wherein the predefined target loudness level is a sound pressure level at the ear of a user of the ANR headphones.

Images