Automatic adaptive noise cancellation for electronic devices

By using adjustable mixing curve technology in electronic devices, combining direct audio signals and active noise cancellation signals, the balance between noise cancellation and ambient sound transmission is solved, and efficient noise management and user experience in different usage scenarios is achieved promote.

CN119068893APending Publication Date: 2024-12-03APPLE INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410689866.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2024-05-06
Filing Date
2024-05-30
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

When using noise cancellation technology, existing electronic devices have difficulty balancing the transmission of noise cancellation with ambient sound, resulting in users not being able to clearly hear important sounds such as conversations or notifications in some cases.

Method used

By introducing an adjustable mixing curve in electronic devices, combining the through audio signal and active noise cancellation signal, the signal mixing ratio is dynamically adjusted according to the operating status of the device and the ambient sound level, ensuring a flat frequency response auditory in different usage scenarios Experience.

Benefits of technology

While noise cancellation is achieved, users can clearly hear important sounds in the environment, improve the flexibility and adaptability of the user experience, and meet the needs of different usage scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119068893A_ABST
    Figure CN119068893A_ABST
Patent Text Reader

Abstract

Aspects of the subject technology provide for auto-adaptive noise cancellation, which may be provided with a substantially flat frequency response. In one or more implementations, a noise cancellation signal is combined with a pass-through audio signal at a ratio based on mixing curve control. The blending curve may be one of a plurality of blending curves defined for a plurality of respective operating states of the electronic device.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of priority to U.S. Provisional Patent Application No. 63 / 470,818, filed on June 2, 2023, entitled “AUTOMATIC ADAPTIVE NOISECANCELLATION FOR ELECTRONIC DEVICES,” the disclosure of which is hereby incorporated herein in its entirety. Technical Field

[0003] The present specification relates generally to electronic devices, including, for example, automatic adaptive noise cancellation for electronic devices. Background Art

[0004] An electronic device may include one or more microphones. The one or more microphones may generate an audio signal including sounds from one or more sources in the physical environment of the electronic device. Some electronic devices have the ability to generate an anti-noise signal to acoustically cancel the sounds from the one or more sources. BRIEF DESCRIPTION OF THE DRAWINGS

[0005] Certain features of the subject technology are set forth in the appended claims. However, for purposes of explanation, several embodiments of the subject technology are set forth in the following figures.

[0006] Figure 1 Diagrams of exemplary electronic devices are shown that may implement aspects of the subject technology according to one or more implementations.

[0007] Figure 2 A diagram is shown of another exemplary electronic device that can implement aspects of the subject technology according to one or more implementations.

[0008] Figure 3 A block diagram of an audio signal processing architecture for an electronic device according to one or more implementations is shown.

[0009] Figure 4 According to one or more specific implementations, Figure 3 Additional details are provided in the audio signal processing architecture.

[0010] Figure 5 Various examples of blending curves are shown according to one or more implementations.

[0011] Figure 6 A block diagram of another audio signal processing architecture for an electronic device is shown according to one or more implementations.

[0012] Figure 7Examples of modification of blending curves based on user input according to one or more implementations are shown.

[0013] Figure 8 An exemplary user interface for providing user input to adjust the amount of ambient sound in an automatic adaptive noise cancellation operation is shown in accordance with one or more implementations.

[0014] Fig. 9 According to one or more specific implementations, a method based on using Figure 8 Additional examples of modifications to blending curves by user input from a user interface of FIG.

[0015] Fig.10 Examples of gain curves according to one or more implementations are shown.

[0016] Fig.11 According to one or more specific implementations, Figure 6 Additional details are provided in the audio signal processing architecture.

[0017] Fig.12 According to one or more specific implementations, Fig.11 Additional details are provided in the audio signal processing architecture.

[0018] Fig.13 A flow chart of an exemplary process for automatic adaptive noise cancellation is shown in accordance with one or more implementations.

[0019] Fig.14 Exemplary electronic systems are shown that can be used to implement various aspects of the subject technology in accordance with one or more implementations. DETAILED DESCRIPTION

[0020] The specific description shown below is intended to be a description of various configurations of the subject technology and is not intended to represent the only configuration that the subject technology can be practiced. The accompanying drawings are incorporated herein and constitute a part of the detailed description. The detailed description includes specific details intended to provide a thorough understanding of the subject technology. However, the subject technology is not limited to the specific details described herein, and one or more other specific implementations can be used to practice. In one or more specific implementations, structures and components are shown in block diagram form to avoid blurring the concepts of the subject technology.

[0021] Audio devices such as headphones and / or earbuds may provide active noise cancellation (ANC), wherein a microphone of the headphones and / or earbuds (and / or a connected electronic device) receives an audio signal including ambient noise from the environment surrounding the headphones and / or earbuds, and the audio device generates an anti-noise signal that, when output by a speaker, cancels some or all of the ambient noise before it is received in the user's ear canal.

[0022] However, in some use cases, the physical body of the audio device and / or the active noise cancellation operation may also block or cancel ambient sounds that the user may wish to hear. These desirable ambient sounds may include the sound of a person's voice having a conversation with the user, warning or notification sounds, etc. Some electronic devices may generate a pass-through audio signal from an audio signal from a microphone that includes some or all of the ambient sounds in the audio signal (e.g., to allow the user to hear the surrounding environment as if the audio device were not present).

[0023] Aspects of the subject technology can provide an adjustable headphone / earbud pass-through signal with a flat frequency response at various adjusted levels. This can be achieved by mixing the pass-through audio signal with an active noise cancellation (ANC) signal according to a mixing curve that defines the mixing value as a function of the ambient sound level. The mixing curve can be different for different operating states of the device. Different operating states may include the operating mode of the device itself (e.g., phone, conversation, downlink), environmental conditions in the physical environment of the device (e.g., static noise, such as in an airplane), and / or user state (e.g., the motion state of the user of the device, such as walking or running while carrying / wearing the device). When there are multiple operating states, a priority table can be used to select a mixing curve.

[0024] Figure 1 Exemplary electronic devices according to one or more implementations are shown. However, not all of the components depicted may be used in all implementations, and one or more implementations may include additional or different components than those shown in the figures. Changes in the arrangement and types of these components may be made without departing from the spirit or scope of the claims listed herein. Additional components, different components, or fewer components may be provided.

[0025] exist Figure 1 In the example of FIG. 1 , the electronic device 100 has been implemented using a housing 106 that is small enough to be portable and carried or worn by a user (e.g., Figure 1 The electronic device 100 may be a handheld electronic device such as a tablet computer or a cellular phone or a smart phone, or may be a wearable device such as a smart watch, a hanging device, a head-mounted device, etc.). Figure 1In the example of the embodiment, the electronic device 100 includes a display such as a display 110 mounted on the front of the housing 106. However, in other specific implementations, the electronic device 100 may be provided without a display. The electronic device 100 may include one or more input / output devices (such as a touch screen incorporated into the display 110), buttons, switches, dials, crowns, touch displays, ultrasonic sensors, and / or other input-output components disposed on or behind the display 110 or disposed on or behind other portions of the housing 106. The display 110 and / or the housing 106 may include one or more openings to accommodate buttons, speakers, light sources, or cameras (as examples).

[0026] exist Figure 1 In the example of FIG. 1 , the housing 106 includes an opening 108. For example, the opening 108 may form one or more corresponding ports for one or more corresponding audio components. Figure 1 In the example of FIG. 1 , the electronic device 100 includes an opening 108 forming a speaker port for a speaker 112 disposed within the housing 106 and another opening 108 forming a microphone port for a microphone 114 disposed within the housing 106 .

[0027] exist Figure 1 In the example of FIG. 1 , display 110 also includes opening 109. For example, opening 109 may form a port for one or more additional audio components. Figure 1 In the example of FIG. 1 , the opening 109 forms a speaker port for another speaker 112 and a microphone port for a microphone 116 disposed within the housing 106 and behind a portion of the display 110. Although Figure 1 Two microphones are depicted in FIG. 1 , but it should be understood that the electronic device 100 may include one or more additional microphones, such as an error microphone positioned between a speaker (such as speaker 112 mounted behind the display 110) and a port for the speaker.

[0028] In one or more use cases, one or more of the speakers 112 may generate speaker outputs based on, for example, downlink communication signals or device-generated or streamed audio signals. In one or more specific implementations, the speakers 112 may be driven by an output downlink signal that includes a far-end acoustic signal component from a remote device. In one or more use cases, when a near-end user is using the electronic device 100 to input and / or transmit their own voice, ambient noise around the user may also be present in the environment around the electronic device. Therefore, microphones 114 and 116 may capture the user's own voice as well as the ambient sound around the electronic device 100.

[0029] In various implementations, housing 106 and / or display 110 may also include other openings, such as openings for one or more microphones, one or more pressure sensors, one or more light sources, or other components that receive signals from or provide signals to the environment outside of housing 106. Openings such as opening 108 and / or opening 109 may be open ports or may be fully or partially covered with a permeable membrane or mesh structure that allows air and / or sound to pass through the openings. Although in Figure 1 106 , but this is merely illustrative. One opening 108, two openings 108, or more than two openings 108 may be provided on one or more side walls of the housing 106, on the rear surface of the housing 106, and / or on the front surface of the housing 106. One opening 109, two openings 109, or more than two openings 109 may be provided in the display 110. In some implementations, one or more groups of openings 108 in the housing 106 and / or the groups of openings 109 in the display 110 may be aligned with a single port of an audio component within the housing 106. The housing 106, sometimes referred to as a shell, may be formed of plastic, glass, ceramic, fiber composite material, metal (e.g., stainless steel, aluminum, etc.), other suitable materials, or any combination of two or more of these materials. The electronic device 100 also includes additional components, such as processing circuitry (e.g., one or more processors), memory, power sources such as batteries, communication circuitry, and the like.

[0030] Figure 1 The configuration of the electronic device 100 is merely illustrative. In other implementations, the electronic device 100 may be a computer, such as a computer integrated into a display (such as a computer monitor), a laptop computer, a media player, a gaming device, a navigation device, a computer monitor, a television, headphones, earbuds, or other electronic equipment. As discussed herein, in some implementations, the electronic device 100 may be provided in the form of a smart phone. In one or more implementations, the housing 106 may include one or more interfaces for mechanically coupling the housing 106 to a strap or other structure for securing the housing 106 to the wearer.

[0031] Figure 2 Another exemplary implementation of an electronic device 100 is shown in which aspects of the subject technology described herein may be implemented. Specifically, Figure 2 An example of an electronic device 100 implemented as an earbud is shown. In this example, the housing 106 is shaped to be seated in the outer ear of a user and to interface with the user's ear canal. In one or more specific implementations, Figure 2 The earbud may include processing circuitry to perform one or more of the operations described herein. In one or more other implementations, Figure 2The earbuds may be used in conjunction with another electronic device, such as a smart phone or tablet computer, to which microphone signals received by microphones 114, 116 and / or 118 are transmitted and / or from which audio output signals for speaker 112 are received.

[0032] In from and Figure 2 When a microphone signal is received by a wired or wireless data communication link of an earbud, various aspects of the subject technology described herein may be Figure 2 The method may be executed by one or more processors of the earbuds and / or may be executed by a processor within a smartphone or tablet. Figure 2 The electronic device 100 in the example of may include communication circuitry for communicating with one or more other electronic devices via a wired or wireless connection. In use, microphones 114, 116, and / or 118 in the earbuds may receive ambient sounds in the physical environment of the electronic device 100. Figure 2 The earplug may be one of a pair of earplugs for both ears of the user. However, it should also be understood that a single earphone or a single-ear headset may also be used. Figure 2 , but in other specific implementations, the electronic device 100 may be implemented as a headset including a pair of earmuffs configured to be placed over the user's ears. In addition, the earmuffs may be connected via Bluetooth. TM Wired earbuds or cordless wireless earbuds that communicate signals with each other and with external devices such as a smartphone or tablet computer.

[0033] exist Figure 2 In the example of , the electronic device 100 includes: a speaker 112; a top microphone (e.g., microphone 116) whose sound-sensitive surface faces in a direction opposite to the user's eardrum when the earbud is worn; a bottom microphone (e.g., microphone 114) located in or near an end portion of the earbud's housing 106 where it is the microphone closest to the user's mouth; and an error microphone 118 that senses sound at or near the user's eardrum (e.g., in the user's ear canal). Figure 2 In the example of , the error microphone 118 may be in a position and orientation to receive output from the speaker 112 and / or one or more ambient sounds (e.g., ambient noise, voices of people other than the user of the electronic device 100, voices of the user of the electronic device 100, etc.), which one or more ambient sounds leak through the housing 106 to reach the error microphone 118.

[0034] In one or more specific implementations, Figure 2The top microphone and the bottom microphone can be used as a microphone array or as part of a microphone array for the purpose of pickup beamforming. More specifically, the microphone array can be used to create a microphone array beam that can be directed to a given direction by emphasizing and weakening selected top microphones and bottom microphones (for example, to enhance the pickup of the user's voice or another sound in the physical environment from the direction of the user's mouth). Similarly, the microphone array beamforming can also be configured to exhibit or provide pickup nulls in other given directions to suppress the pickup of ambient noise sources. Therefore, the beamforming process (also known as spatial filtering) can be a signal processing technique for directional sound reception using a microphone array.

[0035] In one or more specific implementations, when the electronic device 100 is implemented as Figure 2 When the earbuds are used in the present invention, the electronic device 100 may include a battery device, one or more processors, and a communication interface (not shown). The processor of the earbuds may be a digital signal processing chip that processes audio signals (e.g., microphone signals) from at least one of the microphones 114, 116, and / or 118. In some specific implementations, the communication interface may include a Bluetooth TM The receiver and transmitter communicate acoustic signals from microphones 114, 116, and / or 118 in both directions (uplink and downlink) with an external device such as a smart phone or tablet computer.

[0036] As discussed in further detail below, microphones 114, 116, and / or 118 and / or other microphones and / or sensors of electronic device 100 may be used in conjunction with the architecture / components described herein for automatic adaptive noise cancellation.

[0037] For example, Figure 3 A high-level block diagram of an exemplary architecture 301 that may be implemented in an electronic device 100 to provide automatic adaptive noise cancellation capabilities in accordance with various aspects of the subject technology is shown. Figure 3 In the example of , architecture 301 includes one or more microphones 116 , processing circuitry including filtering circuitry 200 and mixing circuitry 202 , one or more speakers 112 , and memory 204 .

[0038] As shown, microphone signals from one or more microphones 116 may be provided to the filtering circuit 200. The microphone signals may be provided directly from the microphones 116 to the filtering circuit 200, or the microphone signals received by the microphones 116 may be pre-processed prior to providing the microphone signals to the filtering circuit 200. The microphone signals may include representations of one or more sounds (e.g., ambient sounds) from the physical environment surrounding the electronic device 100.

[0039] As shown, the filtering circuit 200 can generate a pass-through audio signal (e.g., a transparency signal) and a noise cancellation signal based on the microphone signal. For example, the pass-through audio signal can include some or all of the ambient sounds included in the microphone signal. For example, the noise cancellation signal can be an anti-noise signal that is configured to destructively interfere with a portion of one or more sounds reaching the user's ears from the physical environment (e.g., any physical blocking of one or more sounds by the housing 106 of the electronic device 100).

[0040] As shown, the pass-through audio signal and the noise cancellation signal may be provided to the mixing circuit 202. As shown, the mixing circuit 202 may also receive the operating state of the electronic device 100. The mixing circuit 202 may also receive a sound level. For example, the sound level may be the current ambient sound level (e.g., sound pressure level or SPL) in the physical environment of the electronic device 100.

[0041] like Figure 3 As shown, the electronic device 100 may include a memory 204 storing one or more mixing curves 206. As shown, each of the mixing curves 206 may be stored in conjunction with a corresponding operating state 207. Figure 3 In the example of , the memory 204 stores a blending curve 206A associated with the operating state 207A, a blending curve 206B associated with the operating state 207B, and a blending curve 206C associated with the operating state 207C. Figure 3 In the example of , the mixing circuit 202 may obtain a mixing curve 206B from the mixing curves 206 stored in the memory 204 from the memory 204. For example, the mixing circuit 202 may obtain the mixing curve 206B based on the operating state of the electronic device 100 (e.g., by determining that the current operating state of the electronic device 100 corresponds to the operating state 207B). As discussed in further detail below, each of the mixing curves 206 may be a function of the ambient sound level. For example, the mixing curve 206B may provide a mixing factor for each ambient sound level in the range of ambient sound levels. For example, the mixing factor may correspond to the ratio of the pass-through audio signal to the noise cancellation signal in the mixed output signal including the variable amount of the pass-through audio signal and the noise cancellation signal.

[0042] Mixed curve 206 may include a linear function of the ambient sound level, a nonlinear function of the ambient sound level, a piecewise defined function of the ambient sound level, a function of the ambient sound level having one or more inflection points at which the rate of change of the mixed curve changes, a monotonically increasing function of the ambient sound level, a function of the ambient sound level having an increasing portion and a decreasing portion, and / or any other suitable function of the ambient sound level specific to the operating state of the electronic device, as described below in conjunction with Figure 5Illustrative examples thereof are described.

[0043] If Figure 3 As shown in the example of , the mixing circuit 202 can receive the operating state of the electronic device 100, obtain the mixing curve 206B from the mixing curve 206 based on the operating state, obtain the mixing value from the mixing curve 206B using the received ambient sound level, and generate a mixed output signal by mixing the pass-through audio signal and the noise cancellation signal at a mixing ratio defined by the mixing factor.

[0044] Figure 4 shows what can be included in Figure 3 For example, Figure 4 As shown, the filter circuit 200 may include an active noise cancellation (ANC) filter 302 and a pass filter 300. As shown, the mixing circuit 202 may include a gain stage 306, a gain stage 308, and an adder 310. Figure 4 As shown, the pass-through filter 300 may be configured to receive a microphone signal from the microphone 116, generate a pass-through audio signal based on the microphone signal, and provide the pass-through audio signal to the gain stage 306. For example, the pass-through filter 300 may be configured to generate a pass-through audio signal to include a representation of any sound from the physical environment that is physically blocked by the housing of the electronic device 100 from reaching the user's ears (e.g., so that the user can experience the acoustic environment as if the electronic device 100 is not worn or used). As an example, the pass-through filter 300 may be implemented as a finite impulse response (FIR), an infinite impulse response (IIR), or other analog or digital filter having a transfer function that causes the output of the speaker 112 to match the input to the microphone 116 when the result is output by the speaker 112 (e.g., as if the electronic device 100 is acoustically transparent).

[0045] As shown, the ANC filter 302 may generate a noise cancellation signal and provide the noise cancellation signal to the gain stage 308. In one or more specific implementations, the ANC filter 302 may include a variation of an optimal filter that may generate an estimate of the ambient sound by filtering a microphone signal corresponding to the microphone 116 (e.g., an audio signal received directly from the microphone 116 or an audio signal received by the microphone 116 and pre-processed before providing the audio signal to the filtering circuit 200) and may generate a noise cancellation signal (e.g., an anti-noise signal) corresponding to the estimate. For example, the estimate of the ambient sound and the corresponding noise cancellation signal (e.g., an anti-noise signal) may be generated, for example, by adaptive prediction and / or by using a predictive filter that utilizes a low-pass characteristic of the audio signal. The noise cancellation signal generated by the ANC filter 302 may be mixed with the output of the gain stage 306 by the gain stage 308 and before providing the mixed output signal from the adder 310 for output by the speaker 112 (e.g., by the adder 310). In one or more implementations, the ANC filter 302 and / or the pass-through filter 300 can be implemented at least partially in hardware, firmware, or software.

[0046] like Figure 4 As shown, gain stage 306 may apply a gain A to the pass-through audio signal generated by pass-through filter 300. As shown, gain stage 308 may apply a gain corresponding to the complement of gain A (e.g., 1-A) to the noise cancellation signal generated by ANC filter 302. For example, the gain (1-A) applied to the noise cancellation signal may be a gain calculated using the current ambient sound level in the physical environment surrounding the electronic device (e.g., as determined based on a microphone signal from microphone 116). Figure 3 2-A) to obtain a mixed value obtained by mixing curve 206B of the electronic device 100. In this way, the mixing value (e.g., (1-A)) can be adjusted to control the ratio of the direct audio signal to the noise cancellation signal in the mixed output signal provided by the adder 310 to the speaker 112. In this way, the mixing value (e.g., (1-A)) can help control the eardrum sound pressure level at or near the eardrum of the user of the electronic device 100 (e.g., by reducing A (and thus increasing (1-A)) to cause more noise cancellation signal relative to the direct audio signal in the mixed output signal, or by increasing A (and thus reducing (1-A)) to cause more direct audio signal relative to the noise cancellation signal in the mixed output signal).

[0047] In other implementations, the amount of noise cancellation may be adjusted simply by adjusting the gain applied to the noise cancellation signal and excluding any pass-through audio signal from the pass-through filter 300. However, it has been determined that the frequency response of such an ANC-only approach may not be flat through gain adjustment. By mixing a certain amount of the pass-through audio signal with the noise cancellation signal as described herein, the amount of noise cancellation at the user's ear may be controlled while keeping the frequency response substantially flat at various amounts of noise cancellation.

[0048] Figure 4 Other aspects of circuitry that may be provided to generate a noise cancellation signal from the ANC filter 302 (eg, in a manner compatible with adding a pass-through audio signal to the mixed output signal) are also shown. Figure 4 As shown, the electronic device 100 may include an adaptive controller 307. Figure 4 As shown, the ANC filter 302 may generate a noise cancellation (e.g., anti-noise) signal that, when output by the speaker 112, destructively interferes with ambient sound leaking through the housing 106 and into the user's ear canal. The leaked ambient noise and the noise cancellation portion of the output of the speaker 112 (based on some or all of the noise cancellation signal generated by the ANC filter 302 and included by the mixing circuit 202 in the mixed output signal) may be intentionally acoustically combined in the user's ear canal in a destructive manner so as to produce very little residual noise or error. As shown, the error microphone 118 may receive this residual noise or error simultaneously output by the speaker 112 (e.g., in addition to any user audio content such as a voice or video call or a one-way digital media streaming or playback session), and may provide an error signal to the feedback noise filter 314. As shown, in one or more specific implementations, the feedback noise filter 314 may generate an anti-residual noise signal that may be mixed into the mixed output signal by the adder 310.

[0049] exist Figure 4In an example of , the ANC filter 302 may be adaptively controlled by an adaptive controller 307 (e.g., which may be implemented as a coefficient generator for the ANC filter 302). As shown, the adaptive controller 307 may receive a first input (e.g., a feedback signal) based on an error signal from the error microphone 118 and a second input based on a microphone signal from the microphone 116. For example, the second input may be a microphone signal from the microphone 116 filtered by a modeling filter 320 (e.g., a secondary path modeling filter). As shown, the error signal from the error microphone 118 may be differentiated (e.g., by an adder 318) from a mixed internal signal from the modeling filter 316 (e.g., a secondary path modeling filter). For example, the modeling filter 316 may receive a combination of the output of the gain stage 306 (e.g., a pass-through audio signal) and the output of the gain stage 322. For example, gain stage 322 may apply a gain corresponding to a negative value of gain A to the output of ANC filter 302 and provide the resulting signal to adder 324 for combining (eg, differentiating) with the pass-through audio signal from gain stage 306 .

[0050] These first input signal and the second input signal may be used by the adaptive controller 307 (e.g., according to a filtered x least mean square (FXLMS) operation) to estimate, for example, a primary path transfer function and a secondary path transfer function. The ANC filter 302 may be an adaptive filter that operates using coefficients that are repeatedly or continuously updated by the adaptive controller 307 to drive the error signal from the error microphone 118 to a minimum. It should also be understood that the adaptive controller 307 may use other adaptive filter algorithms, including adaptive filter algorithms that use different adaptive filter controllers (e.g., a frequency domain adaptive filter (FDAF)). When the electronic device is outputting some or all of the noise cancellation signal from the ANC filter 302, the adaptive controller 307 may perform (e.g., continuously) calculations to adjust or update the filter coefficients of the ANC filter 302 so as to adapt the noise cancellation signal to the changing ambient noise and acoustic load seen by the microphone 116 while the user is using the electronic device 100. As an illustrative example of how the filter coefficients may be updated, the adaptive controller 307 may implement a leaky least mean square (LMS) adaptive algorithm in which the current coefficients are calculated based on a weighting of the previous coefficients. In one or more specific implementations, the gain stage 322, the adder 324, the modeling filter 316, and the adder 318 may facilitate the use of adaptive noise cancellation in conjunction with the pass-through signal, as described herein.

[0051] As discussed herein, the gain A and / or the complement (1-A) can be determined by a blending factor obtained from the blending curve 206 (eg, in some implementations, the complement 1-A can be set as the blending value). Figure 5 An example of a mixing curve is shown, from which the mixing factor (and hence the gain A and its complement) can be obtained. Figure 5 In the example of FIG. 1 , three exemplary mixing curves are shown. For example, Figure 5 Each of the illustrated mixing curves may correspond to a particular operating state 207 of the electronic device 100. For example, when the electronic device 100 is in phone mode (e.g., when the user of the electronic device 100 is using the electronic device 100 for a phone conversation, an audio conference, or a video conference with audio), mixing curve 206A may be used to obtain a mixing value for the current ambient sound level, when the user of the electronic device 100 is engaged in a conversation with a person in the physical environment of the electronic device 100, mixing curve 206B may be used to obtain a mixing value for the current ambient sound level, and when the user of the electronic device 100 is walking or running while wearing or carrying the electronic device 100, mixing curve 206C may be used to obtain a mixing value for the current ambient sound level.

[0052] However, these three examples of hybrid curves and corresponding operating states are merely illustrative, and other hybrid curves may be provided for other operating states. In various examples, the operating state may include an operating mode of the electronic device 100 itself (e.g., a phone mode, a downlink mode, an audio playback mode, etc.), a state of a user of the electronic device 100 (e.g., a conversation state or a motion state, such as a walking state or a running state), or an environmental condition in the physical environment surrounding the electronic device 100 (e.g., a noise condition, such as a static noise state, a dynamic noise state, an airplane noise state, a vehicle noise state, a street noise state, a train noise state, and / or other noise states).

[0053] In one or more use cases, the electronic device may detect more than one concurrent operating state. For example, the electronic device may determine that the user of the electronic device is engaged in a conversation while walking in a street noise environment. As another example, the electronic device 100 may determine that the electronic device 100 is in phone mode when in a static noise environment. As another example, the electronic device 100 may determine that the electronic device 100 is in audio playback mode when in a static noise environment. In one or more specific implementations, in a use case in which multiple operating states 207 are detected concurrently, the electronic device 100 may store a priority list that can be used to select a mixing curve 206 corresponding to a particular operating state 207.

[0054] In one illustrative example, the phone mode of the electronic device 100 may have a higher priority than the conversation mode of the user of the electronic device 100. In another illustrative example, the phone mode of the electronic device 100 may have a higher priority than the walking or running mode of the user of the electronic device 100. As another illustrative example, the conversation mode of the user of the electronic device 100 may have a higher priority than the audio output mode of the electronic device 100. As another illustrative example, the phone mode of the electronic device 100 may have a higher priority than the static noise state of the physical environment. In one or more specific implementations, when multiple operating states of the electronic device are detected concurrently, a priority list may be used to select a hybrid curve of the detected operating state with the highest priority in the priority list. In one or more other specific implementations, when two or more operating states are detected concurrently, the hybrid curves for the two or more operating states may be combined, and / or one or more hybrid curves may be provided for one or more corresponding specific combinations of operating states.

[0055] Figure 5 Also shown are various aspects of various mixing curves 206 that may be set for a particular operating mode in order to control the amount of mixing of the pass-through audio signal and the noise cancellation signal for any given value of ambient sound level that may occur when the electronic device 100 is in that particular operating mode. Figure 5 In the example of , the mixing curve 206A defines a first ambient sound level (SL1) and a second ambient sound level (e.g., SL2), below which only the pass-through audio signal is used in the mixed output signal (e.g., the mixing value MV corresponding to (1-A) is zero, and the gain A is one), and above which only the noise cancellation signal is used in the mixed output signal (e.g., the mixing value MV corresponding to (1-A) is one, and the gain A is zero). In this example, the mixing curve 206A also defines a variable mixing amount of the pass-through audio signal and the noise cancellation signal for ambient sound levels between the first ambient sound level (SL1) and the second ambient sound level (SL2). As shown, the variable mixing amount for ambient sound levels between the first ambient sound level and the second ambient sound level may include: a first change in the ambient sound level between the first ambient sound level (SL1) and the inflection point 500 (e.g., at the ambient sound level SL3) at a first rate and a second change in the ambient sound level between the inflection point 500 and the second ambient sound level (SL2) at a second rate. Figure 5 In the example of , the first rate of change (eg, the slope of the hybrid curve 206A below the inflection point 500 ) is greater than the second rate of change (eg, the slope of the hybrid curve 206A above the inflection point 500 ).

[0056] like Figure 5 As shown, each of the mixed curves 206B and 206C also includes a first ambient sound level (SL1), a second ambient sound level (e.g., SL2), and a variable mixing amount of a pass-through audio signal and a noise cancellation signal for an ambient sound level between the first ambient sound level (SL1) and the second ambient sound level (SL2), below which only the pass-through audio signal is used in the mixed output signal, and above which only the noise cancellation signal is used in the mixed output signal. However, as shown, the first ambient sound level (SL1), the second ambient sound level (SL2), and the sound level SL3 at the inflection point 500 are different for each different mixed curve. As shown, the rate of change between the sound levels SL1, SL2, and SL3 is also different for different mixed curves. In this way, the variation in the mixed curve 206 can provide a variable mixing amount of a pass-through audio signal and a noise cancellation signal in the mixed output signal for various different operating states of the electronic device 100. More specifically, a particular ambient sound level that produces a particular mixing value MV when using mixing curve 206A will produce a different mixing value MV when using mixing curve 206B or mixing curve 206C, even though the ambient sound level has not changed.

[0057] For example, when in one operating state, the electronic device 100 may dynamically adjust the mixing of the pass-through audio signal and the noise cancellation signal in the mixed output signal by obtaining a first measurement of the current ambient sound level at a first time; substantially generating the mixed output signal at the first time by obtaining a mixing value MV from the mixing curve 206A based on the first measurement of the current ambient sound level; obtaining a second measurement of the current ambient sound level at a second time (e.g., after a change in ambient sound in the physical environment); and substantially generating the mixed output signal at the second time by obtaining the mixing value MV from the mixing curve 206A based on the second measurement of the current ambient sound level. At a later time, the electronic device 100 may detect a change in the operating state of the device; obtain the mixing curve 206B based on the detected change in the operating state; and dynamically adjust the mixing of the pass-through audio signal and the noise cancellation signal in the mixed output signal using a third measurement of the current ambient sound level (e.g., which may be the same as or different from the second measurement of the current ambient sound level) based on a different mixing value MV obtained from the mixing curve 206B.

[0058] exist Figure 5In the example of , each of the mixed curves 206B and 206C also includes a second inflection point 502 (e.g., at ambient sound level SL4) at which the rate of change of the mixed value changes. For example, inflection point 500 can be a first inflection point, and a second change that changes at a second rate for the ambient sound level between inflection point 500 and a second ambient sound level (SL2) can be a first portion of the second change. In this example, the second portion of the second change can change at a third rate (e.g., a third slope of mixed curve 206B or mixed curve 206C) for the ambient sound level between the second inflection point 502 and the second ambient sound level (SL2). As shown, the positions of inflection point 500 and second inflection point 502 are different for mixed curve 206B and mixed curve 206C. Although in Figure 5 One or two inflection points are shown in the examples, but it should be understood that one, two, or more than two inflection points may be included in the hybrid curve, and one or more hybrid curves may include increasing and / or decreasing portions and / or rate changes that occur smoothly (e.g., rather than at a single inflection point).

[0059] In one or more specific implementations, a mixing curve 206 (e.g., including mixing curve 206A, mixing curve 206B, and mixing curve 206C) may be generated empirically and deterministically for each operating state to provide a desired mixed output signal. In one or more other specific implementations, the mixing curve 206 (e.g., including mixing curve 206A, mixing curve 206B, and mixing curve 206C) may be learned by training a machine learning model (e.g., by adjusting one or more weights and / or other parameters of the machine learning model during a training operation) to output a mixing curve based on a training environment sound level and a training output mixing value. In one or more specific implementations, the operating state may be deterministically defined and detected in a rule-based detection process. In one or more other specific implementations, the operating state may be detected by one or more machine learning models that have been trained (e.g., by adjusting one or more weights and / or other parameters of the machine learning model during a training operation) to output an operating state based on training audio input data, training input device sensor (e.g., IMU) data, based on training input device operation data, and / or training output operating states.

[0060] In this article combined Figures 3 to 5In the described examples, once a mixing value has been obtained (e.g., from a mixing curve selected according to the current operating state of the device and based on selecting the mixing value from the selected mixing curve using the current ambient sound level), a gain derived from the mixing value (e.g., A) is applied to the pass-through audio signal (e.g., from the pass-through filter 300). In these examples, a single gain across all frequencies of the pass-through signal has been described. However, in one or more specific implementations, the mixing curve may be determined based on the operating state of the device and based on user input (e.g., user input indicating a user preference for the amount of noise cancellation). In addition, in one or more specific implementations, the gain applied to the pass-through audio signal may vary with frequency in a manner that depends on the amount of noise cancellation being performed (e.g., based on the mixing value).

[0061] For example, Figure 6 In one embodiment, a method for providing automatic adaptive noise cancellation capability is shown. Figure 3 An exemplary architecture 301 of the present invention, in which a mixing curve may be determined based on an operating state of the device and based on user input, and in which a gain applied to a pass-through audio signal may vary with frequency in a manner that depends on the ambient sound level (e.g., and / or depends on a mixing value). Figure 6 As shown in the example of , in addition to the operating state and the ambient sound level, the mixing circuit 202 may also receive user input. For example, the user input may be a user preference indicating the amount of ambient noise desired by the user. In one exemplary implementation, the user input may be a mixing value (e.g., a slider or other user input element may be provided to the user for directly adjusting the mixing value). However, for improved audio performance, the mixing circuit 202 may apply the user input to modify the mixing curve that has been selected based on the operating state of the device (e.g., as described herein in conjunction with Figures 7 to 9 discussed), and the mixing circuit can then obtain the mixing value from the modified mixing curve.

[0062] like Figure 6 As shown, once the blending value has been obtained (eg, from a blending curve that has been modified or not modified based on user input), the blending circuit may be configured based on the blending value (eg, Figure 6 The mixed value 607 in the example of ) is used to obtain the gain curve 606. Figure 6In the example of , the mixing circuit 202 has obtained the gain curve 606C based on the mixing value 607C (e.g., obtained by extracting the mixing value corresponding to the ambient sound level from the selected mixing curve 206B) from among a plurality of gain curves (e.g., gain curves 606A, 606B, 606C, etc.) each stored in association with a corresponding mixing value (e.g., mixing values ​​607A, 607B, 607C, etc.). For example, each of the gain curves 606A, 606B, 606C, etc. may identify a number of different gains (e.g., A) to be applied to the pass-through audio signal at each of a number of different corresponding frequencies (e.g., as described below in conjunction with Figures 10 to 12 ). It should be understood that the gain curve may be selected based on a mixing value (e.g., an amount of noise cancellation) but not necessarily based on a mixing curve (e.g., because if the ambient sound level changes, the same mixing value may be obtained from various different mixing curves having various different mixing values ​​for the same ambient sound level at various different times). It should also be understood that not all gain curves may be selected based on a mixing value (e.g., an amount of noise cancellation) but not necessarily based on a mixing curve (e.g., because if the ambient sound level changes, the same mixing value may be obtained from various different mixing curves having various different mixing values ​​for the same ambient sound level at various different times). Figure 6 Rather than storing a set of gain curves each associated with a mixed value as in the illustrative example of , the gain curves may be obtained from the mixed values ​​in some other manner (e.g., by providing the mixed values ​​to a calculation from which the gain curves are derived, or by providing the mixed values ​​to a machine learning model that has been trained to provide gain curves based on the mixed values).

[0063] As above combined Figure 6 As discussed, in one or more implementations, the blending curve may be modified based on user input. For example, Figure 7 An example of a blending curve modified based on user input is shown. As an illustrative example, Figure 7 A range 702 below the blending curve 206B is depicted within which the blending curve 206B may be modified by a user preference for less noise (eg, in response to a swipe down or other input indicating a user preference for less noise). Figure 7 Also shown is a range 704 above the blending curve 206B within which the blending curve 206B may be modified by a user preference for more noise or more transparency (e.g., in response to an upward swipe or other input indicating a user preference for more noise or more transparency). In this example, the blending curve 206B (e.g., selected based on the operating state of the electronic device 100) may be modified between a lower blending curve 706L and an upper blending curve 706H that have been defined for the blending curve 206B. Other blending curves may have different lower and / or upper limits and / or different ranges within which they may be modified.

[0064] As discussed herein, blending curves such as blending curve 206B may include inflection points such as inflection point 500 and inflection point 502. Figure 7As shown, modifying the blending curve based on user input may include modifying the location of the inflection points. For example, the lower blending curve 706L may have inflection points 500L and 502L at different ambient sound levels than the inflection points 500 and 502 of the unmodified blending curve 206B, and the upper blending curve 706H may have inflection points 500H and 502H at different ambient sound levels than the inflection points 500 and 502 of the unmodified blending curve 206B and at different ambient sound levels than the inflection points 500L and 502L of the lower blending curve 706L. In this example, the lower blending curve 706L includes an additional inflection point 700 that is not included in the unmodified blending curve 206B or the upper blending curve 706H.

[0065] In one or more implementations, blending curve 206B can be continuously modified within a range 702 and 704 between a lower blending curve 706L and an upper blending curve 706H (e.g., based on a continuously variable user input, such as a user input to a slider or dial or a dial having a range between zero and one hundred percent). In one or more other implementations, an electronic device such as electronic device 100 can provide a user with a set of discrete user input options and can modify the blending curve between a set of predetermined discrete blending curve modifications.

[0066] For example, Figure 8 An example of a user interface 800 that may be provided to a user (e.g., displayed by a display of an electronic device such as electronic device 100) is shown. Figure 8 In the example of FIG. 8 , the user interface 800 includes a slider 802. In this example, the slider 802 can be moved by the user between three discrete options. As examples, the options can include a "less noise" option 804, a "default" or "neutral" option 806, and a "more noise" or "more transparency" option 806.

[0067] Fig. 9 In one or more embodiments, the user may select Figure 8 804, 806, and 808 of the user interface 800. For example, when the slider 802 of the user interface 800 is set to select option 806, the mixing curve can be an unmodified mixing curve selected by the mixing circuit 222 based on the operating state of the device (e.g., the mixing curve 206B in the various examples discussed herein). Fig. 9 The slider 802 is shown moved to Figure 8 How the “less noise” option 804 of FIG. 804 may result in modifying the blending curve 206B to a modified blending curve 206BL (e.g., with a different rate of change, a different inflection point 500L, and / or a different inflection point 502L). Figure 8The “more noise” option 804 of FIG. 8 may result in modifying the blending curve 206B to a modified blending curve 206BH (eg, with a different rate of change, a different inflection point 500H, and / or a different inflection point 502H). Fig. 9 As shown, in one or more implementations, the modified mixing curve can have a non-linear rate of change and / or can increase or decrease with increasing ambient sound levels.

[0068] Fig.10 Examples of various gain curves as described herein (eg, gain curves that may be applied to a pass-through audio signal generated by the pass-through filter 300 or implemented as a modification to the pass-through filter 300) are shown. Fig.10 As shown, gain curves 606 (such as gain curves 606A, 606B, 606C, 606D, 606E, 606F, and 606G) may each identify a number of different gains (e.g., (f)) for the pass-through audio signal at each of a number of different corresponding frequencies. For example, mixing values ​​607 (e.g., mixing values ​​607A, 607B, 607C, etc.) obtained from a selected (e.g., modified or unmodified) mixing curve may determine the gain of the pass-through signal within a center frequency band (e.g., a frequency band between five hundred Hz and three kHz and including a center frequency fc). In one or more specific implementations, when a zero gain (e.g., when A(fc)=1, 1-A(fc)=zero) is applied to the noise cancellation signal, the gain curve 606A for the pass-through signal may be flat across all frequencies. As Fig.10 As shown, gain curves 606B, 606C, 606D, etc. may define increasing gains A(f) for the pass-through signal at frequencies f above and below the center frequency range as the gain applied to the noise cancellation signal (e.g., 1-A(fc)) increases (e.g., as A(fc) decreases).

[0069] For example, in an implementation where the gain curve 606 is not used (e.g., where a single gain A is applied across all frequencies of the pass-through signal), the flat attenuation can make low-frequency (e.g., below 300 Hz) and high-frequency (e.g., above 6 kHz) components of the ambient sound less audible to the user because the human ear has less sensitivity at these frequencies when the overall sound level is reduced (e.g., due to an actual reduction in the overall sound level or due to an increased gain of the anti-noise signal). In this case, the timbre of the ambient sound after noise cancellation can be perceived by the user as different from the user's perception of the same ambient sound heard with an open ear (e.g., without an earbud or headset in or on the user's ear). By applying the gain curve 606 instead of a flat (e.g., constant) gain, the ambient sound delivered to the user's ear by the headset or earbud can be more similar in timbre to the ambient sound without the headset or earbud. In one or more implementations, the gain curve 606 can be derived from a loudness model that represents the average perception of the human ear. In one or more other implementations, gain curve 606 can be further tuned for individual users (eg, to account for deviations of individual users' audio perception relative to average humans).

[0070] Using gain curve 606 can provide benefits to users who wish to reduce the loudness of ambient sounds while still being able to hear a certain level of surrounding ambient sounds in a manner that reflects the way the ambient sounds would be perceived without the loudness reduction. For example, in one exemplary use case, a user in a social environment (e.g., a bar or party) may desire to receive a less loud and more natural perception of the sounds of the social environment (e.g., to continue to enjoy the natural background sounds of the social environment while increasing their ability to conduct a conversation within a noisy social environment). In another exemplary use case, a user at a concert (e.g., having 80 to 90 dBA SPL) may desire to reduce the loudness of the concert (e.g., to approximately 65 to 70 dBA SPL) without changing the timbre of the music. In one or more other use cases, applying gain curve 606 can reduce the perceived ear pressure experienced by some users when noise cancellation is active by increasing the gain of low-frequency ambient sounds.

[0071] Fig.11 Shows Figure 4301, wherein an environmental loudness equalizer (ELEQ) 1100 is added. As shown, according to the gain curve 606 selected using the current value of the mixed value, the ELEQ 1100 can modify the pass-through audio signal from the pass-through filter 300 according to the frequency. In one or more specific implementations, the ELEQ 1100 can apply the gain curve by adjusting the frequency response of the pass-through filter 300 itself (e.g., by adjusting the coefficients of the pass-through filter 300 according to the selected gain curve). For example, the ELEQ 1100 can obtain the mixed value and / or the gain A, and adjust the frequency response of the pass-through filter 300 according to the loudness EQ compensation (e.g., according to the selected gain curve). In one or more other specific implementations, the gain curve (e.g., the frequency-dependent gain A(f)) can be applied to the pass-through audio signal by the gain stage 306. In one or more implementations, a gain curve can be used by the pass-through filter 300 and / or the gain stage 306 while applying a constant (e.g., flat in frequency space) gain (e.g., 1-A or 1-A(fc)) to the noise cancellation signal from the ANC filter 302. In one or more other implementations, a frequency-dependent gain can also be applied to the noise cancellation signal from the ANC filter 302.

[0072] In one or more implementations, an electronic device such as electronic device 100 may provide a user with the ability to selectively turn on or off the use of gain curve 606. For example, some users may prefer the more natural effect of using a gain curve and may turn on ELEQ 1100. Other users (or the same user at a different time or in a different acoustic environment) may prefer more noise attenuation than the naturalness of the remaining ambient sound passing through and may turn off ELEQ 1100.

[0073] In one or more other implementations, the electronic device 100 may automatically turn the ELEQ 1100 on or off in certain acoustic environments and / or based on user preferences (e.g., user preferences input by a user, or user preferences learned at the electronic device using a machine learning model that has been trained to determine user preferences based on input from one or more microphones and / or other sensors at the electronic device, based on calendar information, based on purchase information, etc.). For example, Fig.12 An example is shown where the architecture of the electronic device 100 includes a decision block 1200 that can be used to turn the ELEQ 1100 on or off in one or more implementations.

[0074] In various implementations, decision block 1200 may be implemented as, for example, a digital signal processor (DSP) or a trained machine learning model. Fig.12In the example of , decision block 1200 receives input from environmental sensors such as microphone 116 and accelerometer 1202. In this example, decision block 1200 may determine the type of acoustic environment in which electronic device 100 is set (e.g., a social environment such as a party, bar or restaurant, or another acoustic environment such as a concert, office, home, transportation, etc.), and / or the type of activity in which the user of electronic device 100 is engaged. As shown, in one or more specific implementations, decision block 1200 may receive one or more other inputs. As an example, the other inputs may include calendar information (e.g., calendar information indicating that the user of electronic device 100 may be in a work meeting, working out at a gym, attending a party, or attending a concert), purchase information (e.g., purchase information indicating the purchase of tickets for a movie, show, or concert), activity information (e.g., indicating that the user is stationary, walking, running, or dancing), etc.

[0075] As shown, in one or more implementations, the ELEQ 1100, the gain stage 308, the pass filter 300, and / or the gain stage 306 may receive a mixed value and / or a gain derived therefrom (e.g., A) from the adaptive controller 307. The ELEQ 1100 may determine a gain curve based on the mixed value (e.g., or gain) and / or based on the output from the decision block 1200, and provide the gain curve to the gain stage 306 and / or the pass filter 300. In one or more implementations, the output from the decision block 1200 may include instructions to activate (e.g., turn on, such as when the decision block 1200 determines that the user is attending a concert or party) or deactivate (e.g., turn off, such as when the decision block 1200 determines that the user is working in an office) the ELEQ 1100. In one or more implementations, the output from the decision block 1200 may include instructions for the ELEQ 1100 to modify the gain curve based on the acoustic environment and / or activity in which the user is participating. For example, in a music or concert acoustic environment detected by decision block 1200, the gain curve applied by gain stage 306 and / or pass-through filter 300 may be tuned to be stronger (e.g., with higher bass and treble gain). As another example, in an acoustic environment determined by decision block 1200 to have a large amount of undesirable noise (e.g., traffic noise, aircraft noise, fan noise, HVAC noise, crowd noise, appliance noise, etc.), the gain curve applied by gain stage 306 and / or pass-through filter 300 may be tuned to be weaker to prioritize reducing the noise level. In this way, decision block 1200 can classify the acoustic environment and help further fine-tune the ELEQ 1100 and / or the gain curve provided thereby based on the classification.

[0076] Fig.13A flowchart of an exemplary process for automatic adaptive noise cancellation according to one or more specific implementations is shown. For the purpose of explanation, this article mainly refers to Figure 1 or Figure 2 The process 1300 is described with reference to the electronic device 100. However, the process 1300 is not limited to Figure 1 or Figure 2 1300, and one or more blocks (or operations) of process 1300 may be performed by one or more other components and other suitable devices. Further for the purpose of explanation, the blocks of process 1300 are described herein as occurring sequentially or linearly. However, multiple blocks of process 1300 may occur in parallel. In addition, the blocks of process 1300 do not have to be performed in the order shown, and / or one or more blocks of process 1300 do not have to be performed and / or may be replaced by other operations.

[0077] exist Fig.13 In an example, at block 1302, a device (e.g., electronic device 100) may obtain a mixing curve (e.g., mixing curve 206, such as mixing curve 206A, mixing curve 206B, or mixing curve 206C). For example, the mixing curve may define a first ambient sound level (e.g., SL1), a second ambient sound level (e.g., SL2), and a variable mixing amount for an ambient noise level between the first ambient sound level and the second ambient sound level, below which only the pass-through audio signal is used in the mixed output signal, and above which only the noise cancellation signal is used in the mixed output signal.

[0078] In one or more specific implementations, the mixing curve can be a first mixing curve (e.g., mixing curve 206B) obtained from a plurality of mixing curves (e.g., mixing curve 206A, mixing curve 206B, or mixing curve 206C) corresponding to a plurality of corresponding operating states of the device (e.g., operating states 207A, 207B, or 207C) based on the (e.g., current) operating state of the device. Each of the plurality of mixing curves (e.g., including the obtained first mixing curve) can be a function of the ambient sound level (e.g., in the physical environment of the device). As an example, the operating state of the device may include one or more of the following: an operating mode of the device, an environmental condition in the physical environment of the device, or a motion state of a user of the device.

[0079] At block 1304, the device (e.g., mixing circuit 202) may dynamically adjust the mixing of the pass-through audio signal and the noise cancellation signal in the mixed output signal based on a mixing value (e.g., MV) obtained from the mixing curve using the current ambient sound level. For example, the mixing value may be configured to control the eardrum sound pressure level at or near the eardrum of a user of the device (e.g., by controlling the mixing of the pass-through audio signal and the noise cancellation signal). In one or more specific implementations, the mixing value may correspond to a gain applied to the noise cancellation signal, and the complement of the gain may be applied to the pass-through audio signal.

[0080] The pass-through audio signal may include a representation of one or more sounds in the physical environment of the device, and the noise cancellation signal may be configured to cancel (e.g., acoustically cancel at or near the user's ear) one or more sounds. As an example, the pass-through audio signal may be a pass-through audio signal from one or more microphones of the device and may include substantially all of the sounds recorded by the one or more microphones, or may be a processed pass-through audio signal that includes or enhances (e.g., based on filtering performed by the pass-through filter 300) a subset of the sounds recorded by the one or more microphones. For example, the pass-through audio signal may be configured to represent the sound that the user of the device would hear in the absence of the device when output by a speaker of the device (e.g., speaker 112). The noise cancellation signal may be an anti-noise signal that is configured to cancel (e.g., by destructive acoustic interference) the ambient sound reaching the user's ear when output by the speaker of the device.

[0081] In one or more specific implementations, a first mixing curve defines a first ambient sound level (e.g., SL1) and a second ambient sound level (e.g., SL2), below which only the pass-through audio signal is used in the mixed output signal, and above which only the noise cancellation signal is used in the mixed output signal. The first mixing curve may also define a variable mixing amount of the pass-through audio signal and the noise cancellation signal for ambient sound levels between the first ambient sound level and the second ambient sound level. For example, the variable mixing amount for ambient sound levels between the first ambient sound level and the second ambient sound level may include: a first change in the ambient sound level between the first ambient sound level and an inflection point (e.g., inflection point 500) at a first rate and a second change in the ambient sound level between the inflection point and the second ambient sound level at at least a second rate. For example, the first rate of change may be greater than (or less than) the second rate of change. In one or more specific implementations, the inflection point can be a first inflection point, and the second change in the ambient sound level between the inflection point and a second ambient sound level that changes at at least a second rate can include: (i) a first portion of the second change in the ambient sound level between the first inflection point and a second inflection point (e.g., second inflection point 502) that changes at the second rate; and (ii) a second portion of the second change in the ambient sound level between the second inflection point and the second ambient sound level that changes at a third rate.

[0082] In one or more specific implementations, when dynamically adjusting the mixing of the pass-through audio signal and the noise cancellation signal in the mixed output signal based on the mixing value obtained from the first mixing curve using the current ambient sound level, the electronic device may detect a change in the operating state of the device; obtain a second mixing curve (e.g., mixing curve 206C) from a plurality of mixing curves based on the detected change in the operating state; and dynamically adjust the mixing of the pass-through audio signal and the noise cancellation signal in the mixed output signal based on different mixing values ​​obtained from the second mixing curve using the current ambient sound level.

[0083] In one or more specific implementations, an electronic device may determine an operating state of the device at least in part by: identifying a first operating state of the device that occurs concurrently with a second operating state of the device; and determining the operating state by selecting (e.g., from a priority list for operating states) one of the first operating state and the second operating state with a higher priority.

[0084] In one or more specific implementations, dynamically adjusting the mixing of the pass-through audio signal and the noise cancellation signal in the mixed output signal based on the mixing value obtained from the first mixing curve using the current ambient sound level may include: obtaining a first measurement of the current ambient sound level at a first time; generating the mixed output signal substantially at the first time by obtaining the mixing value from the first mixing curve based on the first measurement of the current ambient sound level; obtaining a second measurement of the current ambient sound level at a second time; and generating the mixed output signal substantially at the second time by obtaining a different mixing value from the first mixing curve based on the second measurement of the current ambient sound level. In one or more specific implementations, the device may also dynamically adjust the output of a speaker (e.g., speaker 112) of the device based on the mixed output signal.

[0085] In one or more specific implementations, process 1300 may also include modifying the first blending curve based on user input before obtaining the blending value from the first blending curve. Process 1300 may also include obtaining the blending value from the modified blending curve (e.g., Fig. 9 The modified mixing curve 206BL or the modified mixing curve 206BH, or Figure 7 A mixed value is obtained by using a modified mixing curve within the range 702 or the range 704.

[0086] In one or more specific implementations, dynamically adjusting the mixing of the pass-through audio signal and the noise cancellation signal in the mixed output signal based on the mixing value obtained from the first mixing curve using the current ambient sound level may include applying a frequency-dependent gain (e.g., a gain curve 606, such as gain curves 606A, 606B, 606C, 606D, 606E, 606F, or 606G) to the pass-through audio signal before generating the mixed output signal (e.g., by the gain stage 306 or by adjusting the frequency characteristics of the pass-through filter 300). For example, the frequency-dependent gain may have a frequency dependency determined based on the mixing value (e.g., selected by selecting a gain curve such as gain curve 606C from a set of gain curves 606). In one or more specific implementations, the device may obtain an environmental classification of the acoustic environment of the device using a machine learning model at the device (e.g., decision block 1200). The machine learning model may have been trained to be based at least in part on the audio input (e.g., in a microphone signal and / or an accelerometer signal) to the machine learning model (e.g., in conjunction with, for example, Fig.12 The device may classify the acoustic environment using one or more other inputs described herein. The device may determine the frequency-dependent gain based on the environment classification. For example, determining the frequency-dependent gain may include turning on or off an environment loudness equalizer (e.g., ELEQ 1100) or modifying the tuning or EQ of the frequency-dependent gain based on the environment classification.

[0087] As described above, one aspect of the present technology is to collect and use data available from specific and legitimate sources to provide automatic adaptive noise cancellation for electronic devices. The present disclosure contemplates that, in some instances, the collected data may include personal information data that uniquely identifies or can be used to identify a specific person. Such personal information data may include voice data, demographic data, location-based data, online identifiers, phone numbers, email addresses, home addresses, data or records related to the user's health or fitness level (e.g., vital signs measurements, medication information, exercise information), date of birth, or any other personal information.

[0088] The present disclosure recognizes that the use of such personal information data in the present technology can be used to benefit users. For example, personal information data can be used to operate electronic devices to provide automatic adaptive noise cancellation for electronic devices. Therefore, the use of such personal information data can facilitate transaction processing (e.g., online transaction processing). In addition, the present disclosure also anticipates other uses of personal information data that benefit users. For example, health and fitness data can be used according to the user's preferences to provide insights into their overall health status, or can be used as positive feedback to individuals who use technology to pursue health goals.

[0089] This disclosure envisions that entities responsible for collecting, analyzing, disclosing, transmitting, storing or otherwise using such personal information data will comply with established privacy policies and / or privacy practices. Specifically, such entities will be expected to implement and consistently apply privacy practices that are generally recognized as meeting or exceeding the requirements of the industry or government that maintain user privacy. Such information about the use of personal data should be prominently and easily accessible to users, and should be updated as the collection and / or use of data changes. The user's personal information should be collected only for legitimate use. In addition, such collection / sharing should only occur after receiving user consent or other legal basis specified in applicable law. In addition, such entities should consider taking any necessary steps to defend and safeguard access to such personal information data and ensure that others who have access to personal information data comply with their privacy policies and processes. In addition, such entities may subject themselves to third-party assessments to demonstrate that they comply with widely accepted privacy policies and practices. In addition, policies and practices should be adjusted for specific types of personal information data collected and / or accessed, and applied to applicable laws and standards, including specific considerations that are exclusive to jurisdictions that can be used to impose higher standards. For example, in the United States, collection or access to certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); while health data in other countries may be subject to other regulations and policies and should be handled accordingly.

[0090] Regardless of the foregoing, the present disclosure also contemplates implementation schemes in which users selectively block the use or access of personal information data. That is, the present disclosure contemplates that hardware elements and / or software elements may be provided to prevent or block access to such personal information data. For example, in the case of operating an electronic device to provide automatic adaptive noise cancellation for the electronic device, the present technology may be configured to allow the user to choose to "opt in" or "opt out" to participate in the collection of personal information data at any time during or after registration for the service. In addition to providing "opt-in" and "opt-out" options, the present disclosure also contemplates providing notifications related to access or use of personal information. For example, a user may be notified that their personal information data will be accessed when downloading an application, and then be reminded again just before the personal information data is accessed by the application.

[0091] In addition, it is an object of the present disclosure that personal information data should be managed and processed to minimize the risk of unintentional or unauthorized access or use. Risks can be minimized by limiting data collection and deleting data once it is no longer needed. In addition, and when applicable, including in certain health-related applications, data de-identification can be used to protect the privacy of users. De-identification can be facilitated by removing identifiers, controlling the amount or specificity of stored data (e.g., collecting location data at a city level rather than at an address level), controlling how data is stored (e.g., aggregating data across users), and / or other methods such as differential privacy, where appropriate.

[0092] Therefore, while the present disclosure broadly covers the use of personal information data to implement one or more of the various disclosed embodiments, the present disclosure also contemplates that various embodiments may be implemented without access to such personal information data. That is, various embodiments of the present technology will not fail to function properly due to the lack of all or part of such personal information data.

[0093] Fig.14 An electronic system 1400 is shown that can be used to implement one or more implementations of the subject technology. The electronic system 1400 can be Figure 1 or Figure 2 One or more of the electronic devices 100 shown, and / or may be a part thereof. The electronic system 1400 may include various types of computer-readable media and interfaces for various other types of computer-readable media. The electronic system 1400 includes a bus 1408, one or more processing units 1412, a system memory 1404 (and / or buffer), a ROM 1410, a permanent storage device 1402, an input device interface 1414, an output device interface 1406, and one or more network interfaces 1416, or a subset and variant thereof.

[0094] The bus 1408 generally represents all system, peripheral, and chipset buses that communicatively connect the many internal devices of the electronic system 1400. In one or more implementations, the bus 1408 communicatively connects the one or more processing units 1412 with the ROM 1410, the system memory 1404, and the permanent storage device 1402. The one or more processing units 1412 retrieve instructions to be executed and data to be processed from these various memory units in order to perform the processes disclosed in the present subject matter. In different implementations, the one or more processing units 1412 can be a single processor or a multi-core processor.

[0095] ROM 1410 stores static data and instructions needed by one or more processing units 1412 and other modules of electronic system 1400. In other aspects, permanent storage device 1402 can be a read-write memory device. Permanent storage device 1402 can be a non-volatile memory unit that stores instructions and data even when electronic system 1400 is turned off. In one or more specific implementations, a mass storage device (such as a magnetic or optical disk and its corresponding disk drive) can be used as permanent storage device 1402.

[0096] In one or more implementations, a removable storage device, such as a flash drive, may be used as the permanent storage device 1402. Like the permanent storage device 1402, the system memory 1404 may be a read-write memory device. However, unlike the permanent storage device 1402, the system memory 1404 may be a volatile read-write memory, such as a random access memory. The system memory 1404 may store any of the instructions and data that may be required by one or more processing units 1412 at run time. In one or more implementations, the processes disclosed in the subject matter are stored in the system memory 1404, the permanent storage device 1402, and / or the ROM 1410. The one or more processing units 1412 retrieve instructions to be executed and data to be processed from these various memory units in order to perform the processes of one or more implementations.

[0097] The bus 1408 is also connected to an input device interface 1414 and an output device interface 1406. The input device interface 1414 enables a user to transmit information and select commands to the electronic system 1400. Input devices that can be used with the input device interface 1414 may include, for example, an alphanumeric keyboard and a pointing device (also referred to as a "cursor control device"). The output device interface 1406 may enable, for example, an image generated by the electronic system 1400 to be displayed. Output devices that can be used with the output device interface 1406 may include, for example, a printer and a display device, such as a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a flexible display, a flat panel display, a solid-state display, a projector, or any other device for outputting information. One or more specific implementations may include a device that acts as both an input device and an output device, such as a touch screen. In these specific implementations, the feedback provided to the user may be any form of sensory feedback, such as visual feedback, auditory feedback, or tactile feedback; and input from the user may be received in any form, including acoustic, voice, or tactile input.

[0098] Finally, if Fig.14 As shown, bus 1408 also couples electronic system 1400 to one or more networks and / or to one or more network nodes via one or more network interfaces 1416. In this manner, electronic system 1400 may be part of a computer network, such as a LAN, a wide area network ("WAN"), or an intranet, or may be part of a network of networks, such as the Internet. Any or all components of electronic system 1400 may be used with the subject disclosure.

[0099] Implementations within the scope of the present disclosure may be implemented in part or in whole using a tangible computer-readable storage medium (or multiple tangible computer-readable storage media of one or more types) programmed with one or more instructions. Tangible computer-readable storage media may also be non-transitory in nature.

[0100] Computer-readable storage media can be any storage media that can be read, written, or otherwise accessed by a general or special computing device, including any processing electronics and / or processing circuitry capable of executing instructions. For example, without limitation, computer-readable media can include any volatile semiconductor memory, such as RAM, DRAM, SRAM, T-RAM, Z-RAM, and TTRAM. Computer-readable media can also include any non-volatile semiconductor memory, such as ROM, PROM, EPROM, EEPROM, NVRAM, flash memory, nvSRAM, FeRAM, FeTRAM, MRAM, PRAM, CBRAM, SONOS, RRAM, NRAM, racetrack memory, FJG, and Millipede memory.

[0101] In addition, the computer-readable storage medium may include any non-semiconductor memory, such as optical disk storage, magnetic disk storage, magnetic tape, other magnetic storage devices, or any other medium capable of storing one or more instructions. In one or more specific implementations, the tangible computer-readable storage medium may be directly coupled to the computing device, while in other specific implementations, the tangible computer-readable storage medium may be indirectly coupled to the computing device, for example, via one or more wired connections, one or more wireless connections, or any combination thereof.

[0102] Instructions can be directly executable, or can be used to develop executable instructions. For example, instructions can be implemented as executable or non-executable machine code, or can be implemented as high-level language instructions that can be compiled to produce executable or non-executable machine code. In addition, instructions can also be implemented as data, or can include data. Computer executable instructions can also be organized in any format, including routines, subroutines, programs, data structures, objects, modules, applications, applets, functions, etc. As recognized by those skilled in the art, the details including but not limited to the number, structure, sequence and organization of instructions can be significantly different without changing the underlying logic, function, processing and output.

[0103] Although the above discussion mainly involves microprocessors or multi-core processors that execute software, one or more embodiments are performed by one or more integrated circuits such as ASICs or FPGAs. In one or more specific implementations, such integrated circuits execute instructions stored on the circuit itself.

[0104] Those skilled in the art will recognize that the various illustrative frames, modules, elements, parts, methods and algorithms described herein can be implemented as electronic hardware, computer software or a combination of the two. In order to illustrate this interchangeability of hardware and software, various illustrative frames, modules, elements, parts, methods and algorithms have been generally described above according to functionality. Whether such functionality is implemented as hardware or software depends on the specific application and the design constraints imposed on the entire system. The technician can implement the described functionality in different ways for each specific application. Various parts and frames can be arranged differently (e.g., arranged in different orders, or divided in different ways) without departing from the scope of the subject technology.

[0105] Should be understood that any particular order or the hierarchy of the frame in the disclosed process is an illustration of an exemplary method. Based on design preference, it should be understood that the particular order or the hierarchy of the frame in the process can be rearranged, or all shown frames can be executed. Any frame in these frames can be executed simultaneously. In one or more specific implementations, multitasking and parallel processing may be advantageous. In addition, the division of each system component in the above-mentioned embodiment should not be understood as requiring such division in all embodiments, and should be understood that program components and system can be generally integrated together in a single software product or encapsulated in a plurality of software products.

[0106] As used in this specification and any claims of this patent application, the terms "base station", "receiver", "computer", "server", "processor" and "memory" all refer to electronic devices or other technical devices. These terms exclude people or groups of people. For the purpose of this specification, the term "display" or "displaying" means displaying on an electronic device.

[0107] As used herein, the phrase "at least one of" following a list of items, any of which is separated by the terms "and" or "or", modifies the list as a whole, rather than each member of the list (i.e., each item). The phrase "at least one of" does not require selection of at least one of each item listed; rather, the phrase allows for a meaning that includes at least one of any one item and / or at least one of any combination of items and / or at least one of each item. For example, the phrase "at least one of A, B, and C" or "at least one of A, B, or C" each refers to only A, only B, or only C; any combination of A, B, and C; and / or at least one of each of A, B, and C.

[0108] The predicate words "configured to," "operable to," and "programmed to" do not imply any particular tangible or intangible modification of a subject matter but are intended to be used interchangeably. In one or more embodiments, a processor configured to monitor and control an operation or component may also mean that the processor is programmed to monitor and control the operation or that the processor is operable to monitor and control the operation. Likewise, a processor configured to execute code may be interpreted as a processor programmed to execute code or operable to execute code.

[0109] Phrases such as aspect, this aspect, on the other hand, some aspects, one or more aspects, a specific implementation, this specific implementation, another specific implementation, some specific implementations, one or more specific implementations, an embodiment, this embodiment, another embodiment, some embodiments, one or more embodiments, configuration, this configuration, other configurations, some configurations, one or more configurations, subject technology, disclosure, the present disclosure, other variations thereof, etc. are for convenience and do not mean that the disclosure involving such one or more phrases is essential to the subject technology, nor does it mean that such disclosure applies to all configurations of the subject technology. Disclosures involving such one or more phrases may apply to all configurations or one or more configurations. Disclosures involving such one or more phrases may provide one or more examples. Phrases such as aspect or some aspects may refer to one or more aspects and vice versa, and this applies similarly to the other aforementioned phrases.

[0110] The word "exemplary" is used herein to mean "serving as an example, instance, or illustration." Any implementation described herein as "exemplary" or as an "example" is not necessarily to be construed as preferred or advantageous over other implementations. Furthermore, to the extent that the terms "including," "having," and the like are used in the specification or claims, such terms are intended to be inclusive, in a manner similar to the way the term "comprising" is interpreted when used as a transitional word in a claim.

[0111] All structural and functional equivalents to the elements of the various aspects described throughout this disclosure that are known or later come to be known to those of ordinary skill in the art are expressly incorporated herein by reference and are intended to be covered by the claims. In addition, nothing disclosed herein is intended to be made available to the public regardless of whether the disclosure is explicitly recited in a claim. No claim element shall be interpreted under 35 U.S.C. §112(f) unless the element is explicitly recited using the phrase “means for” or, in the case of a method claim, the element is recited using the phrase “step for”.

[0112] The previous description is provided to enable those skilled in the art to practice the various aspects described herein. Various modifications of these aspects are apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects. Therefore, the claims are not intended to be limited to the aspects shown herein, but are intended to make the full scope consistent with the language claims, wherein reference to elements in singular values ​​is not intended to mean "only one", but refers to "one or more", unless specifically noted. Unless otherwise specifically stated, the term "some" refers to one or more. Male pronouns (e.g., his) include female and neutral (e.g., her and its), and vice versa. Titles and subtitles (if any) are used only for convenience and do not limit the subject disclosure.

Claims

1. A method comprising: obtaining, by a device and based on an operating state of the device, a first mixing curve from a plurality of mixing curves corresponding to a plurality of respective operating states of the device, wherein each of the plurality of mixing curves is a function of an ambient sound level; as well as A mix of the pass-through audio signal and the noise cancellation signal in the mixed output signal is dynamically adjusted based on a mix value obtained from the first mix curve using a current ambient sound level.

2. The method of claim 1, wherein the pass-through audio signal comprises a representation of one or more sounds in a physical environment of the device, and wherein the noise cancellation signal is configured to cancel the one or more sounds.

3. The method according to claim 2, further comprising An output of a speaker of the device is dynamically adjusted based on the mixed output signal.

4. The method of claim 1 , wherein the first mixing curve defines a first ambient sound level and a second ambient sound level, below which only the pass-through audio signal is used in the mixed output signal, and above which only the noise cancellation signal is used in the mixed output signal. 5 . The method of claim 4 , wherein the first mixing curve further defines a variable mixing amount of the pass-through audio signal and the noise cancellation signal for ambient sound levels between the first ambient sound level and the second ambient sound level.

6. The method of claim 5, wherein the variable mixing amount for the ambient sound level between the first ambient sound level and the second ambient sound level comprises: A first change in the ambient sound level between the first ambient sound level and an inflection point changes at a first rate and a second change in the ambient sound level between the inflection point and the second ambient sound level changes at at least a second rate. The method of claim 6 , wherein the first rate of change is greater than the second rate of change.

8. The method of claim 6, wherein the inflection point comprises a first inflection point, and wherein the second change in the ambient sound level between the inflection point and the second ambient sound level at at least the second rate comprises: A first portion of the second change changes at the second rate for the ambient sound level between the first inflection point and a second inflection point, and a second portion of the second change changes at a third rate for the ambient sound level between the second inflection point and the second ambient sound level.

9. The method according to claim 1, further comprising: detecting a change in the operating state of the device while dynamically adjusting the mixing of the pass-through audio signal and the noise cancellation signal in the mixed output signal based on the mixing value obtained from the first mixing curve using the current ambient sound level; deriving a second blending curve from the plurality of blending curves based on the detected change in the operating state; as well as The mixing of the pass-through audio signal and the noise cancellation signal in the mixed output signal is dynamically adjusted based on different mixing values ​​obtained from the second mixing curve using the current ambient sound level.

10. The method of claim 1, wherein the operational state of the device comprises one or more of: an operating mode of the device, an environmental condition in a physical environment of the device, or a motion state of a user of the device.

11. The method of claim 1 , further comprising determining the operational state of the device at least in part by: identifying a first operating state of the device occurring concurrently with a second operating state of the device; and The operating state is determined by selecting one of the first operating state and the second operating state with a higher priority.

12. The method of claim 1 , wherein dynamically adjusting the mixing of the pass-through audio signal and the noise cancellation signal in the mixed output signal based on the mixing value obtained from the first mixing curve using the current ambient sound level comprises: obtaining, at a first time, a first measurement of the current ambient sound level; generating the mixed output signal substantially at the first time by obtaining the mixing value from the first mixing curve based on the first measurement of the current ambient sound level; obtaining, at a second time, a second measurement of the current ambient sound level; as well as The mixed output signal is substantially generated at the second time by deriving a different mixing value from the first mixing curve based on the second measure of the current ambient sound level.

13. The method of claim 1, wherein the mixing value is configured to control eardrum sound pressure level.

14. The method according to claim 1, further comprising: before obtaining the blending value from the first blending curve, modifying the first blending curve based on a user input; as well as The mixing value is obtained from the modified mixing curve.

15. The method of claim 1 , wherein dynamically adjusting the mixing of the pass-through audio signal and the noise cancellation signal in the mixed output signal based on the mixing value obtained from the first mixing curve using the current ambient sound level comprises applying a frequency-dependent gain to the pass-through audio signal before generating the mixed output signal, wherein the frequency-dependent gain has a frequency dependency determined based on the mixing value.

16. The method according to claim 15, further comprising: obtaining an environment classification of an acoustic environment of the device using a machine learning model at the device, the machine learning model having been trained to classify the acoustic environment based at least in part on an audio input to the machine learning model; and The frequency dependent gain is determined based on the environmental classification.

17. A processor, the processor being configured to: obtaining a first mixing curve from a plurality of mixing curves corresponding to a plurality of respective operating states of the device based on an operating state of the device, wherein each of the plurality of mixing curves is a function of an ambient sound level; and A mix of the pass-through audio signal and the noise cancellation signal in the mixed output signal is dynamically adjusted based on a mix value obtained from the first mix curve using a current ambient sound level.

18. The processor of claim 17, wherein the pass-through audio signal comprises a representation of one or more sounds in a physical environment of the device, and wherein the noise cancellation signal is configured to cancel the one or more sounds.

19. The processor of claim 17, wherein the first mixing curve defines a first ambient sound level and a second ambient sound level, below which only the pass-through audio signal is used in the mixed output signal, and above which only the noise cancellation signal is used in the mixed output signal.

20. The processor of claim 19, wherein the first mixing curve further defines a variable mixing amount of the pass-through audio signal and the noise cancellation signal for ambient sound levels between the first ambient sound level and the second ambient sound level.

21. The processor of claim 20, wherein the variable mixing amount for the ambient sound level between the first ambient sound level and the second ambient sound level comprises: A first change in the ambient sound level between the first ambient sound level and an inflection point changes at a first rate and a second change in the ambient sound level between the inflection point and the second ambient sound level changes at at least a second rate.

22. A device comprising: Memory; and A processing circuit, the processing circuit being configured to: Get the blending curve; as well as Dynamically adjust the mixing of the pass-through audio signal and the noise cancellation signal in the mixed output signal based on a mixing value obtained from the mixing curve using a current ambient sound level, wherein the mixing curve defines a first ambient sound level, a second ambient sound level, and a variable mixing amount of the pass-through audio signal and the noise cancellation signal for an ambient noise level between the first ambient sound level and the second ambient sound level, below which only the pass-through audio signal is used in the mixed output signal, and above which only the noise cancellation signal is used in the mixed output signal.

23. The device of claim 22, wherein the processing circuit is configured to obtain the mixing curve based on an operating state of the device.