Synchronization of instability mitigation in audio devices

Abstract

This invention provides a method and system for controlling an audio device with active noise cancellation. The system detects instability conditions in a first earphone; uses a first controller to generate one or more control signals to adjust one or more ANR parameters of the first earphone, wherein the one or more ANR parameters are adjusted to change the first earphone from a first ANR state to a second ANR state to alleviate the instability conditions; and synchronizes one or more ANR parameters of the first earphone with a second earphone. In one example, the system returns the first earphone to the first ANR state after detecting that the first earphone has been removed from the user's ear at a first time and after detecting that the first earphone has been engaged with the ear at a second time.

Description

Background Technology

[0001] This disclosure generally relates to methods and systems for controlling audio devices such as headphones that have active noise cancellation. Summary of the Invention

[0002] All examples and features mentioned below can be combined in any technically possible way.

[0003] Generally speaking, in one aspect, a method for controlling an active noise cancellation (ANR) audio system is provided. The method includes: detecting an instability condition in a first headphone; using a first controller to generate one or more control signals to adjust one or more ANR parameters of the first headphone, wherein the one or more ANR parameters are adjusted to change the first headphone from a first ANR state to a second ANR state to alleviate the instability condition; and synchronizing the one or more ANR parameters of the first headphone with one or more parameters of a second headphone.

[0004] In one respect, the one or more ANR parameters involve at least one of a feedback filter, a feedforward filter, and an audio equalizer.

[0005] In one aspect, the method further includes detecting, at a first time, whether the first earphone is engaged with or removed from the user's ear at a first sensor of the first earphone; and at a second time, detecting, at a first sensor of the first earphone, whether the first earphone is engaged with or removed from the user's ear.

[0006] In one aspect, the method further includes returning the first earphone to a first ANR state and the second earphone to the first ANR state after detecting that the first earphone has been removed from the ear at a first time and after detecting that the first earphone has been engaged with the ear at a second time.

[0007] In one aspect, the method also includes prompting the user via an audio system to remove the first earphone and then reinsert it.

[0008] In one aspect, the method further includes returning the first earphone to the first ANR state and the second earphone to the first ANR state after a predetermined amount of time has elapsed since one or more ANR parameters of the first earphone were adjusted to transition the first earphone from a first ANR state to a second ANR state to alleviate the instability.

[0009] In one aspect, the method further includes detecting a predetermined number of times the first earphone switches from a first ANR state to a second ANR state, from the second ANR state to the first ANR state, and then from the first ANR state to the second ANR state; and keeping the first earphone in the second ANR state.

[0010] In one aspect, the first sensor of the first earphone includes at least one of the following: a gyroscope, an accelerometer, an infrared sensor, a magnetometer, an acoustic sensor, a motion sensor, a piezoelectric sensor, a piezoresistive sensor, a capacitive sensor, and a magnetic field sensor.

[0011] Generally speaking, in one aspect, an active noise cancellation (ANR) audio system is provided. The audio system includes: a first earphone, the first earphone including: a first controller, the first controller being configured to: detect instability conditions in the first earphone; and generate one or more control signals to adjust one or more ANR parameters of the first earphone, wherein the one or more ANR parameters are adjusted to change the first earphone from a first ANR state to a second ANR state to alleviate the instability conditions; and synchronize the one or more ANR parameters of the first earphone with one or more ANR parameters of a second earphone. The audio system also includes: a second earphone, the second earphone including a second controller, the second controller being configured to: detect instability conditions in the second earphone; and generate one or more control signals to adjust one or more ANR parameters of the second earphone, wherein the one or more ANR parameters are adjusted to change the second earphone from a first ANR state to a second ANR state to alleviate the instability conditions; and synchronize the one or more ANR parameters of the second earphone with one or more ANR parameters of the first earphone.

[0012] In one respect, the one or more ANR parameters involve at least one of a feedback filter, a feedforward filter, and an audio equalizer.

[0013] In one aspect, the audio system also includes a first sensor for the first earpiece, the first sensor being arranged to detect at a first time whether the first earpiece is engaged with or removed from the user's ear, and at a second time whether the first earpiece is engaged with or removed from the user's ear.

[0014] In one aspect, the first controller is configured to return the first earphone to a first ANR state after detecting that the first earphone has been removed from the ear at a first time and after detecting that the first earphone has been engaged with the ear at a second time.

[0015] In one aspect, the first controller is arranged to return the first earphone to the first ANR state after a predetermined amount of time has elapsed since one or more ANR parameters of the first earphone were adjusted to transition the first earphone from a first ANR state to a second ANR state to alleviate instability.

[0016] In one aspect, the first controller is configured to detect a predetermined number of times the first earphone switches from a first ANR state to a second ANR state, from the second ANR state to the first ANR state, and then from the first ANR state to the second ANR state, and to keep the first earphone in the second ANR state.

[0017] In one aspect, the first sensor of the first earphone includes at least one of the following: a gyroscope, an accelerometer, an infrared sensor, a magnetometer, an acoustic sensor, a motion sensor, a piezoelectric sensor, a piezoresistive sensor, a capacitive sensor, and a magnetic field sensor.

[0018] In one aspect, a computer program product is provided for performing a method of controlling an active noise cancellation (ANR) audio system. The computer program product has a set of non-transitory computer-readable instructions stored in memory and executable by a processor. This set of non-transitory computer-readable instructions is arranged to: detect an instability condition in a first earpiece; use a first controller to generate one or more control signals to adjust one or more ANR parameters of the first earpiece, wherein the one or more ANR parameters are adjusted to change the first earpiece from a first ANR state to a second ANR state to alleviate the instability condition; and synchronize one or more ANR parameters of the first earpiece with one or more parameters of the second earpiece.

[0019] In one respect, the one or more ANR parameters involve at least one of a feedback filter, a feedforward filter, and an audio equalizer.

[0020] In one aspect, the computer program product has a non-transitory computer-readable instruction set, which is further configured to: at a first time, detect whether the first earphone is engaged with or removed from the user's ear at a first sensor of the first earphone; and at a second time, detect whether the first earphone is engaged with or removed from the user's ear at a first sensor of the first earphone.

[0021] In one aspect, the computer program product has a non-transitory computer-readable instruction set, which is further configured to: after detecting that the first earphone has been removed from the user's ear at a first time and after detecting that the first earphone has been engaged with the ear at a second time, return the first earphone to a first ANR state and return the second earphone to the first ANR state.

[0022] In one aspect, the computer program product has a non-transitory computer-readable instruction set, which is further configured to: return the first earphone to the first ANR state after a predetermined amount of time has elapsed since one or more ANR parameters of the first earphone were adjusted to transition the first earphone from a first ANR state to a second ANR state to alleviate instability. Attached Figure Description

[0023] Figure 1 An example of the audio system disclosed herein is shown.

[0024] Figure 2A A first earphone is shown as an example according to this disclosure.

[0025] Figure 2B A second headset is shown as an example according to this disclosure.

[0026] Figure 3A An exemplary configuration of components included in a first earphone according to this disclosure is illustrated schematically.

[0027] Figure 3B An exemplary configuration of components included in a second earphone according to this disclosure is illustrated schematically.

[0028] Figure 4 This is a schematic diagram of an exemplary active noise cancellation system that combines a feedback component and a feedforward component.

[0029] Figure 5 This is a flowchart illustrating the steps of a method according to an aspect of this disclosure.

[0030] Figure 6 It is a representation of a computer program product according to aspects of this disclosure. Detailed Implementation

[0031] In headphones with active noise cancellation (“ANR”) functionality, such as wireless headphones, instability in the headphones can be detected, and the ANR parameters in those headphones can be changed to mitigate the instability. This disclosure provides a method and system for automatically adjusting the ANR parameters in one headphone when the ANR parameters in one headphone have been changed after instability has been detected. As an example, after an instability condition is detected in a first headphone, one or more control signals are generated to adjust one or more ANR parameters of the first headphone. The one or more ANR parameters are adjusted to change the first headphone from a first ANR state to a second ANR state, for example, from a more aggressive ANR mode to a less aggressive ANR mode, which, for example, reduces noise in a narrower frequency range or depth to mitigate the instability condition. A controller in the first headphone synchronizes the changed ANR parameters with the second headphone. After detecting that the headphone in which the instability condition was detected has been removed from and returned to the user's ear, the system automatically returns both the first and second headphone to the first ANR state, for example, the more aggressive ANR mode. Alternatively, other methods, such as using a configurable timer, can be used to return the headphones to the first ANR state. It has been observed that the user experience is improved when the ANR parameters of the first and second earphones, which have been modified to mitigate instability, are synchronized.

[0032] The term "headphones" is intended to refer to a device that is mounted around, on, inside, or near the ear and radiates sound energy into or toward the ear canal. Headphones are sometimes called earpieces, earphones, over-ear receivers, earbuds, or sports headphones, and can be wired or wireless. Headphones include acoustic drivers to convert audio signals into sound energy. The acoustic drivers may be housed in earcups. While some of the accompanying figures and descriptions may show a single headphone, a headphone can be a single, independent unit or one of a pair of headphones (each including its own acoustic driver and earcups), each corresponding to one ear. Headphones can be mechanically connected to another headphone, for example, via a headband and / or via leads that conduct audio signals to the acoustic drivers in the headphones. Headphones may include components for wirelessly receiving audio signals. Headphones may include components of an active noise cancellation system. Headphones may also include other features, such as a microphone, enabling them to function as over-ear headphones. Figure 1 An example of an over-ear headphone is shown, but in other examples, the headphone may be an in-ear headphone, an over-ear headphone, or a near-ear headphone. In some examples, the headphone may be an open-ear device, which includes an acoustic driver that radiates sound energy toward the ear canal while keeping the ear open to its environment and surroundings.

[0033] Now refer to the attached diagram, Figure 1An audio system 100 is schematically illustrated. The audio system 100 typically includes a first headset 102, a second headset 104, and a first device 106. Both the first headset 102 and the second headset 104 are arranged to communicate with the first device 106 and / or with each other. The first device 106 can be any device capable of establishing a connection with the first headset 102 and / or the second headset 104, either wirelessly via a wireless protocol known in the art or via a wired connection, i.e., via a cable capable of transmitting data signals from the first device 106 to the first headset 102 or the second headset 104. In one example, the first device 106 is a smartphone with a computer-executable application installed thereon, such that a connection between the first device 106, the first headset 102, and / or the second headset 104 can be established using a user interface on the first device 106. As an example, the first earpiece 102 and / or the second earpiece 104 may be connected to a server in the cloud or on the Internet that is capable of transmitting data signals to the first earpiece 102 or the second earpiece 104, and the first device 106 may not be required.

[0034] Figure 2A A first earphone 102 is shown. The first earphone 102 includes a housing, which also includes a first driver 108 and (reference) Figure 3A The first antenna 110 and the first driver are acoustic transducers for converting, for example, electrical signals into audio signals that can be heard by the user. The first audio signal may correspond to data associated with at least one digital audio file, which can be streamed wirelessly to the first device 106 or the first earphone 102, stored in the first memory 112 (discussed below), or stored in the memory of the first device 106. The first antenna 110 is arranged to transmit wireless communication information and receive wireless communication information from, for example, the second earphone 104 or the first device 106. The first earphone 102 includes a controllable ANR subsystem. The first earphone 102 includes one or more microphones, such as a first feedforward microphone 114 and / or a first feedback microphone 116. The first feedforward microphone 114 may be configured to sense acoustic signals outside the first earphone when the first earphone 102 is properly worn, for example, configured to detect acoustic signals in the surrounding environment before they reach the user's ear. Feedback microphone 116 may be configured to sense acoustic signals within the acoustic volume formed by the user's ear when the first earphone 102 is properly worn, for example, configured to detect acoustic signals arriving at the user's ear. In various examples, the earphone may include one or more drivers, and in some cases, the earphone may include only a feedforward microphone or only a feedback microphone (or multiple feedback microphones and / or feedforward microphones). Additionally, the first earphone 102 may also include a first sensor 118 to detect proximity or engagement with the user U's ear E. Although in Figure 2A The first sensor 118 is shown as being disposed on the earbud of the first earphone 103, but the first sensor 118 may alternatively be disposed on or within the housing of the first earphone 102. The first sensor 118 may be any of the following: a gyroscope, accelerometer, magnetometer, infrared (IR) sensor, acoustic sensor (e.g., microphone or acoustic driver), motion sensor, piezoelectric sensor, piezoresistive sensor, capacitive sensor, magnetic field sensor, or any other sensor known in the art capable of determining whether the first earphone 102 is close to, engaged with, within, or removed from the ear of the user U.

[0035] refer to Figure 3A The first earphone 102 also includes a first controller 120. In one example, the first controller 120 includes at least a first processor 122 and a first memory 112. The first processor 122 and the first memory 112 of the first controller 120 are arranged to receive, transmit, store, and execute at least one ANR parameter 124 from a set of ANR parameters 126 based on signals from a first feedforward microphone 114 and / or a first feedback microphone 116. The at least one ANR parameter may relate to a feedback filter, a feedforward filter, or an audio equalizer. The first processor 122 and the first memory 112 of the first controller 120 are arranged to receive, transmit, store, and execute at least one user control setting of a first set of user control settings 128. In one example, the first set of user control settings 128 may include settings such as, but not limited to, increasing or decreasing the volume of an audio signal reproduced by the audio system 100; starting / playing / stopping / pausing an audio signal reproduced by the audio system 100; answering or rejecting a phone call; accepting or ignoring a notification; and accessing a voice assistant, such as Alexa, Google Assistant, or Siri.

[0036] Figure 2B A second earphone 104 is shown. The second earphone 104 also includes a housing that further includes a second driver 130 arranged to reproduce a second audio signal and (see reference) Figure 3BThe second antenna 132. The second audio signal may correspond to data associated with at least one digital audio file, which can be streamed wirelessly to the first microphone 102 or the second earphone 104 via a wireless connection, stored in the second memory 134 (discussed below), or stored in the memory of the first device 106. The second antenna 132 is arranged to transmit wireless communication information and receive wireless communication information from, for example, the first earphone 102 or the first device 106. The second earphone 104 also includes a controllable active noise cancellation system. The second earphone 104 includes one or more microphones, such as a second feedforward microphone 136 and / or a second feedback microphone 138. In various examples, the earphone may include one or more drivers, and in some cases the earphone may include only a feedforward microphone or only a feedback microphone (or multiple feedback microphones and / or feedforward microphones). The second earphone 104 may also include a second sensor 140 to detect proximity or engagement with the user U's ear E. Although in Figure 2B The second sensor 140 is shown as being disposed on the earbud of the second earphone 104, but the second sensor 140 may alternatively be disposed on or within the housing of the second earphone 104. The second sensor 140 may be any of the following: a gyroscope, accelerometer, magnetometer, infrared (IR) sensor, acoustic sensor (e.g., microphone or acoustic driver), motion sensor, piezoelectric sensor, piezoresistive sensor, capacitive sensor, magnetic field sensor, or any other sensor known in the art capable of determining whether the second earphone 104 is close to, engaged with, within, or removed from the ear of the user U.

[0037] refer to Figure 3B The second earphone 104 also includes a second controller 142. In one example, the second controller 142 includes at least a second processor 144 and a second memory 134. The second processor 144 and the second memory 134 of the second controller 142 are arranged to receive, transmit, store, and execute at least one ANR parameter 125 from a set of ANR parameters 127 based on signals from a second feedforward microphone 136 and / or a second feedback microphone 138. The at least one ANR parameter may relate to a feedback filter, a feedforward filter, and an audio equalizer. The second processor 144 and the second memory 134 of the second controller 142 are also arranged to receive, transmit, store, and execute at least one user control setting from a second set of user control settings 146.

[0038] An ANR subsystem is used to eliminate or reduce unwanted or unpleasant noise. The ANR subsystem may include an electroacoustic or electromechanical system configured to eliminate at least some of the unwanted noise (often referred to as the main noise) based on the principle of superposition. This can be accomplished by identifying the amplitude and phase of the main noise and generating another signal (often referred to as an anti-noise signal) with approximately the same amplitude and opposite phase. A suitable anti-noise signal is combined with the main noise such that both are substantially eliminated at the location of the error sensor (e.g., eliminated within specifications or acceptable tolerances). In this regard, in the exemplary specific implementation described herein, “eliminating” noise may include reducing the “eliminating” noise to a specified level or within acceptable tolerances, and does not require complete elimination of all noise. The noise cancellation system may include feedforward and / or feedback characteristics. A feedforward component detects noise external to the headset (e.g., via an external microphone) and is used to provide an anti-noise signal to cancel the external noise intended to be transmitted to the user's ears. The feedback component detects acoustic signals arriving at the user's ear (e.g., via an internal microphone) and processes the detected signals to cancel out any signal components not intended to be part of the user's acoustic experience. Although described herein as being coupled to or positioned to connect to other systems via wired or wireless means, it should be understood that the noise cancellation system can operate independently of any other system or equipment.

[0039] Figure 4 An exemplary system and method are shown for processing, for example, a microphone signal in a first earphone 102 to reduce noise reaching the ear E of a user U. Although the following example describes an instability condition in the first earphone 102, it should be understood that both the first earphone 102 and the second earphone 104 have separate first controllers 120 and second controllers 142, which can each detect and mitigate instability conditions in the first earphone 102 and the second earphone 104, respectively, and the system and method described below can also be implemented on the second earphone 104. Figure 4A simplified schematic diagram highlighting the features of the noise reduction system is presented. Various examples of a complete system may include amplifiers, analog-to-digital converters (ADCs), digital-to-analog converters (DACs), equalization, subband splitting and synthesis, and other signal processing. In some examples, the playback signal 148,p(t) may be received to be presented as an acoustic signal by the first driver 108. A first feedforward microphone 114 provides a feedforward signal 150, which is processed by a feedforward processor 122A of the first processor 122 having a feedforward transfer function 156,Kff to generate a feedforward noise immunity signal 152. A first feedback microphone 116 provides a feedback signal 154, which is processed by a feedback processor 122B of the first processor 122 having a feedback transfer function 158,Kfb to generate a feedback noise immunity signal 160. In various examples, any one of the playback signal 148, the feedforward noise immunity signal 152, and / or the feedback noise immunity signal 160 may be combined, for example, by a combiner 162 to generate a driver signal 164,d(t) to be provided to the first driver 108. In various examples, any of the playback signal 148, the feedforward noise immunity signal 152, and / or the feedback noise immunity signal 160 may be omitted, and / or components required to support any of these signals may not be included in a particular implementation of the system.

[0040] The first feedback microphone 116 can be configured to detect sound within an acoustic volume including the user's ear, and thus can detect the acoustic signal 166 generated by the first driver 108, creating a loop. Therefore, in various examples and / or at various times, a feedback loop can exist that generates the acoustic signal 166 from the driver signal 164 via the first driver 108, which is picked up by the feedback microphone, such as the first feedback microphone 116, processed by the feedback transfer function 158,Kfb, and included in the driver signal 164. Thus, at least some components of the feedback signal 154 are caused by the acoustic signal 166 presented from the driver signal 164. In other words, the feedback signal 154 includes components associated with the driver signal 164. The response of the feedback signal 154 to the driver signal 164 is characterized by the controlled volume transfer function 168,G.

[0041] When an ANR subsystem is deployed in headphones, certain instabilities, if not addressed quickly, can cause the headphones to produce loud sounds that are uncomfortable for the user. Instabilities can occur in a variety of ways. As an example, an instability may occur due to a change in the transfer function of the acoustic path between the first driver 108 and the first feedback microphone 116 of the controllable ANR subsystem. This can happen, for example, if the acoustic path between the first driver 108 and the first feedback microphone 116 changes in size or shape. This can be indicated, for example, by blocking an opening (e.g., using a finger or palm) through which sound is emitted from the headphones. In the case of headphones with nozzles that have acoustic channels that couple the front cavity acoustics of the acoustic transducer into the user's ear canal, this condition can be referred to as a nozzle-blocking condition. In practice, this condition can occur, for example, during the insertion / removal of the headphones from the ear. This effect is particularly observable in smaller headphones (e.g., in-ear headphones), where the secondary path can change if the headphones or hearing aid are moved during wear. For example, moving an in-ear headphone can cause changes in the air volume in the corresponding secondary path, which can destabilize the controllable ANR subsystem.

[0042] As another example, instability can occur in an audio system 100 that includes a “perception mode” feature, where an external microphone, such as a first feedforward microphone 114, is used to detect external sounds that the user might want to hear, and a first processor 122 is configured to allow such sounds to pass, for example, to be reproduced by the first driver 108, or to pass with only minimal signal processing. In a specific implementation of headphones that includes a perception mode, several conditions can lead to the onset of instability. For example, if the output of the first driver 108 is fed back to the first feedforward (or external) microphone 114, and the first processor 122 passes a signal back to the first driver 108 (as is typical in perception mode), this can lead to a rapidly deteriorating instability of unpleasant sounds emanating from the first driver 108. This can be illustrated, for example, by cupping the headphones with one's hand to facilitate the feedback path between the first driver 108 and the external microphone 114. Another example of pressure fluctuations that can lead to instability is significant changes in ambient pressure relative to the normal atmospheric pressure at sea level. The instability detection described in this paper and the examples can increase the bandwidth range within which noise reduction of the ANR processor can be effective.

[0043] As explained in U.S. Patent No. 10,244,306, instability conditions can be detected by analyzing the relationship between the feedback microphone signal and the driver signal (e.g., by comparing feedback signal 154 and driver signal 164), the entire contents of which are incorporated herein by reference. Other systems and methods for detecting and mitigating instability are described in U.S. Patent No. 9,922,636, the entire contents of which are incorporated herein by reference. When instability is detected, the systems described herein can respond in various ways, such as by adjusting ANR parameters, to mitigate or eliminate instability and / or the adverse consequences of instability. For example, the audio system may adjust the gain of the feedback filter, such as the filter associated with the feedback microphone (e.g., the first feedback microphone 116) applied to the controlled ANR subsystem; adjust the gain of the feedforward filter, such as the filter associated with the feedforward microphone (e.g., the first feedforward microphone 114) applied to the ANR subsystem; adjust the audio equalization settings; change or replace the feedback transfer function 158; change the processing of the feedback signal or feedforward signal; change to a less aggressive form of noise reduction; change various parameters of the noise reduction system to become less aggressive; change the amplitude of the driver signal (e.g., mute, reduce, or limit the driver signal 164); change, for example, the processing phase response of the driver signal 164 and / or the feedback signal 154 or the feedforward signal 150 in an attempt to disrupt the instability; provide indications to the user (e.g., audible or voice messages, indicator lights, etc.); and / or other actions. In some cases, the ability to detect and respond to instability can allow for the design of a more aggressive feedback or feedforward compensator that operates over a wider frequency range than otherwise possible. In addition, in response to the detection of an unstable condition, the parameters used to detect the unstable condition can be changed, thereby dynamically detecting instability, for example, by lowering the threshold used to detect and respond to the unstable condition after it has been detected.

[0044] During operation of the audio system 100, the first earpiece 102 and / or the second earpiece 104 may be paired with or connected to the first device 106 (e.g., a smartphone) (e.g., using known Bluetooth, Bluetooth Low Energy, or other wireless protocols). An audio stream may be established between the first device 106, the first earpiece 102, and the second earpiece 104. The audio stream may include data associated with an audio file streamed wirelessly or a stored audio file. An ANR subsystem is capable of operating on the first earpiece 102 and the second earpiece 104 to reduce unwanted noise from the environment, wherein the first earpiece 102 operates using a first set of ANR parameters 126, and the second earpiece 104 operates using a second set of ANR parameters 127. In a system with an individually controllable ANR subsystem for each earpiece, an unstable condition that could lead to instability can be detected in one earpiece, such as the first earpiece 102, due to the positioning of the nozzle in the ear, for example, the first earpiece 102 causing nozzle blockage. The first controller 120 may detect the unstable condition according to the method described above. The first controller 120 can then generate one or more control signals to adjust one or more ANR parameters of the first earphone, such as a first set of ANR parameters 126. For example, the first controller 120 can change the gain associated with a filter applied to the first feedback microphone 116, adjust the gain associated with a filter applied to the first feedforward microphone 114, or adjust the audio equalization settings of the first earphone 102 to change the ANR parameters to a less aggressive ANR setting, which can, for example, reduce or eliminate unwanted noise in a narrower frequency range or shallower depth. A first ANR state is an operating state in which the ANR parameters are set when an instability condition is detected, and a second ANR state describes an operating state in which the ANR parameters have been adjusted to mitigate the instability condition. The first controller 120 then sends data to the second controller 142 regarding one or more ANR parameters in the first set of ANR parameters 126 that have been adjusted. The second controller 142 receives data relating to one or more ANR parameters 124 from the first set of ANR parameters 126 that have been adjusted, and adjusts the second set of ANR parameters 127 to match the ANR parameters of the first earphone 102 in the second ANR state. It should be understood that in some cases, it may be advantageous for the system 100 to have ANR parameters on one earphone that differ from those on the other. For example, the second controller 142 may change fewer ANR parameters for the second earphone 104 than all the ANR parameters adjusted by the first controller 120 for the first earphone 102.

[0045] If a sensor (e.g., first sensor 118) detects that an earphone (in this case, first earphone 102) in which an instability condition has been detected engages with a user's ear at a first moment and is then removed from the user's ear at a second moment, a first controller 120 will change the ANR parameters of the first earphone 102 to transition the ANR settings to a first ANR state. The first controller 120 will then send data to a second controller 142 regarding one or more ANR parameters 124 that have been adjusted, which adjusts a second set of ANR parameters 127 to transition the second earphone 104 to the first ANR state. As an example, the audio system may also prompt the user to remove and then reinsert an earphone in which an instability condition has been detected. This prompt may be provided by the ANR controller or any other controller operating in the audio system. The user may receive the prompt as an auditory, visual, or tactile cue on earphones 102 / 104 or the first device 106. As another example, the first controller or the second controller 120 / 142, or any other controller in the audio system, may include a timer and may return the first earphone 102 and the second earphone 104 to the first state after a predetermined amount of time has elapsed since the time when the first earphone 102 and / or the second earphone 104 switched from the first ANR state to the second ANR state after an instability condition was detected. As another example, if the first controller / second controller 120 / 142 detects that the first earphone / second earphone 102 / 104 switched from the first ANR state to the second ANR state in response to an instability condition, and then switched back from the second ANR state to the first ANR state after a predetermined amount of time, and the earphones switched from the first ANR state to the second ANR state again in response to an instability condition a predetermined number of times, the first controller / second controller 120 / 142 may keep the first earphone 102 and the second earphone 104 in the second ANR state and not return them to the first ANR state. As another example, the predetermined amount of time that must elapse is configurable, for example, such that the amount of time required for the headphones to switch from a second ANR state to a first ANR state increases as the number of times the headphones switch ANR states in response to instability conditions increases. As another example, the predetermined amount of time that must elapse is configurable, for example, such that the amount of time depends on how long after returning to a more positive state a new instability condition is detected.

[0046] Figure 5This is a flowchart illustrating the steps of a method for controlling an audio system according to the present disclosure. Method 200 includes the following steps: detecting an instability condition in a first earphone 102 (step 210); generating one or more control signals using a first active noise cancellation (ANR) controller to adjust one or more ANR parameters of the first earphone 102, wherein adjusting the one or more ANR parameters changes the first earphone 102 from a first ANR state to a second ANR state to alleviate the instability condition (step 220); synchronizing one or more ANR parameters of the first earphone 102 with one or more parameters of a second earphone 104 (230); and at a first time, in the first earphone 102… Step 240: At a second time, the first sensor 118 of the first earphone 102 detects whether the first earphone 102 is engaged with or removed from the user's ear; at a second time, the first sensor 118 of the first earphone 102 detects whether the first earphone 102 is engaged with or removed from the user's ear (step 250); and after detecting that the first earphone 102 is removed from the ear at the first time and detecting that the first earphone 102 is engaged with the ear at the second time, the first earphone 102 is returned to the first ANR state and the second earphone 104 is returned to the first ANR state (step 260). Furthermore, the method may include the following step: after a predetermined amount of time has elapsed since the time when one or more ANR parameters of the first earphone 102 were adjusted to transition the first earphone 102 from the first ANR state to the second ANR state to alleviate instability, the first earphone 102 is returned to the first ANR state and the second earphone 104 is returned to the first ANR state (step 270). The method may further include the following steps: detecting the first earphone 102 switching from a first ANR state to a second ANR state, switching from the second ANR state to the first ANR state, and then switching from the first ANR state to the second ANR state a predetermined number of times; and keeping the first earphone 102 in the second ANR state (step 280).

[0047] Computer program product 300 for performing methods to control an audio system Figure 6 (As shown) can have a non-transitory computer-readable instruction set. This non-transitory computer-readable instruction set can be stored in the first earpiece 102 and the second earpiece 104 (e.g., Figure 2A and Figure 2BThe set of non-transitory computer-readable instructions can be arranged to: detect an instability condition in the first earphone 102 (310); generate one or more control signals using a first active noise cancellation (ANR) controller to adjust one or more ANR parameters of the first earphone 102, wherein adjusting the one or more ANR parameters changes the first earphone 102 from a first ANR state to a second ANR state to alleviate the instability condition (320); and synchronize one or more ANR parameters of the first earphone 102 with one or more parameters of the second earphone 104 (330); detect at a first sensor 118 of the first earphone whether the first earphone 102 is engaged with or removed from the user's ear at a first time; and at a second time... At the second time, the first sensor 118 of the first earphone detects whether the first earphone 102 is engaged with or removed from the user's ear (340); after detecting that the first earphone 102 is removed from the user's ear at the first time and detecting that the first earphone 102 is engaged with the ear at the second time, the first earphone 102 is returned to the first ANR state and the second earphone 104 is returned to the first ANR state (350); and after a predetermined amount of time has elapsed since the time when one or more ANR parameters of the first earphone 102 were adjusted to transition the first earphone 102 from the first ANR state to the second ANR state to alleviate the instability, the first earphone 102 is returned to the first ANR state (360).

[0048] Furthermore, this set of non-transitory computer-readable instructions can be arranged to: after a predetermined amount of time has elapsed since one or more ANR parameters of the first earphone 102 were adjusted to transition the first earphone 102 from a first ANR state to a second ANR state to alleviate instability, return the first earphone 102 to the first ANR state and the second earphone 104 to the first ANR state (370). This set of non-transitory computer-readable instructions can be arranged to: detect a predetermined number of transitions from the first ANR state to the second ANR state, from the second ANR state to the first ANR state, and then from the first ANR state to the second ANR state; and maintain the first earphone 102 in the second ANR state (380).

[0049] The examples of the described subject matter described above can be implemented in any of a variety of ways. For example, some aspects can be implemented using hardware, software, or a combination thereof. When any aspect is implemented at least partially in software, the software code can execute on any suitable processor or set of processors, whether provided in a single device or computer or distributed among multiple devices / computers.

[0050] This disclosure can be implemented as a system, method, and / or computer program product at any possible level of technical detail integration. A computer program product may include a computer-readable storage medium (or media) having computer-readable program instructions thereon for causing a processor to execute aspects of this disclosure.

[0051] Computer-readable storage media can be tangible means capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example, but not limited to, electronic storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination of the foregoing. A less complete list of more specific examples of computer-readable storage media includes: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable optical disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices such as punch cards or raised structures in recesses on which instructions are recorded, and any suitable combination of the foregoing. As used herein, computer-readable storage media should not be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0052] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to a corresponding computing device / processing device, or downloaded via a network such as the Internet, a local area network, a wide area network, and / or a wireless network to an external computer or external storage device. The network may include copper cables, optical fibers, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing device / processing device receives the computer-readable program instructions from the network and forwards them to a computer-readable storage medium within the corresponding computing device / processing device.

[0053] Computer-readable program instructions used to perform the operations of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, integrated circuit configuration data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk and C++, and procedural programming languages ​​such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the latter case, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some examples, the electronic circuitry, including, for example, programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), may execute the computer-readable program instructions by personalizing the electronic circuitry with the status information of the computer-readable program instructions in order to perform aspects of this disclosure.

[0054] This document describes aspects of the disclosure with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to examples of the disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0055] Computer-readable program instructions may be provided to a processor of a special-purpose computer or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / actions specified in one or more blocks of a flowchart and / or block diagram. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and / or other means to function in a particular manner, such that the computer-readable storage medium storing the instructions includes an article of writing comprising instructions for implementing aspects of the functions / actions specified in the flowchart and / or block diagram or blocks.

[0056] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device, thereby producing a computer-implemented process, such that the instructions, which execute on the computer, other programmable apparatus or other device, perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0057] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible specific implementations of systems, methods, and computer program products according to various examples of this disclosure. In this regard, each block in a flowchart or block diagram may represent a portion of a module, segment, or instruction, which includes one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions described in the blocks may not occur in the order shown in the drawings. For example, depending on the function involved, two blocks shown consecutively may actually be executed substantially simultaneously, or the blocks may sometimes be executed in reverse order. It will also be noted that each block in the block diagrams and / or flowchart illustrations, and combinations of blocks in the block diagrams and / or flowchart illustrations, may be implemented by a dedicated hardware-based system that performs the specified function or action or executes a combination of dedicated hardware and computer instructions.

[0058] Other specific implementations are within the scope of the following claims and other claims that the applicant may enjoy.

[0059] While various examples have been described and illustrated herein, those skilled in the art will readily conceive of a variety of other means and / or structures for performing the functions described herein and / or obtaining one or more of the results and / or advantages described herein, and each of such variations and / or modifications is considered to be within the scope of the examples described herein. More generally, those skilled in the art will readily understand that all parameters, dimensions, materials, and configurations described herein are intended to be exemplary, and actual parameters, dimensions, materials, and / or configurations will depend on one or more specific applications using the teachings. Those skilled in the art will recognize, or be able to determine, many equivalents of the specific examples described herein using only conventional experimentation. Therefore, it should be understood that the above embodiments are presented by way of example only, and that the examples may be practiced in ways other than those specifically described and claimed within the scope of the appended claims and their equivalents. The examples of this disclosure relate to each individual feature, system, article of manufacture, material, kit, and / or method described herein. Additionally, any combination of two or more such features, systems, articles of manufacture, materials, kits, and / or methods is included within the scope of this disclosure if such features, systems, articles of manufacture, materials, kits, and / or methods do not contradict each other.

Claims

1. A method for controlling an active noise cancellation (ANR) audio system, comprising: Detect instability in the first earphone; A first controller is used to generate one or more control signals to adjust one or more ANR parameters of the first earphone, wherein the one or more ANR parameters are adjusted to change the first earphone from a first ANR state to a second ANR state to alleviate the instability. To synchronize one or more ANR parameters of the first earphone with one or more parameters of the second earphone; At the first moment, the first sensor of the first earphone detects whether the first earphone is engaged with the user's ear or removed from the user's ear; And at a second time, at a first sensor of the first earphone, it is detected whether the first earphone is engaged with the user's ear or removed from the user's ear; as well as After detecting that the first earphone was removed from the ear at the first time and that the first earphone was engaged with the ear at the second time, the first earphone is returned to the first ANR state and the second earphone is returned to the first ANR state.

2. The method of claim 1, wherein the one or more ANR parameters relate to at least one of a feedback filter, a feedforward filter, and an audio equalizer.

3. The method according to claim 1 further includes prompting the user to remove the first earphone and then reinsert it via the audio system.

4. The method of claim 1, further comprising, after a predetermined amount of time elapsed from the time when the one or more ANR parameters of the first earphone were adjusted to transition the first earphone from the first ANR state to the second ANR state to alleviate the instability, returning the first earphone to the first ANR state and the second earphone to the first ANR state.

5. The method of claim 1, further comprising detecting a predetermined number of times the first earphone switches from the first ANR state to the second ANR state, from the second ANR state to the first ANR state, and then from the first ANR state to the second ANR state; and keeping the first earphone in the second ANR state.

6. The method according to claim 1, wherein the first sensor of the first earphone comprises at least one of the following: a gyroscope, an accelerometer, an infrared sensor, a magnetometer, an acoustic sensor, a motion sensor, a piezoelectric sensor, a piezoresistive sensor, a capacitive sensor, and a magnetic field sensor.

7. An active noise cancellation (ANR) audio system, comprising: A first earphone, the first earphone comprising: A first controller, the first controller being arranged as follows: Detecting instability in the first earphone and generating one or more control signals to adjust one or more ANR parameters of the first earphone, wherein the one or more ANR parameters are adjusted to change the first earphone from a first ANR state to a second ANR state to alleviate the instability; and To synchronize the one or more ANR parameters of the first earphone with the one or more ANR parameters of the second earphone, and A first sensor is configured to detect, at a first time, whether the first earphone is engaged with or removed from the user's ear, and at a second time, whether the first earphone is engaged with or removed from the user's ear. The first controller is configured to return the first earphone to the first ANR state after detecting that the first earphone is removed from the ear at the first time and after detecting that the first earphone is engaged with the ear at the second time. The second earphone includes: A second controller, the second controller being arranged as follows: Detecting instability in the second earphone and generating one or more control signals to adjust one or more ANR parameters of the second earphone, wherein the one or more ANR parameters are adjusted to change the second earphone from a first ANR state to a second ANR state to alleviate the instability; and To synchronize the one or more ANR parameters of the second earphone with the one or more ANR parameters of the first earphone.

8. The audio system of claim 7, wherein the one or more ANR parameters relate to at least one of a feedback filter, a feedforward filter, and an audio equalizer.

9. The audio system of claim 7, wherein the first controller is arranged to return the first earphone to the first ANR state after a predetermined amount of time has elapsed since the time from which the one or more ANR parameters of the first earphone were adjusted to transition the first earphone from the first ANR state to the second ANR state to alleviate the instability.

10. The audio system of claim 7, wherein the first controller is arranged to detect the first earphone switching from the first ANR state to the second ANR state, from the second ANR state to the first ANR state, and then from the first ANR state to the second ANR state a predetermined number of times and to keep the first earphone in the second ANR state.

11. The audio system of claim 7, wherein the first sensor of the first earphone comprises at least one of the following: a gyroscope, an accelerometer, an infrared sensor, a magnetometer, an acoustic sensor, a motion sensor, a piezoelectric sensor, a piezoresistive sensor, a capacitive sensor, and a magnetic field sensor.

12. A computer program product comprising a non-transitory computer-readable instruction set stored in memory and executable by a processor to perform a method for controlling an active noise cancellation (ANR) audio system, the non-transitory computer-readable instruction set being arranged as follows: Detect instability in the first earphone; A first controller is used to generate one or more control signals to adjust one or more ANR parameters of the first earphone, wherein the one or more ANR parameters are adjusted to change the first earphone from a first ANR state to a second ANR state to alleviate the instability. To synchronize one or more ANR parameters of the first earphone with one or more parameters of the second earphone; At the first moment, at the first sensor of the first earphone, it is detected whether the first earphone is engaged with the user's ear or removed from the user's ear; And at a second time, at the first sensor of the first earphone, it is detected whether the first earphone is engaged with the user's ear or removed from the user's ear; as well as After detecting that the first earphone was removed from the user's ear at the first time and that the first earphone was engaged with the ear at the second time, the first earphone is returned to the first ANR state and the second earphone is returned to the first ANR state.

13. The computer program product of claim 12, wherein the one or more ANR parameters relate to at least one of a feedback filter, a feedforward filter, and an audio equalizer.

14. The computer program product of claim 12, wherein the computer program product is configured to: After a predetermined amount of time has elapsed since the time from when one or more ANR parameters of the first earphone were adjusted to transition the first earphone from the first ANR state to the second ANR state to alleviate the instability, the first earphone is returned to the first ANR state.

Images