An in-and-out ear detection method for a wireless earphone, a wireless earphone and a storage medium

Abstract

The present disclosure relates to an in-ear detection method for wireless earphones, wireless earphones and storage media. The in-ear detection method detects the capacitance-related parameters of the corresponding part of the earphone at the current time by at least one sensor of any one of the first earphone and the second earphone, determines the first representative deviation value of the capacitance-related parameters of the corresponding part of the earphone at the current time relative to the capacitance-related parameters of the corresponding part of the earphone at the first time, and plays a first audio signal by the loudspeaker in the case where the first representative deviation value is greater than a first threshold value or less than a second threshold value. Based on the previous in-ear state of the earphone and the first audio signal, it is determined whether the earphone has an in-ear action or an out-ear action. According to the in-ear detection method of the present disclosure, it can be quickly determined whether the earphone has an in-ear action or an out-ear action. On this basis, the in-ear state is further determined by audio playback, thereby effectively avoiding false detection and missed detection, improving user experience and reducing power waste.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of wireless earphones, and particularly relates to an in-ear detection method for a wireless earphone, a wireless earphone and a storage medium. BACKGROUND

[0002] With the progress of society and the improvement of people's living standards, earphones have become an essential item in people's lives. Traditional wired earphones are connected to smart devices (such as smartphones, laptops, tablets, etc.) through wires, which limits the wearer's movements, especially in sports situations. At the same time, the entanglement and pulling of the earphone wire, as well as the stethoscope effect, all affect the user experience. Ordinary Bluetooth earphones eliminate the connection between the earphone and the smart device, but there is still a connection between the left and right ears. True wireless earphones can solve the above problems.

[0003] True wireless earphones usually automatically turn on or off or play / pause music when the user is using them according to the current wearing situation. When the wireless earphone is in the ear, it starts playing music; when the wireless earphone is out of the ear, it pauses the music playback. In addition, for active noise reduction earphones, noise reduction processing is needed when the earphone is normally worn and used to improve audio quality, and the active noise reduction function is turned off in the non-use state to reduce power consumption. The method of detecting the sensor capacitance to determine the in-ear or out-ear in the prior art has low accuracy and is prone to miss detection or false detection, and the method of playing a specific audio signal through the earphone's built-in speaker to determine whether the earphone is worn in the user's ear increases the earphone's power consumption and also brings an unpleasant experience to the user. SUMMARY

[0004] The present disclosure is provided to solve the above problems in the prior art.

[0005] A need exists for an in-ear detection method for a wireless earphone, which detects the jump value of the earphone capacitance relative to the previous time to determine whether to play an audio signal through a speaker, and based on the earphone in-ear or out-ear state and the played audio signal, determines whether the earphone has an in-ear action or an out-ear action, and further performs an operation corresponding to the earphone in-ear or earphone out-ear. This can achieve more accurate in-ear or out-ear detection of the earphone with as few audio signals as possible, thereby reducing the power consumption of the earphone while ensuring the user's listening experience.

[0006] According to a first aspect of the present disclosure, a method for detecting ear insertion and removal of a wireless earphone is provided, the wireless earphone comprising a first earphone and a second earphone, each of the first earphone and the second earphone comprising at least one sensor for detecting capacitance of a corresponding part of the earphone, a speaker, and an in-ear microphone, the method comprising: detecting, by the at least one sensor of any one of the first earphone and the second earphone, a capacitance-related parameter of the corresponding part of the earphone at a current time; determining a first representative deviation value of the capacitance-related parameter of the corresponding part of the earphone at the current time relative to a capacitance-related parameter of the corresponding part of the earphone at a first time, wherein the first time is earlier than the current time; and playing, by the speaker, a first audio signal in a case where the first representative deviation value is greater than a first threshold value or the first representative deviation value is less than a second threshold value, wherein the first threshold value is a positive value and the second threshold value is a negative value; and determining, based on a previous ear insertion and removal state of the earphone and the first audio signal, whether the earphone has an ear insertion action or an ear removal action.

[0007] According to a second aspect of the present disclosure, a wireless earphone is provided, the wireless earphone comprising a first earphone and a second earphone, each of the first earphone and the second earphone comprising at least one sensor for detecting capacitance of a corresponding part of the earphone, a speaker, an in-ear microphone, and a processor configured to execute a method for detecting ear insertion and removal of a wireless earphone according to the present disclosure.

[0008] According to a third aspect of the present disclosure, a non-transitory computer-readable storage medium storing a program is provided, the program causing a processor to execute steps of a method for detecting ear insertion and removal of a wireless earphone according to various embodiments of the present disclosure.

[0009] The method for detecting ear insertion and removal of a wireless earphone according to the present disclosure can effectively reduce missed detection or false detection of ear insertion and removal actions of the earphone by detecting a deviation value of an earphone capacitance-related parameter relative to a previous time, and can improve the accuracy of ear insertion and removal state determination of the earphone, reduce missed detection and false detection of ear insertion and removal of the earphone, improve the robustness of ear insertion and removal detection, and reduce power consumption and possible adverse user experience caused by frequent playing of audio signals as much as possible.

[0010] The above description is only a summary of the technical solutions of the present disclosure, in order to enable a person skilled in the art to better understand the technical means of the present disclosure, and to implement the present disclosure according to the content of the specification, and in order to make the above and other purposes, features and advantages of the present disclosure more apparent and easy to understand, the following specific embodiments of the present disclosure are described. BRIEF DESCRIPTION OF DRAWINGS

[0011] In the drawings, which are not necessarily drawn to scale, like numerals describe similar components throughout the several views. Like numerals having different letter suffixes can represent different instances of the components. The drawings illustrate generally, by way of example, various embodiments discussed herein, and are not intended to limit the disclosure to the embodiments depicted. Such embodiments are exemplary, and not intended as exhaustive or limiting of the disclosure. The disclosure is intended to cover alternatives, modifications, and equivalents.

[0012] Figure 1 A constituent diagram of one of the earpieces of the wireless earphone according to an embodiment of the disclosure is shown.

[0013] Figure 2 A first flowchart of an in-ear detection method for a wireless earphone according to an embodiment of the disclosure is shown.

[0014] Figure 3 A second flowchart of an in-ear detection method for a wireless earphone according to an embodiment of the disclosure is shown.

[0015] Figure 4 A third flowchart of an in-ear detection method for a wireless earphone according to an embodiment of the disclosure is shown.

[0016] Figure 5 A fourth flowchart of an in-ear detection method for a wireless earphone according to an embodiment of the disclosure is shown. DETAILED DESCRIPTION

[0017] In order to make the skilled in the art better understand the technical solutions of the disclosure, the disclosure is described in detail below in combination with the drawings and specific embodiments. The embodiments of the disclosure are further described in detail below in combination with the drawings and specific embodiments, but not as a limitation on the disclosure.

[0018] The "first", "second", and similar words used in the disclosure do not represent any order, quantity, or importance, but are only used to distinguish. "Include" or "contain" and similar words mean that the elements before the word cover the elements listed after the word, and do not exclude the possibility of also covering other elements. The execution order of each step in the method described in the disclosure in combination with the drawings is not limited. As long as the logical relationship between the steps is not affected, several steps can be integrated into a single step, a single step can be divided into multiple steps, and the execution order of each step can be exchanged according to specific needs.

[0019] According to embodiments of the present disclosure, a wireless earphone can be provided, which can be a pair of wireless earphones, for example, including a first earphone and a second earphone, wherein each of the first earphone and the second earphone includes at least one sensor for detecting the capacitance of the corresponding part of the earphone, as well as a speaker, an in-ear microphone, a processor, and the like, and the processor in the wireless earphone is configured to perform each step of the in-ear detection method for the wireless earphone according to various embodiments of the present disclosure.

[0020] Figure 1 A schematic diagram of one of the earphones in the wireless earphone according to embodiments of the present disclosure is shown. For example, a first earphone 100 in the wireless earphone according to embodiments of the present disclosure can include a sensor 101, a speaker 102, an in-ear microphone 103, a processor 104, and the like.

[0021] In some embodiments, the sensor 101 can be one or more, wherein each sensor 101 is used to detect the capacitance of a different part of the first earphone 100, respectively. In some embodiments, each sensor 101 for detecting capacitance can be an electrode or a metal sheet, which can be disposed on the inner shell of the wireless earphone or other positions, and when the sensor 101 is in contact with, close to, or near the ear, the detected capacitance value will generally be larger. Therefore, multiple sensors 101 disposed at different parts of the first earphone 100 can be used to detect the degree of contact or proximity of these different parts to the ear. In the process of detecting capacitance by the sensor 101, a detection amount of the relevant capacitance value of the corresponding part of the earphone can be obtained. Different sensors can have different detection amounts of the relevant capacitance value, and the specific value depends on the specific detection circuit for detecting capacitance. In some embodiments, for example, the detection amount of the relevant capacitance value can be the capacitance value itself or a measurement value proportional to the capacitance value, or can be the reciprocal of the capacitance value or a measurement value proportional to the reciprocal of the capacitance value, or can be a monotonic function of the capacitance value, and the function value and the capacitance value are in one-to-one correspondence. In order to facilitate consistent expression, in the embodiments of the present disclosure, the detection amount of the relevant capacitance value is taken as the capacitance value itself, a measurement value proportional to the capacitance value, or a monotonic increasing function of the capacitance value as the basis, and the detection amount of the relevant capacitance value that meets the above trend is taken as the capacitance-related parameter, that is, the capacitance-related parameter is defined as being larger when the earphone is closer to the ear. When the detection amount of the relevant capacitance value is the reciprocal of the capacitance value, a measurement value proportional to the reciprocal of the capacitance value, or a monotonic decreasing function of the capacitance value, the processed detection amount of the relevant capacitance value after the corresponding processing such as taking the reciprocal, taking the opposite number, and the like can be taken as the capacitance-related parameter, which will not be listed one by one here.

[0022] In some embodiments, the sensor 101 can also be a pair of sensors, in each pair of sensors 101, one of the sensors (referred to as sensor 1) is closer to the earphone inner shell relative to the other sensor (referred to as sensor 2), or / and can have a larger area, so when the earphone is in the ear or close to the ear or close to other objects, sensor 1 will also be close to the ear or other objects, so the detection amount of the capacitance value of sensor 1 will have a larger jump relative to the suspension, i.e. when there is no proximity around. The detection amount of the capacitance value of sensor 2 will have a small or almost no jump because it is farther away from the earphone inner shell or / and has a smaller area, so the difference between the detection amount of the capacitance value of sensor 1 and the detection amount of the capacitance value of sensor 2 can be used to represent the proximity of the earphone to other objects. Therefore, in the case of a pair of sensors 101, the detection of the capacitance related parameter of the corresponding part of the earphone at the current time by at least one sensor of any one of the first earphone and the second earphone further comprises: detecting the capacitance of the corresponding part of the earphone at the current time by at least one pair of sensors of any one of the first earphone and the second earphone, and taking the difference between the detection amount of the capacitance value of the corresponding pair of sensors as the capacitance related parameter of the corresponding part of the earphone.

[0023] In some embodiments, the loudspeaker 102 can be used to play audio signals, in particular, can include playing audio signals according to the instructions of the processor 104 when the first earphone 100 is in and out of ear detection, etc.

[0024] In some embodiments, the in-ear microphone 103 can be generally used to collect audio signals in the ear and in-ear noise at a position close to the ear canal on the inner side of the earphone, and the audio response signal of the audio signal played by the first earphone 100 when the in-ear microphone 103 is detected can be sent to the processor 104 for subsequent processing.

[0025] In some embodiments, the processor 104 can be configured to perform various steps of the in-ear detection method for a wireless earphone according to various embodiments of the present disclosure, and can also be configured to perform calculations and processes associated with other functions of the wireless earphone at the same time, which are not limited herein. The processor 104 described above can be a processing device including one or more general-purpose processing devices, such as a microprocessor, a central processing unit (CPU), a graphics processing unit (GPU), and the like. More specifically, the processor can be a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a processor running other instruction sets, or a processor running a combination of instruction sets. The processor can also be one or more special-purpose processing devices, such as an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a digital signal processor (DSP), a system on a chip (SoC), and the like.

[0026] In other embodiments, the first earphone 100 can also include a memory (not shown), for example, for storing or temporarily storing the in-ear state of the first earphone 100 at different times, the capacitance-related parameters of different parts of the first earphone 100 measured by at least one (or a pair of) sensors at different times, and any programs and data required for calculating and judging the in-ear action and initial in-ear state of the first earphone 100, and the like, which are not listed one by one herein. The memory described above can be, for example, a read-only memory (ROM), a random access memory (RAM), a phase-change random access memory (PRAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), an electrically erasable programmable read-only memory (EEPROM), other types of random access memory (RAM), a flash disk or other forms of flash memory, a cache, a register, a static memory, and the like.

[0027] In some embodiments, the wireless earphone according to embodiments of the present disclosure can be an active noise reduction earphone, in which case the first earphone 100 can also include components (not shown) related to active noise reduction, and enable the above-mentioned components related to active noise reduction when it is determined that the in-ear action of the first earphone 100 occurs, to perform noise reduction processing, or stop the operation of the above-mentioned components related to active noise reduction when it is determined that the out-ear action of the first earphone 100 occurs, and the like, which are not described herein.

[0028] Figure 2 A first flowchart of the in-ear detection method for a wireless earphone according to embodiments of the present disclosure is shown.

[0029] In step S201, a capacitance-related parameter of a corresponding part of the earphone at the current time is detected by at least one sensor of any one of the first earphone and the second earphone, and a first representative deviation value of the capacitance-related parameter of the corresponding part of the earphone at the current time relative to the capacitance-related parameter of the corresponding part of the earphone at the first time is determined, wherein the first time is earlier than the current time.

[0030] As described above, each of the at least one sensor is respectively used for detecting the capacitance of a different part of the earphone, and the "corresponding part" can be a part corresponding to one sensor, a part corresponding to a pair of sensors, or a plurality of parts corresponding to a plurality of sensors or a plurality of pairs of sensors. For example, in the case where all sensors (or pairs of sensors) have effective detection of the capacitance value, the "corresponding part" can be all parts corresponding to the sensors (or pairs of sensors), and in the case where only some sensors have effective detection of the capacitance value, the "corresponding part" can refer to the parts with effective detection of the capacitance value. Hereinafter, the meaning of the "corresponding part" is similar, and will not be described again.

[0031] The first representative deviation value can be selected in various ways. In some embodiments, the first representative deviation value of the capacitance-related parameter of the corresponding part of the earphone at the current time relative to the capacitance-related parameter of the corresponding part of the earphone at the first time can be, for example, the maximum value in the deviation between the capacitance-related parameter of the corresponding part of the earphone at the current time and the capacitance-related parameter of the corresponding part of the earphone at the first time, or the sum of the absolute values of the deviation between the capacitance-related parameter of the corresponding part of the earphone at the current time and the capacitance-related parameter of the corresponding part of the earphone at the first time, and the like, which is not specifically limited herein.

[0032] When the sensors of the earphone are a pair of sensors, similarly, the capacitance-related parameter of the corresponding part of the earphone can be first calculated by using the difference between the detection of the capacitance value of the pair of sensors for measuring the capacitance of the corresponding part, and then the first representative deviation value can be obtained according to the method described above, which will not be described again.

[0033] In step S202, the first representative deviation value can be judged, and in the case where the first representative deviation value is greater than a first threshold value or the first representative deviation value is less than a second threshold value, the first audio signal is played by the loudspeaker, wherein the first threshold value is a positive value, and the second threshold value is a negative value.

[0034] In some embodiments, when the environment around the earphone does not change much, for example, the environment can be within a certain distance, such as 0.5 cm, 1 cm, 2 cm, etc., around the sensor part of the earphone, i.e., there is no change in the position of the object around the sensor part of the earphone, in this case, the fluctuation of the sensor detected capacitance related parameters is small, and accordingly, the amplitude of the first representative deviation value representing the fluctuation of the above-mentioned capacitance related parameters is also small. When the earphone handle is held and the earphone moves in the air, there is no change in the position of the object around the sensor part of the earphone, such as within 0.5 cm, 1 cm, 2 cm, etc., which is usually the case when the environment around the earphone does not change much. In other words, by the first representative deviation value, it can be preliminarily judged whether the in-ear or out-ear state of the earphone has changed, and in the case where the relative position relationship between the earphone and the ear does not change significantly, it is not necessary to trigger the speaker to play the first audio signal, nor to further detect based on the first audio signal. The inventors have determined through experiments that playing the audio signal and detecting the in-ear or out-ear state often increases the power consumption by an order of magnitude of 0.5 ma, 1 ma, 2 ma, 4 ma. Therefore, before playing the first audio signal, first judging whether the earphone has a potential change in the in-ear or out-ear state based on the first representative deviation value can reduce the frequency of triggering the speaker to play the first audio signal, thereby reducing the power consumption of the system.

[0035] In some embodiments, different thresholds can be set for different situations, and based on the set thresholds and the first representative deviation value, whether the earphone has an in-ear or out-ear action or a trend of state change can be judged. For example, when the capacitance related parameter is defined as being larger as the earphone is closer to the ear, and the first representative deviation value is defined as the maximum value of the difference between the capacitance related parameter of the corresponding part and the capacitance related parameter of the corresponding part at the first time, when the first representative deviation value is positive, i.e., the capacitance related parameter jumps up, and when the jump value is greater than the first threshold as a positive value, it usually represents that the earphone may have an in-ear action or trend. Correspondingly, when the first representative deviation value is negative, i.e., the capacitance related parameter jumps down, and when the jump value is less than the second threshold as a negative value, i.e., the amplitude of the jump is greater than the absolute value of the second threshold, it usually represents that the earphone may have an out-ear action or trend. When the first representative deviation value is used to judge whether the earphone has a possible state change, the speaker can be triggered to play the first audio signal for further judgment.

[0036] In some embodiments, when the first threshold value and the second threshold value are selected, on one hand, the absolute values of the first threshold value and the second threshold value should be appropriately large, so that the speaker will not play the first audio signal due to slight changes in the surrounding environment, on the other hand, they should not be too large, so that when the earphone has an in-ear or out-ear action, the change in the capacitance-related parameter caused by the earphone being close to or away from the ear can exceed the range of the first threshold value and the second threshold value and be perceived, thus, the specific values of the first threshold value and the second threshold value can be determined in advance through test experiments, etc. By appropriate selection of the first threshold value and the second threshold value, accurate prediction of the possible in-ear or out-ear state change or change trend of the earphone can be achieved while having low power consumption.

[0037] For example, the first audio signal can be a low-frequency audio signal, i.e., an infrasound signal, outside the audible range of the human ear, i.e., a signal below 20 Hz, just as an example. Since the earphone user cannot perceive the infrasound signal, the disturbance to the normal use process of the earphone can be reduced. The frequency of the infrasound signal is low, and in order to effectively detect in-ear or out-ear, it usually takes 1 second or several seconds to play the infrasound signal and detect. In some other embodiments, the first audio signal can also be a prompt tone already set in the wireless earphone for prompting the working state of the earphone, such as a prompt for turning on the earphone, a detection result for prompting the position of the earphone relative to the ear, a prompt for performing wireless communication connection, etc., or any other prompt tone already set in the functions of the wireless earphone, as well as combinations of the above-mentioned infrasound signal and various prompt tones.

[0038] Next, in step S203, it is determined whether the earphone has an in-ear action or an out-ear action based on the previous in-ear or out-ear state of the earphone and the first audio signal.

[0039] As described above, the determination of the obtained first representative deviation value based on the pre-set first threshold value and the second threshold value in step S202 only realizes a preliminary prediction of whether the earphone has a change in the in-ear or out-ear state or a trend of change, thus, the specific circumstances such as the first audio signal and its response signal, and the previous in-ear or out-ear state of the earphone need to be combined to more accurately determine whether the earphone indeed has an in-ear action or an out-ear action. A detailed example of this process will be described below in combination with Figure 3 for further illustration.

[0040] Figure 3 A second flowchart of an in-ear or out-ear detection method for a wireless earphone according to an embodiment of the present disclosure is shown. Figure 3 The flowchart shown is Figure 2 a specific example of step S203 in the above method, through the following steps, the in-ear action or the out-ear action of the earphone can be further determined.

[0041] In step S301, the previous ear-in / ear-out state of the earphone is first determined, for example, by reading a state bit in the earphone memory for marking the ear-in / ear-out state of the earphone, and if the previous ear-in / ear-out state of the earphone is an ear-out state, step S302 is executed, and if the previous ear-in / ear-out state of the earphone is an ear-in state, step S303 is executed.

[0042] Step S302 is executed if the previous ear-in / ear-out state of the earphone is an ear-out state, for determining whether the ear-in action occurs in the ear-out state. In step S302, a state characteristic parameter is determined, for example, in response to a first audio signal played by the loudspeaker in a first time period, the state characteristic parameter including at least one of or a combination of a transfer function of a transmission path from the loudspeaker to the in-ear microphone, a parameter of a second audio signal collected by the in-ear microphone, a correlation parameter of the first audio signal and the second audio signal, and further based on the state characteristic parameter determined for the first time period, it is determined whether the ear-in action occurs.

[0043] In some embodiments, the parameter of the second audio signal collected by the in-ear microphone includes any one of or a combination of a time domain distribution parameter, a frequency domain distribution parameter, a time domain distribution parameter variation, a frequency domain distribution parameter variation, an energy in time domain and / or frequency domain, an energy variation in time domain and / or frequency domain. In some embodiments, the energy in time domain and / or frequency domain, for example, can be an energy normalized with respect to a reference energy, and specifically, the reference energy can be obtained by detecting the first audio signal. Taking the first audio signal as an example of the infrasound signal, the energy is obtained by detecting the audio signal filtered by a filter having a passband range including the infrasound signal from the infrasound signal collected by the microphone. In this way, the energy normalized with respect to the reference energy can measure and compare the energy distribution of the audio signal at different time domain / frequency domain points on a unified scale, thereby avoiding the interference caused by the different amplitudes of the played infrasound signal.

[0044] In some embodiments, in the case that the parameters of the second audio signal as described above are determined for the first audio signal in the first time period, any one of the time domain distribution parameter, the frequency domain distribution parameter, the time domain distribution parameter variation, the frequency domain distribution parameter variation, the energy in time domain and / or frequency domain, the energy variation in time domain and / or frequency domain of the second audio signal is compared with a corresponding threshold value, and according to the comparison result or a combination of the comparison results, it is determined whether the ear-in action occurs.

[0045] In some embodiments, the correlation parameters of the first audio signal and the second audio signal can include any one or a combination of time domain correlation parameters, frequency domain correlation parameters, variation of time domain correlation parameters, variation of frequency domain correlation parameters, energy and / or amplitude of the correlation parameters, and variation of energy and / or amplitude of the correlation parameters. Further, after determining the correlation parameters of the first audio signal and the second audio signal, any one of the time domain correlation parameters, the frequency domain correlation parameters, the variation of time domain correlation parameters, the variation of frequency domain correlation parameters, the energy and / or amplitude of the correlation parameters, and the variation of energy and / or amplitude of the correlation parameters can be compared with a corresponding threshold value, and the earphone is determined to have the ear insertion action according to the comparison result or a combination of comparison results. In some embodiments, the threshold values for determining whether the earphone has the ear insertion action are set to a wider range, which can reduce the false negative rate of the earphone ear insertion action as much as possible, thereby improving the user experience.

[0046] Step S303 is performed when the earphone before the ear insertion and removal state is the ear insertion state, for determining whether the earphone has the ear removal action in the ear insertion state. In step S303, a state feature parameter is determined in response to the first audio signal played by the loudspeaker in the second time period, wherein the second time period is greater than or equal to the first time period. The specific content of the state feature parameter in this step is similar to that in step S302, which is not described here. Next, whether the earphone has the ear removal action can be further determined based on the state feature parameter determined for the second time period, and the specific method used is similar to the method described in step S302, but the threshold values corresponding to the comparison of each state feature parameter and the combination of each comparison result need to be determined according to the needs of the ear removal action determination.

[0047] It can be understood that when the earphone is not determined to have the ear insertion action in step S302 or the earphone is not determined to have the ear removal action in step S303, the original ear insertion and removal state of the earphone can be maintained, which can reduce the false positive rate of the ear insertion and removal detection and reduce the false operation and power consumption caused thereby.

[0048] In the above embodiments, by selecting a shorter first time period, for example, 1 second or 1.5 seconds, and a more relaxed determination threshold, the ear insertion action of the earphone can be quickly determined to improve the user experience. When the earphone is determined to have the ear removal action from the ear insertion state, a longer second time period than the first time period is selected, which can avoid the improper closing of the active noise reduction function and other possible adverse experiences to the user caused by the false judgment of the earphone removal.

[0049] Figure 4A third flowchart of an in-ear detection method for wireless headphones according to an embodiment of the present disclosure is shown. Figure 4 Each step shown is used to re-evaluate the actual in-ear and out-of-ear status of the earphone.

[0050] First, in step S401, the previous in-ear state of the earphone is the out-of-ear state, and for example, according to... Figure 3 In each step of the process, if it is determined that the earphone has been inserted into the ear, the speaker will issue an earphone insertion prompt and perform operations related to the earphone insertion, such as activating the active noise cancellation function or playing music.

[0051] Then, in step S402, after the third time period, a third audio signal is played by the speaker during the next fourth time period, wherein the fourth time period is longer than the first time period, for example, it can be 3 seconds, 4 seconds, or 6 seconds. In some embodiments, after the first time period, when it is determined that the earphone has inserted into the ear, the earphone will emit an in-ear prompt tone. The third time period can be, for example, longer than the playback time of the in-ear prompt tone, so as to reduce the impact of the prompt tone on the playback of the third audio signal and the in-ear detection based on the third audio signal.

[0052] Next, in step S403, in response to the third audio signal played by the speaker during the fourth time period, state characteristic parameters are determined, and based on the state characteristic parameters determined for the fourth time period, it is determined whether the in-ear state of the earphone is out-of-ear state. When it is determined that the in-ear state of the earphone is out-of-ear state, an operation related to the earphone being out of the ear is performed.

[0053] The specific content regarding the state characteristic parameters in step S403 is the same as... Figure 3 The content listed in the corresponding steps is similar and will not be repeated here. The method for determining whether the earphone is in an out-of-ear state based on the state feature parameters in step S403 is similar to the method described in step S303, but the thresholds used for comparison with each state feature parameter, as well as the combination of each comparison result, need to be determined according to the needs of the out-of-ear state determination.

[0054] In such Figure 2In the flow, since the first time period is short, and in order to improve the user experience, the threshold for determining that the earphone has an ear insertion action is set to be relatively loose, there may be a certain probability of false detection (i.e., actually not ear insertion, but judged as ear insertion), in order to avoid unnecessary power consumption and the like caused by such false judgment, after a period of time (i.e., a third time period), when the use state of the earphone is more stable, restart the audio playback and detection, and use a longer fourth time period to reconfirm whether the earphone is indeed in the ear insertion state. Since there is no higher requirement in time in this case, and the played audio signal can be a subsonic signal that has no effect on the normal use of the earphone by the user, a fourth time period longer than the first time period is selected, so that the ear insertion and ear extraction state of the earphone can be more accurately confirmed, the false detection rate is reduced, and when it is determined that the earphone is not inserted into the ear, the operation related to the earphone extraction, such as turning off the active noise reduction function, is performed, thereby avoiding the audio playback interference and power waste caused thereby.

[0055] Figure 5 A fourth flowchart of an ear insertion and extraction detection method for a wireless earphone according to an embodiment of the present disclosure is shown.

[0056] In step S501, when the ear insertion and extraction state of the earphone before this earphone is an ear extraction state, and it is determined that the earphone has an ear insertion action, an earphone ear insertion prompt is issued by the loudspeaker, and an operation related to earphone ear insertion, such as starting the active noise reduction function, is performed.

[0057] In step S502, the loudspeaker continuously plays the first audio signal in the fifth time period after the first time period.

[0058] In step S503, in response to the first audio signal played by the loudspeaker in the fifth time period, the state feature parameter is determined, and based on the state feature parameter determined in the fifth time period, it is determined whether the ear insertion and extraction state of the earphone is an ear extraction state, and when it is determined that the ear insertion and extraction state of the earphone is an ear extraction state, an operation related to earphone ear extraction is performed.

[0059] Unlike the process of reconfirming the ear insertion state of the earphone described in combination Figure 4 with the first embodiment, in the Figure 5 embodiment, the first audio signal is continuously played, for example, by selecting an appropriate length of the fifth time period, such as making the length of the sum of the first time period and the fifth time period 3 seconds, 4 seconds, or 6 seconds, etc., so that the response signal of the first audio collected in this length of time and the determined state feature parameter are more stable states of the earphone, and thus the ear insertion and extraction state of the earphone determined thereby is more accurate, which can timely and accurately correct the false judgment of earphone ear insertion, and avoid the audio interference and power waste caused thereby.

[0060] In some embodiments, the first representative deviation value can be determined by comparing the current time's earphone corresponding part's capacitance related parameter with a third threshold range. The third threshold range can be obtained by pre-measuring the earphone's capacitance related parameters in the in-ear state and the out-of-ear state. In some embodiments, the first audio signal can not be played when the current time's earphone corresponding part's capacitance related parameter is within the third threshold range.

[0061] The second representative value of the current time's earphone corresponding part's capacitance related parameter can be determined in various ways. In some embodiments, for example, the maximum value of the current time's earphone corresponding part's capacitance related parameter can be taken as the second representative value. In other embodiments, the sum of the current time's earphone corresponding part's capacitance related parameters can also be taken as the second representative value. In other embodiments, the sum of the absolute values of the earphone corresponding part's capacitance related parameters can also be taken as the second representative value, which is not limited here as long as the determined second representative value can as much as possible represent the earphone's current time's fitting, close or proximity to the ear or other objects.

[0062] For example, assuming that the third threshold range C th3 may be represented as C th3 = {(0, C1] U [C2, C), C2 > C1}, when the second representative value is within the range (0, C1], it means that the earphone is in the out-of-ear state with a high probability, and when the second representative value is within the range [C2, C), it means that the earphone is in the in-ear state with a high probability. The specific value of C1 is calculated by detecting the capacitance related parameters of one or more sensors based on the earphone in the out-of-ear state, and the specific calculation method is not limited here. The specific value of C2 is calculated by detecting the capacitance related parameters of one or more sensors based on the earphone in the in-ear state, and the specific calculation method is not limited here. The value of C in [C2, C) is the limit of the value that C2 can take in the in-ear state of the earphone according to the calculation method of C1 and C2.

[0063] Although the above-mentioned second representative value, third threshold range C th3and the specific calculation methods of C1, C2 and C are not specifically limited, but it can be understood that the calculation methods of the above-mentioned second representative value, C1, C2 and C should be matched, for example, when the second representative value adopts the maximum value of the capacitance-related parameters of the corresponding part of the earphone, that is, the capacitance-related parameter measured by a single sensor, correspondingly, C1, C2 and C should also select the numerical range of the capacitance-related parameter of a single sensor, instead of the sum of the capacitance-related parameters of multiple sensors, so as to avoid the mismatch of the numerical range, and other cases are similar, which will not be repeated here.

[0064] As described above, when it is judged that the second representative value is in the third threshold range, it indicates that the earphone is in the in-ear state or the out-ear state with a high probability, therefore, the in-ear or out-ear state of the earphone can also be determined according to the specific threshold interval in which the second representative value is located without playing the first audio signal, and the corresponding operation is performed.

[0065] In some existing technical solutions, the in-ear or out-ear state of the earphone is determined only by judging the current capacitance value of the earphone. In such solutions, for example, if the capacitance is greater than a certain threshold due to the existence of an object around the earphone, it may cause the earphone state to be misjudged as in-ear, and then start the noise reduction process, etc., resulting in waste of power consumption.

[0066] In another existing technical solution, the playing of the audio signal and the detection of the in-ear or out-ear state are repeatedly or periodically triggered when the capacitance or other signal quantity detected by the sensor is greater than a certain threshold, which greatly increases the power consumption of the earphone, and also increases the possibility of additional calculation and error judgment during the repeated triggering of the audio signal playing and the in-ear or out-ear detection.

[0067] In another existing technical solution, the playing of the audio signal and the detection of the in-ear or out-ear state are triggered only when the current capacitance or other signal quantity detected by the sensor is greater than a certain threshold for the first time. For example, when the sensor detects a signal quantity greater than a certain threshold for the first time, but the earphone is not properly in-ear at this time, only the position of the object near the earphone sensor changes or the earphone sensor is close to or close to the human ear, at this time, the result of the audio detection is that the earphone is not in-ear, and although the signal quantity detected by the sensor further increases as the earphone is properly in-ear, since it only triggers the playing of the audio signal and the detection of the in-ear or out-ear state when it exceeds the above-mentioned certain threshold for the first time, in a similar situation, it may cause a missed detection.

[0068] The ear-in and ear-out detection method according to the present disclosure first monitors the deviation value between the capacitance-related parameters at the current moment and the previous moment, and through appropriate setting of the first threshold value of the deviation value, the potential earphone ear-in and ear-out actions are sensitively and accurately captured, and through playing the first audio signal, it is determined whether the ear-in action or the ear-out action of the earphone occurs. Compared with the above various prior art, the ear-in and ear-out detection method of the present disclosure has higher sensitivity and accuracy, and can greatly reduce the false detection rate and the missed detection rate, while also avoiding unnecessary power consumption.

[0069] According to an embodiment of the present disclosure, a non-transitory computer readable storage medium having a program stored thereon is also provided, which causes a processor to execute the steps of the ear-in and ear-out detection method for a wireless earphone according to various embodiments of the present disclosure. The storage medium can include a read-only memory (ROM), a flash memory, a random access memory (RAM), a dynamic random access memory (DRAM) such as synchronous DRAM (SDRAM) or Rambus DRAM, a static memory (e.g., flash memory, static random access memory), etc., on which computer executable instructions can be stored in any format.

[0070] In addition, although exemplary embodiments have been described herein, the scope of their range includes any and all embodiments based on the present disclosure having equivalent elements, modifications, omissions, combinations (for example, solutions cross various embodiments), adaptations, or alterations. The elements in the claims are to be construed broadly based on the language adopted in the claims, and are not limited to the examples described in the specification or during the implementation of the present application, which examples are to be construed as non-exclusive. Therefore, the specification and examples are intended to be considered only as examples, and the true scope and spirit are indicated by the full scope of the following claims and their equivalents.

[0071] The above description is intended to be illustrative and not restrictive. For example, the above-described examples (or one or more aspects thereof) can be used in combination with each other. Other embodiments can be used as would be apparent to one of ordinary skill in the art upon reading the above description. Additionally, in the foregoing detailed description, various features can be grouped together in one or more embodiments for the purpose of streamlining the disclosure. This should not be interpreted as a requirement that the claimed subject matter requires more features than are expressly identified in the claims. Rather, the inventive subject matter can be practiced with less than all of the features of a particular disclosed embodiment. Accordingly, the following claims are hereby incorporated into the detailed description, by way of examples or embodiments, wherein each claim is independently a separate embodiment, and the embodiments can be combined or arranged in a variety of combinations or permutations. The scope of the application should be determined by reference to the following claims, and the full scope of equivalents to which such claims are entitled.

[0072] The above examples are only exemplary embodiments of the present disclosure, and are not intended to limit the present disclosure. The scope of protection of the present disclosure is defined by the claims. Those skilled in the art can make various modifications or equivalent replacements to the present disclosure within the spirit and protection scope of the present disclosure, and such modifications or equivalent replacements should also be considered to fall within the protection scope of the present disclosure.

Claims

1. An in-ear detection method for a wireless earphone, the wireless earphone comprising a first earphone and a second earphone, the method comprising: The first earphone and the second earphone each comprise at least one pair of paired sensors for detecting the capacitance of the corresponding part of the earphone, a speaker and an in-ear microphone, and the in-ear detection method comprises: detecting the capacitance of the corresponding part of the earphone at the current time by using at least one pair of paired sensors of any one of the first earphone and the second earphone, taking the difference between the detection values of the corresponding paired sensors as the capacitance-related parameter of the corresponding part of the earphone, determining the first representative deviation value of the capacitance-related parameter of the corresponding part of the earphone at the current time relative to the capacitance-related parameter of the corresponding part of the earphone at the first time, wherein the first time is earlier than the current time; in the case where the first representative deviation value is greater than a first threshold value or the first representative deviation value is less than a second threshold value, playing a first audio signal by the speaker, wherein the first threshold value is a positive value and the second threshold value is a negative value; determining a second representative value of the capacitance-related parameter of the corresponding part of the earphone at the current time, judging the second representative value before judging the first representative deviation value, in the case where the second representative value is within a third threshold value range, not playing the first audio signal, and the third threshold value range is obtained by previously measuring the capacitance-related parameter of the earphone in the in-ear state and the out-ear state; in the case where the second representative value is not within the third threshold value range, further judging the first representative deviation value; judging whether the earphone has an in-ear action or an out-ear action based on the previous in-ear state and out-ear state of the earphone and the first audio signal, specifically comprising: in the case where the previous in-ear state and out-ear state of the earphone is the out-ear state, determining a state characteristic parameter in response to the first audio signal played by the speaker within a first time period, the state characteristic parameter comprising at least one of a transfer function of a transmission path from the speaker to the in-ear microphone, a parameter of a second audio signal collected by the in-ear microphone, and a correlation parameter of the first audio signal and the second audio signal; judging whether the earphone has an in-ear action based on the state characteristic parameter determined for the first time period; in the case where the previous in-ear state and out-ear state of the earphone is the in-ear state, determining the state characteristic parameter in response to the first audio signal played by the speaker within a second time period, wherein the second time period is greater than or equal to the first time period; judging whether the earphone has an out-ear action based on the state characteristic parameter determined for the second time period.

2. The earring detection method according to claim 1, wherein The in-ear detection method further comprises: in the case where the previous in-ear state and out-ear state of the earphone is the out-ear state and it is judged that the earphone has an in-ear action, issuing an earphone in-ear prompt by the speaker and performing an operation related to earphone in-ear; playing a third audio signal by the speaker within a fourth time period after a third time period, wherein the fourth time period is greater than the first time period; determining the state characteristic parameter in response to the third audio signal played by the speaker within the fourth time period; and Based on the state characteristic parameter determined for the fourth time period, it is determined whether the earphone is in the out-of-ear state, and if the earphone is in the out-of-ear state, an operation related to the earphone being out of the ear is performed.

3. The earring detection method of claim 1, wherein, The ear-in-and-out detection method further comprises: In the case that the ear-in-and-out state before the earphone is in the out-of-ear state and it is determined that the earphone has an ear-in action, an earphone ear-in prompt is issued by the loudspeaker, and an operation related to the earphone being in the ear is performed; The first audio signal is continuously played by the loudspeaker in a fifth time period after the first time period; The state characteristic parameter is determined in the fifth time period in response to the first audio signal played by the loudspeaker; and Based on the state characteristic parameter determined for the fifth time period, it is determined whether the earphone is in the out-of-ear state, and if the earphone is in the out-of-ear state, an operation related to the earphone being out of the ear is performed.

4. The earring detection method of claim 1, wherein, The first audio signal is a subsonic wave signal, and / or a prompt sound set in the wireless earphone for prompting the working state of the earphone.

5. The earring detection method of claim 1, wherein, The parameters of the second audio signal include any one or a combination of the time domain distribution parameter, the frequency domain distribution parameter, the time domain distribution parameter change amount, the frequency domain distribution parameter change amount, the energy in the time domain and / or the frequency domain, and the energy change amount in the time domain and / or the frequency domain of the collected second audio signal, wherein the energy in the time domain and / or the frequency domain is the energy normalized with respect to a reference energy, and the reference energy is obtained by detecting the first audio signal; Based on the state characteristic parameter (at least one of the transfer function, the parameter of the second audio signal collected by the in-ear microphone, and the correlation parameter of the first audio signal and the second audio signal) determined for the first time period, it is determined whether the earphone has an ear-in action, specifically including: Any one of the time domain distribution parameter, the frequency domain distribution parameter, the time domain distribution parameter change amount, the frequency domain distribution parameter change amount, the energy in the time domain and / or the frequency domain, and the energy change amount in the time domain and / or the frequency domain of the second audio signal is compared with the corresponding threshold value, and the earphone is determined to have an ear-in action according to the comparison result or a combination of comparison results.

6. The earring detection method of claim 1, wherein, The correlation parameter of the first audio signal and the second audio signal includes any one or a combination of the time domain correlation parameter, the frequency domain correlation parameter, the time domain correlation parameter change amount, the frequency domain correlation parameter change amount, the energy and / or amplitude of the correlation parameter, and the energy and / or amplitude change amount of the correlation parameter; Based on the state characteristic parameter (at least one of the transfer function, the parameter of the second audio signal collected by the in-ear microphone, and the correlation parameter of the first audio signal and the second audio signal) determined for the first time period, it is determined whether the earphone has an ear-in action, specifically including: The first audio signal and any one of the time domain correlation parameters, the frequency domain correlation parameters, the change amount of the time domain correlation parameters, the change amount of the frequency domain correlation parameters, the energy and / or amplitude of the correlation parameters, and the change amount of the energy and / or amplitude of the correlation parameters of the second audio signal are compared with the corresponding threshold values, and according to the comparison result or the combination of the comparison results, it is determined whether the earphone has an ear insertion action.

7. The ear access detection method of claim 1, wherein The second representative value of the capacitance-related parameter of the corresponding part of the earphone at the current time point specifically includes: The maximum value of the capacitance-related parameter of the corresponding part of the earphone at the current time point, or the sum of the capacitance-related parameters of the corresponding part of the earphone at the current time point, is taken as the second representative value, wherein the capacitance-related parameter is defined as being larger as the earphone is closer to the ear.

8. The earring detection method of claim 1, wherein, The first representative deviation value of the capacitance-related parameter of each part of the earphone at the current time point relative to the capacitance-related parameter of the corresponding part of the earphone at the first time point specifically includes: The maximum value of the deviation between the capacitance-related parameter of the corresponding part of the earphone at the current time point and the capacitance-related parameter of the corresponding part of the earphone at the first time point, or the sum of the absolute values of the deviation between the capacitance-related parameter of the corresponding part of the earphone at the current time point and the capacitance-related parameter of the corresponding part of the earphone at the first time point, is taken as the first representative deviation value, wherein the capacitance-related parameter is defined as being larger as the earphone is closer to the ear.

9. A wireless earphone, the wireless earphone comprising a first earphone and a second earphone, characterized in that, Each of the first earphone and the second earphone includes at least one pair of paired sensors for detecting the capacitance of the corresponding part of the earphone, a speaker, an in-ear microphone, and a processor, and the processor is configured to perform the ear insertion detection method for the wireless earphone as claimed in any one of claims 1-8.

10. A non-transitory computer readable storage medium storing a program, the program causing a processor to perform the operations of the ear insertion detection method for the wireless earphone as claimed in any one of claims 1-8.

Images