Wearing state recognition method and earphone
Patent Information
- Application Number
- CN202210193497.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-02-28
- Publication Date
- 2026-10-30
- Estimated Expiration
- 2042-02-28
AI Technical Summary
[0046]可以理解地,上述第二方面提供的耳机、第三方面提供的芯片系统、第四方面提供的计算机程序产品和第五方面提供的计算机存储介质均用于执行本申请实施例所提供的方法。因此,其所能达到的有益效果可参考对应方法中的有益效果,此处不再赘述。
Smart Images

Figure CN116744205B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of headphones and communication technology, and in particular to a method for recognizing wearing status and headphones. Background Technology
[0002] True Wireless Stereo (TWS) earbuds have no traditional physical wires. The left and right earbuds form a stereo system via Bluetooth. Simply connect your phone to either earbud as the receiver, and the receiver will wirelessly transmit the stereo sound to the other earbud to create a stereo system.
[0003] In addition, TWS earbuds generally have a wearing status recognition function to enhance the user experience. For example, they can automatically play music when the earbuds are detected as being worn and stop playing music when the earbuds are removed, achieving a good user experience of "playing when put on and stopping when taken off." Currently, however, how to improve the accuracy of TWS earbud wearing status recognition is a problem that urgently needs to be solved. Summary of the Invention
[0004] This application provides a wearing status recognition method and an earphone to improve the accuracy of earphone wearing status recognition.
[0005] In a first aspect, this application provides a wearing state recognition method applied to headphones, the headphones including a speaker and a microphone, the method comprising: under the condition of satisfying a preset first condition, the headphones emitting a first sound wave through the speaker; the condition of satisfying the preset first condition is used to indicate that the current state is neither directly determined as an in-ear state nor directly determined as an out-of-ear state; the headphones receiving a second sound wave through the microphone, the second sound wave being an echo of the first sound wave; and under the condition that the energy value of the second sound wave is greater than a preset first energy threshold, the headphones determining the wearing state as an in-ear state.
[0006] In the above embodiments, when the headphones meet a preset first condition, the headphones do not simply maintain the current wearing state indicated in the headphones, but instead activate infrasound echo detection. Furthermore, if the energy value of the second sound wave is determined to be greater than a preset first energy threshold, the headphones will directly determine the current wearing state as an in-ear state, even if the conditions for directly determining it as an in-ear state are not met. Without adding any additional physical components to the headphones, and relying solely on the existing physical components, the accuracy of the headphones in recognizing the actual wearing state is further improved. This makes the recognition of the wearing state more accurate in some special cases (e.g., users with special ear canal structures), greatly enhancing the user experience.
[0007] In conjunction with some embodiments of the first aspect, in some embodiments, the earphone further includes a first detection piece and a second detection piece; the front side of the first detection piece is connected to a first detection channel of the earphone, and the back side of the first detection piece is connected to a first reference channel of the earphone, the first detection channel and the first reference channel forming a first differential channel; the front side of the second detection piece is connected to a second detection channel of the earphone, and the back side of the second detection piece is connected to a second reference channel of the earphone, the second detection channel and the second reference channel forming a second differential channel; the first detection channel, the first reference channel, the second detection channel and the second reference channel are capacitance detection channels of the earphone; the method further includes: the earphone periodically detecting the wearing state of the earphone; the preset first condition is: for I consecutive cycles, the detection value of at least one differential channel in the first differential channel and the second differential channel is not greater than the differential high threshold of the differential channel, and the detection value of any differential channel is not less than the differential low threshold of the differential channel, where I is a positive integer.
[0008] In the above embodiments, the earphone can determine whether the current situation meets the preset first condition by detecting the two differential channels in the earphone, so that the determination of the special situation is more accurate and the accuracy of the earphone wearing status recognition is improved.
[0009] In conjunction with some embodiments of the first aspect, in some embodiments, the condition for directly determining the in-ear state is: determining that the detection value of the first differential channel is greater than the first high threshold for J consecutive cycles, and that the detection value of the second differential channel is greater than the second high threshold, where J is a positive integer.
[0010] In conjunction with some embodiments of the first aspect, in some embodiments, the condition for directly determining the state as an out-of-ear state is: for K consecutive cycles, the detection value of the first differential channel is determined to be less than the first low threshold, and the detection value of the second differential channel is less than the second low threshold, where K is a positive integer.
[0011] The condition for directly determining the earphone as being in-ear is that the detection values of both differential channels are greater than the differential high threshold for J consecutive periods. The condition for directly determining the earphone as being out-of-ear is that the detection values of both differential channels are less than the differential low threshold for K consecutive periods. Since neither condition is met, the first preset condition is applied. This makes the determination of whether the earphone is in-ear or out-of-ear more stringent, expanding the range of special cases that meet the first preset condition. Furthermore, because infrasound return detection can be used to more accurately identify the actual wearing status of the earphone in this special case, the accuracy of earphone wearing status identification is greatly improved.
[0012] In conjunction with some embodiments of the first aspect, in some embodiments, the earphone emitting a first sound wave through the speaker when a preset first condition is met includes: when the preset first condition is met, the earphone determining whether the distance from the last time the first sound wave was emitted through the speaker exceeds a preset first duration; and when it is determined that the distance from the last time the first sound wave was emitted through the speaker has exceeded the preset first duration, the earphone emitting a first sound wave through the speaker.
[0013] In the above embodiment, the headphones will only emit the first sound wave through the speaker if the preset first condition is met and a preset first duration has elapsed since the last time the first sound wave was emitted through the speaker. This preset first duration is generally longer than the time it takes for the headphones to obtain the infrasound result after one infrasound echo detection. Since the headphones can also periodically detect the wearing status during infrasound echo detection, this avoids starting the next infrasound echo detection before the previous result is available, greatly saving the headphones' power and extending their battery life.
[0014] In conjunction with some embodiments of the first aspect, in some embodiments, the method further includes: when the distance at which the first sound wave is emitted by the speaker has not exceeded a preset first duration, determining whether the sum of the differential channel detection values is less than a first threshold, wherein the sum of the differential channel detection values is the sum of the detection values of the first differential channel and the detection values of the second differential channel; and determining the wearing state as an out-of-ear state when the sum of the differential channel detection values is determined to be less than the first threshold.
[0015] In the above embodiments, if the time elapsed since the first sound wave was emitted through the speaker has not exceeded a preset first duration, the wearing status of the headphones can be identified by checking whether the sum of the detected values is less than a first threshold, thereby improving the accuracy of the wearing status identification of the headphones during the infrasound echo detection process.
[0016] In conjunction with some embodiments of the first aspect, in some embodiments, when the first sound wave is emitted through the speaker at a determined distance exceeding a preset first duration, the earphone emits the first sound wave through the speaker, comprising: when the first sound wave is emitted through the speaker at a determined distance exceeding a preset first duration, and the current wearing state indicated in the earphone is an in-ear state, the earphone determines whether it has been the Mth consecutive cycle that the current wearing state indicated in the earphone is an in-ear state; when it is determined that it has been the Mth consecutive cycle that the current wearing state indicated in the earphone is an in-ear state, the earphone determines whether the decrease in the sum of the current differential channel detection values compared to the sum of the differential channel detection values before a preset second duration exceeds a first difference threshold; where M is a positive integer; when it is determined that the decrease in the sum of the current differential channel detection values compared to the sum of the differential channel detection values before a preset second duration exceeds the first difference threshold, the earphone emits the first sound wave through the speaker.
[0017] In the above embodiments, when the preset first condition is met and the current wearing state indicated in the earphone is in the ear, two other judgments are made. Only when it is determined that the probability of the current state is out of ear is high will the infrasound return detection be triggered, which further saves the earphone power and improves the earphone's battery life.
[0018] In conjunction with some embodiments of the first aspect, in some embodiments, when the first sound wave is emitted through the speaker at a determined distance exceeding a preset first duration, the earphone emits the first sound wave through the speaker, comprising: when the first sound wave is emitted through the speaker at a determined distance exceeding a preset first duration, and the current wearing state indicated in the earphone is an out-of-ear state, the earphone determines whether the sum of the current differential channel detection values is greater than a second threshold; when it is determined that the sum of the current differential channel detection values is greater than the second threshold, it determines whether it has been the Nth consecutive period that the sum of the differential channel detection values is greater than the second threshold, where N is a positive integer; when it is determined that it has been the Nth consecutive period that the sum of the differential channel detection values is greater than the second threshold, it determines whether the increase in the sum of the current differential channel detection values compared to the sum of the differential channel detection values before a preset third duration exceeds the second differential threshold; when it is determined that the increase in the sum of the current differential channel detection values compared to the sum of the differential channel detection values before a preset third duration exceeds the second differential threshold, the earphone emits the first sound wave through the speaker.
[0019] In the above embodiments, when the preset first condition is met and the current wearing state indicated in the earphone is out of ear, three other judgments are made. Only when the probability of the current state being in ear is high is the infrasound return detection triggered, thereby saving earphone power and improving the earphone's battery life.
[0020] In conjunction with some embodiments of the first aspect, in some embodiments, when it is determined that the energy value of the second sound wave is greater than a preset first energy threshold, the earphone determines the wearing state as an in-ear state, including: when it is determined that the energy value of the second sound wave is not less than a preset second energy threshold, maintaining the wearing state as an in-ear state; the preset second energy threshold is less than the preset first energy threshold; when it is determined that the energy value of the second sound wave is less than the preset second energy threshold, determining whether the detection value of each differential channel is greater than the differential high threshold of the differential channel; when it is determined that the detection value of each differential channel is greater than the differential high threshold of the differential channel, maintaining the wearing state as an in-ear state; when it is determined that the detection value of each differential channel is not greater than the differential high threshold of the differential channel, updating the wearing state to an out-of-ear state.
[0021] In the above embodiments, when the current wearing state is marked as out-of-ear state in the earphone, the wearing state is not only determined based on the result of infrasound return detection, but also by combining the result of infrasound return detection with the currently acquired differential channel detection value to perform more accurate wearing state identification, thereby further improving the accuracy of identifying the actual wearing state of the earphone.
[0022] In conjunction with some embodiments of the first aspect, in some embodiments, when it is determined that the energy value of the second sound wave is greater than a preset first energy threshold, the earphone determines the wearing state as an in-ear state, including: when it is determined that the energy value of the second sound wave is not greater than the preset first energy threshold, maintaining the wearing state as an out-of-ear state; when it is determined that the energy value of the second sound wave is greater than the preset first energy threshold, determining whether the sum of the currently acquired differential channel detection values is less than a second sum threshold; when it is determined that the sum of the currently acquired differential channel detection values is less than the second sum threshold, maintaining the wearing state as an out-of-ear state; and when it is determined that the sum of the currently acquired differential channel detection values is not less than the second sum threshold, updating the wearing state to an in-ear state.
[0023] In the above embodiments, when the current wearing state is identified as in-ear state in the earphone, the wearing state is not only determined based on the result of infrasound return detection, but also by combining the result of infrasound return detection with the differential channel detection value to perform more accurate wearing state identification, thereby further improving the accuracy of identifying the actual wearing state of the earphone.
[0024] In conjunction with some embodiments of the first aspect, in some embodiments, the microphone is a feedback microphone located in front of the speaker and with the sound pickup direction being the same as the sound output direction of the speaker.
[0025] In the above embodiment, the infrasound waves are received by a feedback microphone. The specific position and orientation of the microphone enable it to receive the energy of the reflected infrasound waves more accurately, thereby improving the accuracy of the headphone wearing status recognition.
[0026] In conjunction with some embodiments of the first aspect, in some embodiments, the preset infrasound is a single-frequency infrasound.
[0027] In the above embodiments, since single-frequency infrasound is used, it is easier for the microphone to separate and determine the energy of the infrasound return, thereby further improving the accuracy of headphone wearing status recognition.
[0028] In conjunction with some embodiments of the first aspect, in some embodiments, the frequency of the preset infrasound wave is 16 Hz.
[0029] In the above embodiment, 16Hz is used as the infrasound frequency, which allows the speaker to emit the first sound wave well while avoiding disturbing the user, thereby improving the accuracy of headphone wearing status recognition and enhancing the user experience.
[0030] Secondly, embodiments of this application provide an earphone, which includes: a speaker, a microphone, a first detection chip, a second detection chip, one or more microcontroller units, and a memory; the front side of the first detection chip is connected to a first detection channel of the earphone, and the back side of the first detection chip is connected to a first reference channel of the earphone, the first detection channel and the first reference channel forming a first differential channel; the front side of the second detection chip is connected to a second detection channel of the earphone, and the back side of the second detection chip is connected to a second reference channel of the earphone, the second detection channel and the second reference channel forming a second differential channel; the first detection channel, the first reference channel, the second detection channel, and the second reference channel are components of the microcontroller unit. The device includes a capacitance detection channel; a memory and one or more microcontrollers, the memory storing computer program code including computer instructions, the one or more microcontrollers invoking the computer instructions to cause the earphone to perform the following: emitting a first sound wave through the speaker when a preset first condition is met; the preset first condition indicating that the current state is neither directly determined as an in-ear state nor directly determined as an out-of-ear state; receiving a second sound wave through the microphone, the second sound wave being an echo of the first sound wave; and determining the wearing state as an in-ear state when the energy value of the second sound wave is determined to be greater than a preset first energy threshold.
[0031] In conjunction with some embodiments of the second aspect, in some embodiments, the one or more microcontroller units are further configured to invoke the computer instructions to cause the earphone to perform: periodically detecting the wearing status of the earphone; the preset first condition is: for I consecutive cycles, the detection value of at least one differential channel in the first differential channel and the second differential channel is not greater than the differential high threshold of the differential channel, and the detection value of any differential channel is not less than the differential low threshold of the differential channel, where I is a positive integer.
[0032] In conjunction with some embodiments of the second aspect, in some embodiments, the condition for directly determining the in-ear state is: determining that the detection value of the first differential channel is greater than the first high threshold for J consecutive cycles, and the detection value of the second differential channel is greater than the second high threshold, where J is a positive integer.
[0033] In conjunction with some embodiments of the second aspect, in some embodiments, the condition for directly determining the state as an out-of-ear state is: for K consecutive cycles, the detection value of the first differential channel is determined to be less than the first low threshold, and the detection value of the second differential channel is less than the second low threshold, where K is a positive integer.
[0034] In conjunction with some embodiments of the second aspect, in some embodiments, the one or more microcontroller units are configured to invoke the computer instructions to cause the headphones to perform: if the preset first condition is met, determining whether the distance from the last time the first sound wave was emitted through the speaker exceeds a preset first duration; if the distance from the last time the first sound wave was emitted through the speaker exceeds the preset first duration, emitting the first sound wave through the speaker.
[0035] In conjunction with some embodiments of the second aspect, in some embodiments, the one or more microcontroller units are further configured to invoke the computer instructions to cause the earphone to perform: if the first sound wave emitted by the speaker at a certain distance has not exceeded a preset first duration, determine whether the sum of the differential channel detection values is less than a first threshold, wherein the sum of the differential channel detection values is the sum of the detection values of the first differential channel and the detection values of the second differential channel; and if the sum of the differential channel detection values is determined to be less than the first threshold, determine that the wearing state is an out-of-ear state.
[0036] In conjunction with some embodiments of the second aspect, in some embodiments, the one or more microcontroller units are configured to invoke the computer instructions to cause the earphone to perform: if, after determining that the distance at which the first sound wave was emitted through the speaker has exceeded a preset first duration, and the current wearing state indicated in the earphone is an in-ear state, determining whether it has been the Mth consecutive cycle that the current wearing state indicated in the earphone is an in-ear state; if it has been determined that it has been the Mth consecutive cycle that the current wearing state indicated in the earphone is an in-ear state, determining whether the decrease in the sum of the current differential channel detection values compared to the sum of the differential channel detection values before the preset second duration exceeds a first difference threshold; where M is a positive integer; and when it is determined that the decrease in the sum of the current differential channel detection values compared to the sum of the differential channel detection values before the preset second duration exceeds the first difference threshold, emitting the first sound wave through the speaker.
[0037] In conjunction with some embodiments of the second aspect, in some embodiments, the one or more microcontroller units are configured to invoke the computer instructions to cause the earphone to perform: if, after determining that the distance at which the first sound wave was emitted through the speaker has exceeded a preset first duration, and the current wearing state indicated in the earphone is an out-of-ear state, determining whether the sum of the current differential channel detection values is greater than a second threshold; if the sum of the current differential channel detection values is greater than the second threshold, determining whether it has been the Nth consecutive period that the sum of the differential channel detection values has been greater than the second threshold, where N is a positive integer; if the sum of the current differential channel detection values is greater than the second threshold, determining whether the increase in the sum of the current differential channel detection values compared to the sum of the differential channel detection values before a preset third duration exceeds the second differential threshold; if the increase in the sum of the current differential channel detection values compared to the sum of the differential channel detection values before a preset third duration exceeds the second differential threshold, emitting the first sound wave through the speaker.
[0038] In conjunction with some embodiments of the second aspect, in some embodiments, the one or more microcontroller units are configured to invoke the computer instructions to cause the earphone to perform: maintaining the wearing state as an in-ear state when it is determined that the energy value of the second sound wave is not less than a preset second energy threshold; the preset second energy threshold is less than a preset first energy threshold; determining whether the detection value of each differential channel is greater than the differential high threshold when it is determined that the energy value of the second sound wave is less than the preset second energy threshold; maintaining the wearing state as an in-ear state when it is determined that the detection value of each differential channel is greater than the differential high threshold; and updating the wearing state to an out-of-ear state when it is determined that the detection value of each differential channel is not greater than the differential high threshold.
[0039] In conjunction with some embodiments of the second aspect, in some embodiments, the one or more microcontroller units are configured to invoke the computer instructions to cause the earphone to perform: maintaining the wearing state as an out-of-ear state when it is determined that the energy value of the second sound wave is not greater than the preset first energy threshold; determining whether the sum of the currently acquired differential channel detection values is less than a second threshold when it is determined that the energy value of the second sound wave is greater than the preset first energy threshold; maintaining the wearing state as an out-of-ear state when it is determined that the sum of the currently acquired differential channel detection values is less than the second threshold; and updating the wearing state to an in-ear state when it is determined that the sum of the currently acquired differential channel detection values is not less than the second threshold.
[0040] In conjunction with some embodiments of the second aspect, in some embodiments, the microphone is a feedback microphone located in front of the speaker and with the sound pickup direction being the same as the sound output direction of the speaker.
[0041] In conjunction with some embodiments of the second aspect, in some embodiments, the preset infrasound is a single-frequency infrasound.
[0042] In conjunction with some embodiments of the second aspect, in some embodiments, the frequency of the preset infrasound wave is 16 Hz.
[0043] Thirdly, embodiments of this application provide a chip system applied to an earphone. The chip system includes one or more microcontroller units, which are used to invoke computer instructions to cause the earphone to perform the methods described in the first aspect and any possible implementation thereof.
[0044] Fourthly, embodiments of this application provide a computer program product containing instructions that, when the computer program product is run on headphones, cause the headphones to perform the method described in the first aspect and any possible implementation thereof.
[0045] Fifthly, embodiments of this application provide a computer-readable storage medium including instructions that, when executed on an earphone, cause the earphone to perform the method described in the first aspect and any possible implementation thereof.
[0046] Understandably, the earphones provided in the second aspect, the chip system provided in the third aspect, the computer program product provided in the fourth aspect, and the computer storage medium provided in the fifth aspect are all used to execute the methods provided in the embodiments of this application. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods, and will not be repeated here. Attached Figure Description
[0047] Figure 1 This is a schematic diagram of the hardware structure of the earphone 100 provided in an embodiment of this application;
[0048] Figure 2 This is a schematic diagram of the functional modules of the earphone 100 provided in the embodiments of this application;
[0049] Figure 3 This is an exemplary schematic diagram showing the connection relationship between the MCU 111 and the upper copper plate 131 and the lower copper plate 132 in the earphone 100 provided in this application embodiment;
[0050] Figure 4 This is an exemplary schematic diagram showing the change of the detection value of differential channel 1 and the detection value of differential channel 2 over time, as provided in the embodiments of this application.
[0051] Figure 5 This is another exemplary schematic diagram showing the change of the detection value of differential channel 1 and the detection value of differential channel 2 over time, as provided in the embodiments of this application.
[0052] Figure 6 This is a flowchart illustrating a headphone wearing status recognition method in an embodiment of this application;
[0053] Figure 7 This is another flowchart illustrating the headphone wearing status recognition method in this application embodiment;
[0054] Figure 8 This is another exemplary schematic diagram showing the change of the detection value of differential channel 1 and the detection value of differential channel 2 over time, as provided in the embodiments of this application.
[0055] Figure 9 This is a schematic diagram illustrating the principle of infrasound back-sound detection provided in an embodiment of this application;
[0056] Figure 10 This is another flowchart illustrating the headphone wearing status recognition method in this application embodiment;
[0057] Figure 11 This is a schematic diagram of an exemplary scenario of changes in the wearing state of headphones in the embodiments of this application;
[0058] Figure 12 This is another flowchart illustrating the headphone wearing status recognition method in the embodiments of this application;
[0059] Figure 13 This is another exemplary scenario diagram illustrating the change in headphone wearing status in the embodiments of this application. Detailed Implementation
[0060] The terminology used in the following embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to include the plural expressions as well, unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used in this application refers to and includes any or all possible combinations of one or more of the listed items.
[0061] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more.
[0062] For ease of understanding and simplification, the embodiments in this application all use one earbud from a pair of TWS earbuds as an example. It is understood that in some embodiments, both TWS earbuds in a pair may have the functions of the TWS earbuds described in the embodiments of this application; in some embodiments, one TWS earbud may have the functions of the TWS earbuds described in the embodiments of this application, while the other TWS earbud may have more or fewer functions than the TWS earbuds described in the embodiments of this application, which is not limited here.
[0063] The following is a description of an earphone 100 provided in an embodiment of this application.
[0064] Figure 1 This is a schematic diagram of the hardware structure of the earphone 100 provided in the embodiments of this application.
[0065] The following description uses headphones 100 as an example to illustrate the embodiment. It should be understood that headphones 100 may have more or fewer components than shown in the figures, may combine two or more components, or may have different component configurations. The various components shown in the figures can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.
[0066] The headset 100 may include: a circuit board 110, a microcontroller unit (MCU) 111, a speaker 120, an upper copper plate 131, a lower copper plate 132, a feedforward microphone 141, a feedback microphone 142, an antenna 150, a battery 160, a call microphone 170, etc.
[0067] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the earphone 100. In other embodiments of this application, the earphone 100 may include more or fewer components than illustrated, or combine some components, or separate some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0068] Circuit board 110 is used to carry and connect electronic components in headphone 100. MCU 111 is mounted on circuit board 110.
[0069] The MCU111 can serve as the central nervous system and command center of the headset 100. The MCU111 can control the various components within the headset 100 to perform corresponding functions according to instructions. The MCU111 can also include a memory for storing instructions and data.
[0070] The earphone 100 can be divided into a near-circular ear cup and a cylindrical ear stem. An upper copper plate 131 is mounted on the upper part of the ear cup, and a lower copper plate 132 is mounted on the lower part. The front and back sides of the upper and lower copper plates 131 and 132 are respectively connected to the channel formed by the capacitive sensors in the MCU 111, assisting in the recognition of the earphone wearing status. The upper and lower copper plates 131 and 132 increase the contact area between the end of the channel formed by the capacitive sensors in the MCU 111 and the human ear, thereby improving the sensitivity of the earphone wearing status recognition.
[0071] The feedforward microphone 141 and the feedback microphone 142 are used to capture ambient noise, enabling the headphones 100 to have stronger noise reduction capabilities.
[0072] The earphone 100 can establish a wireless communication channel by connecting to other devices (such as mobile phones) via Bluetooth through the antenna 150.
[0073] The microphone 170 is used to collect the user's voice data and transmits this voice data to other devices via a wireless communication channel established with the antenna 150. The headset 100 can also receive audio data transmitted by other devices through this wireless communication channel and play it through the speaker 120. Alternatively, the headset 100 can also transmit control signals to other devices through this wireless communication channel.
[0074] Battery 160 supplies power to the various components in earphone 100.
[0075] Figure 2 This is a functional block diagram of an earphone 100 according to an embodiment of this application. The earphone 100 may include: a communication module 201, a sound acquisition module 202, a sound playback module 203, a noise reduction module 204, and a wearing status recognition module 205, wherein:
[0076] The communication module 201 is used to establish a wireless communication channel with other electronic devices to transmit control information, voice data, or receive audio data.
[0077] The sound acquisition module 202 is used to acquire the user's voice data;
[0078] The sound playback module 203 is used to play audio data transmitted by other devices through the communication module 201;
[0079] The noise reduction module 204 is used to reduce ambient noise during the operation of the sound acquisition module 202 or the sound playback module 203;
[0080] The wearing status recognition module 205 is used to identify whether the user is wearing the earphone 100 in the ear or out of the ear, so as to control the sound playback module 203 or the sound acquisition module 202 to continue working or stop working.
[0081] The wearing status recognition method in this application embodiment is described below with reference to the hardware and software structure of the exemplary earphone 100 described above:
[0082] Please see Figure 3 This is an exemplary schematic diagram showing the connection relationship between the MCU111 in the earphone 100 and the upper copper plate 131 and the lower copper plate 132.
[0083] The MCU111 can include four sets of capacitive sensors. Each set of capacitive sensors can include one or more capacitive sensors, which is not limited here. Each set of capacitive sensors constitutes one channel, and the four sets of capacitive sensors form four channels: Channel 1, Channel 2, Channel 3, and Channel 4. Every two channels can form a differential channel. Figure 3 In the diagram, channel 1 and channel 2 form differential channel 1, and channel 3 and channel 4 form differential channel 2.
[0084] Of the two channels forming the differential channel, one can serve as the detection channel and the other as the reference channel. The detection channel is connected to the front side of the copper plate (the side that contacts the skin of the ear canal) via a connecting wire to increase the contact area between the end of the detection channel and the skin, thereby improving the sensitivity of capacitance detection. The reference channel is connected to the back side of the same copper plate via a connecting wire, thus allowing for differential capacitance detection between the detection channel and the reference channel under the same conditions. This prevents capacitance detection errors caused by temperature variations in different environments.
[0085] exist Figure 3 In the differential channel 1, channel 1 serves as the detection channel and is connected to the front side of the upper copper sheet 131 via a connecting line; channel 2 serves as the reference channel in the differential channel 1 and is connected to the back side of the upper copper sheet 131 via a connecting line; channel 3 serves as the detection channel in the differential channel 2 and is connected to the front side of the lower copper sheet 132 via a connecting line; and channel 4 serves as the reference channel in the differential channel 2 and is connected to the back side of the lower copper sheet 132 via a connecting line.
[0086] Generally, the capacitance value detected by the detection channel that is in contact with the skin will be higher than the capacitance value of the reference channel that is not in contact with the skin. Therefore, the detection value of the differential channel can be the difference between the capacitance value detected by the detection channel and the capacitance value detected by the reference channel.
[0087] If the detection value of the differential channel is higher than a certain threshold, it indicates that the copper sheet corresponding to the differential channel is in contact with the skin. The higher the detection value, the tighter the contact.
[0088] Therefore, the wearing status of the headphones can be determined by the changes in the detection value of differential channel 1 corresponding to upper copper plate 131 and differential channel 2 corresponding to lower copper plate 132.
[0089] The following example illustrates how to determine the wearing status of earphone 100 by analyzing the changes in the detection values of two differential channels: (The scenario involves a user wearing earphone 100 normally, removing earphone 100, and then wearing earphone 100 again.)
[0090] In this embodiment, the two wearing states of the earphone 100 are referred to as: in-ear state and out-of-ear state. The in-ear state indicates that the earphone is worn by the user, and the out-of-ear state indicates that the earphone is not worn by the user. In practical applications, other names may be used for these two states, and no limitation is made here.
[0091] Figure 4 (a) in the diagram is a schematic diagram showing the change of the detection value of the differential channel 1 corresponding to the upper copper sheet 131 over time. Figure 4 (b) in the figure is a schematic diagram of the change of the detection value of the differential channel 2 corresponding to the lower copper sheet 132 over time.
[0092] exist Figure 4 In this process, the magnitude of the detected value of a differential channel is determined by two thresholds: a differential high threshold and a differential low threshold. These thresholds are written into the earphones after production line calibration before they leave the factory. The differential high threshold and differential low threshold for each differential channel in each earphone may differ from those in other earphones. The differential high threshold is greater than the differential low threshold.
[0093] For example, the detection values of each differential channel can be statistically analyzed when multiple headphones are repeatedly put into and removed from the ears by multiple people. The detection value of a differential channel after most people have put on the headphones can be determined as the differential high threshold for that differential channel. An empirical value that is less than the differential high threshold and greater than the resting value of the differential channel can be determined as the differential low threshold for that differential channel. The resting value of the differential channel represents the detection value of that differential channel when the headphones are removed and left to rest.
[0094] For example, the differential high threshold of differential channel 1 can be set as a first high threshold, and the differential low threshold of differential channel 1 can be set as a first low threshold; the differential high threshold of differential channel 2 can be set as a second high threshold, and the differential low threshold of differential channel 2 can be set as a second low threshold. It is understood that, for ease of description, in some embodiments of this application, the first high threshold and the second high threshold can be collectively referred to as the differential high threshold of the differential channel, and the first low threshold and the second low threshold can be referred to as the differential low threshold of the differential channel. For example, the first high threshold can be 8, the first low threshold can be -500, the second high threshold can be 10, and the second low threshold can be 6.
[0095] like Figure 4The changing trends of the detection values of differential channel 1 and differential channel 2 before time T2, when the user is not wearing headphones for 100 seconds. Figure 4 In (a), the detection value of differential channel 1 is lower than the first low threshold. Figure 4 In (b) of the data, the detection value of differential channel 2 is also lower than the second low threshold.
[0096] After the user puts on the earphone 100, the detection values of both differential channel 1 and differential channel 2 begin to rise. Because the lower part of the earpiece is in closer contact with the ear, the detection value of differential channel 2 corresponding to the lower copper plate 132 rises faster. After time T1, the detection value of differential channel 2 rises above the second highest threshold. The detection value of differential channel 1 corresponding to the upper copper plate 131 continues to rise. After time T2, the detection value of differential channel 1 also rises above the first highest threshold. At this point, the earphone 100 can determine that the current wearing state is an in-ear state.
[0097] exist Figure 4 During the period between time T2 and time T3, since the user may be in motion after wearing the earphone 100, the distance between the upper copper plate 131 and the lower copper plate 132 and the skin will change with the movement. Therefore, the detection values of differential channel 1 and differential channel 2 will also change up and down. Sometimes they may even drop below the differential high threshold of the differential channel. However, as long as they do not drop below the differential low threshold of the differential channel, the earphone 100 will maintain the current wearing state as an in-ear state.
[0098] Before time T3, after the user removes earphone 100, the detection values of both differential channel 1 and differential channel 2 continuously decrease. After time T3, the detection value of differential channel 1 decreases below the first low threshold. At this point, earphone 100 can determine that the current wearing state is out-of-ear. Not far after time T4, the detection value of differential channel 2 also decreases below the second low threshold.
[0099] exist Figure 4 During the period between time T4 and time T5, the detection values of differential channel 1 or differential channel 2 may sometimes exceed the differential low threshold of the differential channel because the user is holding the earphone 100. However, since they do not rise together to exceed the differential high threshold of the two differential channels, the earphone 100 maintains the current wearing state as out-of-ear state during this period.
[0100] Before time T5, the user puts on earphone 100 again, and the detection values of both differential channel 1 and differential channel 2 begin to rise. After time T5, the detection value of differential channel 2 rises to exceed the second highest threshold. After time T6, the detection value of differential channel 1 also rises to exceed the first highest threshold. At this point, earphone 100 again determines the current wearing state as in-ear.
[0101] exist Figure 4 In the illustrated embodiment, when the detection values of the two differential channels change from the differential low threshold to the differential high threshold, and both rise above the differential high threshold, the earphone 100 determines the wearing state as an in-ear state. When either of the detection values of the two differential channels is below the differential low threshold, the earphone 100 determines the wearing state as an out-of-ear state. In other cases, the earphone 100 maintains the current wearing state.
[0102] However, due to differences in ear structure among different users, when the earphone 100 is worn by some users, although the detection value of the differential channel 2 corresponding to the lower copper plate 132 can generally rise to a level exceeding the second highest threshold because the lower copper plate 132 is located below the ear cup and has close contact with the skin of the ear, it is possible that the detection value of the differential channel 1 corresponding to the upper copper plate 131 may not rise to a level exceeding the first highest threshold.
[0103] like Figure 5 As shown in (a), this is a schematic diagram illustrating the change over time of the detection value of the differential channel 1 corresponding to the upper copper plate 131 after some users wear headphones 100. Figure 5 As shown in (b) in the figure, this is a schematic diagram of the change of the detection value of the differential channel 2 corresponding to the lower copper plate 132 over time after the user wears the headphones 100.
[0104] Before time T7, after the user puts on the headphones, the detection values of both differential channel 1 and differential channel 2 begin to rise from the low threshold to the high threshold of the differential channels. After time T7, Figure 5 In (b) shown in the diagram, the detection value of the differential channel 2 corresponding to the lower copper sheet 132 rises to a level exceeding the second highest threshold, but Figure 5 As shown in (a), the detection value of differential channel 1 corresponding to the upper copper sheet 131 can never rise above the first high threshold and can only remain between the first high threshold and the first low threshold. For example, at time T8, the detection value of differential channel 2 has risen to the highest point, while the detection value of differential channel 1 still has not exceeded the first high threshold.
[0105] In this situation, the earphone 100 can only maintain the current wearing state as "out of ear." This does not match the actual state of the user wearing the earphone 100, affecting the user's normal use of the earphone 100. For example, if the user connects the earphone 100 to a mobile phone, wears the earphone 100, and plays music on the mobile phone, the application will still play the music through the mobile phone's speaker, not through the earphone 100.
[0106] This application provides another method for identifying the wearing status of headphones. It not only determines the wearing status of headphones 100 by the relationship between the two differential channels and the differential high threshold and differential low threshold, but also, in some special cases, uses the existing devices of headphones 100 to perform infrasound return detection. The wearing status of headphones 100 is determined by combining the results of the infrasound return detection, thereby further improving the accuracy of identifying the wearing status of headphones.
[0107] The following is combined with Figure 6 The flowchart illustrating the headphone wearing status recognition method is used to describe the headphone wearing status recognition method in this embodiment of the application:
[0108] S601, Earphone 100 periodically detects the wearing status of the earphones;
[0109] The earphone 100 can periodically update the earphone wearing status. For example, the earphone 100 can trigger the earphone wearing status detection process every 50ms with a period of 50ms, thereby ensuring that the earphone wearing status recorded in the earphone 100 is the latest status.
[0110] S602. Confirm whether earphone 100 is in the charging case;
[0111] After a cycle of testing begins, it can be determined whether the earphone 100 is in the charging case;
[0112] If it is determined that the earphone 100 is in the charging case, then step S603 can be executed to directly determine the current wearing status of the earphone;
[0113] If it is determined that the earphone 100 is not in the charging case, step S605 can be executed to continue with subsequent judgments.
[0114] S603. When it is confirmed that the earphone 100 is in the charging case, determine whether the current wearing status indicated on the earphone 100 is in-ear mode.
[0115] The earphone 100 can use different values of a status bit to identify different wearing states of the earphone. For example, a value of 0 can be used to indicate that the earphone is worn out of the ear, and a value of 1 can be used to indicate that the earphone is worn in the ear.
[0116] It is understandable that other methods can be used to record the current wearing status of the earphone in the earphone 100. For example, different values can be used to identify the out-of-ear status or the in-ear status, or the text "out-of-ear status" or "in-ear status" can be used to identify different wearing statuses. No limitation is made here.
[0117] The earphone 100 can read the records in the earphone to determine whether the current wearing status indicated in the earphone 100 is an in-ear state;
[0118] Understandably, when the actual wearing status determined by the headphones differs from the current wearing status indicated in the headphones 100, the headphones 100 will update the current wearing status indicated in the headphones 100 to the latest determined actual wearing status.
[0119] Specifically, if it is determined that the earphone 100 is in the charging case, it means that the user is not using the earphone. However, if it is determined that the current wearing status indicated in the earphone 100 is in the ear, it means that the current wearing status indicated in the earphone 100 is not the latest status. Therefore, step S604 can be executed to update the wearing status of the earphone.
[0120] When it is determined that the current wearing status indicated in the earphone 100 is not in the ear, but out of the ear, this is a normal and reasonable state for the earphone's charging case. Therefore, it is only necessary to jump to step S601 to continue periodically detecting the wearing status of the earphone.
[0121] S604. If it is determined that the current wearing status indicated in the earphone 100 is in-ear and the earphone is in the charging case, update the current wearing status indicated in the earphone 100 to out-of-ear.
[0122] If the current wearing status indicated in the earphone 100 is in the in-ear state and the earphone is in the charging case, it means that the earphone was placed in the charging case after the last detection cycle, and the earphone wearing status indicated in the earphone has not been updated to the latest status. Therefore, it is necessary to update the current wearing status indicated in the earphone 100 to the out-of-ear state.
[0123] S605. Determine that the detection value of at least one differential channel in differential channel 1 and differential channel 2 is not greater than the differential high threshold of that differential channel, and the detection value of any differential channel is not less than the differential low threshold of that differential channel.
[0124] When it is determined that the earphone 100 is not in the charging case, the earphone can trigger the execution of step S606 under the condition that: "the detection value of at least one differential channel in differential channel 1 and differential channel 2 is not greater than the differential high threshold of the differential channel, and the detection value of any differential channel is not less than the differential low threshold of the differential channel".
[0125] Condition 1 can also be described as follows: of the two differential channel detection values, the detection value of one differential channel is above the differential low threshold (or above the differential high threshold) of the differential channel, and the detection value of the other differential channel is between the differential low threshold and the differential high threshold of the differential channel.
[0126] It is understandable that condition 1 represents a special case in the process of recognizing the wearing status of headphones: it does not meet the conditions for directly determining the state as in-ear, nor does it meet the conditions for directly determining the state as out-of-ear.
[0127] In some embodiments, to more accurately determine whether the special case is in effect, it can be set that the special case is only determined when condition 1 is satisfied for I consecutive periods, where I is a positive integer. In some embodiments, for ease of description, the condition for determining whether the special case is in effect can also be called a preset first condition, which is not limited here.
[0128] Since neither the conditions for directly determining it as an in-ear state nor the conditions for directly determining it as an out-of-ear state are met, some wearing status recognition schemes typically maintain the current wearing status indicated on the earphone 100 under this special circumstance. However, maintaining the current wearing status indicated on the earphone 100 under this special circumstance often does not reflect the actual wearing status of the earphone 100. Therefore, in this embodiment, after determining that such a special circumstance is met, subsequent judgment steps are performed to more accurately determine the actual wearing status under this special circumstance, rather than simply maintaining the current wearing status indicated on the earphone 100.
[0129] Optionally, in some embodiments of this application, in addition to using condition 1 shown in S605 to determine that the current situation is in this special case, other methods can also be used to determine that the current situation is in this special case.
[0130] For example, Figure 7 Here is another flowchart illustrating how this special situation is determined in an embodiment of this application:
[0131] S7001. Determine whether the detection value of differential channel 1 is greater than the first high threshold and the detection value of differential channel 2 is greater than the second high threshold;
[0132] In this embodiment of the application, if the detection value of differential channel 1 is greater than the first high threshold and the detection value of differential channel 2 is greater than the second high threshold, it means that the detection values of both differential channels are greater than the differential high threshold of the differential channel, which is a condition for directly determining the in-ear state.
[0133] In some embodiments, to more accurately determine whether the actual wearing state of the headphones is in-ear, the condition for directly determining the in-ear state can be set as follows: for J consecutive cycles, the detection value of differential channel 1 is determined to be greater than a first high threshold and the detection value of differential channel 2 is determined to be greater than a second high threshold, where J is a positive integer. For example, J can be 16.
[0134] When it is determined that the conditions for directly determining the in-ear state are met, step S7004 can be executed to directly determine the wearing state of the headphones as the in-ear state.
[0135] If the condition for directly determining the earphone as being in the ear is not met, step S7003 can be executed to continue judging the actual wearing status of the earphone.
[0136] S7002. Determine whether the detection value of differential channel 1 is less than the first low threshold and the detection value of differential channel 2 is less than the second low threshold;
[0137] In this embodiment of the application, condition 2: "the detection value of differential channel 1 is less than the first low threshold and the detection value of differential channel 2 is less than the difference between the second low threshold" means that the detection values of both differential channels are less than the differential low threshold of the differential channel, which is a condition that can be directly determined as an out-of-ear state.
[0138] In some embodiments, to more accurately determine whether the actual wearing state of the earphone is out-of-ear, the condition for directly determining it as out-of-ear can be set as follows: condition 2 is satisfied for K consecutive cycles, where K is a positive integer. For example, K can be 14.
[0139] Optionally, in some embodiments of this application, the condition 3 used in other headphone wearing status recognition schemes to directly determine the out-of-ear state can also be adopted: "the detection value of differential channel 1 is less than the first low threshold or the detection value of differential channel 2 is less than the second low threshold", which means that either of the detection values of the two differential channels is less than the differential low threshold of the differential channel, and can be used as the condition to directly determine the out-of-ear state in the embodiments of this application.
[0140] Understandably, condition 2 is stricter than condition 3 when used as a direct condition to determine whether an ear has emerged. In other words, there are some cases where condition 3 can directly determine an ear emergence, but condition 2 cannot.
[0141] Using condition 2 as the condition for directly determining the out-of-ear state is a preferred embodiment in this application. Because other headphone wearing status recognition schemes cannot accurately identify the actual wearing status of the headphones under the above-mentioned special circumstances, and can only maintain the current wearing status marked in the headphone 100, if a stricter condition (condition 2) is used in these headphone wearing status recognition schemes to directly determine the out-of-ear state, the range of special circumstances that cannot be accurately identified in these schemes will be larger, resulting in a lower accuracy rate for wearing status recognition. However, in the headphone wearing status recognition method of this application embodiment, since the actual wearing status of the headphones under this special circumstance can be more accurately identified through subsequent steps, a stricter condition (condition 2) can be used to expand the range of this special circumstance. This not only does not reduce the accuracy rate of wearing status recognition, but can actually improve it.
[0142] If it is determined in step S7002 that the condition for directly determining the out-of-ear state is not met, it means that the condition for directly determining the in-ear state is not met at this time, and the condition for directly determining the out-of-ear state is not met either. This is a special case described in step S605, and step S606 can be triggered to continue to use subsequent steps to determine the actual wearing state in this special case.
[0143] When the conditions for directly determining the earphone to be in the out-of-ear state are met, step S7003 can be executed to directly determine the earphone wearing state as the out-of-ear state.
[0144] S7003, Confirm the wearing status as out-of-ear;
[0145] In step S7002, when it is determined that the detection value of differential channel 1 is less than the first low threshold and the detection value of differential channel 2 is less than the second low threshold, that is, when it is determined that the condition for directly determining the out-of-ear state is met, the earphone 100 can determine that the wearing state is the out-of-ear state.
[0146] If the current wearing status indicated in the earphone 100 is out-of-ear, the earphone 100 can keep the current wearing status unchanged; if the current wearing status indicated in the earphone 100 is in-ear, the earphone 100 will update the current wearing status indicated in the earphone 100 to the latest out-of-ear status.
[0147] S7004. Confirm the wearing status as in-ear;
[0148] In step S7001, when it is determined that the detection value of differential channel 1 is greater than the first high threshold and the detection value of differential channel 2 is greater than the second high threshold, that is, when it is determined that the conditions for directly determining the in-ear state are met, the earphone 100 can determine that the wearing state is the in-ear state.
[0149] If the current wearing status indicated in the earphone 100 is in-ear, the earphone 100 can keep the current wearing status unchanged; if the current wearing status indicated in the earphone 100 is out-of-ear, the earphone 100 will update the current wearing status indicated in the earphone 100 to the latest in-ear status.
[0150] In various ways (e.g., step S605 or) Figure 7 After determining that the current situation is in this special case (as shown in the embodiments, etc.), step S606 can be triggered to continue the subsequent judgment steps, thereby making a more accurate determination of the actual wearing status in this special case.
[0151] For example, such as Figure 8 As shown in (a), this is a schematic diagram illustrating the change over time of the detection value of the differential channel 1 corresponding to the copper plate 131 after some users wear headphones 100. Figure 8 As shown in (b) in the figure, this is a schematic diagram of the change of the detection value of the differential channel 2 corresponding to the lower copper plate 132 over time after the user wears the headphones 100.
[0152] Before time T9, Figure 8 The detection value of the differential channel 1 corresponding to the upper copper sheet 131 shown in (a) is... Figure 8 In (b) shown in the diagram, the detection values of the differential channel 2 corresponding to the lower copper plate 132 all increase from the differential low threshold to the differential high threshold. The current wearing state indicated in the earphone 100 is the out-of-ear state.
[0153] After time T9, although the detection value of differential channel 2 rises to a level greater than the differential high threshold, the detection value of differential channel 1 does not rise to a level greater than the differential high threshold. This does not meet the conditions for directly determining the state as an in-ear state or the conditions for directly determining the state as an out-of-ear state. Under the special circumstances described in step S605 above, step S606 will be triggered to continue executing the subsequent judgment steps.
[0154] S606. Determine whether the distance from the last triggered infrasound echo detection exceeds the preset first duration;
[0155] In some embodiments, after executing step S605, that is, when it is determined that the current earphone is in this special situation, step S609 can be directly triggered to emit infrasound wave A to start infrasound echo detection, without executing steps S606 to S608.
[0156] However, executing steps S606 to S608 first is a preferred embodiment of this application. It is understood that from the emission of infrasound A to obtaining the infrasound echo detection result, a period of time is required due to the need to wait for the echo to be received and to detect the echo energy level. This period is referred to as the preset first duration, which, for example, can be 1.5 seconds. If the time since the last triggering of infrasound echo detection has not exceeded this preset first duration, and the result of the previous infrasound echo detection has not yet been obtained, and step S609 is executed again to emit infrasound A for infrasound echo detection, it will greatly waste the energy of the headphones 100 and increase the power consumption of the headphones 100. Since the interval between every two detection cycles in step S601 is generally shorter than the preset first duration, if step S606 is not executed first and step S609 is triggered directly, it is possible to see a situation where the power consumption of the headphones 100 is greatly increased without improving the accuracy of the headphones wearing status detection. Therefore, performing steps S606 to S608 first can effectively avoid wasting headphone energy and improve headphone battery life while increasing the accuracy of headphone wearing status detection.
[0157] In some embodiments, since the time it takes for the headphones to obtain the infrasound return detection result is relatively long, the headphones can continue to trigger step S601 to perform periodic wearing status detection during the infrasound return detection process.
[0158] If the distance to the previous infrasound echo detection has not exceeded the preset first time, that is, if the previous infrasound echo detection has not yet yielded a result, step S607 can be triggered to determine the current actual wearing status of the headphones through other means.
[0159] If a preset first time interval has elapsed since the last infrasound echo detection, meaning the previous infrasound echo detection has already yielded results, it indicates that the headphones have already completed the process of updating the current wearing status flag in the headphones 100 based on the results of the previous infrasound echo detection. Therefore, step S609 can be triggered to emit infrasound wave A again to begin a new round of infrasound echo detection, thereby improving the accuracy of judging the actual wearing status of the headphones.
[0160] S607. Determine whether the sum of the differential channel detection values is less than the first threshold.
[0161] If the infrasound echo detection triggered at a certain distance does not exceed a preset first duration, the headphones can determine whether the sum of the differential channel detection values is less than a first threshold value. The sum of the differential channel detection values is the sum of the detection values of differential channel 1 and differential channel 2. The first threshold value is a preset value. For example, the first threshold value can be 18.
[0162] When the sum of the differential channel detection values is less than the first threshold, it means that although the earphone is in a special case that does not meet the conditions for being directly determined as an in-ear state or the conditions for being directly determined as an out-of-ear state, the detection values of the two differential channels are very small, and the possibility that the actual wearing state of the earphone is an in-ear state is very small. Therefore, step S608 can be triggered to determine that the wearing state is an out-of-ear state.
[0163] When it is determined that the sum of the differential channel detection values is not less than the first threshold, it indicates that although the headphones are in a special situation, the detection values of the two differential channels are not very small, and a judgment result cannot be given directly. Therefore, it can jump to the trigger execution step S601 to perform the wearing status detection in the next cycle.
[0164] Preferably, when the sum of the differential channel detection values is less than a first threshold, although the probability that the headphones are actually worn in an in-ear state is very small, the detection values of both differential channels will change in real time if the user is in motion. To make the determination of the actual wearing state more accurate, the headphones can use the following determination method when actually performing step S607:
[0165] Step S608 is triggered only when the sum of the differential channel detection values is less than a first threshold for L consecutive cycles, to determine that the wearing state is out-of-ear; where L is a positive integer. For example, L can be 15;
[0166] If the sum of the differential channel detection values is not less than the first threshold for L consecutive cycles, the process will jump to trigger execution step S601 to perform the wearing status detection for the next cycle.
[0167] S608. Confirm the wearing status as out-of-ear;
[0168] In some embodiments, when the sum of the differential channel detection values is determined to be less than a first threshold, or in other embodiments, when the sum of the differential channel detection values is determined to be less than the first threshold for L consecutive cycles, the earphone 100 may determine that the wearing state is an out-of-ear state.
[0169] If the current wearing status indicated in the earphone 100 is out-of-ear, the earphone 100 can keep the current wearing status unchanged; if the current wearing status indicated in the earphone 100 is in-ear, the earphone 100 will update the current wearing status indicated in the earphone 100 to the latest out-of-ear status.
[0170] S609, Earphone 100 emits infrasound A through the speaker;
[0171] In some embodiments, when it is determined that the current headphones are in this special situation, or in some embodiments, when it is determined in step S606 that the distance to the last trigger of infrasound echo detection has exceeded a preset first time, the headphones 100 can emit infrasound wave A through the speaker to activate infrasound echo detection, so as to further and more accurately determine the actual wearing status of the headphones 100.
[0172] For example, such as Figure 8 As shown, at time T10, if the headphones determine that they are currently in this special situation and that the time elapsed since the last triggering of infrasound echo detection has exceeded the preset first time elapsed, they can emit infrasound wave A through the speaker to activate infrasound echo detection.
[0173] Please see Figure 9 This is a schematic diagram illustrating the principle of infrasound echo detection in an embodiment of this application. When a user wears the earphone 100, the earpiece of the earphone 100 is located in the user's ear canal. Due to differences in human hearing, the upper copper plate 131 on the upper part of the earpiece is far from the ear canal skin, making it impossible for the detection value of the differential channel 1 corresponding to the upper copper plate 131 to exceed the differential threshold. However, if the earphone is worn on the user's ear, after infrasound echo detection is activated, the earphone 100 emits infrasound wave A through the speaker 120. Part of this infrasound wave A is reflected by the ear canal wall and eardrum in the closed space of the ear canal, and the reflected echo is then detected by the feedback microphone 142 in the earphone 100.
[0174] Therefore, if the energy of the echo detected by the feedback microphone 142 is relatively high, for example, greater than a preset first energy threshold, it indicates that the earphone 100 is facing a relatively enclosed environment and is most likely being worn by the user. If the energy of the echo detected by the feedback microphone 142 is low or no echo is detected, it is very likely that the earphone 100 is simply being held in the user's hand or placed elsewhere so that the upper and lower copper plates are in contact with the skin, rather than being worn by the user.
[0175] In some embodiments, the infrasound wave A is a single-frequency infrasound wave, which makes it easier for the feedback microphone 142 to accurately distinguish the echo of the infrasound wave A from the many received sounds. However, in some embodiments, multi-frequency infrasound waves may also be used as the infrasound wave A for special circumstances, and this is not limited here.
[0176] Understandably, since the frequency of infrasound (below 20Hz) is lower than the frequency of sounds that the human ear can hear, using infrasound can avoid interfering with human hearing when performing infrasound echo detection.
[0177] In some embodiments, the frequency of infrasound A can be any frequency below 20Hz, that is, the frequency of infrasound A is less than 20Hz, such as 5Hz, 10Hz, 13Hz, etc. Preferably, since loudspeakers generally produce sound better in the range of 20Hz to 20kHz, in order to ensure that the performance of infrasound A emitted by the loudspeaker is better and to minimize the impact of infrasound A on human hearing, the frequency of infrasound A can be selected as 16Hz.
[0178] In some embodiments, the audio data of the infrasound wave A can be generated by the headphones 100 according to a preset frequency, and then emitted by the speakers.
[0179] Preferably, in some embodiments, the audio data of the infrasound wave A can be stored in the headphones 100, and the speaker can directly use the stored audio data of the infrasound wave A to emit the infrasound wave A.
[0180] In some embodiments, the size of the stored audio data of the infrasound wave A is approximately 1KB.
[0181] S610 and earphone 100 receive infrasound B through a microphone;
[0182] After a period of time following the emission of infrasound A by the speaker through the headphones 100, the headphones 100 can receive infrasound B through the microphone, which is an echo of infrasound A.
[0183] S611. Determine the energy value of infrasound B;
[0184] After receiving infrasound B through the microphone, the headphone 100 can determine the energy value of the received infrasound B.
[0185] Specifically, the energy value of the received infrasound B can be determined compared to a preset first energy threshold. If the energy value of infrasound B is greater than the preset first energy threshold, it indicates that the energy value of the received infrasound B is high, the earphone 100 is facing a relatively enclosed environment, and the probability that the earphone is in an in-ear state is high, and step S612 can be executed.
[0186] In some embodiments, the headphones may also have a preset second energy threshold, which is less than a preset first energy threshold. The headphones may also determine the magnitude of the energy value of the received infrasound B compared to the preset second energy threshold. If the energy value of the infrasound B is less than the preset second energy threshold, it indicates that the energy value of the received infrasound B is low, and the probability that the headphones are in an out-of-ear state is high.
[0187] It is understandable that the preset first energy threshold and the preset second energy threshold are values written into the earphone 100 when it leaves the factory.
[0188] The following uses a preset first energy threshold as an example to illustrate several representations of energy values and preset energy thresholds:
[0189] In some embodiments, the energy value of infrasound B can be the sound intensity of infrasound B. Sound intensity is a physical quantity of sound determined by the amplitude of the sound. In this case, the speaker in step S609 can emit infrasound A at a preset sound intensity. The preset first energy threshold is a preset first sound intensity threshold smaller than the preset sound intensity. For example, the speaker in step S609 can be set to emit infrasound A at a preset sound intensity of 20 dB, and in step S611, it can be determined whether the sound intensity of infrasound B is greater than the preset first sound intensity threshold of 2 dB.
[0190] In some embodiments, the energy value of infrasound B can be the ratio of the sound intensity of infrasound B to the sound intensity of infrasound A emitted by the speaker. The preset first energy threshold is a preset ratio. For example, if the preset first energy threshold is set to 0.13, and in step S609 the sound intensity of infrasound A emitted by the speaker is 20 dB, and in step S611 it can be determined that the sound intensity of infrasound B is 2 dB, then the energy value of infrasound B received by the feedback microphone is 2 dB / 20 dB = 0.1, which is less than the preset first energy threshold of 0.13. As another example, if the preset first energy threshold is set to 0.13, and in step S609 the sound intensity of infrasound A emitted by the speaker is 20 dB, and in step S611 it can be determined that the sound intensity of infrasound B is 5 dB, then the energy value of infrasound B received by the feedback microphone is 5 dB / 20 dB = 0.25, which is greater than the preset energy threshold of 0.13.
[0191] In some embodiments, the energy value of infrasound B can also be obtained by performing some other calculations on the ratio of the sound intensity of infrasound B received by the feed microphone to the sound intensity of infrasound A emitted by the speaker, and a preset first energy threshold can also be set accordingly. For example, if the energy value of infrasound B received by the feed microphone is set to be 1000 times the ratio of the sound intensity of infrasound B received by the feed microphone to the sound intensity of infrasound A emitted by the speaker, then the preset first energy threshold can be set to a value between 90 and 220, which can vary depending on the calibration of each headphone, for example, it can be 150, 200, etc., and is not limited here. For example, the preset second energy threshold can be set to 80.
[0192] In this embodiment, a feedback microphone is used to receive infrasound B. Since the feedback microphone is located near the speaker, the energy value of the received infrasound B can better reflect the true situation of the reflection of infrasound A, greatly improving the accuracy of the final wearing status recognition.
[0193] In some other embodiments, other microphones in the headset 100 may be used to receive the infrasound wave B, such as a feedforward microphone or another microphone installed in the headset 100, etc., which are not limited here.
[0194] It is understandable that from step S609 when the headphones emit infrasound A to step S611 when the headphones determine the energy value of infrasound B, a certain period of time will be required, which is no longer than the preset first duration set in step S606 above.
[0195] S612. When it is determined that the energy value of the infrasound B is greater than the preset first energy threshold, the earphone 100 determines that the wearing state is the in-ear state.
[0196] For example, in Figure 8 After step S609, which triggers the infrasound backhaul detection at time T10 as shown in (a), after a period of time, Figure 8 When the energy value of the infrasound B is determined to be greater than the preset first energy threshold at time T11 as shown in (a), the earphone 100 can determine that the wearing state is the in-ear state.
[0197] If the current wearing status indicated in the earphone 100 is in-ear, the earphone 100 can keep the current wearing status unchanged; if the current wearing status indicated in the earphone 100 is out-of-ear, the earphone 100 will update the current wearing status indicated in the earphone 100 to the latest in-ear status.
[0198] In some embodiments, if the energy value of the infrasound B is determined to be less than a preset second energy threshold, the earphone 100 may determine that the wearing state is an out-of-ear state.
[0199] In some embodiments, if the energy value of the infrasound B is determined to be not less than a preset second energy threshold and not greater than a preset first energy threshold, the earphone 100 may maintain the identified current wearing state unchanged.
[0200] In this embodiment, when the earphone meets a preset first condition and is in a special situation, the earphone 100 does not simply continue to maintain the current wearing state indicated in the earphone 100, but instead activates infrasound echo detection. Furthermore, if the energy value of the infrasound wave B is determined to be greater than a preset first energy threshold, even if the condition for directly determining it as an in-ear state is not met, the earphone will directly determine the current wearing state as an in-ear state. Without adding any additional physical components to the earphone 100, and only using the existing physical components in the earphone 100, the accuracy of the earphone 100 in recognizing the actual wearing state is further improved. This makes the recognition of the wearing state more accurate in some special situations (e.g., when the earphone wearer is a user with a special ear canal structure), greatly improving the user experience.
[0201] In the above embodiment, if step S606 determines that the time elapsed since the last trigger of infrasound echo detection has exceeded a preset first duration, step S609 can be directly triggered to perform infrasound echo detection. In practical applications, to further avoid wasting headphone energy, other judgments can be made before triggering step S609 to perform infrasound echo detection. Furthermore, to facilitate determining a more accurate actual wearing state, the judgment conditions can vary depending on the current wearing state indicated in the headphone 100.
[0202] Specifically, after step S606 and before step S609, it can be determined whether the current wearing state indicated in the earphone 100 is an in-ear state, and then different judgment conditions are used based on the different judgment results to determine whether to trigger the infrasound return detection.
[0203] Optional, combined Figure 6 In the embodiment shown, after determining in step S606 that the time elapsed since the last trigger of the infrasound echo detection has exceeded a preset first duration, if the current wearing state indicated in the earphone 100 is an in-ear state, the following process can be used to determine whether to trigger step S609. Please refer to [link to relevant documentation]. Figure 10 Here is another flowchart illustrating the headphone wearing status recognition method in this application:
[0204] S1001. Determine whether the current wearing state marked in the earphone 100 has been determined to be in-ear state for M consecutive cycles;
[0205] After step S606, if it is determined that the current wearing state identified in the earphone 100 is the in-ear state, the earphone 100 can determine whether the current wearing state identified in the earphone 100 has been determined to be the in-ear state for M consecutive cycles. That is, whether the determination step S1001 has been reached for the Mth consecutive cycle. Here, M is a positive integer. For example, M can be 12.
[0206] It is understandable that if the Mth consecutive cycle reaches the judgment step S1001, combined with the judgment conditions before step S1001, it means that although the current wearing state marked by the earphone 100 is the in-ear state in these M cycles, the detection values of the two differential channels cannot meet the conditions for directly determining the in-ear state or the conditions for directly determining the out-of-ear state in these M cycles. It is possible that the actual wearing state of the earphone has changed from the in-ear state to the out-of-ear state.
[0207] Therefore, if step S1001 has not yet determined that the current wearing state identified in the earphone 100 for M consecutive cycles is the in-ear state, step S601 can be triggered to continue the detection for the next cycle.
[0208] When step S1001 determines that the current wearing state identified in the earphone 100 for M consecutive cycles is the in-ear state, step S1002 can be triggered to determine whether the differential channel detection value has a downward jump.
[0209] S1002. Determine whether the decrease in the sum of the current differential channel detection values compared to the sum of the differential channel detection values before the preset second time period exceeds the first differential threshold.
[0210] When step S1001 determines that the current wearing state identified in the earphone 100 for M consecutive cycles is an in-ear state, the earphone 100 can determine whether the decrease in the sum of the current differential channel detection values compared to the sum of the differential channel detection values before a preset second time period exceeds a first difference threshold. Here, the sum of the differential channel detection values is the sum of the detection values of differential channel 1 and differential channel 2. The first difference threshold is a preset value. For example, the first difference threshold can be 30.
[0211] The sum of the current differential channel detection values refers to the sum of the differential channel detection values when step S1002 is executed in this detection cycle. It is understood that the detection values of differential channel 1 and differential channel 2 are obtained when step S605 is executed in this detection cycle, and the time from executing step S605 to executing step S1002 is very fast, generally negligible. Therefore, optionally, in some embodiments, the sum of the current differential channel detection values in step S1001 can be obtained by adding the detection values of differential channel 1 and differential channel 2 obtained in step S605. Optionally, in some embodiments, the sum of the current differential channel detection values in step S1001 can also be obtained by adding the detection values of differential channel 1 and differential channel 2 obtained in real time when executing step S1001. This is not limited here.
[0212] The sum of differential channel detection values prior to the preset second duration refers to the sum of differential channel detection values prior to the preset second duration of step S1002 in this detection cycle. It is understood that the headphones timestamp and record each acquired detection value of differential channel 1 and differential channel 2. Therefore, the headphones can look up this record to obtain the detection values of differential channel 1 and differential channel 2 prior to the preset second duration, thus obtaining the sum of the differential channel detection values prior to the preset second duration. The preset second duration is a pre-set value and can be equal to, longer than, or shorter than the preset first duration; no limitation is made here.
[0213] If it is determined that the decrease in the sum of the current differential channel detection values compared to the sum of the differential channel detection values before the preset second time period has not exceeded the first differential threshold, it means that the sum of the differential channel detection values has not changed downward within the preset second time period. The possibility of the actual wearing state of the earphone changing from the in-ear state to the out-of-ear state is not high. Therefore, step S601 can be triggered to perform the wearing state detection in the next cycle.
[0214] If the decrease in the sum of the current differential channel detection values compared to the sum of the differential channel detection values before the preset second time period exceeds the first differential threshold, it indicates that the sum of the differential channel detection values has undergone a downward jump within the preset second time period. The possibility that the actual wearing state of the headphones has changed from the in-ear state to the out-of-ear state has increased. Therefore, S609 can be triggered to perform infrasound return detection to make a more accurate judgment on the actual wearing state of the headphones.
[0215] In the above embodiment, when it is determined in step S606 that the distance from the last trigger of infrasound echo detection has exceeded a preset first time, step S609 is not directly triggered to perform infrasound echo detection. Instead, when it is determined that the current wearing state marked in the earphone 100 is the in-ear state, the above steps S1001 and S1002 are judged first. Only when the judgment results are both yes, step S609 is triggered to perform infrasound echo detection, which avoids the waste of earphone energy and improves the accuracy of wearing state recognition.
[0216] In some embodiments, correspondingly, when the current wearing state identified in the earphone 100 is an in-ear state, after obtaining the energy value of the infrasound B in step S611, the method of determining the wearing state solely based on the energy value as shown in step S612 can be abandoned. Instead, a more refined method combining the energy value and the detection value of the differential channel can be used to determine the wearing state, thereby improving the accuracy of the determined wearing state. Please refer to [link / reference]. Figure 10 Steps S1003 to S1007 are shown below:
[0217] When the current wearing state indicated in the earphone 100 is the in-ear state, after obtaining the energy value of the infrasound B in step S611, the magnitude of the energy value of the infrasound B and the preset second energy threshold can be determined. A description of the preset second energy threshold can be found in step S611, and will not be repeated here.
[0218] S1003. Determine that the energy value of infrasound B is not less than the preset second energy threshold.
[0219] When the current wearing state is indicated as in-ear state in the earphone 100, and the energy value of the infrasound B is determined to be not less than the preset second energy threshold, it means that the energy value of the returned infrasound B is not too low, and the earphone may still be in a relatively closed environment. Therefore, step S1004 can be triggered to continue to maintain the wearing state as in-ear state.
[0220] S1004. Keep the earphone wearing position as in-ear;
[0221] When the current wearing state indicated in the earphone 100 is the in-ear state, and the energy value of the infrasound B is determined to be not less than the preset second energy threshold, the current wearing state indicated in the earphone 100 can remain unchanged as the in-ear state.
[0222] S1005. Determine that the energy value of infrasound B is less than the preset second energy threshold.
[0223] If the current wearing state is indicated as in-ear state in the earphone 100, and the energy value of the infrasound B is determined to be less than the preset second energy threshold, it means that the energy value of the returned infrasound B is too low, and the earphone may be in a relatively open environment. Therefore, step S1006 can be triggered for further judgment.
[0224] S1006. Determine whether the detection value of each differential channel is greater than the differential high threshold of that differential channel;
[0225] When the current wearing state is indicated as in-ear state in the earphone 100, and the energy value of infrasound B is determined to be less than the preset second energy threshold, the earphone can determine whether the detection value of each differential channel is greater than the differential high threshold of that differential channel.
[0226] If the detection value of each differential channel is greater than the differential high threshold of that differential channel, it means that the earphone is in close contact with the skin and is more likely to be in the ear. Therefore, step S1004 can be triggered to continue to maintain the wearing state as the earphone.
[0227] If the detection values of each differential channel are not all greater than the differential high threshold of that differential channel, it indicates that the contact between the earphone and the skin is not tight enough. Combined with the infrasound return detection, it is inferred that the earphone may be in a relatively open environment. In this case, the earphone is more likely to be held in the hand or in other positions by the user rather than being worn on the ear. Therefore, step S1006 can be triggered to update the wearing status of the earphone.
[0228] S1007, Update the wearing status to out-of-ear status.
[0229] If it is determined that the detection values of each differential channel are not all greater than the differential high threshold of that differential channel, the earphone can update the wearing status to the out-of-ear status, that is, change the current wearing status marked in the earphone 100 from the in-ear status to the out-of-ear status.
[0230] In the above embodiment, the wearing status of the headphones is determined by combining the energy value obtained from the infrasound return detection with the detection value of the differential channel, which improves the accuracy of the final determined wearing status of the headphones.
[0231] To facilitate understanding of the above embodiments, the following example illustrates the process of earphone wearing status change after applying the earphone wearing status recognition method in the above embodiments of this application: The scenario in which a user removes the earphones but holds them without placing them in the charging case serves as an example.
[0232] Please see Figure 11 This is a schematic diagram of an exemplary scenario of changes in the wearing state of headphones in an embodiment of this application.
[0233] Assuming the initial state is that the user is wearing the headphones, and in this state, the headphones perform the headphone wearing detection method in the above embodiment to periodically detect the wearing state. The obtained parameters are: the detection value of differential channel 1 > the first high threshold, and the detection value of differential channel 2 > the second high threshold. This meets the conditions for directly determining the in-ear state as described in step S7001 above. Therefore, the wearing state marked in the headphones at this time is the in-ear state.
[0234] At a certain moment, the user removes the earphones. The earphones continue to periodically detect the wearing status using the earphone wearing detection method described in the above embodiment. However, since the user's hand is holding the earphones 100 by touching the upper copper plate 131 and lower copper plate 132, the detection values of the two differential channels in this period do not meet the conditions for directly determining the out-of-ear state as described in step S7002 above. Instead, they are... Figure 11As shown: the first high threshold > the detection value of differential channel 1 > the first low threshold, and the detection value of differential channel 2 > the second high threshold. This meets the preset first condition described in step S605 above, that is, the condition that determines the current situation as a special case as described in step S605. Since the wearing state indicated in the earphone is the in-ear state at this time, it will be processed according to... Figure 10 The steps in the illustrated embodiment continue to execute the above steps S1001 and S1002 for subsequent judgment.
[0235] When step S1002 determines that the sum of differential channel detection values before the preset second time period minus the sum of current differential channel detection values is greater than the first differential threshold, i.e., when it is determined that there is a large downward jump in the differential channel detection values, the headphones will trigger step S609 to emit infrasound A and start infrasound echo detection.
[0236] After completing steps S609 to S611, as follows Figure 11 The determination that the energy value of infrasound B is less than a preset second energy threshold indicates that the headphones may be in a relatively open environment. The headphones can then trigger step S1006 to determine whether the detection values of each differential channel are all greater than the differential high threshold of that differential channel. In the case of... Figure 11 As shown, if the detection value of differential channel 1 is less than the first high threshold, or the detection value of differential channel 2 is less than the second high threshold, it indicates that the contact between the earphone and the skin is not tight enough. This suggests that the earphone may be in a relatively open environment, meaning it is more likely that the earphone is not being worn on the user's ears, but rather being held in the user's hand or in another position. Therefore, the current wearing status indicated on the earphone can be updated from in-ear to out-of-ear.
[0237] In the aforementioned scenario, when the user removes the earphones and happens to be holding them at the top and bottom copper contacts, causing the differential channel's detection value to not meet the conditions for directly determining an out-of-ear state, the earphone wearing status recognition method in this embodiment will not, like some other earphone wearing status recognition schemes, directly maintain the wearing status as in-ear, resulting in inaccurate wearing status. Instead, it can accurately determine the current actual wearing status of the earphones as out-of-ear based on the infrasound return detection results and the differential channel's detection value, greatly improving the accuracy of recognizing the actual wearing status of the earphones.
[0238] Optional, combined Figure 6 In the embodiment shown, after determining in step S606 that the time elapsed since the last trigger of the infrasound echo detection has exceeded a preset first duration, if the current wearing state indicated in the earphone 100 is an out-of-ear state, the following procedure can be used to determine whether to trigger step S609. Please refer to [link to relevant documentation]. Figure 12 Here is another flowchart illustrating the headphone wearing status recognition method in this application:
[0239] S1201. If the current wearing state indicated in the earphone 100 is the out-of-ear state, determine whether the sum of the current differential channel detection values is greater than the second threshold.
[0240] After step S606, if it is determined that the current wearing state identified in the earphone 100 is an out-of-ear state, it is determined whether the sum of the current differential channel detection values is greater than a second sum threshold; wherein, the second sum threshold is a preset value. For example, the second sum threshold can be 20.5.
[0241] If it is determined that the sum of the current differential channel detection values is not greater than the second threshold, it means that the sum of the differential channel detection values is not large enough, and the possibility of changing from the out-of-ear state to the in-ear state is low. Therefore, step S601 can be triggered to perform the wearing detection of the next cycle.
[0242] If it is determined that the sum of the current differential channel detection values is greater than the second threshold, it indicates that the sum of the differential channel detection values is large, and step S1202 can be triggered for subsequent judgment.
[0243] S1202. Determine whether the sum of the differential channel detection values has been determined to be greater than the second threshold for N consecutive cycles;
[0244] In this detection cycle step S1201, after determining that the sum of the current differential channel detection values is greater than the second threshold, the earphone can further determine whether the sum of the differential channel detection values has been greater than the second threshold for N consecutive cycles; where N is a positive integer. For example, N can be 8.
[0245] Understandably, if the sum of the differential channel detection values is greater than the second threshold for N consecutive cycles, combined with the judgment conditions before step S1202, it means that although the current wearing state marked by the earphone 100 is out-of-ear state in these N cycles, the detection values of the two differential channels cannot meet the conditions for directly determining the state as in-ear or out-of-ear in these N cycles, and the detection values of the two differential channels are always large, then the actual wearing state of the earphone may have changed from out-of-ear state to in-ear state.
[0246] Therefore, if it is not determined in step S1202 that the sum of the differential channel detection values has been determined to be greater than the second threshold for N consecutive cycles, step S601 can be triggered to continue the detection for the next cycle.
[0247] When step S1202 determines that the sum of the differential channel detection values for N consecutive cycles is greater than the second threshold, step S1203 can be triggered to determine whether the differential channel detection values have jumped upwards.
[0248] S1203. Determine whether the increase in the sum of the current differential channel detection values compared to the sum of the differential channel detection values before the preset third time period exceeds the second differential threshold.
[0249] When step S1202 determines that the sum of the differential channel detection values for N consecutive cycles is greater than the second threshold, the earphone 100 can determine whether the increase in the current sum of the differential channel detection values compared to the sum of the differential channel detection values before a preset third time interval exceeds the second threshold. Here, the sum of the differential channel detection values is the sum of the detection values of differential channel 1 and differential channel 2. The second threshold is a preset value. For example, the second threshold can be 12.
[0250] The sum of the current differential channel detection values refers to the sum of the differential channel detection values when step S1203 is executed in this detection cycle. It is understood that the detection values of differential channel 1 and differential channel 2 are obtained when step S605 is executed in this detection cycle, and the time from executing step S605 to executing step S1002 is very fast, generally negligible. Therefore, optionally, in some embodiments, the sum of the current differential channel detection values in step S1203 can be obtained by adding the detection values of differential channel 1 and differential channel 2 obtained in step S605. Optionally, in some embodiments, the sum of the current differential channel detection values in step S1203 can also be obtained by adding the detection values of differential channel 1 and differential channel 2 obtained in real time when executing step S1203. This is not limited here.
[0251] The sum of differential channel detection values before the preset third duration refers to the sum of differential channel detection values before the preset third duration of step S1203 in this detection cycle. It is understood that the headphones timestamp and record the detection values of differential channel 1 and differential channel 2 acquired each time. Therefore, the headphones can look up this record to obtain the detection values of differential channel 1 and differential channel 2 before the preset third duration, thus obtaining the sum of differential channel detection values before the preset third duration. The preset third duration is a pre-set value, which can be equal to, longer than, or shorter than the preset first or second duration; no limitation is made here.
[0252] If it is determined that the increase in the sum of the current differential channel detection values compared to the sum of the differential channel detection values before the preset third time period has not exceeded the second differential threshold, it means that the sum of the differential channel detection values has not jumped upward within the preset third time period. The possibility of the actual wearing state of the earphone changing from the out-of-ear state to the in-ear state is not high. Therefore, step S601 can be triggered to perform the wearing state detection in the next cycle.
[0253] If the sum of the current differential channel detection values is found to be greater than the sum of the differential channel detection values before the preset third time period than the second differential threshold, it indicates that the sum of the differential channel detection values has jumped upward within the preset second time period. The possibility that the actual wearing state of the headphones has changed from out-of-ear state to in-ear state has increased. Therefore, S609 can be triggered to perform infrasound return detection to make a more accurate judgment on the actual wearing state of the headphones.
[0254] In the above embodiment, when it is determined in step S606 that the distance from the last trigger of infrasound echo detection has exceeded a preset first time, step S609 is not directly triggered to perform infrasound echo detection. Instead, when it is determined that the current wearing state marked in the earphone 100 is the out-of-ear state, the judgments in steps S1201 to S1203 are performed first. Only when the judgment results are all yes, step S609 is triggered to perform infrasound echo detection. This avoids wasting earphone energy and improves the accuracy of wearing state recognition.
[0255] In some embodiments, correspondingly, when the current wearing state identified in the earphone 100 is the out-of-ear state, after obtaining the energy value of the infrasound B in step S611, the method of determining the wearing state solely based on the energy value as shown in step S612 can be abandoned. Instead, a more refined method combining the energy value and the detection value of the differential channel can be used to determine the wearing state, thereby improving the accuracy of the determined wearing state. Please refer to [link / reference]. Figure 12 Steps S1204 to S1208 are shown below:
[0256] When the current wearing state indicated in the earphone 100 is the in-ear state, after obtaining the energy value of the infrasound B in step S611, the magnitude of the energy value of the infrasound B and the preset first energy threshold can be determined. A description of the preset first energy threshold can be found in step S611, and will not be repeated here.
[0257] S1204. Determine that the energy value of infrasound B is not greater than the preset first energy threshold.
[0258] When the current wearing state is marked as out-of-ear state in the earphone 100, and the energy value of the infrasound B is determined to be no greater than the preset first energy threshold, it means that the energy value of the returned infrasound B is not too high, and the earphone may still be in a relatively open environment. Therefore, step S1205 can be triggered to continue to maintain the wearing state as out-of-ear state.
[0259] S1205. Keep the ear-out wearing position.
[0260] When the current wearing state indicated in the earphone 100 is the out-of-ear state, and the energy value of the infrasound B is determined to be no greater than the preset first energy threshold, the current wearing state indicated in the earphone 100 can remain unchanged as the out-of-ear state.
[0261] S1206. Determine that the energy value of infrasound B is greater than the preset first energy threshold.
[0262] If the current wearing state is marked as out-of-ear state in the earphone 100, and the energy value of the infrasound B is determined to be greater than the preset first energy threshold, it indicates that the energy value of the returned infrasound B is high, and the earphone may be in a relatively closed environment. Therefore, step S1207 can be triggered for further judgment.
[0263] S1207. Determine whether the sum of the currently acquired differential channel detection values is less than the second threshold.
[0264] When the current wearing state is marked as out-of-ear state in the earphone 100, and the energy value of infrasound B is determined to be greater than the preset first energy threshold, the earphone can determine whether the sum of the currently acquired differential channel detection values is less than the second threshold.
[0265] It is understandable that, since infrasound backhaul detection in steps S609 to S611 has been performed previously, and infrasound backhaul detection generally takes a long time, the sum of the differential channel detection values currently obtained in step S1207 is obtained by adding the detection value of differential channel 1 and the detection value of differential channel 2 obtained in real time when step S1207 is performed, rather than directly using the sum of the detection values of differential channel 1 and differential channel 2 obtained when step S605 is performed in this detection cycle. In some embodiments, the sum of the differential channel detection values currently obtained in step S1207 can also be obtained by adding the detection value of differential channel 1 and the detection value of differential channel 2 obtained at any time after obtaining the result of infrasound backhaul detection in step S611 and before performing step S1207. This is not limited here.
[0266] If it is determined that the sum of the currently acquired differential channel detection values is less than the second threshold, it indicates that the contact between the earphone and the skin is not tight enough and it is more likely that the earphone is still in the out-of-ear state. Therefore, step S1205 can be triggered to continue to maintain the wearing state as the out-of-ear state.
[0267] If it is determined that the sum of the currently acquired differential channel detection values is not less than the second threshold, it indicates that the earphone is in close contact with the skin. Combined with the infrasound return detection, it is inferred that the earphone may be in a relatively closed environment. At this time, it is more likely that the earphone has been worn by the user. Therefore, step S1208 can be triggered to update the wearing status of the earphone.
[0268] S1208, Update the wearing status to in-ear mode.
[0269] If the sum of the currently acquired differential channel detection values is not less than the second threshold, the earphone can update the wearing status to the in-ear status, that is, change the current wearing status marked in the earphone 100 from the out-of-ear status to the in-ear status.
[0270] In the above embodiment, the wearing status of the headphones is determined by combining the energy value obtained from the infrasound return detection with the detection value of the differential channel, which improves the accuracy of the final determined wearing status of the headphones.
[0271] To facilitate understanding of the above embodiments, the following example illustrates the process of earphone wearing status change after applying the earphone wearing status recognition method in the above embodiments of this application: A user with a special ear canal structure takes the earphones out of the charging case and puts them on.
[0272] Please see Figure 13 This is a schematic diagram of another exemplary scenario of headphone wearing status changes in the embodiments of this application.
[0273] Assuming the initial state is that the earphones are placed in the charging case, in this state, the earphones perform the earphone wearing detection method in the above embodiment to periodically detect the wearing status, and the result is: the earphones are in the charging case. According to the processing method of steps S602 to S604 above, the wearing status marked on the earphones will remain in the out-of-ear state.
[0274] At some point, the user takes the earbuds out of the charging case and puts them on. The earbuds continue to periodically detect the wearing status using the earbud wearing detection method described in the above embodiment. However, due to the special structure of the user's ear canal, the upper copper plate does not make close enough contact with the user's ear canal skin. Therefore, in this periodic detection, the detection values of the two differential channels do not meet the conditions for directly determining the earbud state as described in step S7001 above, but are instead... Figure 13 As shown: the first high threshold > the detection value of differential channel 1 > the first low threshold, and the detection value of differential channel 2 > the second high threshold. This meets the preset first condition described in step S605 above, that is, the condition that determines the current situation as a special case as described in step S605. Since the wearing state indicated in the earphone is the out-of-ear state at this time, it will be processed according to... Figure 12 The steps in the illustrated embodiment continue to execute the above steps S1201 to S1203 for subsequent judgment.
[0275] When step S1202 determines that the sum of differential channel detection values for N consecutive cycles is greater than the second threshold, and step S1203 determines that the sum of the current differential channel detection values minus the sum of differential channel detection values before the preset third time interval is greater than the second threshold, i.e., when it is determined that there is a large upward jump in the differential channel detection values, the headphones will trigger step S609 to emit infrasound A and start infrasound echo detection.
[0276] After completing steps S609 to S611, as follows Figure 13 The diagram shows that if the energy value of infrasound B is greater than a preset first energy threshold, it indicates that the headphones may be in a relatively enclosed environment. The headphones can then trigger step S1207 to determine whether the sum of the currently acquired differential channel detection values is less than a second threshold. In such cases... Figure 13 As shown, if the sum of the currently acquired differential channel detection values is greater than or equal to the second threshold, it indicates that the earphone is in close contact with the skin. Combined with the possibility that the earphone is in a relatively enclosed environment, it is more likely that the earphone is already being worn by the user. Therefore, the current wearing status indicated on the earphone can be updated from out-of-ear to in-ear.
[0277] In the aforementioned scenario, when a user removes the earbuds from the charging case and puts them on, but the user's ear canal structure is unique, causing the differential channel detection value to not meet the conditions for directly determining an in-ear state, the earbud wearing state recognition method in this embodiment will not, like some other earbud wearing state recognition schemes, directly maintain the wearing state as an out-of-ear state, resulting in inaccurate wearing state. Instead, it can accurately determine the current actual wearing state of the earbuds as an in-ear state based on the infrasound return detection result and the differential channel detection value, greatly improving the accuracy of recognizing the actual wearing state of the earbuds.
[0278] It is understandable that the above Figure 7 The illustrated embodiment Figure 10 The illustrated embodiments and Figure 12 One or more of the embodiments shown can be individually or entirely related to the above. Figure 6 The embodiments shown are combined to obtain other embodiments of the headphone wearing status recognition method in this application.
[0279] In some embodiments of this application, the current wearing state of the headphones is also referred to as the wearing state of the headphones, and this is not limited here. In some embodiments of this application, the differential channel 1 mentioned above can also be referred to as the first differential channel, and the differential channel 2 can also be referred to as the second differential channel, and this is not limited here.
[0280] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
[0281] As used in the above embodiments, depending on the context, the term "when..." can be interpreted as meaning "if...", "after...", "in response to determining...", or "in response to detecting...". Similarly, depending on the context, the phrase "when determining..." or "if (the stated condition or event) is interpreted as meaning "if determining...", "in response to determining...", "when (the stated condition or event) is detected", or "in response to detecting (the stated condition or event)".
[0282] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive), etc.
[0283] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
Claims
1. A method for recognizing wearing status, applied to headphones, characterized in that, The headphones include a speaker, a microphone, a first differential channel, and a second differential channel. The method includes: Under the condition of satisfying a preset first condition, the earphone emits a first sound wave through the speaker; the condition of satisfying the preset first condition is used to indicate that the current state is neither directly determined to be an in-ear state nor directly determined to be an out-of-ear state; wherein, the preset first condition is that for I consecutive cycles, the detection value of at least one differential channel in the first differential channel and the second differential channel is not greater than the differential high threshold of the differential channel, and the detection value of any differential channel is not less than the differential low threshold of the differential channel, where I is a positive integer; The earphone receives a second sound wave through the microphone, and the second sound wave is an echo of the first sound wave; If the energy value of the second sound wave is determined to be greater than a preset first energy threshold, the earphone is determined to be in an in-ear state.
2. The method according to claim 1, characterized in that, The first differential channel consists of a first detection channel and a first reference channel, and the second differential channel consists of a second detection channel and a second reference channel; the earphone also includes a first detection plate and a second detection plate; The front side of the first detection piece is connected to the first detection channel of the earphone, and the back side of the first detection piece is connected to the first reference channel of the earphone. The front side of the second detection piece is connected to the second detection channel of the earphone, and the back side of the second detection piece is connected to the second reference channel of the earphone; The first detection channel, the first reference channel, the second detection channel, and the second reference channel are the capacitance detection channels of the earphone; The method further includes: the earphone periodically detecting the wearing status of the earphone.
3. The method according to claim 2, characterized in that, The condition for directly determining the in-ear state is: the detection value of the first differential channel is greater than the first high threshold for J consecutive cycles, and the detection value of the second differential channel is greater than the second high threshold, where J is a positive integer.
4. The method according to claim 2 or 3, characterized in that, The condition for directly determining the state as "ear-out" is: for K consecutive cycles, the detection value of the first differential channel is less than the first low threshold, and the detection value of the second differential channel is less than the second low threshold, where K is a positive integer.
5. The method according to claim 4, characterized in that, When a preset first condition is met, the headphones emit a first sound wave through the speaker, including: If the preset first condition is met, the earphone determines whether the distance from the last time the first sound wave was emitted through the speaker exceeds a preset first duration; If the distance at which the first sound wave is emitted through the speaker exceeds a preset first duration, the headphones emit the first sound wave through the speaker.
6. The method according to claim 5, characterized in that, The method further includes: If the distance between the first sound wave emitted by the speaker and the first sound wave is less than the preset first duration, determine whether the sum of the differential channel detection values is less than a first threshold. The sum of the differential channel detection values is the sum of the detection values of the first differential channel and the detection values of the second differential channel. When the sum of the differential channel detection values is less than the first threshold, the wearing state is determined to be the out-of-ear state.
7. The method according to claim 6, characterized in that, When the first sound wave emitted by the speaker at a predetermined distance has exceeded a preset first duration, the earphones emitting the first sound wave through the speaker includes: If the distance at which the first sound wave is emitted through the speaker exceeds a preset first duration, and the current wearing state indicated in the earphone is in the in-ear state, the earphone determines whether it has been the Mth consecutive cycle that the current wearing state indicated in the earphone is in the in-ear state. If it is determined that the current wearing state identified in the earphone is the in-ear state for the Mth consecutive cycle, the earphone determines whether the decrease in the sum of the current differential channel detection values compared to the sum of the differential channel detection values before a preset second time period exceeds a first difference threshold; where M is a positive integer; When it is determined that the decrease in the sum of the current differential channel detection values compared to the sum of the differential channel detection values before a preset second time period exceeds a first differential threshold, the headphones emit a first sound wave through the speaker.
8. The method according to claim 7, characterized in that, When the first sound wave emitted by the speaker at a predetermined distance has exceeded a preset first duration, the earphones emitting the first sound wave through the speaker includes: If the distance at which the first sound wave is emitted through the speaker exceeds a preset first duration, and the current wearing state indicated in the earphone is out of ear, the earphone determines whether the sum of the current differential channel detection values is greater than a second threshold. When it is determined that the sum of the current differential channel detection values is greater than the second threshold, it is determined whether it has been the Nth consecutive period in which the sum of the differential channel detection values is greater than the second threshold, where N is a positive integer; When it is determined that the sum of the differential channel detection values has been greater than the second threshold for the Nth consecutive period, it is determined whether the increase in the sum of the current differential channel detection values compared with the sum of the differential channel detection values before the preset third time period exceeds the second differential threshold. When it is determined that the increase in the sum of the current differential channel detection values compared to the sum of the differential channel detection values three preset time intervals exceeds the second differential threshold, the headphones emit a first sound wave through the speaker.
9. The method according to claim 7, characterized in that, The step of determining the wearing state of the headphones as in-ear mode when the energy value of the second sound wave is determined to be greater than a preset first energy threshold includes: If the energy value of the second sound wave is determined to be not less than a preset second energy threshold, the wearing state remains in the in-ear state; the preset second energy threshold is less than the preset first energy threshold. If the energy value of the second sound wave is determined to be less than the preset second energy threshold, it is determined whether the detection value of each differential channel is greater than the differential high threshold of that differential channel. When the detection value of each differential channel is determined to be greater than the differential high threshold of that differential channel, the wearing state is maintained as an in-ear state; When it is determined that the detection values of each differential channel are not all greater than the differential high threshold of that differential channel, the wearing status is updated to the out-of-ear status.
10. The method according to claim 7, characterized in that, The step of determining the wearing state of the headphones as in-ear mode when the energy value of the second sound wave is determined to be greater than a preset first energy threshold includes: If the energy value of the second sound wave is determined to be no greater than the preset first energy threshold, the wearing state remains in the out-of-ear state. If the energy value of the second sound wave is determined to be greater than the preset first energy threshold, determine whether the sum of the currently acquired differential channel detection values is less than the second sum threshold. When the sum of the currently acquired differential channel detection values is determined to be less than the second threshold, the wearing state remains in the out-of-ear state; When the sum of the currently acquired differential channel detection values is determined to be no less than the second threshold, the wearing status is updated to in-ear status.
11. The wearing status recognition method according to claim 10, characterized in that, The microphone is a feedback microphone located in front of the speaker and whose sound pickup direction is the same as the sound output direction of the speaker.
12. The wearing status recognition method according to claim 11, characterized in that, The preset infrasound is a single-frequency infrasound.
13. The wearing status recognition method according to claim 12, characterized in that, The preset frequency of the infrasound is 16Hz.
14. An earphone, characterized in that, The earphone includes: a speaker, a microphone, a first detection chip, a second detection chip, one or more microcontroller units, and a memory; The front side of the first detection piece is connected to the first detection channel of the earphone, and the back side of the first detection piece is connected to the first reference channel of the earphone. The first detection channel and the first reference channel form a first differential channel. The front side of the second detection piece is connected to the second detection channel of the earphone, and the back side of the second detection piece is connected to the second reference channel of the earphone. The second detection channel and the second reference channel form a second differential channel. The first detection channel, the first reference channel, the second detection channel, and the second reference channel are capacitance detection channels in the microcontroller unit. Wherein, the first differential channel and the second differential channel are used to trigger the speaker to emit a first sound wave when a preset first condition is met; the preset first condition is used to indicate that the current state is neither directly determined to be an in-ear state nor directly determined to be an out-of-ear state; wherein, the preset first condition is that for I consecutive cycles, the detection value of at least one of the first differential channel and the second differential channel is not greater than the differential high threshold of the differential channel, and the detection value of any differential channel is not less than the differential low threshold of the differential channel, where I is a positive integer; The memory and the one or more microcontrollers, the memory being used to store computer program code including computer instructions, the one or more microcontrollers invoking the computer instructions to cause the earphones to perform the method of any one of claims 1 to 13.
15. A chip system applied to an earphone, the chip system comprising one or more microcontroller units configured to invoke computer instructions to cause the earphone to perform the method as described in any one of claims 1-13.
16. A computer program product containing instructions, characterized in that, When the computer program product is run on the headphones, the headphones perform the method as described in any one of claims 1-13.
17. A computer-readable storage medium comprising instructions, characterized in that, When the instruction is executed on the headphones, the headphones perform the method as described in any one of claims 1-13.
Citation Information
Patent Citations
Earphone, in-ear detection method of earphone, and storage medium
CN112995881A