Earphone wearing detection method and related device

Abstract

The invention discloses an earphone wearing detection method and a related device, the earphone wearing detection method is applied to an earphone, the earphone comprises two earphone bodies, the first earphone body comprises an in-ear microphone and an out-of-ear microphone, and the first earphone body is any one of the two earphone bodies; the method is characterized by comprising the following steps: controlling an in-ear microphone and an out-of-ear microphone of a first earphone body to be powered on when detecting that two earphone bodies of the earphone are switched from a pull-in state to a separated state; controlling the in-ear microphone and the out-of-ear microphone to collect audio data; according to first audio data currently collected by the in-ear microphone and / or second audio data currently collected by the out-of-ear microphone, the current wearing state of the first earphone body is identified, and the wearing state is a worn state or a non-worn state. Therefore, in combination with the equipment characteristics of the earphone, the wearing detection of the earphone is accurately realized, and the use experience of a user is effectively improved.

Description

Technical Field

[0001] The present application relates to the field of electronic technology, and in particular to a headphone wearing detection method and related devices. Background Art

[0002] Headphones are accessories for smart watches, mobile phones, computers and other terminal devices. Configuring the working state of headphones according to the wearing state of headphones is a hot research direction. For example, when the headphones are detected to be not worn, the audio output is automatically stopped.

[0003] At present, most neck-worn headphones do not have a wearing detection function; this is mainly because the control chip of neck-worn products is generally located in the main control box of the neck-worn cable. Adding a wearing sensor (such as a capacitive sensor) in the headphone body, the communication between the wearing sensor and the control chip is easily interfered by the wire of the neck-worn cable, and the wearing detection function cannot be accurately realized; and adding a control chip in the headphone body of the neck-worn product is costly. In addition, if a capacitive sensor is used for wearing detection, in order to improve the detection sensitivity and accuracy, the metal electrode of the above-mentioned capacitive sensor needs to have a large enough metal area to form a large capacitance with the human body. However, the size of neck-worn headphones is small and the internal space is limited, so it is difficult to increase the metal area of ​​the metal electrode.

[0004] How to combine the device characteristics of the headphones to accurately implement headphone wearing detection remains to be studied. Summary of the invention

[0005] The embodiments of the present application provide an earphone wearing detection method and related devices, which can accurately implement earphone wearing detection in combination with the device characteristics of the earphone, thereby effectively improving the user experience.

[0006] In a first aspect, the present application provides a headphone wearing detection method, which is applied to a headphone, wherein the headphone includes two headphone bodies, the first headphone body includes an in-ear microphone and an external-ear microphone, and the first headphone body is any one of the two headphone bodies; the method includes: when it is detected that the two headphone bodies of the headphone are switched from an engaged state to a separated state, controlling the in-ear microphone and the external-ear microphone of the first headphone body to power on; the in-ear microphone and the external-ear microphone collect audio data; according to the first audio data currently collected by the in-ear microphone and / or the second audio data currently collected by the external-ear microphone, identifying the current wearing state of the first headphone body, the wearing state being a worn state or a not worn state.

[0007] Neck-worn headphones may have the following device characteristics: after putting on the first earphone body, part of the first earphone body is inserted into the ear canal, and part of it is not inserted into the ear canal; the control chip of the neck-worn headphones is generally in the main control box. If a wearing sensor for wearing detection is added to the earphone body, the communication between the wearing sensor and the control chip is easily interfered by the wire of the neck-worn cable, and the wearing detection cannot be accurately realized. Adding control chips to the two earphone bodies of the neck-worn product respectively is costly; the two earphone bodies of the earphone have an attracted state and a separated state. In the attracted state, the earphone can enter a power saving mode or shut down, and in the separated state, the earphone can enter a working mode; the neck-worn cable of the neck-worn headphones is usually provided with multiple lines, such as a left channel signal line, a right channel signal line, and a microphone signal line for communication between the microphone and the main control box. The in-ear microphone and the outside-ear microphone can communicate with the control chip of the main control box through the microphone signal line, and the communication is not easily interfered with.

[0008] When implementing the embodiment of the present application, when the two earphone bodies of the earphone are switched from the engaged state to the separated state, the in-ear microphone and the external ear microphone are powered on, and the wearing detection of the first earphone body is performed; the wearing state of the earphone body is identified based on the audio data collected by the in-ear microphone and the external ear microphone. In this way, combined with the device characteristics of the earphone, the timing of powering on the in-ear microphone and the external ear microphone, and the timing of triggering the wearing detection, the energy consumption of the in-ear microphone and the external ear microphone can be reduced, the energy consumption caused by meaningless wearing detection can be avoided, and the user experience of the earphone wearing detection can be improved. In addition, combined with the device characteristics of the earphone, the in-ear microphone and the external ear microphone are reasonably set, and the wearing state of the earphone body is identified based on the audio data collected by the in-ear microphone and the external ear microphone, which can improve the accuracy of wearing detection and have low detection costs.

[0009] In one implementation, the in-ear microphone and the external-ear microphone collect audio data, including: controlling the in-ear microphone and the external-ear microphone to collect audio data in a first low power consumption mode. In this way, collecting audio data in the first low power consumption mode and performing wearing detection can reduce energy consumption of the in-ear microphone and the external-ear microphone.

[0010] In one implementation, the method further includes: when it is detected that the two earphone bodies of the earphone switch from the separated state to the attracted state, controlling the in-ear microphone and the external-ear microphone of the first earphone body to power off. In this way, in combination with the device characteristics of the earphone, the power-off timing of the in-ear microphone and the external-ear microphone is reasonably set, the energy consumption of the in-ear microphone and the external-ear microphone is reduced, the energy consumption caused by meaningless wearing detection is avoided, and the user experience of earphone wearing detection is improved.

[0011] In one implementation, the earphone stores wearing information of a first earphone body, the wearing information is used to indicate a wearing state of the first earphone body, and the wearing state of the first earphone body includes a not-worn state and a worn state; according to first audio data currently collected by an in-ear microphone and / or second audio data currently collected by an external-ear microphone, the current wearing state of the first earphone body is identified, including: according to the first audio data currently collected by the in-ear microphone and / or the second audio data currently collected by the external-ear microphone, a first action is identified, and the first action is used to put on the first earphone body or take off the first earphone body; if the wearing state indicated by the wearing information is an not-worn state, determining that the first action is specifically used to put on the first earphone body, identifying that the earphone is currently in a worn state, and switching the wearing state indicated by the wearing information to a worn state; if the wearing state indicated by the wearing information is a worn state, determining that the first action is specifically used to take off the first earphone body, identifying that the earphone is currently in a not-worn state, and switching the wearing state to a not-worn state. By implementing the embodiment of the present application, the conditions for determining the first action can be set based on the common features of the audio data collected by the in-ear microphone and the external ear microphone when the user puts on the earphone body and takes off the earphone body, and the current wearing state of the earphone can be identified in combination with the wearing information of the earphone. In this way, the accuracy of wearing detection can be improved, and the user experience of wearing detection can be effectively improved.

[0012] In one implementation, the method further includes: when it is detected that the two earphone bodies of the earphone switch from the attracted state to the separated state, setting the initial wearing state indicated by the wearing information to the unworn state. In this way, the initial wearing state indicated by the wearing information is reasonably set, which helps to improve the accuracy of wearing detection.

[0013] In one implementation, based on the first audio data currently collected by the in-ear microphone and / or the second audio data currently collected by the external-ear microphone, a first action is identified, including: when it is detected that the first signal feature of the first audio data is greater than or equal to a first threshold, it is determined that the first action is identified; the first signal feature indicates the signal strength of the audio data; when it is detected that the change value of the second signal feature of the first audio data is greater than or equal to the second threshold, and the difference between the third signal features of the first audio data and the second audio data is greater than or equal to the third threshold, it is determined that the first action is identified. In this way, by using the signal features of the audio data collected by the in-ear microphone and / or the audio data collected by the external-ear microphone to perform wearing detection, the accuracy of wearing detection can be improved, and the user experience of wearing detection can be effectively improved.

[0014] In one implementation, according to the first audio data currently collected by the in-ear microphone and / or the second audio data currently collected by the external-ear microphone, identifying the current wearing state of the first earphone body includes: when it is detected that the first signal feature of the first audio data is greater than or equal to the fourth threshold, identifying that the first earphone body is currently in the worn state; when it is detected that the first signal feature of the first audio data is greater than the fifth threshold and less than the sixth threshold, identifying that the first earphone body is currently in the unworn state; the sixth threshold is less than the fourth threshold; when it is detected that the change value of the second signal feature of the first audio data is greater than or equal to the seventh threshold, and the difference between the third signal features of the first audio data and the second audio data is greater than or equal to the eighth threshold, identifying that the first earphone body is in the worn state; when it is detected that the change value of the second signal feature of the first audio data is greater than the ninth threshold and less than the tenth threshold, and the difference between the third signal features of the first audio data and the second audio data is greater than the eleventh threshold and less than the twelfth threshold, identifying that the first earphone body is in the unworn state; the tenth threshold is less than the seventh threshold, and the twelfth threshold is less than the eighth threshold. In this way, by using the signal features of the audio data collected by the in-ear microphone and the audio data collected by the external-ear microphone to perform wearing detection, the accuracy of wearing detection can be improved, and the user experience of wearing detection can be effectively improved.

[0015] In one implementation, after controlling the in-ear microphone and the external-ear microphone of the first earphone body to power on, the method further includes: when it is detected that there is no audio service within the first time period, controlling the in-ear microphone and the external-ear microphone of the first earphone body to power off; when the first earphone body is in a separated state, when it is detected that the first earphone body has an audio service, controlling the in-ear microphone and the external-ear microphone of the first earphone body to power on, the in-ear microphone and the external-ear microphone to collect audio data, and identifying the current wearing state of the first earphone body according to the first audio data currently collected by the in-ear microphone and / or the second audio data currently collected by the external-ear microphone. In the implementation of the embodiment of the present application, when there is no audio service for a long time, the first earphone body exits the wearing detection, and controls the in-ear microphone and the external-ear microphone to power off. In this way, for the situation that the user does not use the first earphone body for a long time after the first earphone body is switched to the separated state, the energy consumption waste caused by long-term data collection and wearing detection is avoided. In addition, in the separated state, after the in-ear microphone and the external-ear microphone are powered off, the newly executed audio service can directly trigger the in-ear microphone and the external-ear microphone to power on, and restart the wearing detection. In this way, while saving energy consumption, the timeliness of wearing detection is guaranteed as much as possible.

[0016] In one implementation, after the in-ear microphone and the external-ear microphone of the first earphone body are powered on, the method further includes: when it is detected that there is no audio service within a first time period, the in-ear microphone and the external-ear microphone of the first earphone body are switched to a second low power consumption mode, and the identification of the current wearing state of the first earphone body is stopped; the second low power consumption mode has lower power consumption than the first low power consumption mode; when the first earphone body is in a separated state, when it is detected that the first earphone body has an audio service, the in-ear microphone and the external-ear microphone are switched to the first low power consumption mode, and the current wearing state of the first earphone body is identified according to the first audio data currently collected by the in-ear microphone and / or the second audio data currently collected by the external-ear microphone. In the implementation of the embodiment of the present application, when there is no audio service for a long time, the first earphone body exits the wearing detection, and the in-ear microphone and the external-ear microphone are controlled to switch to the second low power consumption mode with lower power consumption. In this way, for the situation where the user does not use the first earphone body for a long time after the first earphone body is switched to the separated state, the energy waste caused by long-term data collection and wearing detection is reduced. In addition, in the separated state, after switching to the second low power consumption mode, the newly executed audio service can directly trigger the in-ear microphone and the external ear microphone to switch back to the first low power consumption mode and restart the wearing detection. In this way, while saving energy consumption, the timeliness of wearing detection is further improved.

[0017] In one implementation, the method further includes: when detecting that the first earphone body switches from an unworn state to a worn state, the first earphone body executes a preset audio output function; the preset audio output function includes one or more of the following: outputting a greeting; outputting the weather of the day; outputting a reminder of the day's to-do schedule; detecting the fit of the first earphone body, and outputting a first voice prompt when it is not fitted, to remind the user to adjust the wearing position of the earphone body to increase the fit. In this way, based on the result of the wearing detection, more audio output functions on the earphone side are realized, effectively improving the user experience.

[0018] In one implementation, the method further includes: the first earphone body receives an instruction for searching the earphone sent by the terminal device; in response to the instruction, when it is recognized that the first earphone body is currently in a worn state, the first earphone body outputs a second voice prompt to prompt the user that the first earphone body is worn; when it is recognized that the first earphone body is currently not in a worn state, the first earphone body outputs a first ring and / or first vibration information for searching the earphone. In this way, when the user wears the first earphone body, the earphone body vibration and the high-volume search ring can be prevented from damaging the user's ears.

[0019] In one implementation, the first signal feature, the second signal feature, and the third signal feature are any of the following: the signal strength of the audio data at the current moment in the time domain, the average value of the signal strength of the audio data in the most recent second time period in the time domain, and the signal energy of the audio data in the most recent second time period in the time domain; the signal strength of the audio data at a preset frequency point in the frequency domain, the average value of the signal strength of the audio data in a preset frequency band in the frequency domain, and the signal energy of the audio data in a preset frequency band in the frequency domain; any two of the first signal feature, the first signal feature, and the third signal feature are the same or different.

[0020] In a second aspect, an embodiment of the present application provides an earphone, comprising: a processor and a memory, wherein the memory is coupled to the processor, the memory is used to store computer program code, the computer program code comprises computer instructions, and when the processor reads the computer instructions from the memory, the earphone executes the earphone wearing detection method described in the first aspect.

[0021] In a third aspect, an embodiment of the present application provides a computer storage medium, including computer instructions. When the computer instructions are executed on the headset, the headset executes the headset wearing detection method in any possible implementation of any of the above aspects.

[0022] In a fourth aspect, an embodiment of the present application provides a computer program product. When the computer program product runs on a computer, the computer executes the headphone wearing detection method in any possible implementation of any of the above aspects. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 A schematic diagram of an application scenario provided in an embodiment of the present application;

[0024] FIG. 2A to FIG. 2C A schematic diagram of a neck-worn headset provided in an embodiment of the present application;

[0025] FIG. 3A to FIG. 3D A schematic diagram of a TWS headset provided in an embodiment of the present application;

[0026] FIG. 4A to FIG. 4B A schematic diagram of a wired headset provided in an embodiment of the present application;

[0027] Figure 5 A time domain diagram of audio data provided by an embodiment of the present application;

[0028] Fig. 6A A schematic diagram of a flow chart of a headphone wearing detection method provided in an embodiment of the present application;

[0029] Figure 6B A schematic diagram of a low power consumption mode provided in an embodiment of the present application;

[0030] Fig. 7A and Figure 7B A schematic diagram of a flow chart of a headphone wearing detection method provided in an embodiment of the present application;

[0031] Fig. 8A and Figure 8B A schematic diagram of a flow chart of a headphone wearing detection method provided in an embodiment of the present application;

[0032] Fig. 9A and Fig. 9B A schematic diagram of a flow chart of a headphone wearing detection method provided in an embodiment of the present application;

[0033] Fig.10 A schematic diagram of the structure of an earphone provided in an embodiment of the present application. DETAILED DESCRIPTION

[0034] The technical solutions in the embodiments of the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship of the associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0035] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0036] In combination with the device characteristics of neck-worn headphones, an embodiment of the present application provides a headphone wearing detection method. In the method, the neck-worn headphones include at least one headphone body; when it is detected that the headphone body enters a preset state, the in-ear microphone and the external-ear microphone of the headphone body are powered on, and the audio data collected by the in-ear microphone and / or the external-ear microphone are used to detect whether the user has put on the headphone body or removed the headphone body; when the action of the user putting on the headphone body or removing the headphone body is detected, the preset audio output function can be executed. In this way, wearing detection can be performed in combination with the equipment characteristics of the neck-worn headphones to improve the accuracy of wearing detection; and based on the results of wearing detection, more audio output functions on the headphone side can be realized, effectively improving the user experience.

[0037] The above-mentioned earphone wearing detection method can also be applied to other types of earphones, such as TWS earphones, wired earphones, etc.

[0038] For example, Figure 1 As shown, an application scenario of the headset wearing detection method provided in the present application includes a headset 100 and a terminal device 200. The terminal device 200 may include: a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a PDA, a laptop computer, a vehicle-mounted device, a personal digital assistant (PDA), and a smart wearable device, etc. The present application does not specifically limit the type of the terminal device 200.

[0039] The headset 100 and the terminal device 200 may establish a wired or wireless communication connection. When the headset 100 and the terminal device 200 establish a communication connection, the terminal device 200 may perform audio services through the headset 100. For example, when the terminal device 200 makes a call, plays music, plays a video, or starts a game, the audio signal is output through the headset 100; when making a call, the user's voice signal is received through the headset 100.

[0040] For example, FIG. 2A to FIG. 2C Neckband headphones and FIG. 3A to FIG. 3D The TWS headset shown can establish a wireless communication connection with the terminal device 200 through short-range communication technology. This application does not specifically limit the above-mentioned short-range communication technology. For example, the above-mentioned short-range communication technology can be WiFi communication technology, Bluetooth communication (such as classic Bluetooth (Basic Rate / Enhanced Date Rate, BR / EDR) or Bluetooth Low Energy (Bluetooth Low Energy, BLE)) technology, Ultra Wide Band (UWB) communication technology, Near Field Communication (NFC) technology or ZigBee communication technology, etc., and the embodiments of this application do not specifically limit this.

[0041] For example, FIG. 4A to FIG. 4B The wired headset shown can establish a wired communication connection with the terminal device 200 through the headset interface. For example, the headset interface of the terminal device 200 can be a USB interface 130, or a 3.5mm open mobile electronic device platform standard interface, or a standard interface of the American Cellular Telecommunications Industry Association.

[0042] In the embodiment of the present application, in combination with the wearing detection result of the earphone 100, the earphone 100 can realize one or more preset audio output functions.

[0043] In some embodiments, after the headset 100 detects the action of the user putting on the headset body, the audio output function 1 is executed. Optionally, the above audio output function 1 includes one or more of the following: outputting a greeting; outputting the weather of the day; outputting a reminder of the day's to-do schedule (such as meetings, express delivery, tickets, and air tickets); detecting the fit of the headset body, and outputting a first voice prompt when it is not fit, to remind the user to adjust the wearing position of the headset body to increase the fit, etc. The audio output function 1 belongs to the audio service of the headset 100.

[0044] In some embodiments, after the earphone 100 detects that the user has taken off the earphone body, it executes the audio output function 2, such as pausing the output of multimedia audio of multimedia services such as music and video.

[0045] In some embodiments, the user can set the audio output functions (ie, the above-mentioned audio output function 1 and audio output function 2) corresponding to different wearing detection results of the headset 100 through the terminal device 200.

[0046] In some embodiments, the headset 100 has a headset search function. After the headset 100 receives a headset search instruction sent by the terminal device 200, if it is detected that the user is not currently wearing the headset body, the headset body can remind the user of the location of the headset body through headset body vibration (i.e., first vibration information) and headset search ringing (i.e., first ringing). In one implementation, when receiving a headset search instruction sent by the terminal device 200, if it is detected that the user is wearing the headset body, the headset body outputs a second voice prompt to remind the user that the headset body is being worn, so as to avoid damage to the user's ears by the headset body vibration and the high-volume search ringing.

[0047] The earphone 100 involved in the embodiment of the present application has the following device feature 1: after wearing the earphone body of the earphone 100, a part of the earphone body (for example, the left earphone body) is inserted into the ear canal, and a part of it is not inserted into the ear canal. According to the earphone insertion method, the earphone 100 may include an in-ear earphone with a rubber sleeve (for example, Figure 2A and Figure 4A Headphones shown), semi-in-ear headphones without rubber sleeves (such as Figure 3C headphones shown).

[0048] See also FIG. 2A to FIG. 4B The earphone 100 shown, based on the above-mentioned device characteristics of the earphone 100, is provided with a microphone near the ear canal on the part of the earphone body that is inserted into the ear canal (for the convenience of description, this microphone will be referred to as an in-ear microphone hereinafter), and a microphone is provided on the part of the earphone body that is not inserted into the ear canal (for the convenience of description, this microphone will be referred to as an extra-ear microphone hereinafter).

[0049] For example, in Figure 5A time domain diagram of audio data collected by an in-ear microphone is shown, wherein the ordinate of the time domain diagram is the signal strength normalized according to a preset value (eg, 5).

[0050] The in-ear microphone may include one or more microphones. When the earphone body is not worn, the in-ear microphone can be used to collect the full-band ambient noise generated by the user's environment. When the earphone body is worn, the in-ear microphone can be used to collect the friction noise generated by the user wearing the earphone body; when the earphone body is removed, the in-ear microphone can be used to collect the friction noise generated by the user removing the earphone body. Figure 5 , when putting on and taking off the earphone body, the signal strength of the audio collected by the in-ear microphone increases significantly. When the earphone body is worn, the in-ear microphone can be used to collect audio in the user's ear canal. The audio in the ear canal may include noise in the ear canal (such as noise from the external environment transmitted into the ear canal through the human body, such as noise from the user's voice transmitted into the ear canal through the human body), and may also include audio output by the speaker when the earphone body plays audio; when the earphone body is worn, the noise in the ear canal transmitted into the ear canal through the human body collected by the in-ear microphone is usually low-frequency audio; compared to when the earphone body is not worn, the signal strength of the audio (especially high-frequency audio) collected by the in-ear microphone is smaller.

[0051] The external ear microphone may include one or more microphones. When the earphone body is not worn or when the earphone body is worn, the external ear microphone can be used to collect the ambient noise generated by the user's environment; when the earphone body is worn, the external ear microphone can be used to collect the friction noise generated by the user wearing the earphone body.

[0052] When the earphone body is not worn, the audio data collected by the in-ear microphone and the external ear microphone are all environmental noise, and the various signal characteristics (such as signal strength) of the audio data collected by the in-ear microphone and the external ear microphone are similar. Figure 5 When putting on and taking off the earphone body, the signal strength of the audio collected by the in-ear microphone and the external ear microphone both increase, but the increase in the signal strength corresponding to the external ear microphone is much lower than the increase in the signal strength corresponding to the in-ear microphone, that is, the difference in the signal strength of the audio collected by the external ear microphone and the in-ear microphone increases significantly. In addition, compared with when the earphone body is not worn, when the earphone body is worn, the difference in some signal characteristics (such as signal strength) of the audio data collected by the in-ear microphone and the external ear microphone increases significantly; for example, the difference in signal strength of the audio data collected by the in-ear microphone and the external ear microphone in the high frequency band increases.

[0053] In some embodiments, the in-ear microphone is a feedback microphone (FB mic), and the out-of-ear microphone is a feed-forward microphone (FF mic).

[0054] In the embodiment of the present application, the characteristics of the audio data collected by the in-ear microphone and the external-ear microphone before and after the user wears the earphone body are studied, and the audio data collected by the in-ear microphone and the external-ear microphone are used to perform wearing detection of the earphone 100.

[0055] In some embodiments, the headset 100 may also be provided with a wearing sensor (eg, a capacitive sensor) in the headset body. The headset 100 may perform headset wearing detection by combining sensor data collected by the wearing sensor and audio data collected by the in-ear microphone and / or the external ear microphone.

[0056] In some embodiments, when it is detected that the headset 100 enters a preset state, the headset 100 powers on the in-ear microphone and the external-ear microphone, and uses the audio data collected by the in-ear microphone and the external-ear microphone to detect whether the user wears the headset 100 or takes off the headset 100.

[0057] The following is for FIG. 2A to FIG. 4B The three types of earphones shown are used to exemplify the preset states, the in-ear microphone and the external-ear microphone of the earphone 100. The earphone 100 includes a left earphone body and a right earphone body.

[0058] FIG. 2A to FIG. 2C A neck-worn headset is shown. As shown in the figure, the neck-worn headset body includes a left earphone body, a right earphone body, a main control box and a battery compartment, and the above four modules are connected by a neck-worn cable. Among them, the battery compartment can also be set in the main control box. The main control box may include some or all of the following: a volume button, a power button, a function key, a call microphone, an LED display and a Type-C interface. The power button is used to control the power on and off of the headset, the function key is used to trigger a specific function (such as a voice assistant), the LED display is used to display the headset information (such as the remaining power), and the Type-C interface is used for headset pairing and charging.

[0059] In the embodiment of the present application, the left earphone body may also be referred to as the left earphone or the left ear bag, and the right earphone body may also be referred to as the right earphone or the left ear bag.

[0060] Neck-worn headphones also have the following device feature 2: The control chip of neck-worn headphones is generally in the main control box. If a wearing sensor for wearing detection is added to the headphone body, the communication between the wearing sensor and the control chip is easily interfered by the wire of the neck-worn cable, and accurate wearing detection cannot be achieved; and adding control chips to each of the two headphone bodies of the neck-worn product is costly.

[0061] Figure 2A The two earphone bodies of the earphone are shown in the sucked state. Figure 2BThe two earphone bodies of the headset are shown in a separated state. When the user does not need to use the neck-worn headset, the two earphone bodies can be in an attracted state, which is convenient for fixing and carrying. For example, it can be hung around the user's neck as an ornament to achieve the effect of saving power. When the user needs to use the neck-worn headset, the two earphone bodies are usually in a separated state, and the two earphone bodies are worn on the user's left ear and right ear respectively.

[0062] The neck-worn earphone also has the following device characteristic 3: in the suction state, the earphone 100 can enter the power saving mode or shut down; in the detached state, the earphone 100 can enter the working mode. In the working mode, the earphone 100 can establish a connection with the terminal device 200 and output the audio from the terminal device 200.

[0063] For example, Figure 2C A perspective view of the earphone body of a neck-worn earphone is shown, and the perspective view shows some components in the earphone body. As shown in the figure, the shell of the left earphone body includes a magnet 11 and a Hall sensor 13, and the shell of the right earphone body includes a magnet 12. Under the influence of the suction force of the magnets, when the magnet 11 and the magnet 12 are close to each other, they will attract each other, so that the left earphone body and the right earphone body are in an attracted state. When the left earphone body and the right earphone body are in the attracted state, the Hall sensor 13 will sense the magnetic field generated by the induction magnet 12, thereby sending an indication signal, and the earphone determines that the earphone is in the attracted state based on the indication signal. The embodiment of the present application does not specifically limit the type of the Hall sensor 13 and the specific implementation of the Hall sensor 13 detecting the attracted state.

[0064] The embodiment of the present application does not specifically limit the method for detecting the engaged state and the disengaged state of the neck-worn earphone. For example, the detection can also be performed by obtaining the distance between the two earphone bodies.

[0065] like Figure 2C It is shown that the left earphone body and the right earphone body are respectively provided with an in-ear microphone and an external earphone microphone; the audio data collected by the in-ear microphone and the external earphone microphone of the left earphone body are used to realize the wearing detection of the left earphone body, that is, to detect whether the user is wearing the left earphone body and taking off the left earphone body; the audio data collected by the in-ear microphone and the external earphone microphone of the right earphone body are used to realize the wearing detection of the right earphone body.

[0066] The neck-worn headset also has the following device feature 4: The neck-worn cable of the neck-worn headset is usually provided with multiple lines, such as a left channel signal line, a right channel signal line, and a microphone signal line for communication between a microphone (such as an in-ear microphone and an external ear microphone) and a main control box. The in-ear microphone and the external ear microphone can communicate with the control chip of the main control box through the microphone signal line, and the communication is not easily interfered.

[0067] In some embodiments, the headset 100 is a neck-worn headset; after detecting that the headset 100 is in the above-mentioned separation state, the control chip of the headset 100 controls the in-ear microphone and the external ear microphone of each earphone body to power on, and uses the audio data collected by the in-ear microphone and the external ear microphone of each earphone body to detect whether the user is wearing the earphone body or taking off the earphone body. In this way, in combination with the above-mentioned device characteristics 2, device characteristics 3 and device characteristics 4 of the neck-worn headset, the headset 100 can use the in-ear microphone and the external ear microphone of each earphone body to detect the action of the user wearing the earphone body or taking off the earphone body; thus improving the accuracy of the wearing detection of the neck-worn headset and effectively improving the user experience.

[0068] FIG. 3A to FIG. 3D A TWS earphone is shown. As shown in the figure, the TWS earphone body includes a left earphone body, a right earphone body and an earphone compartment. Figure 3A The earphone body is placed in the earphone compartment and the earphone compartment is closed; Figure 2B The figure shows the state where the earphone body is placed in the earphone compartment and the cover of the earphone compartment is opened; Figure 3C The earphone body and the earphone compartment are completely separated. After the earphone body is placed in the earphone compartment, the earphone compartment can be used to charge the earphone body.

[0069] For example, Figure 3D The perspective view shown shows some components of the TWS headset. Figure 3D As shown, a magnet 21 and a Hall sensor 23 are provided at the bottom of the earphone body, and a magnet 22 is provided at the contact part of the bottom of the earphone body in the earphone compartment; the magnet 21 at the bottom of the earphone body and the magnet 22 at the earphone compartment can attract each other, so that the bottom of the earphone body and the earphone compartment are in an attracted state, and the Hall sensor 23 can be used to detect the attracted state. Optionally, as Figure 3D As shown, a magnet 31 and a Hall sensor 33 are provided on the top of the earphone body, and a magnet 32 ​​is provided at the contact position of the top of the earphone body in the flip cover of the earphone compartment; the magnet 31 on the top of the earphone body and the magnet 32 ​​in the flip cover can attract each other, so that the top of the earphone body and the flip cover of the earphone compartment are in an attracted state, and the Hall sensor 33 can be used to detect the attracted state. Figure 3D As shown, a connector assembly (such as a PIN pin) is provided at the bottom of each earphone body, which is adapted to the connector assembly (such as a PIN pin) provided at the bottom of the earphone compartment for charging or communication; the connector assembly can also be used to detect the above-mentioned engagement state. For example, when the earphone body (such as the left earphone body) and the earphone compartment establish communication through the connector assembly, the bottom of the earphone body and the earphone compartment are in an engagement state.

[0070] like Figure 3AAs shown, when the user does not need to use a certain earphone body of the TWS earphone, the earphone body can be placed in the earphone compartment, and the flip cover of the earphone compartment is closed for easy carrying; at this time, the top and bottom of the earphone body are both in the suction state with the earphone compartment. Figure 3B As shown in FIG. 1 , when the user needs to use TWS, the user opens the flip cover of the earphone compartment; at this time, the top of the earphone body and the flip cover of the earphone compartment are in a separated state, and the bottom of the earphone body and the bottom of the earphone compartment are in an attracted state; then, as shown in FIG. Figure 3C As shown, the user takes the earphone body out of the earphone compartment, and the top and bottom of the earphone body are separated from the earphone compartment. Figure 3A The state of the earphone body shown can be called a fully engaged state. Figure 3B The state of the earphone body shown can be called a partially separated state. Figure 3C The state of the earphone body shown can be called a completely separated state.

[0071] Figure 3A In the fully engaged state shown, the earphone body of the TWS earphone disconnects the wireless communication connection with the terminal device 200, and the earphone can enter the power saving mode. Figure 3B The partially separated state and Figure 3C In the fully separated state shown, the earphone body of the TWS earphone can establish a wireless communication connection with the terminal device 200, and the earphone can enter the working mode.

[0072] Similar to Figure 2C Neckband headphones as shown, such as Figure 3D As shown, the left earphone body and the right earphone body are respectively provided with an in-ear microphone and an external-ear microphone; the audio data collected by the in-ear microphone and the external-ear microphone of an earphone body (for example, the left earphone body and the right earphone body) are used to realize the wearing detection of the earphone body.

[0073] In some embodiments, the earphone 100 is a TWS earphone; when it is detected that the earphone body (for example, the left earphone body) of the earphone 100 is in the above-mentioned partially separated state or completely separated state, the earphone 100 controls the in-ear microphone and the external ear microphone of the earphone body to power on, and uses the audio data collected by the in-ear microphone and the external ear microphone to detect whether the user is wearing the earphone body or taking off the earphone body.

[0074] In some embodiments, the earphone 100 is a TWS earphone; when it is detected that the earphone body of the earphone 100 is in a completely separated state, the earphone 100 controls the in-ear microphone and the external-ear microphone of the earphone body to power on, and uses the audio data collected by the in-ear microphone and the external-ear microphone to detect whether the user is wearing the earphone body or taking off the earphone body.

[0075] Figure 4A and Figure 4B A wired headset is shown. As shown in the figure, the wired headset body includes a left headset body, a right headset body, and a main control box. Figure 4A It shows that the earphone 100 establishes a wired communication connection with the terminal device 200 through the earphone interface of the terminal device 200, and each earphone body of the earphone 100 is in a wired connection state; Figure 2B It shows that the earphone is not connected to the terminal device 200 by wire, and each earphone body of the earphone is in an unconnected state.

[0076] Similar to Figure 2C Neckband headphones or Figure 3D The TWS earphones shown, Figure 4A In the wired headset shown, the left earphone body and the right earphone body include an in-ear microphone and an external earphone microphone respectively; the audio data collected by the in-ear microphone and the external earphone microphone of an earphone body (such as the left earphone body and the right earphone body) are used to realize the wearing detection of the earphone body.

[0077] In some embodiments, the earphone 100 is a wired earphone; when it is detected that the earphone 100 is in the above-mentioned wired connection state, the earphone 100 controls the in-ear microphone and the external ear microphone of the two earphone bodies to power on; and uses the audio data collected by the in-ear microphone and the external ear microphone of each earphone body to detect whether the user is wearing the earphone body or taking off the earphone body.

[0078] The following is a detailed introduction to the headphone wearing detection method provided in an embodiment of the present application. The method is applicable to neck-worn headphones, and is also applicable to various other types of in-ear headphones, such as TWS headphones and wired headphones.

[0079] For example, Fig. 6A A method flow of a headphone wearing detection method is shown, which is applied to the headphone 100. The method flow includes part or all of steps S101 to S106.

[0080] S101. When it is detected that the first earphone body of the earphone 100 is switched from a non-preset state to a preset state, execute S102; wherein the first earphone body is the left earphone body or the right-left earphone body of the earphone 100.

[0081] S102 , controlling the in-ear microphone and the external-ear microphone of the first earphone body of the earphone 100 to power on.

[0082] In some embodiments, see Figure 2A and Figure 2B , the earphone 100 is a neck-worn earphone, and the preset state is Figure 2B The separation state shown is not the default state. Figure 2A When it is detected that the two earphone bodies of the earphone 100 are switched to the separated state, the in-ear microphones and the external-ear microphones of the two earphone bodies are powered on, and steps S103 to S106 are respectively executed to perform wearing detection of each earphone body.

[0083] In some embodiments, see Figure 3A and Figure 3B , earphone 100 is a TWS earphone; the default state is Figure 3C The fully separated state shown, the non-preset state may include Figure 3B The partially separated state and Figure 3A In some embodiments, the earphone 100 is a TWS earphone, and the preset state may include Figure 3B The partially separated state and Figure 3C The fully separated state shown, the non-preset state can be Figure 3A It is understood that the two earphone bodies of the TWS earphone can be in different states, for example, the left earphone body is in a completely separated state and the right earphone body is in a completely engaged state.

[0084] In some embodiments, see Figure 3A and Figure 3B , the headset 100 is a wired headset; the default state is Figure 4A The wired connection status shown is not the default status. Figure 4B When it is detected that the two earphone bodies of the earphone 100 are switched to the wired connection state, the in-ear microphones and the external-ear microphones of the two earphone bodies are powered on, and steps S103 to S106 are respectively executed to perform wearing detection of each earphone body.

[0085] S103: Control the in-ear microphone and the external-ear microphone of the first earphone body to collect audio data in the first low power consumption mode, and start wearing detection of the first earphone body.

[0086] In an embodiment of the present application, the battery capacity of the wireless communication headset (such as a neck-worn headset) is relatively small. In order to save energy, the in-ear microphone and the external-ear microphone are controlled to collect audio data in a first low power consumption mode, and the wearing detection of the first earphone body is implemented in the first low power consumption mode.

[0087] In one implementation, Figure 6B As shown, in the first low power consumption mode, the in-ear microphone and the external ear microphone continuously sample at sampling frequency 1 in each sampling period; the period interval between adjacent sampling periods is X seconds (s), and the period length of the sampling period is Y s. For example, X is equal to 0.2, Y is equal to 0.5, and sampling frequency 1 is equal to 4KHz, 8KHZ, etc. The embodiments of the present application do not specifically limit the above-mentioned X, Y and sampling frequency 1. In one implementation, in the first low power consumption mode, the in-ear microphone and the external ear microphone continuously sample at sampling frequency 1 in all time periods.

[0088] S104: Identify the user's actions of wearing the first earphone body and taking off the first earphone body according to the audio data 1 currently collected by the in-ear microphone and / or the external microphone of the first earphone body.

[0089] In the embodiment of the present application, the action of the user putting on the first earphone body is recognized, that is, it is recognized that the first earphone body is currently in a worn state; the action of the user taking off the first earphone body is recognized, that is, it is recognized that the first earphone body is currently in an unworn state.

[0090] In some embodiments, the audio data 1 includes audio data collected by the in-ear microphone and / or the external microphone of the first earphone body within the most recent preset duration 1. For example, the preset duration 1 is the most recent sampling period, or the sampling duration of the most recent N sampling points, where N is a positive integer greater than zero.

[0091] The wearing detection of the first earphone body is turned on, including the earphone 100 continuously detecting the user's action of wearing the first earphone body and the action of taking off the first earphone body through the audio data 1 currently collected by the in-ear microphone and / or the external ear microphone, that is, continuously executing S104. In some embodiments, when the in-ear microphone and the external ear microphone collect audio data, the earphone 100 periodically determines whether the user's action of putting on or taking off the earphone body is recognized based on the most recently collected audio data 1, and the above judgment period is the sampling duration of M sampling points, where M is a positive integer greater than zero.

[0092] Step S102 may further include S105 and S106.

[0093] S105. When it is detected that the first earphone body of the earphone 100 is switched from the preset state to the non-preset state, the wearing detection of the first earphone body is exited, and S106 is executed.

[0094] Exiting the wearing detection of the first earphone body includes the earphone 100 stopping executing S104.

[0095] S106 , power off the in-ear microphone and the external-ear microphone of the first earphone body of the earphone 100 .

[0096] It can be understood that when the first earphone body is in a non-preset state (for example, the attracted state of the earphone body of the aforementioned neck-mounted earphone), the user will not wear the first earphone body; after the first earphone body is switched to the non-preset state, it exits the wearing detection, controls the in-ear microphone and the external ear microphone to be powered off, and can save energy.

[0097] The following describes how to identify the action of putting on or taking off the earphone body based on the audio data of the microphone inside and outside the ear through implementation scheme one and implementation scheme two.

[0098] Implementation scheme 1: The earphone 100 stores wearing information of the first earphone body, and the wearing information is used to indicate the wearing state of the first earphone body, and the wearing state of the first earphone body includes an unworn state and a worn state. A judgment condition is set according to the common characteristics of the audio data collected by the external ear microphone and the internal ear microphone when the user puts on the earphone body and takes off the earphone body, so as to identify the first action of the user, and the first action is to put on the earphone body or take off the earphone body; after the first action is identified, it is then identified whether the first action is to put on the earphone body or take off the earphone body according to the wearing state indicated by the wearing information.

[0099] In some embodiments, see Fig. 7A , step S104 includes S104A and S104B.

[0100] S104A, when a first action is recognized based on the audio data 1 of the in-ear and / or external-ear microphone, execute S104B; the first action is to wear or remove the first earphone body.

[0101] S104B. When the first action is identified, if the wearing information currently indicates a not-worn state, determine that the first action is for putting on the first earphone body, and switch the wearing state indicated by the wearing information to a worn state; if the wearing information currently indicates a worn state, determine that the first action is for removing the first earphone body, and switch the wearing state indicated by the wearing information to a not-worn state.

[0102] In the embodiment of the present application, after the wearing detection is turned on, the earphone 100 can continuously determine whether the user's first action is recognized based on the audio data 1 currently collected by the in-ear and / or external ear microphone. If the first action is recognized, it is determined whether the first action is specifically used to wear the first earphone body or remove the first earphone body according to the wearing state currently indicated by the wearing information, and the wearing state indicated by the wearing information is modified; then the process returns to S104A to continue detecting the user's first action. If the first action is not recognized, the process also returns to S104A to continue recognizing the user's first action.

[0103] In some embodiments, when it is detected that the first earphone body is switched to a preset state, the initial wearing state indicated by the wearing information is set to a not-worn state.

[0104] In an embodiment of the present application, after the first earphone body is switched to a preset state, when the in-ear microphone and the external ear microphone detect for the first time that the user is wearing the earphones after being powered on for the first time, the earphone 100 can automatically execute the audio output function 1 (for example, outputting greetings, outputting the weather of the day, outputting reminders of the day's to-do schedule, etc.), effectively improving the user's experience of using the earphone 100.

[0105] In some embodiments, step S104A specifically includes: the headset 100 detects the signal characteristics of the audio data 2 of the in-ear microphone and / or the audio data 3 of the external ear microphone, and when at least one of the following conditions 1 to 3 is met, it is determined that the first action is recognized; otherwise, it is determined that the first action is not recognized. Audio data 1 includes audio data 2 and / or audio data 3.

[0106] In the embodiment of the present application, the audio data 2 of the in-ear microphone may also be referred to as the first audio data; the audio data 3 of the external ear microphone may also be referred to as the second audio data.

[0107] In some embodiments, when the in-ear microphone collects audio data, if the headset 100 plays audio through a speaker, the audio data collected by the in-ear microphone also includes the audio played by the speaker. In this case, before step S104, the audio component played by the speaker in the audio data collected by the in-ear microphone is filtered out, and the audio data 2 is the filtered audio data.

[0108] Condition 1 includes: based on audio data 2 recently collected by the in-ear microphone, determining that signal feature 1 at the current moment is greater than threshold 1;

[0109] In some embodiments, signal feature 1 is used to indicate the volume of the audio; the louder the audio, the larger the signal feature 1.

[0110] In some embodiments, signal feature 1 may indicate the signal strength of the audio data in the time domain. In one implementation, signal feature 1 may be the average value of the signal strength of the audio data in the most recent second duration in the time domain to avoid misjudgment caused by sudden interference audio collected by the in-ear microphone. In one implementation, signal feature 1 may be the energy of the audio data in the most recent second duration in the time domain, which is equal to the mean square sum of the signal strengths in the second duration. The second duration is less than or equal to the preset duration 1.

[0111] Exemplary, reference Figure 5 In the time domain diagram of the audio data shown, the signal strength of the audio collected by the in-ear microphone is significantly greater when the user puts on and takes off the headphones than when the headphones are worn and not worn. The threshold 1 can be set based on the common characteristics of the signal strength of the audio collected by the in-ear microphone when the user puts on and takes off the headphones.

[0112] In some embodiments, signal feature 1 may indicate the signal strength of the audio data in the frequency domain. In one implementation, signal feature 1 may be the average value of the signal strength of the audio data in a preset frequency band. In one implementation, signal feature 1 may be the energy of the audio data in the preset frequency band, and the energy may be equal to the envelope area formed by the envelope of the signal strength of the audio data in the preset frequency band. The preset frequency band may be a full frequency band or a partial frequency band (e.g., 0 to 1 KHz).

[0113] Condition 2 includes: based on the audio data 2 recently collected by the in-ear microphone, the feature change value of the determined signal feature 2 within the duration 4 is greater than the threshold 2.

[0114] In one implementation, the feature change value is equal to the difference between the signal feature 2 at the current moment and the signal feature 2 at the moment 1, and the interval between the current moment and the moment 1 is 4. Optionally, the headset 100 obtains the signal feature 2 at the current moment every 4 seconds. For example, the duration 4 is the sampling duration of K sampling points.

[0115] In one implementation, the duration 4 is less than the average duration required for a user to put on or take off the headset. Figure 5 As shown in the time domain diagram of the audio data, the signal strength of the audio collected by the in-ear microphone increases significantly when the user puts on and takes off the headphones. Threshold 2 can be set based on the common characteristics of the amplitude of the change in the signal strength of the audio data collected by the in-ear microphone when the user puts on and takes off the headphones.

[0116] In the embodiment of the present application, signal feature 2 may refer to the relevant description of signal feature 1, and signal feature 1 and signal feature 2 may be the same or different.

[0117] Condition 3 includes: a feature difference value of signal feature 3 of audio data 2 from the in-ear microphone and audio data 3 from the external-ear microphone is greater than threshold 3.

[0118] When the user puts on and takes off the earphones, the difference in signal strength in the time domain / frequency domain between the audio collected by the in-ear microphone and the external ear microphone increases significantly. The above feature difference is equal to the difference between signal feature 3 of audio data 2 and signal feature 3 of audio data 3 of the external ear microphone.

[0119] Exemplary, reference Figure 5 In the time domain diagram of the audio data shown, the difference in the signal strength of the audio collected by the in-ear microphone and the external ear microphone increases significantly when the user puts on and takes off the headphones. The threshold 3 can be set based on the common characteristics of the difference in the signal strength of the audio collected by the in-ear microphone and the external ear microphone when the user puts on and takes off the headphones.

[0120] In the embodiment of the present application, signal feature 3 may refer to the relevant description of signal feature 1, and signal feature 1 and signal feature 3 may be the same or different.

[0121] In the embodiment of the present application, signal feature 1 may also be referred to as the first signal feature; signal feature 2 may also be referred to as the second signal feature; signal feature 3 may also be referred to as the third signal feature. Threshold 1 may also be referred to as the first threshold; threshold 2 may also be referred to as the second threshold; threshold 3 may also be referred to as the third threshold.

[0122] In some embodiments, reference Figure 7B , step S104A specifically includes A1 and A2.

[0123] A1. Detect whether signal feature 1 of audio data 2 of the in-ear microphone satisfies condition 1; if so, determine that the first action is recognized; otherwise, execute A2.

[0124] A2. Determine whether the feature change value of signal feature 2 of audio data 2 of the in-ear microphone satisfies condition 2, and whether the feature difference value of signal feature 3 of audio data 2 of the in-ear microphone and audio data 3 of the external microphone satisfies condition 3; if so, determine that the first action is recognized; otherwise, determine that the first action is not recognized.

[0125] In some embodiments, step S104A specifically includes: when the audio data 2 of the in-ear microphone and / or the audio data 3 of the external ear microphone are detected and at least two of the above conditions 1 to 3 are met, determining that the first action is recognized; otherwise, determining that the first action is not recognized.

[0126] In some embodiments, step S104A specifically includes: when the audio data 2 of the in-ear microphone and / or the audio data 3 of the external ear microphone are detected and the above conditions 1 to 3 are met, it is determined that the first action is recognized; otherwise, it is determined that the first action is not recognized.

[0127] In some embodiments, step S104A specifically includes A1 and A3.

[0128] A1. Detect whether signal feature 1 of audio data 2 of the in-ear microphone satisfies condition 1; if so, determine that the first action is recognized; otherwise, execute A3.

[0129] A3. When it is detected that the feature change value of signal feature 2 of audio data 2 of the in-ear microphone meets condition 2, and the feature difference value of signal feature 3 of audio data 2 of the in-ear microphone and audio data 3 of the external microphone meets condition 3, or when it is determined that the sensor data of the worn sensor meets condition 4, it is determined that the first action is recognized; otherwise, it is determined that the first action is not recognized.

[0130] In some embodiments, step S104A specifically includes: when the audio data 2 of the in-ear microphone and / or the audio data 3 of the external ear microphone are detected and at least one of the above conditions 1 to 3 is satisfied, and the sensor data of the wearable sensor satisfies condition 4, it is determined that the first action is recognized; otherwise, it is determined that the first action is not recognized. In this way, the audio data collected by the in-ear / external ear microphone and the sensor data collected by the wearable sensor can be combined to comprehensively identify the first action, so as to further improve the accuracy of wearing detection.

[0131] In some embodiments, the wearing sensor is a motion sensor that can detect the movement path of the earphone body. The motion sensor includes the following or multiple sensors: an acceleration sensor, a gyroscope sensor, and a vibration sensor. The earphone 100 stores motion data 1 of the earphone body when the user puts on the earphone body and motion data 2 of the earphone body when the user takes off the earphone body. Condition 4 includes: the wearing sensor detects that the matching degree of the motion data of the earphone body and motion data 1 is greater than a preset value; or, the wearing sensor detects that the matching degree of the motion data of the earphone body and motion data 2 is greater than a preset value. For example, the above preset value is equal to 80%. The above motion data may include one or more of the following data: the movement path of the earphone body, the acceleration change curve, the azimuth change curve, etc.

[0132] In some embodiments, the wearing sensor is a capacitive sensor, which is disposed in a position in the earphone body that can contact the ear canal; condition 4 includes: the wearing sensor detects that the capacitance value increases from capacitance 1 to capacitance 2; or, the wearing sensor detects that the capacitance value decreases from capacitance 2 to capacitance 1; wherein capacitance 1 is less than capacitance threshold 1, which is close to or equal to 0; capacitance 2 is greater than capacitance threshold 2, which is the lower limit of the capacitance that can be detected when the preset capacitance sensor contacts the ear canal. It can be understood that after the wearing sensor contacts the ear canal, the detected capacitance value is greater than capacitance threshold 2, and after the wearing sensor is away from the ear canal, the detected capacitance value is less than capacitance threshold 1.

[0133] In some embodiments, the wearing sensor is a distance sensor, which is arranged in a position in the earphone body close to the ear canal and can detect the distance to the nearest object (for example, the distance to the ear canal); Condition 4 includes: the wearing sensor detects that the distance decreases from distance 2 to distance 1; or, the wearing sensor detects that the distance increases from distance 1 to distance 2; wherein, distance 1 is less than or equal to distance threshold 1, and distance threshold 1 is close to 0 or equal to 0, for example, 1 mm; distance 2 is greater than distance threshold 2, and distance 2 is a preset lower limit of the distance between the earphone body and the ear canal when the earphone is removed, for example, 1 cm.

[0134] In some embodiments, the wear sensor is a proximity light sensor, which is disposed in the earphone body at a position close to the ear canal and can detect the ambient light intensity (e.g., the light intensity in the ear canal); condition 4 includes: the wear sensor detects that the light intensity decreases from light intensity 2 to light intensity 1; or the wear sensor detects that the light intensity increases from light intensity 1 to light intensity 2. Among them, light intensity 1 is less than or equal to light intensity threshold 1, and light intensity threshold 1 is close to 0 or equal to 0, such as 0.1 lux; light intensity 2 is greater than light intensity threshold 2, and light intensity threshold 2 is the lower limit of the preset ambient light intensity.

[0135] In some embodiments, before step S104, the neural network 1 is trained based on the audio data collected by the external microphone and the internal microphone when the user puts on the earphone body and takes off the earphone body. The input of the trained neural network 1 includes the audio data 1 recently collected by the external microphone and the internal microphone, and the output of the neural network 1 indicates whether the first action is recognized. In one implementation, step S104A specifically includes: inputting the audio data 1 recently collected by the external microphone and the internal microphone into the trained neural network 1, and the neural network 1 outputs indication information 1, and the indication information 1 indicates whether the first action is recognized.

[0136] Implementation Plan 2: According to the distinguishing features of the audio data collected by the microphones (i.e., the external microphone and the internal microphone) when the user puts on the earphone and takes off the earphone, judgment conditions are set respectively to specifically identify the user's action of putting on the earphone and the user's action of taking off the earphone. It can be understood that the judgment conditions for putting on the earphone and the judgment conditions for taking off the earphone are different.

[0137] In some embodiments, see Fig. 8A , step S104 includes S104C and S104D.

[0138] S104C, determining whether it is specifically recognized that the user has put on the first earphone body or taken off the first earphone body based on the signal feature 1 of the audio data 2 of the in-ear microphone; if not, executing S104D.

[0139] S104D. Determine whether it is specifically recognized that the user is wearing the first earphone body or taking off the first earphone body based on the feature change value of signal feature 2 of audio data 2 of the in-ear microphone and the feature difference value of signal feature 3 of audio data 2 of the in-ear microphone and audio data 3 of the external microphone; if not, determine that it is not recognized that the user is wearing the first earphone body or taking off the first earphone body, and return to execute S104.

[0140] In some embodiments, see Figure 8B , step S104C specifically includes C1 and C2, and step S104D specifically includes C3 and C4.

[0141] C1. Detect whether signal feature 1 of audio data 2 of the in-ear microphone satisfies condition 5; if so, recognize that the user is wearing the first earphone body; otherwise, execute C2.

[0142] C2. Detect whether signal feature 1 of audio data 2 of the in-ear microphone satisfies condition 6; if so, recognize that the user has taken off the first earphone body; otherwise, execute C3.

[0143] Condition 5 includes: signal feature 1 (eg, signal strength) of audio data 2 of the in-ear microphone is greater than or equal to threshold 4;

[0144] Condition 6 includes: signal feature 1 (eg, signal strength) of audio data 2 of the in-ear microphone is within the range of (threshold 5, threshold 6]; wherein threshold 6 is less than threshold 4.

[0145] In the embodiment of the present application, threshold 4 may also be referred to as the fourth threshold; threshold 5 may also be referred to as the fifth threshold; and threshold 6 may also be referred to as the sixth threshold.

[0146] Among them, signal feature 1 indicates the signal strength of the audio data in the time domain or frequency domain; specifically, the signal feature 1 can refer to the relevant description of implementation scheme 1, which will not be repeated here. Figure 5 As shown in the time domain diagram of the audio data, the signal strength in the time domain of the audio data collected by the in-ear microphone increases when the user puts on and takes off the earphone body; the signal strength in the time domain of the audio data of the in-ear microphone when the user puts on the earphone body is much greater than the signal strength when the user takes off the earphone body.

[0147] In the embodiment of the present application, the condition 6 for identifying that the first earphone body is removed may be determined first, and then the condition 5 for identifying that the first earphone body is put on may be determined, which is not specifically limited here.

[0148] C3, determine whether the characteristic change value of the signal characteristic 2 of the audio data 2 of the in-ear microphone satisfies condition 7 / condition 8, and the characteristic difference value of the signal characteristic 3 of the audio data 3 of the external microphone and the audio data 2 of the in-ear microphone satisfies condition 9; if so, it is recognized that the user is wearing the first earphone body; otherwise, execute C4.

[0149] Condition 7: The feature change value of the signal feature 2 (eg, signal strength) of the audio data 2 of the in-ear microphone within the duration 4 is greater than the threshold 7.

[0150] Condition 8: The feature change value of the signal feature 2 of the audio data 2 of the in-ear microphone within the duration 4 is less than the negative threshold 13, and the threshold 13 is greater than 0.

[0151] Condition 9: The feature difference value of signal feature 3 between audio data 2 from the external microphone and audio data 3 from the internal microphone is greater than threshold 8.

[0152] C4, determine whether the characteristic change value of the audio data 2 of the in-ear microphone satisfies condition 10 / condition 11, and the characteristic difference value of the audio data 3 of the external microphone and the audio data 2 of the in-ear microphone satisfies condition 12; if so, it is recognized that the user takes off the first earphone body; otherwise, it is determined that the user is not recognized to put on the first earphone body and does not take off the first earphone body, and return to execute S104.

[0153] Condition 10: The feature change value of the signal feature 2 of the audio data 2 of the in-ear microphone within the duration 4 is within the range of (threshold 9, threshold 10], and threshold 10 is less than threshold 7.

[0154] In the embodiment of the present application, threshold 7 may also be referred to as the seventh threshold; threshold 9 may also be referred to as the ninth threshold; and threshold 10 may also be referred to as the tenth threshold.

[0155] In some embodiments, the duration 4 is less than the average duration required for a user to put on or take off the earphone body. Figure 5 As shown in the time domain diagram of the audio data, the signal strength of the audio collected by the in-ear microphone increases significantly when the user puts on the earphone body and takes off the earphone body; and the increase in signal strength when the earphone body is put on is significantly greater than the increase when the earphone body is taken off. Thresholds 7, 9, and 10 can be set according to the difference in the change in the signal strength of the audio data collected by the in-ear microphone when the user puts on the earphone body and takes off the earphone body.

[0156] Condition 11: The feature change value of the signal feature 2 of the audio data 2 of the in-ear microphone within the duration 4 is greater than the threshold 13.

[0157] In some embodiments, the duration 4 is greater than the average duration required for a user to put on or take off the earphone body.

[0158] In one implementation, the signal feature 2 may indicate the signal strength in the time domain of the audio data 2. The signal strength in the time domain of the audio data 2 collected by the in-ear microphone becomes significantly smaller after the earphone body is put on than before the earphone body is put on; conversely, the signal strength in the time domain of the audio data 2 collected by the in-ear microphone increases significantly after the earphone body is taken off than before the earphone body is taken off.

[0159] In one implementation, signal feature 2 may indicate the signal strength of audio data 2 in a high frequency band, for example, signal feature 2 is the average value of the signal strength in the high frequency band or the envelope area corresponding to the signal strength in the high frequency band. The signal strength of the audio data 2 collected by the in-ear microphone in the high frequency band decreases after the earphone body is put on compared to before the earphone body is put on; conversely, the signal strength of the audio data 2 collected by the in-ear microphone in the high frequency band increases after the earphone body is taken off compared to before the earphone body is taken off. The threshold 13 may be set according to the difference in the amplitude of the change of the signal feature 2 of the audio data collected by the in-ear microphone before and after the user puts on the earphone body and before and after the user takes off the earphone body.

[0160] Condition 12: The feature difference value of signal feature 3 of audio data 3 of the external microphone and audio data 2 of the internal microphone is within the range of (threshold 11, threshold 12]. Among them, threshold 12 is less than threshold 8.

[0161] In the embodiment of the present application, threshold 8 may also be referred to as the eighth threshold; threshold 11 may also be referred to as the eleventh threshold; and threshold 12 may also be referred to as the twelfth threshold.

[0162] Exemplary, reference Figure 5 In the time domain diagram of the audio data shown, the characteristic difference of the signal strength of the audio data of the external microphone and the internal microphone increases significantly when the user puts on the earphone body and takes off the earphone body; and the above characteristic difference when the earphone body is put on is significantly greater than the characteristic difference when the earphone body is taken off. Threshold 8, threshold 11 and threshold 12 can be set according to the difference of the above characteristic difference when the user puts on the earphone body and takes off the earphone body.

[0163] In some embodiments, step S104D specifically includes: determining whether it is specifically recognized that the user is wearing the first earphone body or removing the first earphone body based on the feature change value of signal feature 2 of audio data 2 of the in-ear microphone, the feature difference value of signal feature 3 of audio data 2 of the in-ear microphone and audio data 3 of the external microphone, and sensor data of the wearing sensor; if not, determining that the user is not recognized to be wearing the first earphone body or removing the first earphone body, and returning to execute S104.

[0164] Step C3 specifically includes: when it is detected that the characteristic change value of the audio data 2 of the in-ear microphone satisfies condition 7 / condition 8, and the characteristic difference value of the audio data 3 of the external microphone and the audio data 2 of the in-ear microphone satisfies condition 9, or when it is detected that the sensor data of the wearing sensor satisfies condition 13, it is determined that the user is wearing the first earphone body; otherwise, execute C4.

[0165] Step C4 specifically includes: when it is detected that the characteristic change value of the audio data 2 of the in-ear microphone satisfies condition 10 / condition 11, and the characteristic difference value of the audio data 3 of the external microphone and the audio data 2 of the in-ear microphone satisfies condition 12, or when it is detected that the sensor data of the wearing sensor satisfies condition 14, it is determined that the user has been recognized to have taken off the first earphone body; otherwise, it is determined that the user has not been recognized to be wearing the first earphone body and has not taken off the first earphone body, and the process returns to execute S104.

[0166] In some embodiments, the wearing sensor is a motion sensor that can detect the movement path of the earphone body. The motion sensor includes the following or multiple sensors: an acceleration sensor, a gyroscope sensor, and a vibration sensor; the earphone 100 stores the movement data 1 of the earphone body when the user puts on the earphone body and the movement data 2 of the earphone body when the user takes off the earphone body; condition 13 includes: the wearing sensor detects that the matching degree of the movement data of the earphone body and the movement data 1 is greater than a preset value; or condition 14 includes: the wearing sensor detects that the matching degree of the movement data of the earphone body and the movement data 2 is greater than a preset value. For example, the above preset value is equal to 80%. The above motion data may include one or more of the following data: the movement path of the earphone body, the acceleration change curve, the orientation change curve, etc.

[0167] In some embodiments, the wearing sensor is a capacitive sensor, which is disposed in a position in the earphone body that can contact the ear canal; condition 15 includes: the wearing sensor detects that the capacitance value increases from capacitance 1 to capacitance 2; condition 14 includes: the wearing sensor detects that the capacitance value decreases from capacitance 2 to capacitance 1. Among them, capacitance 1 is less than capacitance threshold 1, which is close to or equal to 0; capacitance 2 is greater than capacitance threshold 2, which is the lower limit value of the capacitance that can be detected when the preset capacitance sensor contacts the ear canal.

[0168] In some embodiments, the wearing sensor is a distance sensor, which is arranged in the earphone body at a position close to the ear canal and can detect the distance to the nearest object (for example, the distance to the ear canal). Condition 13 includes: the wearing sensor detects that the distance decreases from distance 2 to distance 1. Condition 14 includes: the wearing sensor detects that the distance increases from distance 1 to distance 2. Wherein, distance 1 is less than or equal to distance threshold 1, and distance threshold 1 is close to 0 or equal to 0, for example, 1 mm; distance 2 is greater than distance threshold 2, and distance 2 is the preset lower limit of the distance between the earphone body and the ear canal when the earphone is removed, for example, 1 cm.

[0169] In some embodiments, the wear sensor is a proximity light sensor, which is disposed in the earphone body at a position close to the ear canal and can detect the surrounding light intensity (e.g., the light intensity in the ear canal). Condition 13 includes: the wear sensor detects that the light intensity decreases from light intensity 2 to light intensity 1; Condition 14 includes: the wear sensor detects that the light intensity increases from light intensity 1 to light intensity 2. Among them, light intensity 1 is less than or equal to light intensity threshold 1, and light intensity threshold 1 is close to 0 or equal to 0, such as 0.1 lux; light intensity 2 is greater than light intensity threshold 2, and light intensity threshold 2 is the lower limit of the preset ambient light intensity.

[0170] In some embodiments, after the wearing detection is turned on, if the headset 100 has no audio service for a long time (for example, audio output service of multimedia applications such as music or call service), the headset 100 can exit the wearing detection of the first earphone body; after exiting the wearing detection, when the first earphone body is in a preset state, when the headset 100 performs an audio service, it will trigger the headset 100 to turn on the wearing detection of the first earphone body again.

[0171] In some embodiments, Fig. 9A As shown, in the aforementioned wearing detection method, after step S103, steps S107 to S109 are also included.

[0172] S107: When it is detected that the headset 100 has no audio service within the first time period, the headset 100 exits the wearing detection of the first earphone body and executes S108.

[0173] S108: The earphone 100 controls the in-ear microphone and the external-ear microphone of the first earphone body to power off.

[0174] In some embodiments, the headset 100 is set with a service state. When the headset 100 performs an audio service, the service state is serviced; when the headset 100 does not perform an audio service, the service state is no service. When the service state is switched to no service, the headset 100 starts timing; when it is detected that the service state is switched to serviced, the headset 100 stops timing; when it is detected that the timing reaches a first time length (for example, 5 minutes), the headset 100 exits the wearing detection of the first headset body and controls the in-ear microphone and the external ear microphone to power off.

[0175] In this way, it is avoided that after the first earphone body is switched to a preset state (for example, the earphone body of the neck-worn earphone is switched to a separated state), when the user does not wear the earphone 100 for a long time, energy waste caused by long-term wearing detection is avoided.

[0176] S109: When an audio service is detected, the headset 100 returns to execute S102 to S104, that is, controls the in-ear microphone and the external-ear microphone of the first headset body to power on, and starts wearing detection of the first headset body.

[0177] In some embodiments, after step S108, when it is detected that the earphone 100 has an audio service, that is, when it is detected that the service state is switched to having service, if the first earphone body is currently in a preset state (for example, the earphone body of the neck-worn earphone is in a separated state), then the process returns to execute S102 to S104, that is, the in-ear microphone and the external earphone microphone of the first earphone body are powered on, audio data is collected based on the first low power consumption mode, and the wearing detection of the first earphone body is turned on again.

[0178] In some embodiments, after the first earphone body is switched to a preset state in step S101, S102 can be executed to control the in-ear microphone and the external microphone of the first earphone body to be powered on. That is, after the first earphone body is switched to the preset state, when the in-ear microphone and the external microphone are powered on for the first time, the earphone 100 can be in a state with business or in a state without business. After the first earphone body is powered off in step S108, the non-first power-on can be directly triggered by the newly executed audio service.

[0179] In some embodiments, the aforementioned step S102 may specifically include: when the headset 100 has an audio service, controlling the in-ear microphone and the external-ear microphone of the first headset body to power on. That is, after the first headset body is switched to the preset state, when the in-ear microphone and the external-ear microphone are powered on for the first time, the headset 100 also needs to be in a service state.

[0180] When implementing the embodiment of the present application, when there is no audio service for a long time, the headset 100 exits the wearing detection and controls the in-ear microphone and the external ear microphone to be powered off. In this way, after the first earphone body is switched to a preset state (for example, the earphone body of a neck-worn earphone is switched to a separated state), the user does not use the earphone 100 for a long time, thereby avoiding the waste of energy caused by long-term data collection and wearing detection. In addition, in the preset state, after the in-ear microphone and the external ear microphone are powered off, the newly executed business can directly trigger the in-ear microphone and the external ear microphone to be powered on, and the wearing detection can be restarted. In this way, while saving energy, the timeliness of wearing detection can be guaranteed as much as possible.

[0181] In some embodiments, Fig. 9B As shown, in the aforementioned wearing detection method, after step S103, steps S110 to S112 are also included.

[0182] S110: When it is detected that the headset 100 has no audio service within the first time period, the headset 100 exits the wearing detection of the first earphone body and executes S111.

[0183] S111 , the earphone 100 controls the in-ear microphone and the external-ear microphone of the first earphone body to collect audio data in the second low power consumption mode.

[0184] S112: When an audio service is detected, the headset 100 returns to execute S103 to S104, that is, controls the in-ear microphone and the external ear microphone to collect audio data in the first low power consumption mode, and turns on the wearing detection of the first earphone body again.

[0185] Optional, see Figure 6B In the second low power mode, the in-ear microphone and the external ear microphone continuously sample at sampling frequency 2 in each sampling period; compared with the first low power mode, the second low power mode meets some or all of the following characteristics: the sampling period has a shorter period duration, the sampling period interval is longer, and the sampling frequency in the sampling period is smaller. Optionally, in the second low power mode, the in-ear microphone and the external ear microphone continuously sample at sampling frequency 2 in all time periods; compared with the first low power mode, the sampling frequency of the second low power mode is smaller.

[0186] When implementing the embodiment of the present application, when there is no business for a long time, the headset 100 exits the wearing detection and controls the in-ear microphone and the external ear microphone to switch to the second low power consumption mode with lower power consumption. In this way, after the first earphone body switches to the preset state, the user does not use the headset 100 for a long time, which reduces the energy waste caused by long-term data collection and wearing detection. In the preset state, after switching to the second low power consumption mode, the newly executed business can directly trigger the in-ear microphone and the external ear microphone to switch back to the first low power consumption mode and restart the wearing detection. Fig. 8A The related embodiments directly control the power off of the in-ear microphone and the external-ear microphone of the first earphone body, and the in-ear microphone and the external-ear microphone are switched to the second low-power consumption mode with lower power consumption, so that the wearing detection can be performed more quickly when a new audio service starts. In this way, while saving energy consumption, the timeliness of the wearing detection is further improved.

[0187] The structure of an earphone 100 provided in an embodiment of the present application is introduced below. Fig.10 A schematic structural diagram of the earphone 100 is shown.

[0188] The headset 100 may include a processor 110, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a sensor module 180, a button 190, etc.

[0189] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the headset 100. In other embodiments of the present application, the headset 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0190] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (AP), a modem processor, a general processor, a controller, a video codec, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general processor may be a microprocessor or the processor may also be any conventional processor, a baseband processor, etc. Among them, different processing units may be independent devices or may be integrated in one or more processors.

[0191] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0192] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0193] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpase input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0194] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from a wired charger through a USB interface 130 (e.g., a Type-C interface). In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through a wireless charging coil of the headset 100. While the charging management module 140 is charging the battery 142, it can also power the headset 100 through the power management module 141.

[0195] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110 and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0196] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the headset 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via an antenna, demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna.

[0197] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the earphone 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0198] The internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM).

[0199] The earphone 100 can realize audio functions such as music playing through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C and the processor.

[0200] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0201] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. For example, music can be listened to through the speaker 170A.

[0202] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the headset receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.

[0203] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 170C with their mouth to input the sound signal into the microphone 170C. In the embodiment of the present application, the headset 100 is provided with an in-ear microphone and an external-ear microphone, and a solid-line wearing detection can be performed in combination with the sound signals collected by the in-ear microphone and / or the external-ear microphone. Optionally, the in-ear microphone is a feedback microphone, and the external-ear microphone is a feedforward microphone. In some embodiments, the headset 100 can be provided with two microphones 170C, which can not only collect sound signals, but also realize a noise reduction function. In other embodiments, the headset 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, realize a directional recording function, and the like.

[0204] The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

[0205] The pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor, the capacitance between the electrodes changes. Optionally, the headset 100 determines the intensity of the pressure based on the change in capacitance.

[0206] The gyro sensor 180B can be used to determine the motion posture of the headset 100. In some embodiments, the angular velocity of the headset 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. In some embodiments, the motion posture of the headset 100 measured by the gyro sensor 180B can be combined to achieve wearing detection.

[0207] The magnetic sensor 180D includes a Hall sensor. The earphone 100 can use the magnetic sensor 180D to detect the engagement state of the earphone. For example, the earphone 100 is a neck-worn earphone, and the magnetic sensor 180D can be used to detect whether the left earphone body and the right earphone body are engaged. For example, the earphone 100 is a TWS earphone, and the magnetic sensor 180D can be used to detect whether the top / bottom of the earphone body and the earphone compartment are engaged. In some embodiments, wearing detection can be achieved in combination with the engagement state / non-engagement state of the earphone 100 detected by the magnetic sensor 180D.

[0208] The acceleration sensor 180E can detect the magnitude of the acceleration of the earphone 100 in various directions (generally three axes).

[0209] The distance sensor 180F is used to measure the distance. The headset 100 can measure the distance by infrared or laser. In some embodiments, the headset 100 can implement wearing detection in combination with the distance measured by the distance sensor 180F.

[0210] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. In some embodiments, the headset 100 may implement wearing detection in combination with the light intensity measured by the proximity light sensor 180G.

[0211] The ambient light sensor 180L is used to sense the brightness of ambient light.

[0212] The temperature sensor 180J is used to detect temperature. In some embodiments, the headset 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. In some embodiments, the headset 100 can implement wearing detection in combination with the temperature detected by the temperature sensor 180J.

[0213] The touch sensor 180K is also called a "touch control device". The touch sensor 180K is used to detect a touch operation applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operation to a processor to determine the type of touch event.

[0214] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of a human vocal part.

[0215] The button 190 includes a power button, a volume button, etc. The button 190 can be a mechanical button or a touch button. The headset 100 can receive the button input and generate a key signal input related to the user setting and function control of the headset 100.

[0216] For more details about the functions and working principles of the earphone 100, please refer to the relevant contents in the above embodiments, which will not be repeated here.

[0217] The various implementation modes of the present application can be combined arbitrarily to achieve different technical effects.

[0218] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in this application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integration. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)), etc.

[0219] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

[0220] In short, the above description is only an embodiment of the technical solution of the present invention, and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for detecting wearing of an earphone, applied to an earphone, wherein the earphone comprises two earphone bodies, a first earphone body comprises an in-ear microphone and an out-ear microphone, and the first earphone body is any one of the two earphone bodies; characterized in that: The method comprises: When it is detected that the two earphone bodies of the earphone are switched from the attracted state to the separated state, the in-ear microphone and the external-ear microphone of the first earphone body are controlled to be powered on; The in-ear microphone and the out-ear microphone collect audio data; According to the first audio data currently collected by the in-ear microphone and / or the second audio data currently collected by the external-ear microphone, the current wearing state of the first earphone body is identified, and the wearing state is a worn state or a not worn state.

2. The method according to claim 1, characterized in that The in-ear microphone and the out-ear microphone collect audio data, including: The in-ear microphone and the external-ear microphone are controlled to collect audio data in a first low power consumption mode.

3. The method according to claim 1, characterized in that The method further comprises: When it is detected that the two earphone bodies of the earphone are switched from a separated state to a closed state, the in-ear microphone and the external-ear microphone of the first earphone body are controlled to be powered off.

4. The method according to any one of claims 1 to 3, characterized in that: The earphone stores wearing information of the first earphone body, where the wearing information is used to indicate a wearing state of the first earphone body, where the wearing state of the first earphone body includes an unworn state and a worn state; identifying a current wearing state of the first earphone body according to first audio data currently collected by the in-ear microphone and / or second audio data currently collected by the external-ear microphone, including: A first action is identified based on first audio data currently collected by the in-ear microphone and / or second audio data currently collected by the external-ear microphone, where the first action is used to put on the first earphone body or take off the first earphone body; If the wearing state indicated by the wearing information is a non-wearing state, determining that the first action is specifically for wearing the first earphone body, identifying that the earphone is currently in a worn state, and switching the wearing state indicated by the wearing information to a worn state; If the wearing state indicated by the wearing information is the worn state, it is determined that the first action is specifically used to remove the first earphone body, identify that the earphone is currently in the unworn state, and switch the wearing state to the unworn state.

5. The method according to claim 4, characterized in that The method further comprises: When it is detected that the two earphone bodies of the earphone are switched from the attracted state to the separated state, the initial wearing state indicated by the wearing information is set to the unworn state.

6. The method according to claim 4, characterized in that The identifying a first action according to the first audio data currently collected by the in-ear microphone and / or the second audio data currently collected by the external-ear microphone includes: When it is detected that the first signal feature of the first audio data is greater than or equal to a first threshold, it is determined that the first action is recognized; the first signal feature indicates the signal strength of the audio data; When it is detected that the change value of the second signal feature of the first audio data is greater than or equal to a second threshold, and the difference between the third signal features of the first audio data and the second audio data is greater than or equal to a third threshold, it is determined that the first action is recognized.

7. The method according to any one of claims 1 to 3, characterized in that: Identifying a current wearing state of the first earphone body according to first audio data currently collected by the in-ear microphone and / or second audio data currently collected by the external-ear microphone includes: When it is detected that the first signal feature of the first audio data is greater than or equal to a fourth threshold, it is identified that the first earphone body is currently in a worn state; when it is detected that the first signal feature of the first audio data is greater than a fifth threshold and less than a sixth threshold, it is identified that the first earphone body is currently in a not-worn state; the sixth threshold is less than the fourth threshold; When it is detected that the change value of the second signal characteristic of the first audio data is greater than or equal to the seventh threshold, and the difference between the third signal characteristics of the first audio data and the second audio data is greater than or equal to the eighth threshold, it is identified that the first earphone body is in a worn state; when it is detected that the change value of the second signal characteristic of the first audio data is greater than the ninth threshold and less than the tenth threshold, and the difference between the third signal characteristics of the first audio data and the second audio data is greater than the eleventh threshold and less than the twelfth threshold, it is identified that the first earphone body is in a not worn state; the tenth threshold is less than the seventh threshold, and the twelfth threshold is less than the eighth threshold.

8. The method according to any one of claims 1 to 7, characterized in that: After controlling the in-ear microphone and the external-ear microphone of the first earphone body to be powered on, the method further includes: When it is detected that there is no audio service within a first time period, controlling the in-ear microphone and the external-ear microphone of the first earphone body to be powered off; When the first earphone body is in the separated state and it is detected that the first earphone body has an audio service, the in-ear microphone and the external-ear microphone of the first earphone body are controlled to be powered on, the in-ear microphone and the external-ear microphone collect audio data, and the current wearing state of the first earphone body is identified based on the first audio data currently collected by the in-ear microphone and / or the second audio data currently collected by the external-ear microphone.

9. The method according to any one of claims 2 to 7, characterized in that: After controlling the in-ear microphone and the external-ear microphone of the first earphone body to be powered on, the method further includes: When no audio service is detected within the first time period, the in-ear microphone and the external-ear microphone of the first earphone body are switched to the second low power consumption mode, and the recognition of the current wearing state of the first earphone body is stopped; the second low power consumption mode has lower power consumption than the first low power consumption mode; When the first earphone body is in the separated state, when it is detected that the first earphone body has an audio service, the in-ear microphone and the external ear microphone switch to a first low power consumption mode, and identify the current wearing state of the first earphone body based on the first audio data currently collected by the in-ear microphone and / or the second audio data currently collected by the external ear microphone.

10. The method according to any one of claims 1 to 9, characterized in that: The method further comprises: When it is detected that the first earphone body switches from an unworn state to a worn state, the first earphone body executes a preset audio output function; the preset audio output function includes one or more of the following: outputting a greeting; outputting the weather of the day; outputting a reminder of the day's to-do schedule; detecting the fit of the first earphone body, and outputting a first voice prompt when it does not fit, to remind the user to adjust the wearing position of the earphone body to increase the fit.

11. The method according to any one of claims 1 to 10, characterized in that: The method further comprises: The first earphone body receives an instruction for searching the earphone sent by the terminal device; In response to the instruction, when it is identified that the first earphone body is currently in a worn state, the first earphone body outputs a second voice prompt to prompt the user that the first earphone body is worn; when it is identified that the first earphone body is currently not in a worn state, the first earphone body outputs a first ring and / or first vibration information for finding the earphone.

12. The method according to claim 6 or 7, characterized in that: The first signal feature, the second signal feature, and the third signal feature are any of the following: the signal strength of the audio data at the current moment in the time domain, the average value of the signal strength of the audio data in the second most recent time period in the time domain, and the signal energy of the audio data in the second most recent time period in the time domain; the signal strength of the audio data at a preset frequency point in the frequency domain, the average value of the signal strength of the audio data in a preset frequency band in the frequency domain, and the signal energy of the audio data in a preset frequency band in the frequency domain; any two of the first signal feature, the first signal feature, and the third signal feature are the same or different.

13. A headset, characterized in that: include: A processor and a memory, wherein the memory is coupled to the processor, the memory is used to store computer program code, the computer program code includes computer instructions, and when the processor reads the computer instructions from the memory, the headset executes the headset wearing detection method as described in claims 1 to 12.

14. A computer-readable storage medium, characterized in that: The method comprises computer instructions, and when the computer instructions are executed on the earphone, the earphone executes the earphone wearing detection method as claimed in claims 1 to 12.

Images