Method for determining earphone usage status and earphone
By using speakers and in-ear microphones in headphones, using the frequency response of the test audio to detect the wearing status of the headphones, the problems of high cost, high energy consumption and low reliability in the detection of the use status of the headphones in the prior art are solved, and the problem of high cost, high energy consumption and low reliability is realized. Lower cost, higher efficiency and higher reliability headphone usage status detection.
Patent Information
- Application Number
- CN202210815842.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-07-12
- Publication Date
- 2025-02-18
- Estimated Expiration
- 2042-07-12
AI Technical Summary
When detecting the use status of existing headphones, relying on sensors leads to high design costs, high energy consumption and low reliability, especially when users are handheld, they are prone to wearing misidentification problems.
By setting the speaker and in-ear microphone in the headset, the frequency response of the test audio is used to determine whether the headset is worn in the user's ear without additional sensors.
It reduces the design and manufacturing cost of headphones, reduces energy consumption, improves the reliability of detection, and avoids the problem of misidentification when wearing.
Smart Images

Figure CN115361612B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the technical field of earphones, and in particular to a method for determining a usage status of an earphone and an earphone. Background Art
[0002] With the development of portable electronic devices, the use scenarios of headphones are becoming more and more extensive. In some scenarios, it is necessary to know the usage status of the headphones, that is, whether the headphones are worn in the user's ears or taken off by the user, so as to decide whether the player and other applications on the mobile phone and other devices should continue to play audio or interrupt the audio. In order to meet this demand, some headphones are equipped with sensors specifically for detecting the usage status of the headphones. For example, such sensors can be optical sensors (based on infrared ranging technology) or contact sensors (based on capacitance changes).
[0003] However, adding sensors to earphones will increase the design and manufacturing costs of the earphones. In addition, such sensors have relatively high energy consumption, so for wireless earphones, using such sensors is not conducive to battery life. In addition, when holding the earphones, users may inadvertently block the optical sensors or touch the contact sensors, which may cause the earphones to be mistakenly recognized as being worn even though they are not worn on the ears. Therefore, the reliability of using such sensors to determine the usage status of the earphones is relatively poor. Summary of the invention
[0004] In one aspect, the present disclosure provides a method for determining the use status of an earphone. The earphone includes a speaker and an in-ear microphone. The method includes: controlling the speaker to play a test audio; controlling the in-ear microphone to pick up the test audio; and determining whether the earphone is worn in the ear of a user according to the picked up test audio.
[0005] In one possible implementation, determining whether the earphone is worn in the user's ear based on the picked up test audio includes: determining a frequency response corresponding to the test audio based on the picked up test audio; determining whether the frequency response corresponding to the test audio matches a first calibrated frequency response to obtain a first matching result; and determining whether the earphone is worn in the user's ear based on the first matching result.
[0006] In one possible implementation, determining whether the earphone is worn in the user's ear based on the first matching result includes: when the frequency response corresponding to the test audio matches the first calibrated frequency response, determining that the earphone is worn in the user's ear; or when the frequency response corresponding to the test audio matches the first calibrated frequency response, determining that the earphone is not worn in the user's ear.
[0007] In one possible implementation, when the frequency response corresponding to the test audio matches the first calibrated frequency response, determining that the earphone is worn in the user's ear includes: when the deviation between the frequency response corresponding to the test audio and the first calibrated frequency response is less than a first threshold, determining that the earphone is in an optimal wearing position and posture; when the deviation between the frequency response corresponding to the test audio and the first calibrated frequency response is greater than the first threshold but less than a second threshold, adjusting the audio equalizer parameters of the earphone according to the deviation, wherein the second threshold is the minimum condition for determining that the frequency response corresponding to the test audio matches the first calibrated frequency response.
[0008] In one possible implementation, the method also includes: in response to determining that the earphone is worn in the user's ear and the speaker is playing application audio, controlling the speaker to stop playing the test audio; determining whether the earphone is kept in the user's ear based on the application audio picked up by the in-ear microphone; and in response to determining that the earphone is taken out of the user's ear, controlling the speaker to stop playing the application audio and play the test audio again.
[0009] In one possible implementation, determining whether the earphone is kept in the user's ear based on the application audio picked up by the in-ear microphone includes: determining a frequency response corresponding to the application audio based on the application audio picked up by the in-ear microphone; determining whether the frequency response corresponding to the application audio matches a second calibrated frequency response to obtain a second matching result; and determining whether the earphone is kept in the user's ear based on the second matching result.
[0010] In one possible implementation, determining whether the earphone is kept in the user's ear based on the second matching result includes: when the deviation between the frequency response corresponding to the application audio and the second calibrated frequency response is less than a third threshold, determining that the earphone is in an optimal wearing position and posture; when the deviation between the frequency response corresponding to the application audio and the second calibrated frequency response is greater than the third threshold but less than a fourth threshold, adjusting the audio equalizer parameters of the earphone based on the deviation to ensure that the application audio is in the best listening quality, wherein the fourth threshold is the minimum condition for determining that the frequency response corresponding to the application audio matches the second calibrated frequency response.
[0011] In one possible implementation, controlling the speaker to play the test audio includes: in response to detecting that an earphone box containing the earphone is opened, controlling the speaker to play the test audio, wherein the method further includes: determining whether the earphone is placed in the earphone box based on the picked up test audio.
[0012] In one possible implementation, determining whether the earphone is placed in the earphone box based on the picked up test audio includes: determining a frequency response corresponding to the test audio based on the picked up test audio; determining whether the frequency response corresponding to the test audio matches a third calibrated frequency response to obtain a third matching result; and determining whether the earphone is placed in the earphone box based on the third matching result.
[0013] In a possible implementation, the test audio includes ultrasonic audio and / or infrasonic audio.
[0014] In a possible implementation, the earphone is an active noise reduction earphone, and the in-ear microphone is an error microphone of the active noise reduction earphone.
[0015] In one possible implementation, the narrowband frequency of the test audio is the same as the resonance frequency of the acoustic cavity of the earphone.
[0016] On the other hand, the present disclosure also provides a device for determining the use status of an earphone. The device includes: a control module and a determination module. The control module is used to: control the speaker of the earphone to play a test audio; control the in-ear microphone of the earphone to pick up the test audio. The determination module is used to: determine whether the earphone is worn in the user's ear according to the picked up test audio.
[0017] On the other hand, the present disclosure also discloses an earphone, including a speaker and an in-ear microphone. The earphone also includes a processor coupled to the memory, and the processor is configured to execute the method for determining the earphone usage status provided by the above aspect of the present disclosure based on instructions stored in the memory.
[0018] In the implementation provided by the present disclosure, the use status of the headset is determined based on the audio played by the speaker picked up by the inherent in-ear microphone of the headset. Since there is no need to set up an additional sensor specifically for detecting the use status of the headset, this implementation can reduce the design and manufacturing costs of the headset.
[0019] In addition, compared with the implementation method using optical sensors or contact sensors, the implementation method provided by the present disclosure has relatively low energy consumption, which is beneficial to the battery life of the headset.
[0020] In addition, since the implementation method provided by the present disclosure does not rely on optical sensors or contact sensors, there is no problem of misidentification of wearing caused by the user easily blocking the optical sensor or touching the contact sensor when holding the headset. Therefore, the reliability of the implementation method provided by the present disclosure is relatively good. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments are briefly introduced below.
[0022] It should be understood that the following drawings only illustrate some embodiments of the present disclosure, rather than all embodiments, and therefore should not be considered to limit the scope.
[0023] It should also be understood that the same or corresponding reference numerals are used in the drawings to represent the same or corresponding elements (components or steps).
[0024] Figure 1 is a schematic structural diagram of an earphone according to an embodiment of the present disclosure.
[0025] Figure 2 The present invention is a flowchart of a method for determining the usage status of headphones according to an embodiment of the present disclosure.
[0026] Figure 3 It is a flowchart of a method for determining whether an earphone is worn in a user's ear based on picked up test audio according to an embodiment of the present disclosure.
[0027] Figure 4 The present invention is a flowchart of a method for determining the usage status of headphones according to another embodiment of the present invention.
[0028] Figure 5 It is a flowchart of a method for determining whether an earphone is worn in a user's ear based on picked-up application audio according to an embodiment of the present disclosure.
[0029] Figure 6 The present invention is a flowchart of a method for determining the usage status of headphones according to another embodiment of the present invention.
[0030] Figure 7 The present invention is a flowchart of a method for determining whether an earphone is placed in an earphone box according to picked up test audio according to an embodiment of the present disclosure.
[0031] Figure 8 The present invention is a flowchart of a method for determining the usage status of headphones according to an example of the present disclosure.
[0032] Fig. 9 It is a structural schematic diagram of a device for determining the usage status of headphones according to an embodiment of the present disclosure.
[0033] Fig.10 is a schematic structural diagram of an earphone according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0034] The following is an exemplary description of the embodiments of the present disclosure in conjunction with the accompanying drawings. It should be understood that the present disclosure can be implemented in a variety of ways and should not be construed as being limited to the embodiments described here. The embodiments described here are only for a more thorough and complete understanding of the present disclosure.
[0035] Example Headphones
[0036] Figure 1 is a schematic structural diagram of an earphone 100 according to an embodiment of the present disclosure.
[0037] like Figure 1 As shown, the headset 100 includes a processing unit 110, a speaker 120, and an in-ear microphone 130. The speaker 120 can play audio under the control of the processing unit 110. The in-ear microphone 130 can pick up the audio played by the speaker 120 under the control of the processing unit 110.
[0038] In one example, the earphone 100 may be a true wireless earphone (TWS, True Wireless Stereo). In another example, the earphone 100 may be a true wireless earphone with an active noise reduction function.
[0039] It can be understood that in other embodiments, under the premise of no contradiction, the earphones involved in the present disclosure can also be of other types, such as head-mounted headphones.
[0040] Exemplary Methods
[0041] Figure 2 2 is a flow chart of a method S200 for determining the usage status of an earphone according to an embodiment of the present disclosure. Exemplarily, the method S200 may be executed by the processing unit 110 of the earphone 100. The processing unit 110 may implement the method S200 by controlling the speaker 120 and the in-ear microphone 130.
[0042] It is understood that in other embodiments, method S200 may also be executed by a terminal device (eg, a mobile phone) used in conjunction with the headset. The terminal device may implement method S200 by controlling the speaker and the in-ear microphone of the headset.
[0043] like Figure 2 As shown, method S200 includes steps S210 to S230.
[0044] In step S210 , the processing unit 110 controls the speaker 120 to play the test audio.
[0045] The test audio may be, for example, audio played specifically to determine the usage status of the headset. In particular, the test audio may be ultrasonic audio or infrasonic audio. In this way, the test audio will not be perceived by the user and will not affect the user's experience of using other applications such as music and phone calls, thereby improving the user experience.
[0046] In step S220 , the processing unit 110 controls the in-ear microphone 130 to pick up the test audio played by the speaker 120 .
[0047] When the speaker 120 plays the test audio, the test audio propagates in the acoustic cavity 100 a of the earphone 100 . During this process, the in-ear microphone 130 can pick up the test audio under the control of the processing unit 110 .
[0048] In step S230 , the processing unit 110 determines whether the earphone 100 is worn in the ear of the user according to the picked up test audio.
[0049] The processing unit 110 may determine whether the earphone 100 is worn in the ear of the user based on the test audio played by the speaker 120 picked up by the in-ear microphone 130 .
[0050] In this implementation, the use status of the headset is determined based on the audio played by the speaker picked up by the inherent in-ear microphone of the headset. Since there is no need to set up an additional sensor specifically for detecting the use status of the headset, this implementation can reduce the design and manufacturing costs of the headset.
[0051] In addition, compared with the implementation method using optical sensors or contact sensors, this implementation method has relatively low energy consumption, which is beneficial to the battery life of the headphones.
[0052] In addition, since this implementation does not rely on optical sensors or contact sensors, there is no problem of misidentification caused by the user easily blocking the optical sensor or touching the contact sensor when holding the headset. Therefore, the reliability of this implementation is relatively good.
[0053] Figure 3 4 is a flowchart of a method S300 for determining whether an earphone is worn in a user's ear based on picked-up test audio according to an embodiment of the present disclosure.
[0054] In one example, step S230 in method S200 may be implemented by method S300 .
[0055] See also Figure 3 , method S300 includes steps S310 to S330.
[0056] In step S310 , the processing unit 110 determines a frequency response corresponding to the test audio according to the test audio picked up by the in-ear microphone 130 .
[0057] For example, the frequency response model of the acoustic cavity 100a of the earphone 100 (i.e., the back cavity of the earphone 100) can be constructed as: Here, FR is used to represent frequency response, p is used to represent the sound pressure value picked up by the in-ear microphone 130, e is used to represent the voltage value of the driving electrical signal input to the speaker 120, and f is used to represent the frequency of the audio.
[0058] Assuming that the center frequency of a narrowband component of the test audio is f', the frequency response corresponding to the component of the test audio determined in real time by the processing unit 110 can be:
[0059] In step S320 , the processing unit 110 determines whether the frequency response corresponding to the test audio matches the first calibration frequency response to obtain a first matching result.
[0060] When the earphone 100 is not worn in the ear of the user (for example, held in hand), the sound outlet 100b is open, and the acoustic cavity 100a is connected to the infinite space through the sound outlet 100b with a smaller cross-sectional area than itself, which can be approximated as a Helmholtz resonant cavity model. When the earphone 100 is worn in the ear of the user, the sound outlet 100b is blocked, and the acoustic cavity 100a is no longer a resonant cavity model, but becomes a closed cavity model.
[0061] It can be seen from this that the frequency response of the acoustic cavity 100a when the earphone 100 is worn in the user's ear is different from the frequency response when the earphone 100 is not worn in the user's ear, that is, for the same driving electrical signal input to the speaker 120, the sound signals collected by the in-ear microphone 130 are different when the earphone 100 is worn on the ear and when it is not worn on the ear.
[0062] In view of this, as a possible implementation method, the frequency response of the acoustic cavity 100a corresponding to the test audio when the earphone 100 is worn in the user's ear can be pre-calibrated. The processing unit 110 can use the frequency response corresponding to the test audio determined in real time as the first calibration frequency response. With the first calibration frequency response A comparison is performed to determine whether the two match, and a first matching result is obtained.
[0063] As another possible implementation, the frequency response of the acoustic cavity 100a corresponding to the test audio when the earphone 100 is not worn in the user's ear can also be pre-calibrated. The processing unit 110 can use the frequency response corresponding to the test audio determined in real time as the first calibration frequency response. With the first calibration frequency response A comparison is performed to determine whether the two match, and a first matching result is obtained.
[0064] In step S330 , the processing unit 110 determines whether the earphone 100 is worn in the ear of the user according to the first matching result.
[0065] The first matching result may be used to indicate whether the frequency response corresponding to the test audio determined in real time by the processing unit 110 matches the first calibrated frequency response.
[0066] The first calibration frequency response is In the implementation manner, if the frequency response corresponding to the test audio determined in real time by the processing unit 110 matches the first calibrated frequency response, it can be determined that the earphone 100 is worn in the ear of the user.
[0067] The first calibration frequency response is In the implementation manner, if the frequency response corresponding to the test audio determined in real time by the processing unit 110 matches the first calibrated frequency response, it can be determined that the earphone 100 is not worn in the user's ear.
[0068] Exemplarily, the basis for determining whether the frequency response corresponding to the test audio determined in real time matches the first calibration frequency response may be the deviation between the two. For example, when the deviation between the two is greater than a preset threshold, it can be determined that the two do not match; when the deviation between the two is less than the preset threshold, it can be determined that the two match.
[0069] Through the above method, it is possible to accurately determine whether the earphone is worn in the user's ear based on the speaker playback test audio collected by the in-ear microphone.
[0070] As an example, in the first calibration frequency response is In the implementation manner, step S330 of method S300 may specifically include the following steps a and b.
[0071] In step a, the frequency response corresponding to the test audio is determined in real time With the first calibration frequency response When the deviation of is less than the first threshold, the processing unit 110 determines that the headset 100 is in the best wearing position and posture. The calibration may be performed when the earphone 100 is in the optimal wearing position and posture of the artificial ear.
[0072] In step b, the frequency response corresponding to the test audio is determined in real time With the first calibration frequency response When the deviation is greater than the first threshold but less than the second threshold, it indicates that although the earphone 100 has been worn on the ear, it is not yet in the best wearing position or posture (for example, the TWS earphone is shallowly inserted into the ear, worn loosely, or the headphone is worn crookedly). The processing unit 110 can adjust the audio equalizer parameters of the earphone 100 according to the deviation between the two. If the speaker 120 starts to play music subsequently, it can ensure that the music is in the best listening quality.
[0073] Here, the second threshold value can be a frequency response corresponding to the test audio determined in real time. With the first calibration frequency response That is, if the frequency response of the test audio corresponding to the real-time determination is With the first calibration frequency response If the deviation is greater than the second threshold, the two do not match, indicating that the earphone 100 is not worn on the ear.
[0074] In this way, it is possible to determine not only whether the earphone is worn in the user's ear, but also whether the earphone is in the best wearing position and posture. When it is detected that the earphone is not in the best wearing position and posture, the parameters of the earphone's audio equalizer are adaptively adjusted based on the deviation between the measured frequency response and the calibrated frequency response, so as to compensate for the sound quality degradation caused by the poor wearing position or posture, thereby improving the user experience.
[0075] Figure 4 4 is a flow chart of a method S400 for determining the usage status of an earphone according to another embodiment of the present disclosure.
[0076] See also Figure 4 The method S400 includes steps S410 to S460. It should be noted that steps S410 to S430 of the method S400 are the same as steps S210 to S230 of the method S200, and for the purpose of brevity, repeated descriptions are appropriately omitted.
[0077] In step S410 , the processing unit 110 controls the speaker 120 to play a test audio.
[0078] In step S420 , the processing unit 110 controls the in-ear microphone 130 to pick up the test audio played by the speaker 120 .
[0079] In step S430 , the processing unit 110 determines whether the earphone 100 is worn in the ear of the user according to the picked up test audio.
[0080] In step S440 , in response to determining that the earphone 100 is worn in the ear of the user and the speaker 120 plays the application audio, the processing unit 110 controls the speaker 120 to stop playing the test audio.
[0081] Application audio may be, for example but not limited to, call audio from a device such as a mobile phone, music audio, or an audio stream in a video.
[0082] In step S450 , the processing unit 110 determines whether the earphone 100 is held in the ear of the user based on the application audio played by the speaker 120 picked up by the in-ear microphone 130 .
[0083] In step S460 , in response to determining that the earphone is taken out of the user's ear, the processing unit 110 controls the speaker 120 to stop playing the application audio and play the test audio again.
[0084] In the above implementation, after the earphones are worn and start playing the application audio, the speaker stops playing the test audio, and the basis for determining the wearing status of the earphones changes from the test audio to the application audio, which can prevent the test audio, which is an audible sound, from affecting the user's experience of using other applications. Once the earphones are taken off, the speaker stops playing the application audio and plays the test audio again, and the basis for determining the wearing status of the earphones changes from the application audio to the test audio, thereby ensuring that the earphone usage status can still be accurately determined after the earphones are taken off.
[0085] Throughout the entire process of putting on the headphones → keeping on → taking them off → keeping taking them off → putting them on, the switching between the test audio and the application audio can be completed automatically and timely without the user having to perform additional operations. In this way, the use status of the headphones can be identified in real time during the entire use process without affecting the user's experience, that is, there will be no conflict between the user hearing the application audio and the test audio at the same time.
[0086] Especially in the implementation method where the test audio is ultrasonic audio or infrasonic audio that is inaudible, the use status of the headset is determined by the above implementation method, and the user will not feel the existence of the test audio at all. The detection of the use status can be completed smoothly without knowing it, without the need for user participation and without causing any discomfort or inconvenience to the user. Since the human ear cannot hear it, the speaker can always keep playing the test audio and use it to determine the wearing status of the headset, regardless of whether it is playing the application audio at the same time. Since there is no intersection between the frequency spectrum of the audible application audio and the inaudible test audio, when the headset is worn and starts playing the application audio, the basis for determining the wearing status of the headset can be either the test audio or the application audio.
[0087] It is worth emphasizing that in the implementation of the above step S440, the use of the test audio only occurs when the user is not wearing the headphones. After the headphones are worn, the test audio is no longer used, and the application audio is used instead as the basis for determining the wearing status of the headphones. It can be seen that this implementation can minimize the potential adverse effects of the test audio on the user's physiology and psychology, especially in the implementation of the test audio as ultrasonic audio or infrasonic audio.
[0088] Figure 5 4 is a flow chart of a method S500 for determining whether an earphone is worn in a user's ear based on picked-up application audio according to an embodiment of the present disclosure.
[0089] In one example, step S450 in method S400 may be implemented by method S500 .
[0090] like Figure 5As shown, method S500 may include steps S510 to S530.
[0091] In step S510 , the processing unit 110 determines a frequency response corresponding to the application audio according to the application audio played by the speaker 120 picked up by the in-ear microphone 130 .
[0092] For example, assuming that the center frequency of a narrowband component of the application audio is f", the frequency response corresponding to the component of the application audio determined in real time by the processing unit 110 can be
[0093] In step S520 , the processing unit 110 determines whether the frequency response corresponding to the application audio matches the second calibration frequency response to obtain a second matching result.
[0094] As a possible implementation method, the frequency response of the acoustic cavity 100a corresponding to the applied audio when the earphone 100 is worn in the ear of the user can be pre-calibrated. The processing unit 110 can use the frequency response corresponding to the application audio determined in real time as the second calibration frequency response. With the second calibration frequency response A comparison is performed to determine whether the two match, and a second matching result is obtained.
[0095] As another possible implementation, the frequency response of the acoustic cavity 100a corresponding to the applied audio when the earphone 100 is not worn in the user's ear can also be pre-calibrated. The processing unit 110 can use the frequency response corresponding to the application audio determined in real time as the second calibration frequency response. With the second calibration frequency response A comparison is performed to determine whether the two match, and a second matching result is obtained.
[0096] In step S530 , the processing unit 110 determines whether the earphone 100 is held in the ear of the user according to the second matching result.
[0097] The second matching result may be used to indicate whether the frequency response corresponding to the application audio determined in real time by the processing unit 110 matches the second calibrated frequency response.
[0098] The second calibration frequency response is In an implementation manner, if the frequency response corresponding to the application audio determined in real time by the processing unit 110 matches the second calibrated frequency response, it can be determined that the earphone 100 is worn in the ear of the user.
[0099] The second calibration frequency response is In the implementation manner, if the frequency response corresponding to the application audio determined in real time by the processing unit 110 matches the second calibrated frequency response, it can be determined that the headset 100 is not worn in the user's ear.
[0100] Exemplarily, the basis for determining whether the frequency response corresponding to the application audio determined in real time matches the second calibration frequency response may be the deviation between the two. For example, when the deviation between the two is greater than a preset threshold, it can be determined that the two do not match; when the deviation between the two is less than the preset threshold, it can be determined that the two match.
[0101] Through the above method, it is possible to accurately determine whether the earphone is kept in the user's ear based on the application audio played by the speaker collected by the in-ear microphone.
[0102] As an example, in the second calibration frequency response is In the implementation manner, step S530 of method S500 may specifically include the following steps a and b.
[0103] In step a, the frequency response corresponding to the applied audio is determined in real time With the second calibration frequency response When the deviation is less than the third threshold, the processing unit 110 determines that the headset 100 is in the best wearing position and posture. The calibration may be performed when the earphone 100 is in the optimal wearing position and posture of the artificial ear.
[0104] In step b, the frequency response corresponding to the applied audio is determined in real time With the second calibration frequency response When the deviation is greater than the third threshold but less than the fourth threshold, it indicates that although the earphone 100 is still kept in the ear, it is not in the best wearing position or posture (for example, the TWS earphone is shallow in the ear, worn loosely, or the headphone is worn crookedly). The processing unit 110 can adjust the audio equalizer parameters of the earphone 100 according to the deviation between the two to ensure that the application audio is in the best listening quality.
[0105] Here, the fourth threshold value may be a frequency response corresponding to the application audio determined in real time. With the second calibration frequency response That is, if the frequency response of the application audio is determined in real time With the second calibration frequency response If the deviation is greater than the fourth threshold, the two do not match, which means that the earphone 100 is at the limit position for playing the application audio. If the limit position is exceeded, the earphone 100 is completely removed, the application audio stops playing, and the speaker 130 switches to playing the test audio. The processing unit 110 continues to make real-time judgments on the wearing status of the earphone through steps a and b in the aforementioned step S330.
[0106] In this way, it is possible to determine not only whether the earphone is held in the user's ear, but also whether the earphone is in the best wearing position and posture. When it is detected that the earphone is not in the best wearing position and posture, the parameters of the earphone's audio equalizer are adaptively adjusted based on the deviation between the measured frequency response and the calibrated frequency response, so as to compensate for the sound quality degradation caused by the poor wearing position or posture, thereby improving the user experience.
[0107] Figure 6 2 is a flow chart of a method S600 for determining the usage status of an earphone according to another embodiment of the present disclosure. Steps S620 and S630 of the method S600 are the same as steps S220 and S230 of the method S200, and for the purpose of brevity, repeated descriptions are appropriately omitted.
[0108] like Figure 6 As shown, method S600 includes steps S610 to S640.
[0109] In step S610 , in response to detecting that the earphone box containing the earphone 100 is opened, the processing unit 110 controls the speaker 120 to play the test audio.
[0110] In step S620 , the processing unit 110 controls the in-ear microphone 130 to pick up the test audio played by the speaker 120 .
[0111] In step S630 , the processing unit 110 determines whether the earphone 100 is worn in the ear of the user according to the test audio picked up by the in-ear microphone 130 .
[0112] In step S640 , the processing unit 110 determines whether the earphone 100 is placed in the earphone box according to the test audio picked up by the in-ear microphone 130 .
[0113] In this way, it is possible to determine not only whether the earphone is worn in the user's ear, but also whether the earphone is still placed in the earphone box, so as to more accurately determine the use status of the earphone. When it is determined that the earphone is still placed in the earphone box, certain functions of the earphone, such as the Bluetooth function, can be turned off to reduce energy consumption and extend battery life.
[0114] It should be noted that the present disclosure does not specifically limit the order of step S630 and step S640. In some embodiments, step S640 may be performed first and then step S630. In some embodiments, step S630 and step S640 may also be performed simultaneously.
[0115] Figure 7 4 is a flow chart of a method S700 for determining whether an earphone is placed in an earphone box according to picked up test audio according to an embodiment of the present disclosure.
[0116] In one example, step S640 in method S600 may be implemented by method S700 .
[0117] like Figure 7 As shown, method S700 includes steps S710 to S730.
[0118] In step S710 , the processing unit 110 determines a frequency response corresponding to the test audio according to the test audio played by the speaker 120 picked up by the in-ear microphone 130 .
[0119] For example, assuming that the center frequency of a narrowband component of the test audio is f', the frequency response corresponding to the component of the test audio determined in real time by the processing unit 110 can be
[0120] In step S720 , the processing unit 110 determines whether the frequency response corresponding to the test audio matches the third calibrated frequency response to obtain a third matching result.
[0121] When the earphone 100 is placed in the earphone box, although the sound hole 100b is open, the sound cavity 100a is connected to the limited space (the storage compartment of the earphone box) through the sound hole 100b. It can be seen that the frequency response of the sound cavity 100a when the earphone 100 is placed in the earphone box is different from the frequency response of the aforementioned resonant cavity model and the frequency response of the closed cavity model.
[0122] For example, the frequency response of the acoustic cavity 100a corresponding to the test audio when the earphone 100 is placed in the earphone box can be pre-calibrated. The third calibration frequency response is used as the third calibration frequency response. When used, the processing unit 110 can calculate the frequency response corresponding to the test audio determined in real time. With the third calibration frequency response A comparison is performed to determine whether the two match, and a third matching result is obtained.
[0123] The third matching result can be used to indicate whether the frequency response corresponding to the test audio determined in real time by the processing unit 110 matches the third calibration frequency response. When the deviation between the two is greater than a preset threshold, it can be determined that the two do not match; when the deviation between the two is less than the preset threshold, it can be determined that the two match.
[0124] In step S730, the processing unit 110 determines whether the earphone 100 is placed in the earphone box according to the third matching result.
[0125] For example, if the frequency response corresponding to the test audio determined in real time by the processing unit 110 matches the third calibrated frequency response, it can be determined that the earphone 100 is placed in the earphone box. Otherwise, it is determined that the earphone 100 is taken out of the earphone box.
[0126] In this way, it is possible to accurately determine whether the earphone is taken out of the earphone box.
[0127] In some embodiments, the earphone 100 may be an active noise reduction earphone, and the in-ear microphone 130 may be an error microphone of the active noise reduction earphone 100 .
[0128] In this implementation, the error microphone of the active noise reduction headset is used to realize both the active noise reduction function and the headset usage status detection function, which is conducive to simplifying the structure of the headset, directly utilizing the original hardware of the headset, and significantly reducing the design and manufacturing costs of the headset.
[0129] In some embodiments, the narrowband frequency of the test audio may be the same as the resonance frequency of the acoustic cavity 100 a of the earphone 100 .
[0130] For example, the narrowband frequency f' of the test audio may be set to be the same as the resonance frequency of the acoustic cavity 100a of the earphone 100, and the pre-calibrated frequency response of the acoustic cavity 100a corresponding to the test audio when the earphone 100 is not worn in the user's ear is set to As the first calibration frequency response.
[0131] In this way, the characteristics of the first calibration frequency response can be made more prominent, so that the usage status of the earphone can be determined more accurately.
[0132] In some embodiments, in order to improve the accuracy of detection, the test audio may use broadband audio, and a first calibration frequency response including multiple frequency points is pre-calibrated. (or ).
[0133] In this way, when determining the usage status of the earphone, multiple frequency points on the frequency response curve can be used as a basis for in-ear detection, thereby improving the accuracy of the detection.
[0134] In some embodiments, in order to improve the accuracy of detection in the wearing state, a second calibration frequency response including multiple frequency points may also be pre-calibrated. (or ).
[0135] In some embodiments, a third calibrated frequency response including multiple frequency points may also be pre-calibrated. In order to more accurately determine whether the earphone 100 is placed in the earphone box.
[0136] Figure 8 4 is a flowchart of a method S800 for determining earphone usage status according to an example of the present disclosure.
[0137] like Figure 8 As shown, method S800 includes steps S810 to S880.
[0138] In step S810, the processing unit 110 determines whether the earphone box is opened.
[0139] If the determination result is yes, step S820 is executed; if the determination result is no, step S810 is repeated.
[0140] In step S820 , the processing unit 110 controls the speaker 120 to play the test audio.
[0141] In step S830 , the processing unit 110 controls the in-ear microphone 130 to pick up the test audio played by the speaker 120 .
[0142] In step S840 , the processing unit 110 determines the usage status of the headset 100 according to the picked up test audio.
[0143] When the earphone 100 is in the earphone box, step S840 is repeated; when the earphone 100 is in the earphone box, step S850 is executed; when the earphone 100 is neither in the earphone box nor in the ear of the user, step S840 is repeated.
[0144] It should be understood that the manner of determining the usage status of the earphone can refer to the implementation manner in the aforementioned embodiment of the present disclosure, which will not be described in detail for the purpose of brevity.
[0145] In step S850 , the processing unit 110 determines whether the speaker 120 starts playing the application audio.
[0146] If the determination result is yes, step S860 is executed; if the determination result is no, step S850 is repeated.
[0147] In step S860 , the processing unit 110 controls the speaker 120 to stop playing the test audio.
[0148] In step S870 , the processing unit 110 determines whether the earphone 100 is held in the ear of the user based on the application audio played by the speaker 120 picked up by the in-ear microphone 130 .
[0149] If the determination result is yes, step S870 is repeated; if the determination result is no, step S880 is executed.
[0150] In step S880 , the processing unit 110 controls the speaker 120 to play the test audio again.
[0151] After executing step S880, return to execute step S840.
[0152] Combination of the above Figures 2 to 8 , exemplarily describes an embodiment of the method for determining the usage status of headphones disclosed in the present invention, and the following is combined with Fig. 9 , an exemplary description is given of the apparatus for determining the usage status of an earphone disclosed in the present invention. The descriptions of the method embodiment and the apparatus embodiment correspond to each other, and for the sake of brevity, repeated descriptions are appropriately omitted.
[0153] Fig. 9 is a structural diagram of an apparatus 900 for determining earphone usage status according to an embodiment of the present disclosure.
[0154] like Fig. 9 As shown, the device 900 includes a control module 910 and a determination module 920 .
[0155] The control module 910 is used to: control the speaker to play the test audio; and control the in-ear microphone to pick up the test audio.
[0156] The determination module 920 is used to determine whether the earphone is worn in the ear of the user according to the picked up test audio.
[0157] In one example, the determination module 920 is used to: determine the frequency response corresponding to the test audio based on the picked up test audio; determine whether the frequency response corresponding to the test audio matches the first calibrated frequency response to obtain a first matching result; and determine whether the earphone is worn in the user's ear based on the first matching result.
[0158] In one example, the determination module 920 is used to: determine that the earphone is worn in the user's ear when the frequency response corresponding to the test audio matches the first calibrated frequency response; or determine that the earphone is not worn in the user's ear when the frequency response corresponding to the test audio matches the first calibrated frequency response.
[0159] In one example, the determination module 920 is used to: determine that the earphone is in the optimal wearing position and posture when the deviation between the frequency response corresponding to the test audio and the first calibrated frequency response is less than a first threshold; when the deviation between the frequency response corresponding to the test audio and the first calibrated frequency response is greater than the first threshold but less than a second threshold, adjust the audio equalizer parameters of the earphone according to the deviation, wherein the second threshold is the minimum condition for determining that the frequency response corresponding to the test audio matches the first calibrated frequency response.
[0160] In one example, the control module 910 is further used to: in response to determining that the earphone is worn in the user's ear and the speaker is playing the application audio, control the speaker to stop playing the test audio. The determination module 920 is further used to: determine whether the earphone is kept in the user's ear according to the application audio picked up by the in-ear microphone. The control module 910 is further used to: in response to determining that the earphone is taken out of the user's ear, control the speaker to stop playing the application audio and play the test audio again.
[0161] In one example, the determination module 920 is used to: determine the frequency response corresponding to the application audio based on the application audio picked up by the in-ear microphone; determine whether the frequency response corresponding to the application audio matches the second calibrated frequency response to obtain a second matching result; and determine whether the earphone is held in the user's ear based on the second matching result.
[0162] In one example, the determination module 920 is used to: determine that the earphone is in the optimal wearing position and posture when the deviation between the frequency response corresponding to the application audio and the second calibrated frequency response is less than a third threshold; when the deviation between the frequency response corresponding to the application audio and the second calibrated frequency response is greater than the third threshold but less than a fourth threshold, adjust the audio equalizer parameters of the earphone according to the deviation to ensure that the application audio is in the best listening quality, wherein the fourth threshold is the minimum condition for determining that the frequency response corresponding to the application audio matches the second calibrated frequency response.
[0163] In one example, the control module 910 is used to: in response to detecting that the earphone box containing the earphone is opened, control the speaker to play the test audio. The determination module 920 is also used to: determine whether the earphone is placed in the earphone box according to the picked up test audio.
[0164] In one example, the determination module 920 is used to: determine the frequency response corresponding to the test audio based on the picked up test audio; determine whether the frequency response corresponding to the test audio matches the third calibrated frequency response to obtain a third matching result; and determine whether the earphone is placed in the earphone box based on the third matching result.
[0165] In one example, the test audio includes ultrasonic audio and / or infrasonic audio.
[0166] In one example, the earphone is an active noise reduction earphone, and the in-ear microphone is an error microphone of the active noise reduction earphone.
[0167] In one example, the narrowband frequency of the test audio is the same as the resonant frequency of the acoustic cavity of the earphone.
[0168] Fig.10 is a schematic diagram of the structure of an earphone 1000 according to an embodiment of the present disclosure.
[0169] See also Fig.10 The headset 1000 includes a speaker and an in-ear microphone (not shown), a processor 1010 and a memory 1020. The processor 1010 is coupled to the memory 1020. The processor 1010 is configured to execute the method for determining the usage status of the headset provided in the present disclosure based on the instructions stored in the memory 1020.
[0170] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this disclosure.
[0171] In the several embodiments provided in the present disclosure, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0172] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0173] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0174] The term "including" and its variations used in the present disclosure are open inclusions, i.e., "including but not limited to". The term "according to" means "at least in part according to". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment".
[0175] Although the terms “first” or “second” etc. may be used in the present disclosure to describe various elements, these elements are not limited by these terms, and these terms are only used to distinguish one element from another.
[0176] The above is only a specific embodiment of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person skilled in the art who is familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present disclosure, which should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.
Claims
1. A method for determining the usage status of an earphone, the earphone comprising a speaker and an in-ear microphone, characterized in that: The method comprises: Controlling the speaker to play the test audio; Controlling the in-ear microphone to pick up the test audio; Determining a frequency response corresponding to the test audio according to a voltage value of the test audio and a sound pressure value picked up by the in-ear microphone; Determining whether the earphone is worn in the ear of the user according to a deviation between a frequency response corresponding to the test audio and a first calibrated frequency response; The step of determining whether the earphone is worn in the ear of the user according to the deviation between the frequency response corresponding to the test audio and the first calibrated frequency response includes: When the deviation between the frequency response corresponding to the test audio and the first calibrated frequency response is less than a first threshold, determining that the earphone is worn in the ear of the user and is in an optimal wearing position and posture; When the deviation between the frequency response corresponding to the test audio and the first calibrated frequency response is greater than the first threshold but less than the second threshold, determining that the earphone is worn in the ear of the user, and adjusting the audio equalizer parameters of the earphone according to the deviation so that the earphone provides the best listening sound quality; When the deviation between the frequency response corresponding to the test audio and the first calibrated frequency response is greater than the second threshold, it is determined that the earphone is not worn in the ear of the user.
2. The method according to claim 1, characterized in that The method further comprises: In response to determining that the earphone is worn in the user's ear and the speaker plays the application audio, controlling the speaker to stop playing the test audio; Determining whether the earphone is held in the user's ear based on the application audio picked up by the in-ear microphone; and In response to determining that the earphone is taken out of the user's ear, the speaker is controlled to stop playing the application audio and play the test audio again.
3. The method according to claim 2, characterized in that The determining, based on the application audio picked up by the in-ear microphone, whether the earphone is held in the user's ear comprises: Determining a frequency response corresponding to the application audio according to the application audio picked up by the in-ear microphone; Determining whether the frequency response corresponding to the application audio matches the second calibrated frequency response to obtain a second matching result; and According to the second matching result, it is determined whether the earphone is held in the ear of the user.
4. The method according to claim 3, characterized in that: The determining, according to the second matching result, whether the earphone is held in the user's ear comprises: When the deviation between the frequency response corresponding to the application audio and the second calibrated frequency response is less than a third threshold, determining that the headset is in an optimal wearing position and posture; When the deviation between the frequency response corresponding to the application audio and the second calibrated frequency response is greater than the third threshold but less than the fourth threshold, the audio equalizer parameters of the headphones are adjusted according to the deviation to ensure that the application audio is at the best listening quality, wherein the fourth threshold is the minimum condition for determining that the frequency response corresponding to the application audio matches the second calibrated frequency response.
5. The method according to claim 1, characterized in that The controlling the speaker to play the test audio comprises: In response to detecting that the earphone box containing the earphone is opened, controlling the speaker to play the test audio, wherein the method further comprises: Determine whether the earphone is placed in the earphone box according to the picked up test audio.
6. The method according to claim 5, characterized in that The step of determining whether the earphone is placed in the earphone box according to the picked-up test audio comprises: Determining a frequency response corresponding to the test audio according to the picked up test audio; Determining whether the frequency response corresponding to the test audio matches a third calibrated frequency response to obtain a third matching result; and Determine whether the earphone is placed in the earphone box according to the third matching result.
7. The method according to any one of claims 1 to 6, characterized in that The test audio includes ultrasonic audio and / or infrasonic audio.
8. The method according to any one of claims 1 to 6, characterized in that The earphone is an active noise reduction earphone, and the in-ear microphone is an error microphone of the active noise reduction earphone.
9. The method according to any one of claims 1 to 6, characterized in that The narrowband frequency of the test audio is the same as the resonance frequency of the acoustic cavity of the earphone.
10. An earphone, comprising a speaker and an in-ear microphone, characterized in that: The computer readable medium further comprises a processor coupled to the memory, wherein the processor is configured to execute the method according to any one of claims 1 to 9 based on instructions stored in the memory.
Citation Information
Patent Citations
Headphone wearing state detection method, device, headphone, and storage medium
WO2022027899A1