Earphone detection method, earphone and storage medium

By setting a sensor or camera on the wireless headset, detecting the wearing status of the headset and automatically adjusting the playback mode, the wearing error problem caused by the fixed left and right ear design of the existing wireless headset is solved, and the use experience of the headset is improved.

CN115396802BActive Publication Date: 2025-04-22GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202110494832.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-05-07
Publication Date
2025-04-22
Estimated Expiration
2041-05-07

AI Technical Summary

Technical Problem

The left and right ears of existing wireless earphones are fixed and cannot be flexibly worn, resulting in wearing errors that affect the playback effect and user experience.

Method used

By setting the first sensor and the second sensor on the first and second earphones of the wireless in-ear headphones, the detection value is collected to determine the wearing state; for the headphones, a camera is installed on the earmuff, and a detection image is collected for image feature recognition to determine the wearing state.

Benefits of technology

It realizes flexible detection and determination of the wearing status of the headphones without fixing the left and right earphones, thereby automatically adjusting the playback mode, avoiding the impact of the audio effect due to wearing errors and improving the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115396802B_ABST
    Figure CN115396802B_ABST
Patent Text Reader

Abstract

The embodiment of the present application discloses an earphone detection method, earphones and storage medium. For wireless in-ear earphones, the two earphones include two sensors respectively, and the wearing status of the first earphone and / or the second earphone is determined based on the detection values ​​of the two sensors. For head-mounted earphones, the first earphone, the second earphone and the camera are included, wherein the camera is installed on the earmuff of the first earphone or the second earphone close to the face, and the optical axis of the camera is biased toward the middle position of the face. The camera collects the detection image, and the wearing status of the first earphone and / or the second earphone is determined based on whether the detection image contains facial image features. In this way, for in-ear earphones and head-mounted earphones, there is no need to fix the left and right earphones, but the wearing status of the left and right earphones is detected by the set sensor or camera, so as to flexibly set the playback mode of the left and right earphones, avoid the playback effect due to the user's wearing error, and improve the user experience of wireless earphones.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of wireless earphones, and in particular to an earphone detection method, an earphone and a storage medium. Background Art

[0002] The left and right ears of existing wireless headphones are fixed by structural design. For example, the left earphone of some wireless headphones cannot be put into the right ear, and the right earphone cannot be put into the left ear. Some wireless headphones output the left channel of the left earphone and the right channel of the right earphone. In this way, the fixed left and right earphone design makes it impossible to wear the wireless headphones on the ears at will. If the headphones are worn incorrectly, it will affect the headphone playback effect and the user's wearing experience. Summary of the invention

[0003] In order to solve the above technical problems, the embodiments of the present application hope to provide an earphone detection method, an earphone and a storage medium.

[0004] The technical solution of this application is implemented as follows:

[0005] In a first aspect, a wireless in-ear headset detection method is provided, wherein a first headset and a second headset of the wireless in-ear headset respectively include a first sensor and a second sensor; wherein the tragus-side housings of the first headset and the second headset include the first sensor, and the housings on the opposite tragus sides of the first headset and the second headset include the second sensor, and the method includes:

[0006] Collecting a first detection value through a first sensor;

[0007] Collecting a second detection value by a second sensor; and

[0008] The wearing status of the first earphone and / or the second earphone is determined based on the first detection value and the second detection value.

[0009] In a second aspect, a wireless in-ear headset is provided, the wireless in-ear headset comprising a first headset, a second headset and a processor;

[0010] The first earphone and the second earphone of the wireless in-ear earphone respectively include a first sensor and a second sensor; wherein the tragus-side housings of the first earphone and the second earphone include the first sensor, and the housings on the opposite tragus sides of the first earphone and the second earphone include the second sensor, wherein,

[0011] The first sensor is used to collect a first detection value;

[0012] The second sensor is used to collect a second detection value;

[0013] The processor is used to determine the wearing status of the first earphone and / or the second earphone based on the first detection value and the second detection value.

[0014] In a third aspect, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method described in the first aspect are implemented.

[0015] In a fourth aspect, a wireless headset detection method is provided, wherein the wireless headset comprises a first headset, a second headset, and a camera, wherein the camera is mounted on an earmuff of the first headset or the second headset close to the face, and an optical axis of the camera is biased toward a middle position of the face, and the method comprises:

[0016] When the wireless headset is switched from a non-wearing state to a wearing state, collecting a detection image through the camera;

[0017] Performing image feature recognition on the detection image;

[0018] Based on whether the detection image contains facial image features, the wearing status of the first earphone and / or the second earphone is determined.

[0019] In a fifth aspect, a wireless headset is provided, comprising a first headset, a second headset, a camera, and a processor, wherein the camera is mounted on an earmuff of the first headset or the second headset close to the face, and an optical axis of the camera is biased toward the middle of the face.

[0020] The camera is used to collect detection images when the wireless headset is switched from a non-wearing state to a wearing state;

[0021] The processor is used to perform image feature recognition on the detection image; and determine the wearing status of the first earphone and the second earphone based on whether the detection image contains facial image features.

[0022] In a sixth aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method described in the fourth aspect are implemented.

[0023] In the embodiment of the present application, a headset detection method, a headset and a storage medium are provided. For wireless in-ear headsets, the first headset and the second headset respectively include a first sensor and a second sensor; wherein, the tragus side shell of the first headset and the second headset includes a first sensor, and the shell of the first headset and the second headset on the opposite tragus side includes a second sensor, and the wearing state of the first headset and the second headset is determined based on the detection values ​​of the two sensors. For head-mounted headsets, the first headset, the second headset and the camera are included, wherein the camera is installed on the earmuff of the first headset or the second headset close to the face, and the optical axis of the camera is biased to the middle position of the face, and the detection image is collected by the camera; the image feature recognition is performed on the detection image; based on whether the detection image contains facial image features, the wearing state of the first headset and / or the second headset is determined. In this way, for in-ear headsets and head-mounted headsets, there is no need to fix the left and right headsets, but the wearing state of the left and right headsets is detected by the set sensor or camera, so as to flexibly set the playback mode of the left and right headsets, avoid the application of playback effects due to user wearing errors, and improve the user experience of wireless headsets. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 This is a first structural schematic diagram of a wireless in-ear headset in an embodiment of the present application;

[0025] Figure 2 This is a schematic diagram of a first process of a wireless in-ear headset detection method in an embodiment of the present application;

[0026] Figure 3 This is a schematic diagram of a second process of the wireless in-ear headset detection method in an embodiment of the present application;

[0027] Figure 4 A third flow chart of the wireless in-ear headset detection method in an embodiment of the present application;

[0028] Figure 5 This is a schematic diagram of a fourth process of the wireless in-ear headset detection method in an embodiment of the present application;

[0029] Figure 6 This is a second structural schematic diagram of the wireless in-ear headset in an embodiment of the present application;

[0030] Figure 7 This is a first structural schematic diagram of a wireless headset in an embodiment of the present application;

[0031] Figure 8 This is a schematic diagram of a first process of a wireless headset detection method in an embodiment of the present application;

[0032] Fig. 9 This is a schematic diagram of a second process of the wireless headset detection method in an embodiment of the present application;

[0033] Fig.10 Schematic diagram of the second structure of the wireless headset in the embodiment of the present application. DETAILED DESCRIPTION

[0034] In order to enable a more detailed understanding of the features and technical contents of the embodiments of the present application, the implementation of the embodiments of the present application is described in detail below in conjunction with the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present application.

[0035] The present application embodiment provides a wireless in-ear headset detection method, such as Figure 1 As shown, the first earphone and the second earphone of the wireless in-ear earphone respectively include a first sensor 11 and a second sensor 12; wherein, the tragus side shells of the first earphone and the second earphone include the first sensor 11, and the shells on the opposite tragus side of the first earphone and the second earphone include the second sensor 12.

[0036] Based on the above wireless in-ear headphones, the embodiment of the present application provides a wireless in-ear headphone detection method. Figure 2 FIG. 1 is a schematic diagram of a first process of a wireless in-ear headset detection method according to an embodiment of the present application. Figure 2 As shown, the method may specifically include:

[0037] Step 201: collecting a first detection value through a first sensor;

[0038] Step 202: collecting a second detection value through a second sensor;

[0039] In some embodiments, the first sensor and the second sensor are one of the following: a pressure sensor, a temperature sensor, or a light sensor.

[0040] Correspondingly, when the sensor is a pressure sensor, the detection value is the pressure value; when the sensor is a temperature sensor, the detection value is the temperature value; when the sensor is a light sensor, the detection value is the amount of light entering.

[0041] Step 203: Determine the wearing status of the first earphone and / or the second earphone based on the first detection value and the second detection value.

[0042] like Figure 1As shown, when the in-ear earphone is in a wearing state, the in-ear earphone is judged whether it is worn on the left ear or the right ear based on the difference in contact characteristics of the in-ear earphone at a position close to the tragus (the position corresponding to the first sensor 11, which may be referred to as the first position) and the opposite position (i.e., the position corresponding to the second sensor 12, which may be referred to as the second position), such as the difference in contact area, pressure, distance and other information. In the embodiment of the present application, the setting positions of the two sensors can be determined according to the contact characteristics between the earphone and the ear canal, and the greater the difference in contact characteristics, the higher the detection accuracy. Exemplarily, when the first earphone is worn on the left ear, the position of the first sensor is in contact with the first position of the ear, and the position of the second sensor is not in contact with the second position of the ear. On the contrary, when worn on the right ear, the position of the first sensor is in contact with the second position of the ear, and the position of the second sensor is not in contact with the first position of the ear.

[0043] When the sensor is a pressure sensor, a temperature sensor or a light sensor, whether the first earphone and / or the second earphone is in the left ear wearing state or the right ear wearing state is determined by comparing the first detection value and the second detection value.

[0044] In some embodiments, when it is detected that the first earphone and / or the second earphone switches from the non-in-ear state to the in-ear state, the corresponding sensor is turned on; after determining the wearing state of the first earphone and / or the second earphone, the corresponding sensor is turned off. That is, when switching from the non-in-ear state to the in-ear state, it indicates that the user performs a wearing operation on the earphone, and a wearing state detection is required, and the sensor is turned on; in other states, there is no need to perform a wearing detection, and the sensor can be turned off to reduce the power consumption of the earphone.

[0045] In other embodiments, the sensor may be turned on at certain time intervals or may be in a normally open state.

[0046] In some embodiments, the method further includes: controlling the first earphone and / or the second earphone to operate in an earphone playback mode corresponding to the wearing state thereof. Here, the earphone playback mode is a left ear playback mode or a right ear playback mode. For in-ear earphones, users can use two earphones at the same time, or use one earphone separately. There is no need to distinguish between left and right earphones. After the earphones are worn, they will automatically identify the ear on which each earphone is worn according to the detection values ​​of the first sensor and the second sensor, thereby controlling the earphones to operate in an earphone playback mode corresponding to their own wearing state, avoiding the playback effect affected by user wearing errors, and improving the user experience of wireless earphones. In addition, the left and right earphones can be set to be exactly the same, which also saves design and production costs.

[0047] The detection methods of different sensors are further illustrated below with examples.

[0048] In some embodiments, the first sensor and the second sensor are pressure sensors, the first detection value is a first pressure value, and the second detection value is a second pressure value.

[0049] The determining the wearing state of the first earphone and / or the second earphone based on the first detection value and the second detection value includes:

[0050] Under the pre-determined conditions,

[0051] When the first pressure value is greater than the second pressure value, it is determined that the first earphone is in the right ear wearing state; when the first pressure value is less than the second pressure value, it is determined that the first earphone is in the left ear wearing state;

[0052] When the first pressure value is greater than the second pressure value, it is determined that the second earphone is in the right ear wearing state; when the first pressure value is less than the second pressure value, it is determined that the second earphone is in the right ear wearing state.

[0053] That is to say, the left and right earphone identification methods of the first earphone and the second left ear are exactly the same.

[0054] like Figure 1 As shown, since the contact area of ​​the earphone at the first position of the ear is larger, the earphone applies greater pressure to the first position, and the contact area of ​​the earphone at the second position of the ear is smaller, the earphone applies less pressure to the second position. At this time, when the in-ear earphone is worn on the right ear, the first sensor is used to detect the pressure value at the first position of the right ear, and the second sensor is used to detect the pressure value at the second position of the right ear canal. On the contrary, when the in-ear earphone is worn on the left ear, the first sensor is used to detect the pressure value at the second position of the left ear, and the second sensor is used to detect the pressure value at the first position of the left ear.

[0055] Therefore, when it is detected that the first pressure value is greater than the second pressure value, it is determined that the earphone is worn on the right ear, and when the first pressure value is less than the second pressure value, it is determined that the earphone is worn on the left ear.

[0056] In some embodiments, the first sensor and the second sensor are temperature sensors, the first detection value is a first temperature value, and the second detection value is a second temperature value.

[0057] The determining the wearing state of the first earphone and / or the second earphone based on the first detection value and the second detection value includes:

[0058] Under the pre-determined conditions,

[0059] When the first temperature value is greater than the second temperature value, it is determined that the first earphone is in the right ear wearing state; when the first temperature value is less than the second temperature value, it is determined that the first earphone is in the left ear wearing state;

[0060] When the first temperature value is greater than the second temperature value, it is determined that the second earphone is in the right ear wearing state; when the first temperature value is less than the second temperature value, it is determined that the second earphone is in the left ear wearing state.

[0061] like Figure 1 As shown, since the contact area of ​​the earphone at the first position of the ear is larger, the temperature value detected at the first position is more affected by the body temperature, and the contact area of ​​the earphone at the second position of the ear is smaller, the temperature detected at the second position is less affected by the body temperature. At this time, when the in-ear earphone is worn on the right ear, the first sensor is used to detect the temperature value at the first position of the right ear, and the second sensor is used to detect the temperature value at the second position of the right ear canal. On the contrary, when the in-ear earphone is worn on the left ear, the first sensor is used to detect the temperature value at the second position of the left ear, and the second sensor is used to detect the temperature value at the first position of the left ear.

[0062] Therefore, when it is detected that the first temperature value is greater than the second temperature value, it is determined that the earphone is worn on the right ear, and when the first temperature value is less than the second temperature value, it is determined that the earphone is worn on the left ear.

[0063] In some embodiments, the first sensor and the second sensor are light sensors, the first detection value is a first amount of incoming light, and the second detection value is a second amount of incoming light.

[0064] The determining the wearing state of the first earphone and / or the second earphone based on the first detection value and the second detection value includes:

[0065] Under the pre-determined conditions,

[0066] When the first light input amount is less than the second light input amount, it is determined that the first earphone is in the right ear wearing state; when the first light input amount is greater than the second light input amount, it is determined that the first earphone is in the left ear wearing state;

[0067] When the first light input amount is less than the second light input amount, it is determined that the second earphone is in the right ear wearing state; when the first light input amount is greater than the second light input amount, it is determined that the second earphone is in the left ear wearing state.

[0068] The light sensor has the functions of self-luminescence and self-reception. The wearing status is judged according to the amount of light received. The light sensor can sense visible light signals or invisible light signals. Figure 1As shown, since the contact area of ​​the earphone at the first position of the ear is larger, the first position has a greater impact on light transmission, and the amount of light reflected by the first position into the light sensor is smaller. The contact area of ​​the earphone at the second position of the ear is smaller, and the second position has a smaller impact on light transmission, and the amount of light reflected by the second position into the light sensor is larger. At this time, when the in-ear earphone is worn on the right ear, the first sensor is used to detect the amount of light entering the first position of the right ear, and the second sensor is used to detect the amount of light entering the second position of the right ear canal. Conversely, when the in-ear earphone is worn on the left ear, the first sensor is used to detect the amount of light entering the second position of the left ear, and the second sensor is used to detect the amount of light entering the first position of the left ear.

[0069] In some embodiments, the predetermined condition includes any one of the following: the first earphone and the second earphone are in a communication disconnected state; the first earphone and the second earphone are in a communication connected state, and the first earphone or the second earphone is in an in-ear state; and the first earphone and the second earphone are in a communication connected state, and the first earphone and the second earphone are in an in-ear state.

[0070] That is to say, the earphone detection method provided in the embodiment of the present application can be implemented for a single earphone; it can also be implemented when the two earphones are in a communication connection state, only one earphone is in the in-ear state, or both earphones are in the in-ear state at the same time.

[0071] Further, in some embodiments, when the first earphone is performing wearing state detection, the first earphone serves as a receiving end, the first earphone and the second earphone are in a communication connection state, and the first earphone and the second earphone are in an in-ear state, such as Figure 3 As shown, the method also includes:

[0072] Step 301: The first earphone receives second detection information sent by the second earphone;

[0073] In some embodiments, the method further includes: within a preset time period, the first earphone does not receive second detection information sent by the second earphone, and the first earphone determines that the first earphone is in a left ear wearing state or a right ear wearing state based on the first detection information.

[0074] That is to say, if the first earphone times out in receiving the second detection information, the first earphone does not need to refer to the detection information of the second earphone for judgment, and can directly determine the current wearing state according to the first detection information.

[0075] Step 302: when the first detection information of the first headset is consistent with the second detection information, it is determined that the first detection information is wrong;

[0076] The detection information (including the first detection information and the second detection information) may be a left earphone wearing state or a right ear wearing state.

[0077] In some embodiments, when it is determined that the detection information is wrong (here, the first detection information is wrong), the method further includes: re-executing the wireless in-ear headset detection method; or generating and outputting a prompt message of the detection error.

[0078] That is, if the first detection information and the second detection information are consistent, it means that two earphones are worn on one ear, and there must be an earphone detection error, then a prompt message (such as a beeping sound or an abnormal light signal) can be generated to prompt the user to manually find the problem. Or a re-detection instruction can be generated to control the first earphone and the second earphone to re-execute the detection operation.

[0079] Step 303: When the first detection information of the first earphone itself is consistent with the second detection information, it is determined that the first detection information is correct.

[0080] That is to say, if both earphones are worn, they can verify each other based on their respective detection information to improve the accuracy of the detection.

[0081] When the second earphone is performing wearing state detection, the second earphone serves as a receiving end, the first earphone and the second earphone are in a communication connection state, and the first earphone and the second earphone are in an in-ear state, such as Figure 4 As shown, the method also includes:

[0082] Step 401: The second earphone receives first detection information sent by the first earphone;

[0083] In some embodiments, the method further includes: within a preset time period, the second earphone does not receive the first detection information sent by the first earphone, and the second earphone determines that the second earphone is in the left ear wearing state or the right ear wearing state based on the second detection information.

[0084] That is to say, if the second earphone times out in receiving the first detection information, the second earphone also does not need to refer to the detection information of the first earphone for judgment, and can directly determine the current wearing state according to the second detection information.

[0085] Step 402: when the second detection information of the second headset is consistent with the first detection information, it is determined that the second detection information is wrong;

[0086] In some embodiments, when it is determined that the detection information is wrong (here, the second detection information is wrong), the method further includes: re-executing the wireless in-ear headset detection method; or generating and outputting a prompt message of the detection error.

[0087] That is, if the first detection information and the second detection information are consistent, it means that two earphones are worn on one ear, and there must be an earphone detection error, then a prompt message (such as a beeping sound or an abnormal light signal) can be generated to prompt the user to manually find the problem. Or a re-detection instruction can be generated to control the first earphone and the second earphone to re-execute the detection operation.

[0088] Step 403: When the second detection information of the second earphone itself is inconsistent with the first detection information, determine that the second detection information is correct; wherein the detection information is the left earphone wearing state or the right ear wearing state.

[0089] In some embodiments, the detection information (including the first detection information and the second detection information) may also be a first detection value and a second detection value.

[0090] Correspondingly, the first earphone and the second earphone are in a communication connection state, and the first earphone and the second earphone are in an in-ear state, and the method further includes:

[0091] The first earphone receives second detection information sent by the second earphone;

[0092] When the wearing state represented by the first detection information is consistent with the wearing state represented by the second detection information, determining that the first detection information is wrong;

[0093] When the wearing state represented by the first detection information and the wearing state represented by the second detection information are inconsistent, it is determined that the first detection information is correct.

[0094] or,

[0095] The second earphone receives the first detection information sent by the first earphone;

[0096] When the wearing state represented by the first detection information is consistent with the wearing state represented by the second detection information, determining that the first detection information is wrong;

[0097] When the wearing state represented by the first detection information and the wearing state represented by the second detection information are inconsistent, it is determined that the first detection information is correct.

[0098] In some embodiments, the method further includes: when it is determined that the first detection information is correct, controlling the first earphone to operate in an earphone playback mode corresponding to its own wearing state; when it is determined that the second detection information is correct, controlling the second earphone to operate in an earphone playback mode corresponding to its own wearing state.

[0099] In this way, there is no need to fix the left and right earphones for in-ear headphones, and there is no need to fix the left and right earphones for wireless in-ear headphones. Instead, the wearing status of the left and right earphones is detected by the set sensors, so as to flexibly set the playback mode of the left and right earphones, avoid the application of playback effects due to user wearing errors, and improve the user experience of wireless headphones. In addition, the left and right earphones can be set to be exactly the same, which also saves design and production costs.

[0100] It should be noted that the first earphone and the second earphone are only used to distinguish the two earphones of the wireless earphone, and the first earphone can also be regarded as the second earphone, and the second earphone can also be regarded as the first earphone. The two earphones have the same or similar appearance.

[0101] Based on the above-mentioned wireless in-ear headphone detection method, the sensor is further illustrated by taking a pressure sensor as an example. Figure 5 FIG. 4 is a schematic diagram of a fourth process of the wireless in-ear headset detection method in an embodiment of the present application. Figure 5 As shown, the method includes:

[0102] Step 501: The earphone is in the ear-wearing state;

[0103] Step 502: Determine whether the two earphones are in a connected state. If not, execute step 503; if yes, execute step 504;

[0104] Step 503: the local earphone determines whether the local A pressure is greater than the B pressure; if yes, it is determined to be the right earphone; if no, it is determined to be the left earphone;

[0105] Here, if the local earphone is the first earphone, the opposite earphone is the second earphone; if the local earphone is the second earphone, the opposite earphone is the first earphone.

[0106] The A pressure is the first pressure value detected by the first pressure sensor, and the B pressure is the second pressure value detected by the second pressure sensor.

[0107] That is to say, if the two earphones are in a disconnected state, a single-ear detection method is used to identify the left and right earphones, without the need for the two earphones to transmit the detection results for mutual verification.

[0108] In some embodiments, if the two earphones are in a connected state, but one earphone is in the ear and the other earphone is not in the ear, there is no need for the two earphones to transmit the detection results to verify each other. In this state, it can also be understood that one earphone has timed out from receiving the detection signal of the other earphone.

[0109] Step 504: requesting to obtain a detection signal from the other end;

[0110] That is to say, if the two earphones are connected and both are in the ears, they can verify each other based on their respective detection results to improve the accuracy of the detection.

[0111] If the two earphones are connected but not worn, no left or right ear judgment is made.

[0112] Step 505: Determine whether the reception of the opposite end detection signal has timed out. If yes, execute step 503; if no, execute step 506;

[0113] Step 506: Determine whether the pressure at the other end B is greater than the pressure at A. If yes, execute step 507; if no, execute step 508;

[0114] Step 507: Determine whether the pressure of A on the local end is greater than the pressure of B. If so, determine that it is the right earphone; if not, the detection results conflict and do not make a left-right ear determination;

[0115] Step 508: Determine whether the pressure at the local end B is greater than the pressure at the local end A. If so, determine that it is the left earphone; if not, the detection results conflict and no left or right ear determination is performed.

[0116] With the above-mentioned left and right earphone automatic identification technology, there is no need to distinguish the left and right earphones in the structure and appearance of the earphones, and the earphone manufacturers do not need to distinguish the left and right earphones when producing. Two pressure values ​​can be collected by two pressure sensors set on the earphones, and the left and right earphones can be distinguished according to the size of the two pressure values, thereby ensuring the user's wearing experience and the earphone playback effect.

[0117] The present application also provides a wireless in-ear headset. Figure 6 As shown, the wireless in-ear headset includes a first sensor 601, a second sensor 602 and a processor 603;

[0118] The first earphone and the second earphone of the wireless in-ear earphone respectively include a first sensor 601 and a second sensor 602; wherein the tragus-side housings of the first earphone and the second earphone include the first sensor 601, and the housings of the first earphone and the second earphone on the opposite tragus side include the second sensor 602.

[0119] The first sensor 601 is used to collect a first detection value;

[0120] The second sensor 602 is used to collect a second detection value;

[0121] The processor 603 is configured to determine a wearing status of the first earphone and / or the second earphone based on the first detection value and the second detection value.

[0122] In some embodiments, the first sensor and the second sensor are pressure sensors, the first detection value is a first pressure value, and the second detection value is a second pressure value. The processor 603 is specifically used to determine, under predetermined conditions, that the first earphone is in the right ear wearing state when the first pressure value is greater than the second pressure value, and that the first earphone is in the left ear wearing state when the first pressure value is less than the second pressure value; and that the second earphone is in the right ear wearing state when the first pressure value is greater than the second pressure value.

[0123] In some embodiments, the first sensor and the second sensor are temperature sensors, the first detection value is a first temperature value, and the second detection value is a second temperature value.

[0124] The processor 603 is specifically used to, under predetermined conditions, determine that the first earphone is in the right ear wearing state when the first temperature value is greater than the second temperature value, and determine that the first earphone is in the left ear wearing state when the first temperature value is less than the second temperature value; determine that the second earphone is in the right ear wearing state when the first temperature value is greater than the second temperature value, and determine that the second earphone is in the left ear wearing state when the first temperature value is less than the second temperature value.

[0125] In some embodiments, the first sensor and the second sensor are light sensors, the first detection value is a first amount of incoming light, and the second detection value is a second amount of incoming light.

[0126] The processor 603 is specifically used to, under predetermined conditions, determine that the first earphone is in the right ear wearing state when the first light input amount is less than the second light input amount, and determine that the first earphone is in the left ear wearing state when the first light input amount is greater than the second light input amount; determine that the second earphone is in the right ear wearing state when the first light input amount is less than the second light input amount, and determine that the second earphone is in the left ear wearing state when the first light input amount is greater than the second light input amount.

[0127] In some embodiments, the predetermined condition includes any one of the following: the first earphone and the second earphone are in a communication disconnected state; the first earphone and the second earphone are in a communication connected state, and the first earphone or the second earphone is in an in-ear state; and the first earphone and the second earphone are in a communication connected state, and the first earphone and the second earphone are in an in-ear state.

[0128] In some embodiments, the first earphone and the second earphone are in a communication connection state, and the first earphone and the second earphone are in an in-ear state, and the processor is further used to control the first earphone to receive second detection information sent by the second earphone; when the first detection information of the first earphone itself and the second detection information are consistent, it is determined that the first detection information is wrong; when the first detection information of the first earphone itself and the second detection information are inconsistent, it is determined that the first detection information is correct; wherein the detection information is the left earphone wearing state or the right ear wearing state.

[0129] In some embodiments, the detection information (including the first detection information and the second detection information) may also be a first detection value and a second detection value.

[0130] Correspondingly, the first earphone and the second earphone are in a communication connection state, and the first earphone and the second earphone are in an in-ear state. The processor is also used to control the first earphone to receive the second detection information sent by the second earphone; when the wearing state represented by the first detection information is consistent with the wearing state represented by the second detection information, it is determined that the first detection information is wrong; when the wearing state represented by the first detection information is inconsistent with the wearing state represented by the second detection information, it is determined that the first detection information is correct.

[0131] or,

[0132] The processor is also used to control the second earphone to receive the first detection information sent by the first earphone; when the wearing state represented by the first detection information is consistent with the wearing state represented by the second detection information, it is determined that the first detection information is wrong; when the wearing state represented by the first detection information is inconsistent with the wearing state represented by the second detection information, it is determined that the first detection information is correct.

[0133] In some embodiments, the processor is further used to control the first earphone to determine whether the first earphone is in the left ear wearing state or the right ear wearing state based on the first detection information if the first earphone does not receive the second detection information sent by the second earphone within a preset time period.

[0134] In some embodiments, the first earphone and the second earphone are in a communication connection state, and the first earphone and the second earphone are in an in-ear state, and the processor is further used for the second earphone to receive first detection information sent by the first earphone; when the second detection information of the second earphone itself is consistent with the first detection information, it is determined that the second detection information is wrong; when the second detection information of the second earphone itself is inconsistent with the first detection information, it is determined that the second detection information is correct; wherein the detection information is the left earphone wearing state or the right ear wearing state.

[0135] In some embodiments, the processor 603 is further configured to, if the second earphone does not receive the first detection information sent by the first earphone within a preset time period, determine, based on the second detection information, that the second earphone is in the left ear wearing state or the right ear wearing state.

[0136] In some embodiments, the processor 603 is further configured to re-execute the wireless in-ear headset detection method when determining that the detection information is erroneous; or generate and output a prompt message of a detection error.

[0137] In some embodiments, the processor 603 is further used to turn on the corresponding sensor when detecting that the first earphone and / or the second earphone switches from a non-in-ear state to an in-ear state; and turn off the corresponding sensor after determining the wearing state of the first earphone and / or the second earphone.

[0138] It should be noted that the first earphone and the second earphone of the wireless in-ear earphone may both be provided with a processor to control the two earphones to implement the above-mentioned wireless in-ear earphone detection method. In other embodiments, the first earphone and the second earphone may include only one processor to control the two earphones to implement the above-mentioned wireless in-ear earphone detection method. The embodiments of the present application do not specifically limit other hardware structures and control methods of the earphones.

[0139] In practical applications, the wireless in-ear headset further includes a memory for storing a computer program, and the processor is configured to execute the steps of the wireless in-ear headset detection method in any of the aforementioned embodiments when running the computer program.

[0140] Of course, in actual application, the various components in the wireless headset are coupled together through a bus system. It can be understood that the bus system is used to achieve connection and communication between these components. In addition to the data bus, the bus system also includes a power bus, a control bus and a status signal bus.

[0141] The above-mentioned wireless in-ear headphones do not need to fix the left and right earphones, but instead detect the wearing status of the left and right earphones through the set sensors, so as to flexibly set the playback mode of the left and right earphones, avoid the playback effect due to the user's wearing error, and improve the user experience of the wireless headphones.

[0142] In an exemplary embodiment, the embodiment of the present application further provides a computer-readable storage medium, such as a memory including a computer program, and the computer program can be executed by a processor of the wireless in-ear headset to complete the steps of the aforementioned wireless in-ear headset detection method.

[0143] The present application also provides a wireless headset detection method. Figure 7As shown, the wireless headset includes: a first headset 71, a second headset 72 and a camera 73, wherein the camera 73 is mounted on an earmuff of the first headset 71 or the second headset 72 close to the face, and the optical axis of the camera 73 is biased toward the middle position of the face. Figure 7 The camera 73 is installed on the first earphone 71. The camera 73 can also be installed on the second earphone 72, and the installation position is the same as that of the first earphone 71. Figure 7 The positions in are symmetrical.

[0144] Based on the above wireless headset, the embodiment of the present application provides a wireless headset detection method. Figure 8 FIG. 1 is a schematic diagram of a first process of a wireless headset detection method in an embodiment of the present application. Figure 8 As shown, the method may specifically include:

[0145] Step 801: when the wireless headset is switched from a non-wearing state to a wearing state, a detection image is collected by the camera;

[0146] Step 802: performing image feature recognition on the detection image;

[0147] Step 803: Determine the wearing status of the first earphone and / or the second earphone based on whether the detected image contains facial image features.

[0148] The left and right earphones of the headset are symmetrically designed, and the appearance and structure of the left and right earphones are the same or similar. It is easy for users to wear the left and right earphones wrongly. Therefore, identifying the wearing status of the left and right earphones of the headset is a prerequisite for ensuring the audio effect of the headset.

[0149] In an embodiment of the present application, a camera is provided on the first earphone or the second earphone. When the earphone is worn in the forward direction, the camera can capture the face of the person, but when the earphone is worn in the reverse direction, the face of the person cannot be captured. Thus, by identifying whether the facial features are contained in the detection image, it can be determined whether the headset is in the forward wearing state or the reverse wearing state. In some embodiments, cameras can also be provided at symmetrical positions on the two earphones at the same time, and the detection method is the same. Here, if the detection accuracy of the wearing state is easily affected by external interference when one camera is used, two cameras can be provided to improve the detection accuracy and reduce the interference effect.

[0150] Here, in the forward wearing state, the first earphone is the right earphone, and the second earphone is the left earphone. In the reverse wearing state, the first earphone is the left earphone, and the second earphone is the right earphone.

[0151] In some embodiments, the method further includes: performing scene feature recognition on the detection image; when the detection image contains target scene features, determining a target scene mode corresponding to the target scene features; and controlling the wireless headset to operate in the target scene mode.

[0152] In some embodiments, the camera is a fisheye camera, and the camera can be a normal camera or a wide-angle camera.

[0153] In actual applications, the optical axis of the camera is biased toward the center of the headset to ensure that the detection image captured by the camera will include the user's head image (face or back of the head). By setting the camera's shooting angle, the detection image can also include the external environment image, and the current usage scene of the headset is determined based on the scene features in the environment image, thereby controlling the headset to work in a scene mode that matches the current scene.

[0154] Exemplarily, the scene modes include normal mode, outdoor mode, indoor mode, party mode, etc. By judging whether the detection scene contains corresponding scene features, the target usage scene in which the headset is currently located is judged, and the corresponding target scene mode is determined according to the mapping relationship between the usage scene and the scene mode.

[0155] In some embodiments, the deflection angle of the optical axis of the camera toward the middle of the face is greater than or equal to 30°.

[0156] In some embodiments, the method further includes: when the wireless headset switches from a non-wearing state to a wearing state, turning on the camera; after determining the wearing states of the first headset and the second headset, turning off the camera. That is, when the wireless headset switches from a non-wearing state to a wearing state, it indicates that the user performs a wearing operation on the headset, and a wearing state detection is required, and the camera is turned on; in other states, there is no need to perform a wearing detection, and the sensor can be turned off to reduce the power consumption of the headset.

[0157] In some embodiments, the method further includes: controlling the first earphone and the second earphone to work in an earphone playback mode corresponding to their own wearing state. Here, the earphone playback mode is a left ear playback mode or a right ear playback mode. For headphones, users can use two earphones at the same time, or use one earphone separately. There is no need to distinguish between left and right earphones. After the earphones are worn, they will automatically identify the ear where each earphone is worn based on whether the detected image contains facial features, thereby controlling the earphones to work in the earphone playback mode corresponding to their own wearing state, avoiding the playback effect affected by the user's wearing error, and improving the user's experience of using wireless headphones. In addition, the left and right earphones can be set to be exactly the same, which also saves design and production costs.

[0158] The following further illustrates the detection method when the camera is installed on different headphones.

[0159] In some embodiments, the camera is mounted on the first headset, and determining the wearing status of the first headset and / or the second headset based on whether the detected image contains a facial image feature includes:

[0160] The first earphone is a left earphone, and when the detected image contains a facial image feature, it is determined that the first earphone is in a left ear wearing state; and it is determined that the second earphone is in a right ear wearing state;

[0161] When the detected image does not include a facial image feature, it is determined that the first earphone is in a right ear wearing state; and it is determined that the second earphone is in a left ear wearing state.

[0162] In some embodiments, the camera is mounted on the second headset, and determining the wearing status of the first headset and / or the second headset based on whether the detected image contains a facial image feature includes:

[0163] The second earphone is a right earphone, and when the detected image contains a facial image feature, it is determined that the second earphone is in a right ear wearing state; and the first earphone is determined to be in a left ear wearing state;

[0164] When the detected image does not include a facial image feature, it is determined that the second earphone is in a left-ear wearing state; and it is determined that the first earphone is in a right-ear wearing state.

[0165] That is to say, when determining the wearing status of the first earphone and / or the second earphone based on whether the detection image contains facial image features, it is related to the installation position of the camera. When the earphone installed with the camera is the left earphone, if the detection image contains facial image features, the earphone where the camera is located is the left earphone, and the other earphone is the right earphone; if the detection image does not contain facial image features, the earphone where the camera is located is the right earphone, and the other earphone is the left earphone.

[0166] On the contrary, when the earphone installed with the camera is the right earphone, if the detected image contains facial image features, the earphone where the camera is located is the right earphone, and the other earphone is the left earphone; if the detected image does not contain facial image features, the earphone where the camera is located is the left earphone, and the other earphone is the right earphone.

[0167] In some embodiments, when cameras are installed on both left and right earphones, the left and right earphones that can detect facial image features are pre-defined, for example, the first earphone is the left earphone and the second earphone is the right earphone. In actual application, if at least one of the two detection images contains facial features, the left and right earphones are consistent with the pre-defined ones. If neither of the detection images contains the detection image, the left and right earphones are opposite to the pre-defined ones, that is, the first earphone is the right earphone and the second earphone is the left earphone.

[0168] By using the above wireless headset detection method, there is no need to distinguish between left and right headsets in terms of the structure and appearance of the headset, and the headset manufacturer does not need to distinguish between left and right headsets when producing. The camera can be used to detect the wearing status of the left and right headsets of the headset, and the correct headset playback mode can be set for the left and right headsets to ensure the headset playback effect.

[0169] Based on the above wireless headset detection method, an example is given in which the camera is installed on the first headset, and the first headset is the right headset. The wireless headset detection method is further described by an example. Fig. 9 FIG. 2 is a schematic diagram of a second process of the wireless headset detection method in an embodiment of the present application. Fig. 9 As shown, the method includes:

[0170] Step 901: Put on the earphones and confirm the left and right earphones;

[0171] Step 902: The camera is turned on to take a photo;

[0172] Step 903: determine whether the image contains facial image features; if yes, determine it is the right earphone; if no, determine it is the left earphone;

[0173] Here, when the facial image feature is included, it is determined that the first earphone is the right earphone, and the second earphone is the left earphone. If the facial image feature is not included, it is determined that the first earphone is the left earphone, and the second earphone is the right earphone.

[0174] In actual applications, a neural network processor (Neural Processing Unit, NPU) is set inside the headset, and the NPU recognizes whether the image contains facial features.

[0175] Step 904: Use scene recognition to adjust the sound effects.

[0176] Here, the NPU can also be used to identify the shooting scene in the image and adjust the sound effect according to the identified usage scene. For example, when the usage scene is identified as indoor, it is adjusted to indoor mode; when the usage scene is outdoor, it is adjusted to outdoor mode; when the usage scene is a sports scene, it is adjusted to sports mode; when the usage scene cannot be determined, it can work in normal mode.

[0177] Headphones use AI technology to install fisheye cameras on one or both sides of the headphones (for example, the optical center of the camera is 30° inward) to take pictures of faces. The headphones need to detect the left and right headphones. If the face can be recognized, it is considered to be the right headphone, otherwise it is considered to be the left headphone, and the left and right headphones are controlled to work in the left and right ear playback mode respectively. And the sound playback effect can be dynamically adjusted according to the current usage scenario.

[0178] The present application also provides a wireless headset, such as Fig.10 As shown, the wireless headset 100 includes a camera 1001 and a processor 1002, wherein the camera is mounted on an earmuff of a first earphone or a second earphone of the wireless headset close to the face, and the optical axis of the camera is biased toward the middle position of the face.

[0179] The camera 1001 is used to collect detection images when the wireless headset is switched from a non-wearing state to a wearing state;

[0180] The processor 1002 is used to perform image feature recognition on the detection image; and determine the wearing status of the first earphone and the second earphone based on whether the detection image contains facial image features.

[0181] In some embodiments, the camera is installed on the first earphone, and the first earphone is a left earphone, and the processor 1002 is specifically used to determine that the first earphone is worn on the left ear when the detection image contains facial image features; determine that the second earphone is worn on the right ear; when the detection image does not contain facial image features, determine that the first earphone is worn on the right ear; and determine that the second earphone is worn on the left ear.

[0182] In some embodiments, the camera is installed on the second earphone, and the second earphone is a right earphone, and the processor 1002 is specifically used to determine that the second earphone is worn on the right ear when the detection image contains facial image features; determine that the first earphone is worn on the left ear; when the detection image does not contain facial image features, determine that the second earphone is worn on the left ear; and determine that the first earphone is worn on the right ear.

[0183] In some embodiments, the deflection angle of the optical axis of the camera toward the middle of the face is greater than or equal to 30°.

[0184] In some embodiments, the processor 1002 is further configured to turn on the camera when the wireless headset is switched from a non-wearing state to a wearing state; and turn off the camera after determining the wearing state of the first headset and the second headset.

[0185] In some embodiments, the processor 1002 is further used to perform scene feature recognition on the detection image; when the detection image contains target scene features, determine the target scene mode corresponding to the target scene features; and control the wireless headset to operate in the target scene mode.

[0186] It should be noted that the wearable headset may include only one processor for controlling the audio playback units of the two headsets to output audio, or each headset may be provided with a processor for controlling the audio playback units of the respective headsets to output audio. The embodiments of the present application do not specifically limit other hardware structures and control methods of the headset.

[0187] In practical applications, the wireless headset further includes a memory for storing a computer program, and the processor is configured to execute the steps of the wireless headset detection method in any of the above embodiments when running the computer program.

[0188] Of course, in actual application, the various components in the wireless headset are coupled together through a bus system. It can be understood that the bus system is used to achieve connection and communication between these components. In addition to the data bus, the bus system also includes a power bus, a control bus and a status signal bus.

[0189] The wireless headset does not need to distinguish between left and right earphones in terms of structure and appearance, and the headset manufacturer does not need to distinguish between left and right earphones when producing. The camera can be used to detect the wearing status of the left and right earphones of the headset, and the correct headset playback mode can be set for the left and right earphones to ensure the headset playback effect.

[0190] In an exemplary embodiment, the present application also provides a computer-readable storage medium, such as a memory including a computer program, and the computer program can be executed by a processor of a wireless headset to complete the steps of the aforementioned wireless headset detection method.

[0191] In practical applications, the processor may be at least one of an application-specific integrated circuit (ASIC), a digital signal processing device (DSPD), a programmable logic device (PLD), a field-programmable gate array (FPGA), a controller, a microcontroller, and a microprocessor. It is understandable that for different devices, the electronic device used to implement the functions of the processor may also be other, and the embodiments of the present application do not specifically limit this.

[0192] The above-mentioned memory can be a volatile memory (volatile memory), such as a random access memory (RAM); or a non-volatile memory (non-volatile memory), such as a read-only memory (ROM), a flash memory, a hard disk (HDD) or a solid-state drive (SSD); or a combination of the above-mentioned types of memory, and provide instructions and data to the processor.

[0193] It should be understood that the terms used in the present application are only for the purpose of describing specific embodiments, but are not intended to limit the present application. The singular forms of "a", "said" and "the" used in the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used in this article refers to and includes any or all possible combinations of one or more associated listed items. The expressions "having", "may have", "include" and "include", or "may include" and "may include" in this application can be used to indicate the presence of corresponding features (e.g., elements such as numerical values, functions, operations or components), but the presence of additional features is not excluded.

[0194] It should be understood that although the terms first, second, third, etc. may be used in this application to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other and are not necessarily used to describe a specific order or sequence. For example, without departing from the scope of the present invention, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information.

[0195] The technical solutions described in the embodiments of the present application can be combined arbitrarily without conflict.

[0196] In the several embodiments provided in the present application, it should be understood that the disclosed methods, devices and equipment can be implemented in other ways. The embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0197] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0198] In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be a separate unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0199] The above description is only a specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application.

Claims

1. A wireless headset detection method, characterized in that: The wireless headset comprises a first headset, a second headset and a camera, wherein the camera is mounted on an earmuff of the first headset or the second headset close to the face, and an optical axis of the camera is biased toward the middle position of the face, and the method comprises: When the wireless headset is switched from a non-wearing state to a wearing state, collecting a detection image through the camera; Performing image feature recognition on the detection image; determining a wearing state of the first headset and / or the second headset based on whether the detected image contains a facial image feature; The camera is mounted on the first earphone, and determining the wearing state of the first earphone and / or the second earphone based on whether the detected image contains a facial image feature includes: The first earphone is a left earphone, and when the detected image contains a facial image feature, it is determined that the first earphone is in a left ear wearing state; and it is determined that the second earphone is in a right ear wearing state; When the detected image does not contain a facial image feature, determining that the first earphone is in a right ear wearing state; and determining that the second earphone is in a left ear wearing state; And / or, the camera is installed on the second earphone, and determining the wearing state of the first earphone and / or the second earphone based on whether the detected image contains a facial image feature includes: The second earphone is a right earphone, and when the detected image contains a facial image feature, it is determined that the second earphone is in a right ear wearing state; and the first earphone is determined to be in a left ear wearing state; When the detected image does not include a facial image feature, it is determined that the second earphone is in a left-ear wearing state; and it is determined that the first earphone is in a right-ear wearing state.

2. The method according to claim 1, characterized in that The deflection angle of the optical axis of the camera toward the middle position of the face is greater than or equal to 30°.

3. The method according to claim 1, characterized in that The method further comprises: When the wireless headset is switched from a non-wearing state to a wearing state, turning on the camera; After determining the wearing status of the first earphone and the second earphone, turning off the camera.

4. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: Performing scene feature recognition on the detection image; When the detected image contains a target scene feature, determining a target scene mode corresponding to the target scene feature; The wireless headset is controlled to operate in the target scene mode.

5. A wireless headset, characterized in that: The wireless headset comprises: a camera and a processor, wherein the camera is mounted on an earmuff of a first earphone or a second earphone of the wireless headset close to the face, and an optical axis of the camera is biased toward the middle position of the face, The camera is used to collect detection images when the wireless headset is switched from a non-wearing state to a wearing state; The processor is configured to perform image feature recognition on the detection image; and determine the wearing status of the first earphone and the second earphone based on whether the detection image contains facial image features; The camera is installed on the first earphone, and the first earphone is a left earphone, and the processor is specifically used to determine that the first earphone is in a left ear wearing state when the detection image contains a facial image feature; determine that the second earphone is in a right ear wearing state; when the detection image does not contain a facial image feature, determine that the first earphone is in a right ear wearing state; determine that the second earphone is in a left ear wearing state; And / or, the camera is installed on the second earphone, and the second earphone is a right earphone, and the processor is specifically used to determine that the second earphone is worn on the right ear when the detection image contains facial image features; determine that the first earphone is worn on the left ear; when the detection image does not contain facial image features, determine that the second earphone is worn on the left ear; determine that the first earphone is worn on the right ear.

6. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 4 are implemented.

Citation Information

Patent Citations

  • Adaptive earphone sound channel switching method and device, and earphone

    CN107249150A

  • Earbuds with biometric sensing

    CN107852540A

  • Symmetric earphone device

    CN110536196A

  • Earphone, earphone control method and electronic equipment

    CN110891217A

  • Audio playing mode switching method and device and head-mounted equipment

    CN111930341A