Earphone control method, device and computer readable storage medium

Abstract

The application discloses an earphone control method and device and a computer readable storage medium. The method is applied to a head-mounted device. The method comprises the following steps: acquiring earphone control information, wherein the earphone control information comprises gesture control information obtained by identifying an image acquired by a camera in the head-mounted device, and / or control information triggered by pressing a key in a handle device for the earphone device, and the handle device is in communication connection with the head-mounted device; and sending the earphone control information to the earphone device in communication connection with the head-mounted device, so that the earphone device performs corresponding operations according to the earphone control information. The application controls the earphone device to perform corresponding operations by using the camera in the head-mounted device or the handle device, realizes corresponding functions, improves the convenience and accuracy of the user operation on the earphone, and enriches the human-computer interaction experience of the user.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of earphones, and in particular to an earphone control method, device and computer readable storage medium. BACKGROUND

[0002] With the development and maturity of wireless earphone technology, the functions of wireless earphones are becoming more and more rich, and the use is also becoming more and more extensive, and the functional requirements and experience requirements of users for wireless earphones are also becoming higher and higher. At present, the earphone human-computer interaction function is mostly through using a touch sensing area or a physical button on the earphone, and the user interacts by touching or pressing the button. Limited by the shape and volume of the earphone, only simple single click / double click / long press operations can be defined, resulting in relatively complex user operation. SUMMARY

[0003] The main purpose of the present application is to provide an earphone control method, device and computer readable storage medium, aiming at solving the technical problem that the current wireless earphone performs human-computer interaction by setting a touch sensing area or a physical button, resulting in complex user operation.

[0004] To achieve the above-mentioned purpose, the present application provides an earphone control method, which is applied to a head-mounted device, and the earphone control method comprises the following steps:

[0005] obtaining earphone control information, wherein the earphone control information comprises gesture control information obtained by recognizing an image acquired by a camera in the head-mounted device, and / or control information triggered by a key in a handle device for an earphone device, the handle device being in communication connection with the head-mounted device;

[0006] sending the earphone control information to an earphone device in communication connection with the head-mounted device, so that the earphone device performs an operation corresponding to the earphone control information.

[0007] Optionally, the step of obtaining earphone control information comprises:

[0008] recognizing the image acquired by the camera to obtain a recognition result, wherein the recognition result is used to represent whether the image contains a control gesture of a preset type;

[0009] when the recognition result is that the image contains the control gesture of the preset type, generating gesture control information corresponding to the control gesture of the preset type.

[0010] Optionally, the step of recognizing the image acquired by the camera to obtain a recognition result comprises:

[0011] recognizing a skin area in the image acquired by the camera;

[0012] binarize the skin region and the region outside the skin region in the image to obtain a binarization result of the image;

[0013] input the binarization result of the image into a gesture recognition model to obtain a recognition result of the image, wherein the gesture recognition model is obtained by training using training samples in advance.

[0014] Optionally, before the step of obtaining the earphone control information, the method further comprises:

[0015] when receiving the information prompt sent by the earphone device, starting the handle control earphone mode;

[0016] the step of obtaining the earphone control information comprises:

[0017] when detecting, in the handle control earphone mode, the control information triggered by operating the keys in the handle device, generating the control information for the earphone device according to the triggered control information.

[0018] Optionally, when the information prompt is a prompt instructing the user to input text in the user terminal, before the step of obtaining the earphone control information, the method further comprises:

[0019] when receiving the information prompt sent by the earphone device, displaying, through the display screen of the head-mounted device, a preset text input window and prompt content corresponding to the information prompt;

[0020] the step of, when detecting, in the handle control earphone mode, the control information triggered by operating the keys in the handle device, generating the control information for the earphone device according to the triggered control information comprises:

[0021] when detecting, in the handle control earphone mode, target text input in the text input window by operating the keys in the handle device, taking the target text as the control information for the earphone device, so that the earphone device, after receiving the target text, performs an operation of sending the target text to the user terminal.

[0022] To achieve the above object, the application further provides an earphone control method applied to an earphone device, the earphone control method comprising the following steps:

[0023] receive earphone control information, wherein the earphone control information comprises gesture control information obtained by a head-mounted device in communication connection with the earphone device through identification of an image obtained by a camera, and / or control information for the earphone device triggered by operation of a key in a handle device in communication connection with the head-mounted device;

[0024] perform an operation corresponding to the earphone control information.

[0025] Optionally, when the earphone control information comprises the gesture control information, the step of performing an operation corresponding to the earphone control information comprises:

[0026] extracting a target gesture type in the gesture control information;

[0027] determining a target operation type corresponding to the target gesture type according to a preset mapping relationship between gesture types and operation types, and performing an operation of the target operation type.

[0028] Optionally, before the step of receiving earphone control information, the earphone control method further comprises:

[0029] when receiving an information prompt sent by a user terminal, forwarding the information prompt to the head-mounted device, so that the head-mounted device starts the camera to obtain an image or starts a handle control earphone mode, and when detecting control information triggered by operation of a key in the handle device in the handle control earphone mode, determining the triggered control information as control information for the earphone device.

[0030] To achieve the above object, the present application further provides an earphone control method applied to a handle device, the earphone control method comprising the following steps:

[0031] when detecting control information triggered by operation of a key in the handle device, generating earphone control information for an earphone device according to the control information;

[0032] sending the earphone control information to the earphone device, or forwarding the earphone control information to the earphone device through a head-mounted device in communication connection with the handle device, so that the earphone device performs an operation corresponding to the earphone control information.

[0033] To achieve the above object, the present application further provides an earphone control device, which comprises a memory, a processor and an earphone control program stored in the memory and executable on the processor, and the earphone control program realizes the steps of the earphone control method as above when executed by the processor.

[0034] In addition, to achieve the above object, the application further provides a computer readable storage medium, wherein the computer readable storage medium stores an earphone control program, and the earphone control program realizes the steps of the earphone control method when executed by a processor.

[0035] In the application, the earphone control information is acquired by the head-mounted device, the earphone control information comprises gesture control information obtained by recognizing an image acquired by a camera in the head-mounted device, and / or control information for the earphone device triggered by pressing a key in a handle device in communication connection with the head-mounted device, the earphone control information is sent to the earphone device in communication connection with the head-mounted device, so that the earphone device performs an operation corresponding to the earphone control information, the human-computer interaction of the earphone device is linked to the head-mounted device, the camera or the handle device of the head-mounted device is used to control the earphone device to perform a corresponding operation, a corresponding function is realized, and the convenience and accuracy of the user in operating the earphone are improved, and the human-computer interaction experience of the user is also enriched. BRIEF DESCRIPTION OF DRAWINGS

[0036] Figure 1 A flowchart of an earphone control method according to a first embodiment of the application is shown in FIG. 1.

[0037] Figure 2 A flowchart of an earphone control method according to a third embodiment of the application is shown in FIG. 3.

[0038] The implementation, functional features and advantages of the application will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION

[0039] It should be understood that the specific embodiments described herein merely serve to explain the application and do not limit the application.

[0040] Reference Figure 1 , Figure 1 A flowchart of an earphone control method according to a first embodiment of the application is shown in FIG. 1.

[0041] The embodiments of the earphone control method provided by the application are described in the present embodiment, and it should be noted that although the logical order is shown in the flowchart, in some cases, the steps shown or described herein can be executed in an order different from that shown herein. In the present embodiment, the earphone control method is applied to a head-mounted device, which can be a device with a display device, such as a VR device, an AR device, etc., for the user to wear on the head. In the present embodiment, the earphone control method comprises:

[0042] In step S10, the earphone control information is acquired, where the earphone control information includes gesture control information obtained by recognizing an image acquired by a camera in the head-mounted device, and / or control information for the earphone device triggered by a key in an operation handle device, which is in communication connection with the head-mounted device.

[0043] The earphone device can be in communication connection with the user terminal and the head-mounted device through a Bluetooth multi-point connection function. The user terminal can be a smart phone, a personal computer, or other user terminal device. The Bluetooth multi-point connection function is a function configured in the earphone device to establish a Bluetooth communication connection with multiple devices. This function can be implemented based on the Bluetooth multi-point connection technology, which is not described in this embodiment. In an implementation, the earphone device can use different Bluetooth links to connect with the user terminal and the head-mounted device, for example, based on an SPP (Serial Port Profile) link to connect with the user terminal and a BLE (Bluetooh Low Energy) link to connect with the head-mounted device.

[0044] In this embodiment, the human-computer interaction of the earphone device can be linked with the head-mounted device, and the camera or the handle device of the head-mounted device can be used to control the earphone device to perform corresponding operations and realize corresponding functions, so as to improve the convenience and accuracy of the user's operation of the earphone and enrich the user's human-computer interaction experience.

[0045] Specifically, the head-mounted device can acquire control information for the earphone (hereinafter referred to as earphone control information for the sake of distinction). The earphone control information can include gesture control information obtained by the head-mounted device by recognizing an image acquired by a camera in the head-mounted device, and / or control information for the earphone device triggered by a key in an operation handle device. In a specific implementation, the camera provided in the head-mounted device can be used for other functions in the head-mounted device in addition to obtaining gesture control information, such as face recognition function, auxiliary motion tracking function, or external environment viewing function, etc. The gesture control information can be the type of user gesture (or gesture ID) obtained by recognizing the image, or can be the operation type in the earphone device corresponding to the recognized user gesture, which is not limited in this embodiment.

[0046] In the specific embodiment, the head-mounted device can be provided with a gesture control earphone mode. When entering the gesture control earphone mode, the operation of identifying the image obtained by the camera to obtain gesture control information is performed. When not entering the gesture control earphone mode, it is determined whether to turn on the camera according to the opening and closing of other functions, and the operation performed on the image obtained by the camera is determined, for example, when the face recognition function is turned on, the camera is turned on to obtain the image, and the face recognition is performed on the image to obtain the face recognition result. The head-mounted device enters the gesture control earphone mode in various ways, which are not limited here, for example, it can be triggered by voice, or triggered by pressing the physical button provided in the head-mounted device, or triggered when receiving the information prompt sent by the earphone device, and the like.

[0047] The handle device is in communication connection with the head-mounted device. When the handle device detects that the button is pressed, control information is generated and sent to the head-mounted device. The control information can specifically include the pressed button ID or the combination of button IDs, etc. The head-mounted device generates control information for the earphone device according to the control information received from the handle device. The buttons provided in the handle device can be touch buttons or physical pressing buttons, which are not limited in this embodiment. After receiving the control information sent by the handle device, the head-mounted device can generate control information for the earphone device according to the control information. In the specific embodiment, after receiving the control information sent by the handle device, the head-mounted device can directly use the control information as the control information for the earphone device, or can convert the control information into the corresponding operation type of the earphone device, or can generate control information for the earphone according to the operation result after performing the corresponding operation of the head-mounted device according to the control information.

[0048] In the specific embodiment, the head-mounted device can be provided with a handle control earphone mode. When entering the handle control earphone mode, the control information for the earphone device is generated according to the control information sent by the handle device. When not entering the handle control earphone mode, the control information sent by the handle device is identified as control information for the head-mounted device itself. The head-mounted device enters the handle control earphone mode in various ways.

[0049] In the specific embodiments, the gesture control earphone mode and the handle control earphone mode can be triggered simultaneously based on the same trigger mode, or different trigger modes can be defined to realize independent triggering. When the gesture control earphone mode and the handle control earphone mode are started simultaneously, the head-mounted device can obtain earphone control information through the image obtained by the recognition camera, or through the handle device. Further, in an embodiment, if the head-mounted device obtains earphone control information through the image obtained by the recognition camera and through the handle device within a short period of time (the time length can be defined according to the needs), and the operation types of the earphone devices corresponding to the two earphone control information belong to the conflict type, only one of the earphone control information can be sent to the earphone device, for example, the earphone control information obtained first is sent to the earphone device; wherein the conflict type can be set in advance, for example, the operation types of the hang-up operation and the call operation belong to the conflict type.

[0050] Step S20, sending the earphone control information to the earphone device in communication connection with the head-mounted device, so that the earphone device performs the operation corresponding to the earphone control information.

[0051] After the head-mounted device obtains the earphone control information, the earphone control information is sent to the earphone device. After the earphone device receives the earphone control information, the operation corresponding to the earphone control information is performed, for example, the active noise reduction mode is started, the volume is increased, the music is played, and the like. Different operations corresponding to different earphone control information in the earphone device can be defined in advance.

[0052] In an embodiment, when the earphone control information is the operation type in the earphone device, the earphone performs the operation of this type. In another embodiment, when the earphone control information is the gesture type obtained by recognizing the image obtained by the camera, the earphone device performs the operation associated with the gesture type. In another embodiment, when the earphone control information is the key ID or the combination of key IDs of the handle device operated by the user, the operation associated with the key ID or the combination of key IDs is performed.

[0053] In the embodiment, the headset control information is acquired by the head-mounted device, the headset control information includes gesture control information obtained by recognizing an image acquired by a camera in the head-mounted device, and / or control information for the headset device triggered by operating a key in a handle device in communication connection with the head-mounted device, the headset control information is sent to the headset device in communication connection with the head-mounted device, so that the headset device performs corresponding operations according to the headset control information, the human-computer interaction of the headset device is linked to the head-mounted device, the headset device is controlled to perform corresponding operations by using the camera in the head-mounted device or the handle device, corresponding functions are realized, and the convenience and accuracy of user operation of the headset are improved, and the human-computer interaction experience of the user is also enriched.

[0054] Further, in an embodiment, the step S10 comprises:

[0055] In step S101, an image acquired by the camera is recognized to obtain a recognition result, wherein the recognition result is used to represent whether the image contains a control gesture of a preset type.

[0056] The head-mounted device can acquire an image (hereinafter referred to as a target image) by the camera, and recognize the target image to obtain a recognition result used to represent whether the target image contains a control gesture of a preset type. The preset type can be one or more, which can be set in advance in the head-mounted device, and the control gesture is a gesture made by a user by fingers, for example, an "OK" gesture. In the embodiment, there are many methods for recognizing the target image to obtain the recognition result, for example, the image can be recognized based on a pre-trained image recognition model, or the image similarity calculation method can be used. In an embodiment, the image similarity calculation method can specifically be that an image containing a control gesture of a preset type is set in the head-mounted device, the similarity between the target image and the image containing the control gesture of the preset type is calculated, the calculated similarity is compared with a pre-set threshold value, when the similarity is greater than the threshold value, it is determined that the recognition result is that the target image contains the control gesture of the preset type, and when the similarity is less than or equal to the threshold value, it is determined that the recognition result is that the target image does not contain the control gesture of the preset type.

[0057] In step S102, when the recognition result is that the image contains the control gesture of the preset type, gesture control information corresponding to the control gesture of the preset type is generated.

[0058] When the recognition result indicates that the target image contains a preset type of control gesture, the head-mounted device can generate gesture control information corresponding to that preset type of control gesture. Specifically, the head-mounted device can directly use the preset type as the gesture control information; or, the head-mounted device can pre-set a mapping relationship between preset types and operation types in the headphone device, determine the operation type corresponding to the preset type of control gesture based on the mapping relationship, and use that operation type as the gesture control information.

[0059] It should be noted that when there are multiple preset categories, if the recognition result is that the target image contains any preset category of control gesture, gesture control information corresponding to the preset category of control gesture will be generated; if the recognition result is that the target image does not contain any preset category of control gesture, gesture control information will not be generated.

[0060] Further, in one embodiment, step S101 includes:

[0061] Step S1011: Identify skin regions in the image acquired by the camera device;

[0062] This embodiment proposes a method for identifying a target image to obtain a recognition result. Specifically, the head-mounted device can first identify the skin region in the target image. There are many methods for identifying skin regions, and this embodiment is not limited to any particular method; for example, image semantic segmentation methods can be used.

[0063] Step S1012: Binarize the skin region and the region outside the skin region in the image to obtain the binarization result of the image;

[0064] After identifying the skin region, binarization processing is performed on the skin region and the region outside the skin region in the target image to obtain the binarized result of the target image. The binarization process assigns a first value to pixels within the skin region and a second value to pixels outside the skin region. The resulting binarized image can also be viewed as an image, but the values ​​of each pixel in this image are either the first or the second value. The first and second values ​​are two different values, and their specific values ​​are not limited in this embodiment.

[0065] Step S1013: Input the binarization result of the image into the gesture recognition model for recognition to obtain the recognition result of the image, wherein the gesture recognition model is trained in advance using training samples.

[0066] The head-mounted device inputs the binarization result of the target image into a gesture recognition model to obtain a recognition result of the target image. A gesture recognition model can be pre-set in the head-mounted device to recognize whether the image contains a preset type of control gesture. The gesture recognition model can be pre-trained using training samples. In specific embodiments, the model structure of the gesture recognition model can be a neural network model, a convolutional neural network model, etc., which is not limited herein. A training sample can include an input data and a training label corresponding to the input data. The input data can be a binarization result obtained by binarizing an image according to the steps S1011 and S1021, and the training label can be a label representing whether the image contains a preset type of control gesture. The gesture recognition model can be trained using a supervised training method, which enables the gesture recognition model to learn how to recognize whether an image contains a preset type of control gesture based on the supervision of the training label.

[0067] Further, based on the first embodiment, a second embodiment of the earphone control method of the application is proposed. In this embodiment, before the step S10, the method further includes:

[0068] In step S30, when receiving the information prompt sent by the earphone device, the handle control earphone mode is started.

[0069] The earphone device can send the information prompt to the head-mounted device when receiving the information prompt sent by the user terminal. The information prompt is a prompt to the user, which can be a call information prompt, a short message information prompt, etc., which is not limited in this embodiment.

[0070] The head-mounted device can start the handle control earphone mode when receiving the information prompt. Alternatively, in other embodiments, the head-mounted device can start the gesture control earphone mode and the handle control earphone mode simultaneously, or only start the gesture control earphone mode when receiving the information prompt.

[0071] The step S10 includes:

[0072] In step S103, when detecting control information triggered by operating the keys in the handle device in the handle control earphone mode, control information for the earphone device is generated according to the triggered control information.

[0073] The handle device generates control information and sends it to the headset when detecting that the button is pressed. If the headset receives the control information sent by the handle device in the handle control mode, the headset generates control information for the earphone device according to the control information, that is, sends the control information to the earphone device, or converts the control information into an operation type in the earphone device and sends it to the earphone device, or executes a corresponding operation in the headset according to the control information and generates control information for the earphone device according to the operation result.

[0074] Further, in an embodiment, when the information prompt is a prompt indicating that the user inputs text in the user terminal, the step S10 further includes, before the step S10:

[0075] Step S40, when receiving the information prompt sent by the earphone device, displaying a preset text input window and prompt content corresponding to the information prompt on the display screen of the headset.

[0076] When the information prompt received by the headset from the earphone device is a prompt indicating that the user inputs text in the user terminal, the headset can also display a preset text input window and prompt content corresponding to the information prompt on the display screen of the headset while opening the handle control earphone mode. The information prompt indicating that the user inputs text in the user terminal can be predefined, for example, the short message information prompt can be defined as the information prompt indicating that the user inputs text in the user terminal, and the prompt content corresponding to the information prompt can be the content of the short message.

[0077] The step S103 includes:

[0078] Step S1031, when detecting that the target text input in the text input window by operating the button in the handle device in the handle control earphone mode, the target text is taken as control information for the earphone device, so that the earphone device receives the target text and executes the operation of sending the target text to the user terminal.

[0079] After the user sees the displayed text input window and prompt content in the display screen of the head-mounted device, the user can output text in the head-mounted device by operating the keys in the handle device. When the head-mounted device detects the text (hereinafter referred to as target text for the sake of distinction) output by the keys in the handle device in the text input window in the handle control earphone mode, the head-mounted device sends the target text as control information for the earphone device, i.e. sends the target text to the earphone device. After the earphone device receives the target text, the earphone device sends the target text to the user terminal. The user terminal takes the target text as user input text and performs corresponding operations, for example, sends the target text as a reply to the short message prompt information to the opposite party.

[0080] In the embodiment, when the head-mounted device receives the information prompt sent by the earphone device, the head-mounted device displays a preset text input window and prompt content corresponding to the information prompt in the display screen and starts the handle control earphone mode. When the head-mounted device detects the target text input by operating the keys in the handle device in the text input window in the handle control earphone mode, the head-mounted device takes the target text as control information for the earphone device. After the earphone device receives the target text, the earphone device performs the operation of sending the target text to the user terminal. The convenience and accuracy of the user operation of the earphone are improved, and the user's human-computer interaction experience is also enriched.

[0081] Further, based on the first and / or second embodiments, the third embodiment of the earphone control method of the present application is proposed. Referring to Figure 2 , Figure 2 The flowchart of the third embodiment of the earphone control method of the present application is shown in the figure. In the embodiment, the earphone control method is applied to the earphone device. The method comprises the following steps:

[0082] Step A10, receiving earphone control information, wherein the earphone control information comprises gesture control information obtained by the head-mounted device in communication connection with the earphone device by recognizing the image obtained by the camera device, and / or control information for the earphone device triggered by the keys in the handle device in communication connection with the head-mounted device;

[0083] Step A20, performing an operation corresponding to the earphone control information.

[0084] The specific embodiments of steps A10 and A20 can refer to the specific embodiments of steps S10 and S20 in the first embodiment described above, and will not be repeated here. In addition, it should be noted that the handle device can send the control information triggered by pressing the keys in the handle device to the headset, and the headset generates control information for the earphone device according to the control information and sends it to the earphone device, or the handle device can generate control information for the earphone device according to the control information triggered by pressing the keys in the handle device, and directly send it to the earphone device, that is, the handle device can establish a communication connection with the earphone device.

[0085] Further, in the case of sending control information directly to the earphone device, a handle control earphone mode can be set in the handle device; when the handle control earphone mode is turned on, the handle device can generate control information for the earphone device and send it to the earphone device when detecting the pressing operation of the keys; when the handle control earphone mode is turned off, the handle device can generate control information for the headset when detecting the pressing operation of the keys, and send it to the headset for the headset to perform corresponding operations according to the control information.

[0086] Further, in an embodiment, when the earphone control information includes the gesture control information, the step A20 includes:

[0087] Step A201, extracting the target gesture type in the gesture control information;

[0088] When the earphone control information includes the gesture control information, and the gesture control information includes the gesture type, the earphone device can extract the gesture type in the gesture control information (hereinafter referred to as the target gesture type for distinction).

[0089] Step A202, according to a preset mapping relationship between the gesture type and the operation type, determining a target operation type corresponding to the target gesture type, and performing an operation of the target operation type.

[0090] The earphone device can pre-set a mapping relationship between different gesture types and various operation types, for example, setting the "OK" gesture to correspond to the phone call operation. The earphone device determines the operation type corresponding to the target gesture type (hereinafter referred to as the target operation type for distinction) according to the mapping relationship, and performs an operation of the target operation type.

[0091] Further, in an embodiment, when the earphone control information is information containing a combination of the button ID in the handle and the button ID, the earphone device can extract the button ID or the combination of the button ID information from the earphone control information. The earphone device can be pre-configured with a mapping relationship between different button ID or combination of button ID information and various operation types, for example, setting the "confirm" button corresponding to the operation of answering the phone. The earphone device determines the operation type corresponding to the extracted button ID or combination of button ID information according to the mapping relationship, and performs the operation of the operation type.

[0092] Further, in an embodiment, before the step A10, the method further comprises:

[0093] Step A30, when receiving the information prompt sent by the user terminal, forwarding the information prompt to the head-mounted device, so that the head-mounted device opens the camera to obtain images or opens the handle control earphone mode, and when detecting the control information triggered by operating the button in the handle device in the handle control earphone mode, determining the triggered control information as the control information for the earphone device.

[0094] The specific implementation of step A30 can refer to the specific implementation of steps S30 and S103 described above, which will not be repeated here.

[0095] Further, based on the first, second and / or third embodiments described above, a fourth embodiment of the earphone control method of the application is proposed. In this embodiment, the earphone control method is applied to the handle device. The method comprises the following steps:

[0096] Step B10, when detecting the control information triggered by operating the button in the handle device, generating earphone control information for the earphone device according to the control information;

[0097] Step B20, sending the earphone control information to the earphone device, or forwarding the earphone control information to the earphone device through the head-mounted device in communication connection with the handle device, so that the earphone device performs the operation corresponding to the earphone control information.

[0098] The specific implementation of steps B10 and B20 can refer to the specific implementation of steps S10 and S20 in the first embodiment described above, and refer to the specific implementation of steps A10 and A20 in the third embodiment described above, which will not be repeated here.

[0099] In addition, the embodiment of the present application also provides an earphone control device, which can be a head-mounted device. In the embodiment, the head-mounted device can include a structural shell, a master control module, a memory and the like. The master control module can include a microprocessor, an audio decoding unit, a power supply and a power management unit, sensors and other active or passive devices required by the system (which can be replaced, reduced or increased according to actual functions), to realize the receiving and playing functions of wireless audio. The earphone control program can be stored in the memory of the head-mounted device, and the microprocessor can be used to call the earphone control program stored in the memory and perform the following operations:

[0100] obtaining earphone control information, wherein the earphone control information includes gesture control information obtained by identifying an image obtained by the camera in the head-mounted device, and / or control information triggered by pressing a key in the handle device, the handle device being in communication connection with the head-mounted device;

[0101] sending the earphone control information to an earphone device in communication connection with the head-mounted device, so that the earphone device performs an operation corresponding to the earphone control information.

[0102] Further, the operation of obtaining the earphone control information includes:

[0103] identifying the image obtained by the camera to obtain an identification result, wherein the identification result is used to represent whether the image contains a control gesture of a preset type;

[0104] when the identification result is that the image contains the control gesture of the preset type, generating gesture control information corresponding to the control gesture of the preset type.

[0105] Further, the operation of identifying the image obtained by the camera to obtain an identification result includes:

[0106] identifying a skin region in the image obtained by the camera;

[0107] performing a binaryzation processing on the skin region and a region outside the skin region in the image to obtain a binaryzation result of the image;

[0108] inputting the binaryzation result of the image into a gesture recognition model to obtain the identification result of the image, wherein the gesture recognition model is obtained by training a training sample in advance.

[0109] Further, before the operation of obtaining the earphone control information, the microprocessor can also be used to call the earphone control program stored in the memory and perform the following operations:

[0110] When receiving the information prompt sent by the earphone device, the handle control earphone mode is started;

[0111] The operation of obtaining earphone control information includes:

[0112] When detecting control information triggered by operating a key in the handle device in the handle control earphone mode, control information for the earphone device is generated according to the triggered control information.

[0113] Further, when the information prompt is a prompt instructing a user to input text in a user terminal, before the operation of obtaining earphone control information, the microprocessor can also be configured to invoke an earphone control program stored in the memory to perform the following operations:

[0114] When receiving the information prompt sent by the earphone device, a preset text input window and prompt content corresponding to the information prompt are displayed on a display screen of the head-mounted device;

[0115] The operation of generating control information for the earphone device according to the triggered control information when detecting control information triggered by operating a key in the handle device in the handle control earphone mode includes:

[0116] When detecting target text input in the text input window by operating a key in the handle device in the handle control earphone mode, the target text is taken as control information for the earphone device, so that the earphone device receives the target text and performs an operation of sending the target text to a user terminal.

[0117] In addition, the embodiment of the present application also provides an earphone control device. In the embodiment, the earphone control device can be an earphone device, which can include a structural shell, a master control module, a loudspeaker, a microphone, a memory, and the like. The master control module can include a microprocessor, an audio decoding unit, a power supply and a power management unit, sensors and other active or passive devices required by the system (which can be replaced, reduced or increased according to actual functions), to realize the functions of receiving and playing wireless audio. The memory of the earphone device can store an earphone control program, and the microprocessor can be configured to invoke the earphone control program stored in the memory and perform the following operations:

[0118] Receiving earphone control information, wherein the earphone control information includes gesture control information obtained by recognizing an image acquired by a camera by a head-mounted device in communication connection with the earphone device, and / or control information for the earphone device triggered by operating a key in a handle device in communication connection with the head-mounted device;

[0119] perform an operation corresponding to the earphone control information.

[0120] Further, when the earphone control information comprises the gesture control information, the operation of performing an operation corresponding to the earphone control information comprises:

[0121] extracting a target gesture type in the gesture control information;

[0122] determining a target operation type corresponding to the target gesture type according to a preset mapping relationship between gesture types and operation types, and performing an operation of the target operation type.

[0123] Further, before the operation of receiving earphone control information, the microprocessor can further be configured to invoke an earphone control program stored in the memory, and perform the following operations:

[0124] when receiving an information prompt sent by the user terminal, forwarding the information prompt to the head-mounted device, so that the head-mounted device starts the camera to acquire an image or starts a handle control earphone mode, and when detecting control information triggered by operating a key in the handle device in the handle control earphone mode, determining the triggered control information as earphone control information for the earphone device.

[0125] In addition, the embodiment of the present application also proposes an earphone control device, in the embodiment, the earphone control device can be a handle device, the handle device can include a structural shell, a master control module, a memory and the like. The master control module can include a microprocessor, a power supply and a power management unit, sensors and other active or passive devices required by the system (which can be replaced, reduced or increased according to actual functions). The memory of the handle device can store an earphone control program, and the microprocessor can be configured to invoke the earphone control program stored in the memory and perform the following operations:

[0126] when detecting control information triggered by operating a key in the handle device, generating earphone control information for the earphone device according to the control information;

[0127] sending the earphone control information to the earphone device, or forwarding the earphone control information to the earphone device through a head-mounted device in communication connection with the handle device, so that the earphone device performs an operation corresponding to the earphone control information.

[0128] In addition, the embodiment of the present application also proposes a computer readable storage medium, the storage medium stores an earphone control program, and the earphone control program is executed by a processor to realize the steps of the earphone control method as described above.

[0129] Embodiments of the earphone control device and the computer readable storage medium can refer to embodiments of the earphone control method, which will not be described herein.

[0130] It should be noted that, in this document, the terms "comprise", "comprising", or any other variant thereof are intended to cover a non-exclusive inclusion, such that processes, methods, articles, or apparatuses that comprise a list of elements are not limited to those elements, but can also include other elements not expressly listed or inherent to such processes, methods, articles, or apparatuses. Without further limitation, an element defined by the statement "comprising a" does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.

[0131] The above-mentioned embodiment numbers of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments.

[0132] From the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be realized by software and necessary general hardware platforms, and of course, they can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, or optical disk) and includes a plurality of instructions for making a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device) execute the methods described in the embodiments of the present application.

[0133] The above is only the preferred embodiment of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation, or direct or indirect application in other related technical fields based on the content of the specification and drawings of the present application, are also included in the patent protection scope of the present application.

Claims

1. A headphone control method, characterized in that, The headphone control method is applied to a head-mounted device, and the headphone control method includes the following steps: When a message prompt is received from the headset device, and the message prompt is an instruction for the user to input text on the user terminal, the gamepad control headset mode is activated, and a preset text input window and the prompt content corresponding to the message prompt are displayed on the display screen of the headset device. Acquire headphone control information, wherein the headphone control information includes control information for the headphone device triggered by buttons in the operating handle device, and the handle device is communicatively connected to the head-mounted device; The headphone control information is sent to the headphone device that is communicatively connected to the head-mounted device, so that the headphone device can perform operations corresponding to the headphone control information; The step of obtaining headphone control information includes: When the target text entered in the text input window by operating the buttons on the controller device is detected in the controller-controlled headset mode, the target text is used as control information for the headset device, so that after the headset device receives the target text, it can perform the operation of sending the target text to the user terminal.

2. A headphone control method, characterized in that, The headphone control method is applied to a headphone device, and the headphone control method includes the following steps: When a message prompt is received from a user terminal, the message prompt is forwarded to the head-mounted device so that the head-mounted device can activate the handle control headset mode and display a preset text input window and the prompt content corresponding to the message prompt on the display screen of the head-mounted device. When the target text entered in the text input window by operating the button in the handle device is detected in the handle control headset mode, the target text is determined as control information for the headset device. Receive headphone control information, wherein the headphone control information includes control information for the headphone device triggered by buttons in the operating handle device, the handle device being communicatively connected to the head-mounted device, and the head-mounted device being communicatively connected to the headphone device; Perform an operation corresponding to the headphone control information, wherein when the headphone control information includes the target text, the operation includes sending the target text to the user terminal.

3. A headphone control method, characterized in that, The headphone control method is applied to the handle device, and the headphone control method includes the following steps: When target text is detected in the gamepad-controlled headset mode by operating the buttons on the gamepad device in a preset text input window, the target text is used as control information for the headset device. The headphone control information is sent to the headphone device, or the head-mounted device that is communicatively connected to the handle device forwards the headphone control information to the headphone device, so that the headphone device can send the target text to the user terminal; The handle control mode is a control mode activated when the head-mounted device receives the information prompt sent by the headphone device, and the information prompt is a prompt instructing the user to perform text input on the user terminal. The text input window is an input window displayed on the screen of the head-mounted device in the handle control mode, and the screen of the head-mounted device also displays the prompt content corresponding to the information prompt.

4. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a headphone control program, which, when executed by a processor, implements the steps of the headphone control method as described in any one of claims 1 to 3.

Images