A control method, system, head-mounted device, and hand-mounted device

Abstract

The application provides a control method, system, head-mounted device and wearable device. In the scheme, the gesture recognition module is automatically controlled according to the position of the hand-mounted device relative to the head-mounted device, without the user actively issuing a control instruction for controlling the gesture recognition module to the head-mounted device, thereby reducing the operation amount of the user and improving the user experience satisfaction.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of wearable devices, in particular to a control method, system, head-mounted device and wearable device. BACKGROUND

[0002] At present, many head-mounted devices have gesture recognition modules that can recognize user gestures. The gesture recognition modules achieve control of the head-mounted devices by recognizing gestures made by the user. However, there is currently no method that can automatically control the gesture recognition modules. Generally, the functions related to the gesture recognition modules need to be controlled by the user. For example, when the user needs to turn on or turn off the gesture recognition module, the user needs to actively operate the head-mounted device to turn on or turn off the gesture recognition module. SUMMARY

[0003] The embodiments of the present application aim to provide a control method, system, head-mounted device and wearable device to solve the above technical problems.

[0004] To achieve the above-mentioned purpose, the technical solutions provided by the present application include:

[0005] In a first aspect, a control method is provided, comprising:

[0006] determining the position of a hand-mounted device relative to a head-mounted device; the head-mounted device comprising a gesture recognition module for gesture recognition;

[0007] controlling the gesture recognition module according to the position.

[0008] In the above-mentioned embodiments, the gesture recognition module is automatically controlled according to the position of the hand-mounted device relative to the head-mounted device, without the user actively issuing a control instruction to the head-mounted device for controlling the gesture recognition module, thereby reducing the amount of user operations and improving user experience satisfaction.

[0009] In combination with the first aspect, in some optional embodiments, the gesture recognition module comprises an image acquisition unit and an image recognition unit; the image acquisition unit is configured to acquire images and send the acquired images to the image recognition unit, and the image recognition unit is configured to perform gesture recognition according to the received images.

[0010] In the above-mentioned embodiments, the gesture recognition module performs gesture recognition by image analysis of the acquired images, thereby improving the recognition accuracy.

[0011] In combination with the first aspect, in some optional embodiments, the controlling the gesture recognition module according to the position comprises:

[0012] Control a working state of the gesture recognition module according to the position.

[0013] In the above embodiment, the working state of the gesture recognition module is automatically controlled according to the position of the hand-wearable device relative to the head-wearable device.

[0014] In combination with the first aspect, in some optional embodiments, the control of the working state of the gesture recognition module according to the position comprises:

[0015] When it is determined according to the position that the hand-wearable device is located within a first preset position range of the head-wearable device, the gesture recognition module is controlled to enter a normal working state;

[0016] When it is determined according to the position that the hand-wearable device is located outside the first preset position range, the gesture recognition module is controlled to enter a low-power-consumption state.

[0017] In the above embodiment, the gesture recognition module is switched between the normal working state and the low-power-consumption state (or the sleep state) according to the position of the hand-wearable device relative to the head-wearable device, which can reduce the power consumption of the head-wearable device.

[0018] In combination with the first aspect, in some optional embodiments, the control of the gesture recognition module according to the position comprises:

[0019] The image collection angle of the image collection unit is controlled according to the position.

[0020] In the above embodiment, the image collection angle of the image collection unit is controlled according to the position of the hand-wearable device relative to the head-wearable device, which is more convenient for the collection and recognition of gesture images, and can improve the efficiency of gesture recognition.

[0021] In combination with the first aspect, in some optional embodiments, the head-wearable device comprises a first wireless communication module and a second wireless communication module; and the hand-wearable device comprises a third wireless communication module.

[0022] The determination of the position of the hand-wearable device relative to the head-wearable device comprises:

[0023] The first wireless communication module and the second wireless communication module are controlled to respectively communicate with the third wireless communication module.

[0024] A first position region of the hand-wearable device relative to the head-wearable device is determined based on the communication between the first wireless communication module and the third wireless communication module, and the communication between the second wireless communication module and the third wireless communication module.

[0025] In the above embodiments, the positioning of the hand-held device is achieved through communication between the wireless communication module on the head-mounted device and the wireless communication module on the hand-held device.

[0026] In combination with the first aspect, in some optional embodiments, the determining of the first position region of the hand-held device relative to the head-mounted device based on the communication between the first wireless communication module and the third wireless communication module and the communication between the second wireless communication module and the third wireless communication module comprises:

[0027] The first distance between the first wireless communication module and the third wireless communication module and the second distance between the second wireless communication module and the third wireless communication module are determined by using the TOF method, and the first position region of the hand-held device relative to the head-mounted device is determined according to the first distance, the second distance and a preset third distance; the preset third distance is the distance between the first wireless communication module and the second wireless communication module.

[0028] and / or,

[0029] The first position region of the hand-held device relative to the head-mounted device is determined by using the carrier phase difference method.

[0030] In the above embodiments, the first position region of the hand-held device relative to the head-mounted device is determined by using the TOF method and / or the carrier phase difference method.

[0031] In combination with the first aspect, in some optional embodiments, the head-mounted device further comprises a fourth wireless communication module and a fifth wireless communication module, and the determining of the position of the hand-held device relative to the head-mounted device comprises:

[0032] The fourth wireless communication module and the fifth wireless communication module are controlled to respectively communicate with the third wireless communication module;

[0033] The second position region of the hand-held device relative to the head-mounted device is determined based on the communication between the fourth wireless communication module and the third wireless communication module and the communication between the fifth wireless communication module and the third wireless communication module;

[0034] The position point of the hand-held device relative to the head-mounted device is determined according to the first position region and the second position region.

[0035] In the above embodiments, through the two position regions, the position of the hand-held device is more accurately determined, and accurate positioning of the hand-held device is achieved.

[0036] With reference to the first aspect, in some optional embodiments, the method further includes:

[0037] When the image is acquired by the gesture recognition module and the target gesture is detected according to the image, it is determined whether the target gesture is a false gesture according to the position.

[0038] In the above embodiments, the position of the hand-worn device relative to the head-worn device is used to determine whether the recognized target gesture is a false gesture, which can reduce the interference of other users' hands and other interference objects on gesture recognition, and improve the accuracy of gesture recognition.

[0039] In a second aspect, the present application provides a head-worn device, including: a first processor, a first memory and a gesture recognition module;

[0040] The first memory stores a first computer program;

[0041] The first processor executes the first computer program to implement any of the above control methods.

[0042] In a third aspect, the present application provides a hand-worn device, including: a second processor and a second memory;

[0043] The second memory stores a second computer program;

[0044] The second processor executes the second computer program to implement any of the above control methods.

[0045] In a fourth aspect, the present application provides a control system, including:

[0046] The hand-worn device and any of the above head-worn devices;

[0047] Or,

[0048] The head-worn device and any of the above hand-worn devices; the head-worn device includes a gesture recognition module for gesture recognition. BRIEF DESCRIPTION OF DRAWINGS

[0049] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments of the present application. It should be understood that the following drawings only show some embodiments of the present application, and therefore should not be regarded as a limitation on the scope, and for those skilled in the art, other related drawings can also be obtained without creative labor.

[0050] Figure 1 Flowchart of the control method provided by the embodiments of the present application;

[0051] Figure 2 A schematic diagram of a principle for determining a first location area is provided for an embodiment of the present application.

[0052] Figure 3 A schematic diagram of a structure of a head-mounted device is provided for an embodiment of the present application.

[0053] Figure 4 A schematic diagram of a structure of a head-mounted device is provided for an embodiment of the present application.

[0054] Figure 5 A schematic diagram of a structure of a control system is provided for an embodiment of the present application. DETAILED DESCRIPTION

[0055] In order to make the objects, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and should not be used to limit the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of protection of the present application.

[0056] It should be noted that the terms "first", "second" and the like in the embodiments of the present application are only used for description purposes and should not be understood as indicating or implying relative importance or implicitly indicating the number of the technical features indicated. Therefore, the features with "first" and "second" can explicitly or implicitly include at least one of the features. In addition, the technical solutions of each embodiment can be combined with each other, but it must be based on the fact that those of ordinary skill in the art can realize it. When the combination of technical solutions appears contradictory or unachievable, it should be considered that the combination of technical solutions does not exist and is not within the scope of protection required by the present application.

[0057] In the description of the present application, it should be understood that the numerical reference before the step does not indicate the order of execution of the steps before and after the step, but is only used to facilitate the description of the present application and to distinguish each step, and therefore should not be understood as limiting the present application.

[0058] In the following, the technical solutions of the present application will be described in detail through specific embodiments.

[0059] It should be noted that the specific embodiments below can be combined with each other, and the same or similar concepts or processes can not be described again in some embodiments.

[0060] The wearable device in the embodiments of the present application refers to a device that can be directly worn on the user, including but not limited to a hand-mounted device and a head-mounted device.

[0061] The hand-worn device includes, but is not limited to, a smart watch, a smart bracelet, a smart ring, and a device integrated into a hand-worn garment. The head-worn device includes, but is not limited to, a smart glass, a smart helmet, and a device integrated into a head-worn garment.

[0062] The embodiment of the present application provides a control method, which can be applied to a head-worn device and a hand-worn device. Through the method, automatic control of a gesture recognition module in the head-worn device can be realized. The specific process of the method can be referred to Figure 1 , and includes the following steps.

[0063] S11: determining a position of a hand-worn device relative to a head-worn device; the head-worn device includes a gesture recognition module used for gesture recognition.

[0064] S12: controlling the gesture recognition module according to the position.

[0065] In the following, the specific process of the above steps is described in detail.

[0066] It should be noted that in step S11, the determined position of the hand-worn device relative to the head-worn device can be an accurate position point or a position region. Since the relative position between the hand wearing the hand-worn device and the hand-worn device is basically fixed, the position can represent the position of the hand wearing the hand-worn device relative to the head-worn device. That is, by determining the position of the hand-worn device relative to the head-worn device, the position of the hand wearing the hand-worn device relative to the head-worn device can be indirectly determined. Thus, the gesture recognition module of the head-worn device can be controlled according to the position.

[0067] For step S11, the position of the hand-worn device relative to the head-worn device can be determined through wireless communication.

[0068] In an optional embodiment, the head-worn device is provided with a first wireless communication module and a second wireless communication module, and the hand-worn device is provided with a third wireless communication module. The first wireless communication module and the second wireless communication module can be controlled to respectively communicate with the third wireless communication module, and then based on the communication between the first wireless communication module and the third wireless communication module and the communication between the second wireless communication module and the third wireless communication module, a first position region of the hand-worn device relative to the head-worn device is determined.

[0069] In the following, the specific manner of determining the first position region of the hand-worn device relative to the head-worn device is described.

[0070] In the first example, the TOF (Time of Flight) method can be used to determine the first distance between the first wireless communication module and the third wireless communication module, and the second distance between the second wireless communication module and the third wireless communication module, and determine the first position region of the hand-held device relative to the head-mounted device according to the first distance, the second distance and the preset third distance. In the three-dimensional space, when two points (the position point of the first wireless communication module and the position point of the second wireless communication module) are fixed and the lengths of three line segments are known, a plurality of third points (the position point of the hand-held device) meeting the condition can be determined. In this example, the region composed of the third points meeting the condition can be taken as the first position region.

[0071] For the convenience of understanding, the process of determining the first distance between the first wireless communication module and the third wireless communication module is described. In this example, the first wireless communication module can be controlled to send a pulse signal to the third wireless communication module at time Ta1, and receive the response signal returned by the third wireless communication module at time Ta2. The third wireless communication module receives the pulse signal sent by the first wireless communication module at time Tb1, and sends the response information to the first wireless communication module at time Tb2. At this time, the air transmission time T of the pulse signal between the first wireless communication module and the third wireless communication module can be calculated according to the formula Then, the first distance S between the first wireless communication module and the third wireless communication module can be calculated according to the formula S=C×T, where C is the speed of light.

[0072] It can be understood that the above is described by taking the first wireless communication module as an example to actively initiate communication with the third wireless communication module. This communication mode does not constitute a limitation on the communication mode between the first wireless communication module and the third wireless communication module. In other embodiments, the third wireless communication module can also actively initiate communication with the first wireless communication module.

[0073] The above describes the method of calculating the first distance. Referring to the same method described above, the second distance between the second wireless communication module and the third wireless communication module can be calculated, which is not described here.

[0074] The first wireless communication module and the second wireless communication module in the example can be integrated in different wireless communication devices respectively, for example, the first wireless communication module can be integrated in a first wireless communication device, and the second wireless communication module can be integrated in a second wireless communication device. At this time, the distance between the first wireless communication module and the second wireless communication module is equivalent to the distance between the first wireless communication device and the second wireless communication device. It should be noted that in the example, the third distance between the first wireless communication module and the second wireless communication module can be increased as much as possible, so as to increase the accuracy of the determined relative position. Therefore, for example, the first wireless communication device and the second wireless communication device can be arranged on the two sides of the head-mounted device. When the head-mounted device is smart glasses, the first wireless communication device and the second wireless communication device can be arranged on the left glasses and the right glasses of the smart glasses respectively.

[0075] The single channel bandwidth of UWB (Ultra Wide Band) is more than 500 MHz, and has high positioning accuracy, which can be accurate to centimeter level. Therefore, the first wireless communication device and the second wireless communication device can adopt UWB communication devices. Of course, in other embodiments, Bluetooth devices, WIFI devices, etc. can also be used.

[0076] In the second example, the carrier phase difference method can be used to determine the first position area of the hand-held device relative to the head-mounted device. Specifically, the wireless frame signals received by the first wireless communication module and the second wireless communication module can be cross-correlated, and the azimuth angle of the hand-held device relative to the head-mounted device is determined based on the phase difference of the correlation peak time. The area formed by the position points whose azimuth angles meet the requirements is taken as the first position area.

[0077] The way of determining the first position area of the hand-held device relative to the head-mounted device by using the carrier phase difference method will be described below.

[0078] Please refer to Figure 2As shown, assuming that point B is the position of the first wireless communication module, point C is the position of the second wireless communication module, and point A is the position of the third wireless communication module, the third wireless communication module can simultaneously send a wireless frame signal to the first wireless communication module and the second wireless communication module. According to the phase difference of the wireless frame signals received by the first wireless communication module and the second wireless communication module, the time delay of the first wireless communication module and the second wireless communication module in receiving the wireless frame signal can be determined. According to the time delay, the length difference between AB and AC can be determined. According to the length difference, a point D can be selected on the longer line segment (AB in the figure) of AC and AB, and the point D makes AD equal to AC. Since the length of BC is usually much smaller than the lengths of AC and AB, angle BDC can be a right angle. Since the length of BC is known and the length of BD can be determined, the angle ABC can be determined on this basis. The angle ABC is the azimuth angle of the hand-held device relative to the first wireless communication module. The angle ACB is the azimuth angle of the hand-held device relative to the second wireless communication module.

[0079] In this example, to improve the accuracy of the determined azimuth angle, the first communication module and the second communication module are exemplary arranged on the same side of the head-mounted device. At this time, the first wireless communication module and the second wireless communication module can be integrated in one communication device, that is, the first antenna and the second antenna can be arranged in one communication device, and the first antenna and the corresponding processing circuit are taken as the first wireless communication module, and the second antenna and the corresponding processing circuit are taken as the second wireless communication module.

[0080] In a third example, the first example and the second example described above can be combined, that is, a first position area can be determined by the first example described above, and another first position area can be determined by the second example described above, and then the intersection of the two first position areas is used to determine the accurate position of the hand-held device, thereby achieving accurate positioning of the hand-held device. In this example, the position of the hand-held device needs to be determined by combining the two methods described above. In order to make the first position area determined by the TOF method and the second position area determined by the carrier phase difference method both have high reliability, the positions of the first wireless communication module and the second wireless communication module need to be reasonably set.

[0081] In another optional embodiment, the head-mounted device can further be provided with a fourth wireless communication module and a fifth wireless communication module on the basis of the first wireless communication module and the second wireless communication module described above. At this time, for step S11, the following sub-steps can be further included:

[0082] The fourth wireless communication module and the fifth wireless communication module are controlled to respectively communicate with the third wireless communication module.

[0083] A second position region of the hand-held device relative to the head-mounted device is determined based on the communication between the fourth wireless communication module and the third wireless communication module and the communication between the fifth wireless communication module and the third wireless communication module.

[0084] A position point of the hand-held device relative to the head-mounted device is determined according to the first position region and the second position region.

[0085] It can be understood that the manner of determining the second position region of the hand-held device relative to the head-mounted device based on the communication between the fourth wireless communication module and the third wireless communication module and the communication between the fifth wireless communication module and the third wireless communication module in the embodiment can refer to the manner of determining the first position region, which will not be described herein.

[0086] In the embodiment, the first wireless communication module and the second wireless communication module can be integrated in a first wireless communication device, and the fourth wireless communication module and the fifth wireless communication module can be integrated in a second wireless communication device. The first wireless communication module in the embodiment is composed of a first antenna and corresponding processing circuit, the second wireless communication module is composed of a second antenna and corresponding processing circuit, the fourth wireless communication module is composed of a fourth antenna and corresponding processing circuit, and the fifth wireless communication module is composed of a fifth antenna and corresponding processing circuit. The first wireless communication device and the second wireless communication device can be respectively arranged on two sides of the head-mounted device. For example, when the head-mounted device is smart glasses, the first wireless communication device and the second wireless communication device can be respectively arranged on the left glasses and the right glasses. Exemplarily, the first wireless communication device and the second wireless communication device are far away from the middle position, so as to increase the distance between them, which is beneficial to improve the accuracy of positioning of the hand-held device.

[0087] Exemplarily, in the embodiment, the first azimuth angle of the hand-held device relative to the first wireless communication device and the second azimuth angle of the hand-held device relative to the second wireless communication device can be respectively measured by the carrier phase difference method introduced above. Since the positions of the first wireless communication device and the second wireless communication device are fixed and known, the position of the hand-held device can be determined according to the distance between the first wireless communication device and the second wireless communication device, the first azimuth angle and the second azimuth angle. In the embodiment, the azimuth of the hand-held device relative to the head-mounted device is measured by the double-antenna carrier phase difference method, which can achieve very high measurement accuracy. Finally, the positioning accuracy of centimeter level can be obtained.

[0088] The gesture recognition module in the embodiments of the present application includes an image acquisition unit and an image recognition unit; the image acquisition unit is configured to acquire images and send the acquired images to the image recognition unit, and the image recognition unit is configured to perform gesture recognition according to the received images.

[0089] It should be noted that the image acquisition unit and the image recognition unit in the embodiments of the present application can be integrated in one hardware device, or can be independently arranged in different hardware devices. The image acquisition unit includes but is not limited to a depth camera, a normal camera, etc.

[0090] In step S12, any one of the image acquisition unit and the image recognition unit can be controlled according to the relative position of the hand-held device relative to the head-mounted device.

[0091] For example, the working state of the gesture recognition module can be controlled according to the relative position, and the working state of the image acquisition unit and / or the image recognition unit can be controlled.

[0092] For example, when it is determined according to the relative position that the hand-held device is located within a first preset position range of the head-mounted device, the gesture recognition module is controlled to enter a normal working state; and when it is determined according to the relative position that the hand-held device is located outside the first preset position range, the gesture recognition module is controlled to enter a low-power-consumption state.

[0093] The first preset position range can be flexibly set by a developer, for example, a part of the front of the head-mounted device can be set as the first preset position range. In some embodiments, the gesture recognition module can only recognize gestures within the first preset position range.

[0094] The low-power-consumption state of the embodiments of the present application can be a state in which all functions of the image acquisition unit and / or the gesture recognition unit are closed, of course, it can also be a state in which part of the functions of the image acquisition unit and / or the gesture recognition unit are closed. For example, a depth camera in the image acquisition unit for acquiring gesture images can be closed, or an image feature extraction function in the gesture recognition unit can be closed.

[0095] When the relative position of the wearable device is determined to be within the second preset position range of the head-mounted device, and the gesture recognition module determines that no gesture action has been detected within a preset time range, the gesture recognition module can be restarted. Alternatively, the relative position information can be transmitted to the gesture recognition module during restart to assist it in rapid positioning, thereby accelerating the gesture recognition speed. In practice, due to environmental interference, user movement, hand movement, etc., the gesture recognition module may fail to detect the hand even when it is within the gesture recognition area, or may spend a long time searching and detecting the hand's state, severely impacting the user experience. In such cases, restarting the gesture recognition module and using the detected relative position of the wearable device to the head-mounted device can assist the gesture recognition module in quickly re-recognizing the gesture, reducing user waiting time and improving user satisfaction.

[0096] It is understood that the second preset position range may be the same as the first preset position range, or it may be a subset of the first preset position range.

[0097] For example, in this embodiment of the application, the image acquisition angle of the image acquisition unit can also be controlled according to the relative position. For instance, the image acquisition angle can always be aligned with the wearable device, so that the gesture is located in the central visual area of ​​the image acquisition unit, thereby enabling better acquisition of gesture images and gesture recognition, and improving the accuracy and efficiency of gesture recognition.

[0098] For example, based on the relative position of the hand-worn device to the head-worn device, the image acquisition angle of the image acquisition unit can be reduced, some pixel acquisition functions of the image acquisition unit can be turned off, the power consumption of the image acquisition unit can be reduced, and the size of the image input to the image recognition unit can be reduced, thereby reducing the computational load of the image recognition unit and also reducing its power consumption.

[0099] For example, in some embodiments, after determining the position of the wrist-worn device relative to the head-worn device, a spatial location region containing that position can be determined. This spatial location region is smaller than the viewing angle of the image acquisition unit, and it contains the user's gesture. Then, the image block 1 corresponding to this spatial location region in the acquired image can be sent to the image recognition unit. Image block 1 can be a portion of the entire acquired image, such as occupying only 1 / 10, 1 / 4, or 1 / 2 of the entire image. In this case, image block 1 is used as input to the image recognition unit, while other image content is not input, thereby reducing the computational load of the image recognition unit and also lowering its power consumption.

[0100] In actual application scenarios, when other user's hand falls into the image collection visual angle range of the image collection unit, interference can be caused, and the hand gesture action of the other user can be mistaken as the hand gesture action of the user wearing the hand-wearable device. Therefore, for example, when an image is collected by the gesture recognition module and a target gesture is detected according to the image, whether the target gesture is a false gesture can be determined according to the position of the hand-wearable device relative to the head-mounted device.

[0101] For example, the position of the target gesture relative to the head-mounted device can be calculated according to the collected image containing the target gesture; the position of the hand-wearable device relative to the head-mounted device calculated by the wireless communication method and the position of the target gesture relative to the head-mounted device calculated according to the collected image can be used to determine the distance between the two positions. When the distance is greater than or equal to a preset distance threshold, the target gesture can be determined as a false gesture, and when the distance is less than the preset distance threshold, the target gesture can be determined as a real gesture. The preset distance threshold can be flexibly set by the developer, for example, 20 cm, 30 cm, or 40 cm, and the like.

[0102] The head-mounted device in the embodiments of the present application can obtain its own pose by a simultaneous localization and mapping technology. Accordingly, the position of the hand-wearable device can be obtained from the relative position of the hand-wearable device relative to the head-mounted device.

[0103] The gesture recognition module can automatically use an algorithm to recognize the collected image and detect the action of the hand. In some embodiments, the gesture recognition module can perform feature extraction from the collected image to obtain an image characteristic vector. In some embodiments, the gesture recognition module uses deep learning and a neural network to complete gesture recognition. The gesture recognition model can be a pre-trained KNN model, a random forest, a lightweight network Mobilenetv2 model, and the like, which is not limited herein. In some embodiments, each hand performs capture, tracking, and pose analysis of multiple joint points.

[0104] The user can control or interact with the head-mounted device by using simple gestures. Gesture recognition by the gesture recognition module can include hand position detection, hand shape detection, gesture detection and segmentation, action detection of fingers, palms, and the like, and tracking and positioning of the hand.

[0105] Based on the same inventive concept, the embodiments of the present application also provide a head-mounted device, please refer to Figure 3 As shown in the figure, the head-mounted device includes a first processor 301, a first memory 302 in communication connection with the first processor 301, and a gesture recognition module 303. The first memory 302 stores a first computer program, and the first processor 301 executes the first computer program to implement any of the above control methods.

[0106] Based on the same inventive concept, the embodiment of the present application further provides a hand-wearable device, please refer to Figure 4 As shown in the figure, it comprises a second processor 401 and a second memory 402 connected with the second processor 401; the second memory 402 stores a second computer program; the second processor 401 executes the second computer program to realize any one of the above control methods.

[0107] It should be noted that the head-wearable device and the hand-wearable device in the embodiment of the present application can further comprise more or less components than Figure 3 and Figure 4 or have different configurations from Figure 3 and Figure 4 .

[0108] The first processor 301 and the second processor 401 can be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above method can be completed by the integrated logic circuit of hardware or the instruction in the form of software in the first processor 301 and the second processor 401. The first processor 301 and the second processor 401 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; also can be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a ready programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component. It can realize or execute each method, step and logic block diagram disclosed in the embodiment of the present application. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in combination with the embodiment of the present application can be directly embodied as a hardware code processor for execution, or executed by a combination of hardware and software modules in the code processor. The software module can be located in a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, a register, etc. mature storage medium in the art.

[0109] The first memory 302 and the second memory 402 include but are not limited to a random access memory (RAM), a read-only memory (ROM), a programmable read-only memory (PROM), an erasable read-only memory (EPROM), an electrically erasable read-only memory (EEPROM), etc. In the embodiment of the present application, the memory stores the program required for executing the channel equalization method.

[0110] The first processor 301 and the first memory 302 are connected through a communication bus, the second processor 401 and the second memory 402 are connected through a communication bus, and the bus can be an ISA bus, a PCI bus, an EISA bus, or the like. The bus can be divided into an address bus, a data bus, a control bus, and the like. For convenience of representation, Figure 3 and Figure 4 Only one bidirectional arrow is used in the above description, but it does not mean that there is only one bus or only one type of bus.

[0111] Please refer to Figure 5 The embodiment of the application also provides a control system, including a head-mounted device 501 and a hand-held device 502, wherein the head-mounted device 501 can be the head-mounted device shown in Figure 3 Or the hand-held device can be the hand-held device shown in Figure 4 .

[0112] The embodiment also provides a computer readable storage medium, such as a floppy disk, an optical disk, a hard disk, a flash memory, a U disk, a secure digital (SD) card, a multimedia (MMC) card, and the like, and one or more programs for implementing the above steps are stored in the computer readable storage medium. The one or more programs can be executed by one or more processors to implement the steps of the method in the above embodiments, and details are not repeated here.

[0113] The above-mentioned serial numbers of the embodiments of the application are only for description, and do not represent the advantages and disadvantages of the embodiments.

[0114] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be realized by means of software and necessary general hardware platform, of course, they can also be realized by hardware, but in many cases, the former is a better embodiment.

[0115] The above only describes the embodiments of the application and does not limit the protection scope of the application. For those skilled in the art, the application can have various changes and modifications. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the application shall be included in the protection scope of the application.

Claims

1. A control method, characterized in that, The method includes: Determine the position of the hand-worn device relative to the head-mounted device; the head-mounted device includes a gesture recognition module for performing gesture recognition; The gesture recognition module is controlled according to the location; The step of controlling the gesture recognition module according to the location includes: controlling the working state of the gesture recognition module according to the location; The step of controlling the working state of the gesture recognition module based on the location includes: when the location determines that the wearable device is within a first preset position range of the head-mounted device, controlling the gesture recognition module to enter a normal working state; when the location determines that the wearable device is outside the first preset position range, controlling the gesture recognition module to enter a low-power state. The head-mounted device includes a first wireless communication module and a second wireless communication module; the wrist-worn device includes a third wireless communication module; determining the position of the wrist-worn device relative to the head-mounted device includes: controlling the first wireless communication module and the second wireless communication module to communicate with the third wireless communication module respectively; and determining a first position region of the wrist-worn device relative to the head-mounted device based on the communication between the first wireless communication module and the third wireless communication module, and the communication between the second wireless communication module and the third wireless communication module. The head-mounted device further includes a fourth wireless communication module and a fifth wireless communication module. Determining the position of the wrist-worn device relative to the head-mounted device includes: controlling the fourth wireless communication module and the fifth wireless communication module to communicate with the third wireless communication module respectively; determining a second position region of the wrist-worn device relative to the head-mounted device based on the communication between the fourth wireless communication module and the third wireless communication module, and the communication between the fifth wireless communication module and the third wireless communication module; and determining the position point of the wrist-worn device relative to the head-mounted device based on the first position region and the second position region.

2. The control method as described in claim 1, characterized in that, The gesture recognition module includes an image acquisition unit and an image recognition unit; the image acquisition unit is used to acquire images and send the acquired images to the image recognition unit, and the image recognition unit is used to perform gesture recognition based on the received images.

3. The control method as described in claim 2, characterized in that, The step of controlling the gesture recognition module based on the location includes: The image acquisition angle of the image acquisition unit is controlled according to the position.

4. The control method as described in claim 1, characterized in that, The determination of the first position region of the wrist-worn device relative to the head-worn device based on the communication between the first wireless communication module and the third wireless communication module, and the communication between the second wireless communication module and the third wireless communication module, includes: The first distance between the first wireless communication module and the third wireless communication module, and the second distance between the second wireless communication module and the third wireless communication module are determined using the Time-of-Flight (TOF) method. A first position region of the wrist-worn device relative to the head-worn device is then determined based on the first distance, the second distance, and a preset third distance; the preset third distance is the distance between the first wireless communication module and the second wireless communication module. And / or, The first position region of the hand-worn device relative to the head-worn device is determined using the carrier phase difference method.

5. The control method as described in claim 1, characterized in that, The method further includes: When an image is acquired by the gesture recognition module and a target gesture is detected based on the image, the location is used to determine whether the target gesture is a fake gesture.

6. A head-mounted device, characterized in that, include: The first processor, the first memory, and the gesture recognition module; The first memory stores the first computer program; The first processor executes the first computer program to implement the method as described in any one of claims 1-5.

7. A hand-worn device, characterized in that, include: A second processor and a second memory; The second memory stores a second computer program; The second processor executes the second computer program to implement the method as described in any one of claims 1-5.

8. A control system, characterized in that, include: A hand-worn device and a head-worn device as described in claim 6; or, A head-mounted device and a wrist-worn device as claimed in claim 7; the head-mounted device includes a gesture recognition module for performing gesture recognition.

Images