Gesture control method, wearable device and computer-readable storage medium

Abstract

Provided in the present disclosure is a gesture control method. The method comprises: acquiring the current first detection value of a first sensor assembly of a wearable device, wherein the first detection value of the first sensor assembly represents the perimeter of a target limb part of a user; determining gesture action information of the user according to the current first detection value; and generating a control instruction corresponding to the gesture action information, and sending the control instruction to a device to be controlled. Further provided in the present disclosure are a wearable device and a computer-readable storage medium.

Description

Gesture control method, wearable device, and computer-readable storage medium

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to Chinese patent application No. 202310779470.1 filed on June 28, 2023, the contents of which are incorporated herein by reference in their entirety. Technical Field

[0003] The present disclosure relates to the technical field of wearable devices, and in particular to a gesture control method, a wearable device, and a computer-readable storage medium. Background Art

[0004] With the continuous development of technology, augmented reality (AR) and virtual reality (VR) devices are becoming increasingly popular. In AR / VR environments, manipulation of objects is typically achieved by detecting where the human eye is focused, using cameras to detect user gestures and map them to the virtual space, or using specialized handheld devices to detect user gestures.

[0005] However, the efficiency, accuracy and versatility of the target control methods in the above-mentioned AR / VR space need to be further improved.

[0006] Public content

[0007] In a first aspect, an embodiment of the present disclosure provides a gesture control method, which is applied to a wearable device, comprising: obtaining a current first detection value of a first sensor component of the wearable device, the first detection value of the first sensor component representing the circumference of a target limb part of the user; determining gesture action information of the user based on the current first detection value; generating a control instruction corresponding to the gesture action information, and sending the control instruction to the device to be controlled.

[0008] In a second aspect, an embodiment of the present disclosure provides a wearable device comprising a first sensor component, at least one processor, and a memory; at least one computer program is stored on the memory, and the at least one computer program is executed by the at least one processor, so that the at least one processor implements the gesture control method described in the first aspect of the embodiment of the present disclosure.

[0009] In a third aspect, an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program is executed by a processor so that the processor implements the gesture control method described in the first aspect of the embodiment of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] FIG1 is a flow chart of a gesture control method according to an embodiment of the present disclosure;

[0011] FIG2 is a schematic structural diagram of a first sensor assembly according to an embodiment of the present disclosure;

[0012] FIG3 is a flowchart of some steps in a gesture control method according to an embodiment of the present disclosure;

[0013] FIG4 is a schematic diagram of the composition of a wearable device according to an embodiment of the present disclosure;

[0014] FIG5 is a schematic structural diagram of a wearable device according to an embodiment of the present disclosure;

[0015] FIG6 is a schematic structural diagram of a wearable device according to an embodiment of the present disclosure;

[0016] FIG7 is a schematic diagram of a computer-readable storage medium according to an embodiment of the present disclosure;

[0017] FIG8 is a schematic diagram of a test position in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0018] To enable those skilled in the art to better understand the technical solutions of the present disclosure, the gesture control method, wearable device, and computer-readable storage medium provided by the present disclosure are described in detail below with reference to the accompanying drawings.

[0019] Hereinafter, example embodiments will be described more fully with reference to the accompanying drawings, but the example embodiments may be embodied in different forms, and the present disclosure should not be construed as limited to the embodiments set forth herein. These embodiments are provided to make the present disclosure more thorough and complete and to enable those skilled in the art to fully understand the scope of the present disclosure.

[0020] In the absence of conflict, the various embodiments of the present disclosure and the various features therein may be combined with each other.

[0021] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0022] The terms used herein are used only to describe specific embodiments and do not limit the present disclosure. As used herein, the singular forms "a," "an," and "the" also include the plural forms, unless the context clearly indicates otherwise. It will also be understood that when the terms "comprising" and / or "made of" are used in this specification, they specify the presence of specific features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or possible addition of one or more other features, wholes, steps, operations, elements, components, and / or groups thereof.

[0023] The embodiments described herein may be described with reference to plan views and / or cross-sectional views, with the aid of idealized schematic diagrams of the present disclosure. Therefore, the example illustrations may be modified based on manufacturing techniques and / or tolerances. Therefore, the embodiments are not limited to the embodiments shown in the accompanying drawings, but include modifications of the configurations formed based on the manufacturing process. Therefore, the regions illustrated in the accompanying drawings are schematic in nature, and the shapes of the regions shown in the drawings illustrate specific shapes of the regions of the components, but are not limiting.

[0024] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by those skilled in the art. It will also be understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and the present disclosure, and will not be interpreted as having an idealized or overly formal meaning unless expressly defined as such herein.

[0025] In a first aspect, referring to FIG. 1 , an embodiment of the present disclosure provides a gesture control method, including steps S1 to S3 .

[0026] S1. Obtain a current first detection value of a first sensor component of a wearable device, where the first detection value of the first sensor component represents a circumference of a target limb part of a user.

[0027] S2. Determine the user's gesture action information according to the current first detection value.

[0028] S3. Generate a control instruction corresponding to the gesture action information and send it to the device to be controlled.

[0029] The embodiments of the present disclosure do not specifically limit the wearable devices. For example, wearable devices include watches, bracelets, etc.

[0030] In the disclosed embodiment, the target limb part may be a part where the wearable device is fixed. For example, the wearable device is a watch or a bracelet, and the target limb part may be a wrist, arm, or other part.

[0031] In the disclosed embodiments, the muscles of the target limb will contract or relax as the user's hand position changes, causing the circumference of the target limb to change. For example, if the wearable device is a watch or bracelet worn on the wrist, when the palm is open, the muscles at the wrist relax, causing the wrist circumference to increase; when the fist is clenched, the muscles at the wrist contract, causing the wrist circumference to decrease.

[0032] In the disclosed embodiment, the first sensor assembly is capable of sensing changes in the circumference of a target limb, and the first detection value of the first sensor assembly changes with changes in the circumference of the target limb. In the disclosed embodiment, different user hand states correspond to different circumferences of the target limb, i.e., each user hand state corresponds to a specific first detection value. Obtaining the first detection value can determine the user's hand state, and thus determine the user's gesture information.

[0033] In the embodiment of the present disclosure, the device to be controlled may be a smart phone, a tablet computer, a television, a VR / AR device, etc. The embodiment of the present disclosure does not impose any special limitation on this.

[0034] The gesture control method provided by the embodiment of the present disclosure detects the circumference of the user's target limb part through a first sensor component to determine the user's hand state, thereby determining the user's gesture action information, and then generates corresponding control instructions based on the gesture action information to achieve gesture control of the device to be controlled. The detection of the circumference of the target limb part is convenient and fast, and will not be affected by ambient light. It has high accuracy and does not require camera assistance. There is no restriction on the user's position when performing gesture control, and the method has high versatility.

[0035] The embodiment of the present disclosure does not specifically limit how to determine the user's gesture action information based on the current first detection value.

[0036] In some implementations, corresponding gesture actions are defined corresponding to the static state of the user's hand, and thus corresponding control instructions are defined.

[0037] Accordingly, in some embodiments, determining the user's gesture action information based on the current first detection value includes: determining hand state information characterizing the user's hand state based on the current first detection value and the first correspondence, and obtaining the gesture action information, wherein the first correspondence is the correspondence between the first detection value of the first sensor component and the user's hand state.

[0038] In the embodiment of the present disclosure, the user hand state refers to the static state of the user's hand, such as the user's palm is open, the fist is clenched, the fingers are partially extended and partially closed (for example, the index finger is extended and the rest are closed, "OK" gesture, etc.).

[0039] In the embodiment of the present disclosure, different user hand states correspond to different circumferences of the target limb parts, that is, the user hand state corresponds to a specific first detection value, so that the first corresponding relationship can be pre-set.

[0040] In some implementations, corresponding gesture actions are defined corresponding to changes in the user's hand state, and thus corresponding control instructions are defined.

[0041] Accordingly, in some embodiments, determining the user's gesture action information based on the first detection value includes: determining hand state change information characterizing the change in the user's hand state based on the current first detection value and the first corresponding relationship, and obtaining the gesture action information, wherein the first corresponding relationship is the corresponding relationship between the first detection value of the first sensor component and the user's hand state.

[0042] In the embodiments of the present disclosure, the change in the user's hand state refers to the user's palm changing from open to clenched fist, from clenched fist to open, from open to partially extended fingers and partially closed fingers, from clenched fist to partially extended fingers and partially closed fingers, etc. The embodiments of the present disclosure do not impose any special restrictions on this.

[0043] In an embodiment of the present disclosure, the wearable device also includes at least one second sensor component, which is configured to detect the motion state of the user's hand and combine the user's hand state with the motion state, so as to define more gesture actions and further define more control instructions.

[0044] Accordingly, in some embodiments, determining the user's gesture action information based on the first detection value includes: determining hand state information representing the user's hand state, or hand state change information representing the change in the user's hand state based on the current first detection value and the first corresponding relationship, the first corresponding relationship being the correspondence between the first detection value of the first sensor component and the user's hand state; obtaining the second detection value of the second sensor component of the wearable device; determining motion state information representing the user's hand motion state based on the second detection value; and combining the hand state information or the hand state change information with the motion state information to obtain the gesture action information.

[0045] The second sensor assembly is not particularly limited in the embodiments of the present disclosure. For example, the second sensor assembly includes a gravity sensor capable of detecting whether the wrist is in a horizontal or vertical state; the second sensor assembly includes an acceleration sensor capable of detecting the direction of the hand swing.

[0046] The embodiments of the present disclosure do not impose any special limitation on how to combine the hand state information or the hand state change information with the motion state information.

[0047] For example, the control instructions corresponding to the combination of hand state information or hand state change information and motion state information are shown in Table 1.

[0048] Table 1

[0049] In Table 1, the hand state is horizontal and the hand movement state is horizontal waving, and the corresponding control instruction is to exit the application; the hand state is vertical and the hand movement state is horizontal waving, and the corresponding control instruction is to drag the page horizontally; the hand state is horizontal with the back of the fist and the hand movement state is horizontal waving, and the corresponding control instruction is to move the focus frame horizontally; the hand state is vertical with the back of the fist and the hand movement state is horizontal waving, and the corresponding control instruction is to start the application; the hand state is horizontal with the palm and the hand movement state is vertical waving, and the corresponding control instruction is to drag the page vertically; the hand state is vertical with the hand movement state is vertical waving, and the corresponding control instruction is to exit the application; the hand state is horizontal with the back of the fist and the hand movement state is vertical waving, and the corresponding control instruction is to move the focus frame vertically; the hand state is vertical with the back of the fist and the hand movement state is vertical waving, and the corresponding control instruction is to start the application.

[0050] In the embodiment of the present disclosure, the control instructions corresponding to the combination of hand state information or hand state change information and motion state information are not limited to those shown in Table 1.

[0051] In some implementations, control instructions corresponding to customized hand state information or a combination of hand state change information and motion state information are supported, as shown in Table 2.

[0052] Table 2

[0053] In Table 2, the combination of hand state change and motion state includes palm rotation and fist rotation. Corresponding to the above combination of hand state change information and motion state information, the user can customize the corresponding control instructions.

[0054] Accordingly, in some embodiments, generating a control instruction corresponding to the gesture action information includes at least one of the following: generating a control instruction for exiting the application when the hand state information indicates that the hand state is horizontal and the motion state information indicates that the hand motion state is horizontal waving; generating a control instruction for dragging the page horizontally when the hand state information indicates that the hand state is vertical and the motion state information indicates that the hand motion state is horizontal waving; generating a control instruction for moving the focus frame horizontally when the hand state information indicates that the hand state is horizontal with the back of the hand clenched in a fist and the motion state information indicates that the hand motion state is horizontal waving; generating a control instruction for moving the focus frame horizontally when the hand state information indicates that the hand state is vertical with the back of the hand clenched in a fist and the motion state information indicates that the hand motion state is horizontal In the case of waving, a control instruction for starting the application is generated; in the case where the hand state information represents that the hand state is horizontal and the motion state information represents that the hand motion state is vertical waving, a control instruction for dragging the page vertically is generated; in the case where the hand state information represents that the hand state is vertical and the motion state information represents that the hand motion state is vertical waving, a control instruction for exiting the application is generated; in the case where the hand state information represents that the hand state is horizontal with the back of the fist and the motion state information represents that the hand motion state is vertical waving, a control instruction for vertically moving the focus frame is generated; in the case where the hand state information represents that the hand state is vertical with the back of the fist and the motion state information represents that the hand motion state is vertical waving, a control instruction for starting the application is generated.

[0055] In some embodiments, generating a control instruction corresponding to the gesture action information includes at least one of the following: generating a first custom control instruction when the combination of the hand state information and the motion state information represents that the combination of the hand state and the motion state is a left and right rotation of the palm; generating a second custom control instruction when the combination of the hand state information and the motion state information represents that the combination of the hand state and the motion state is a left and right rotation of the fist.

[0056] The embodiment of the present disclosure does not impose any special limitation on the first sensor component.

[0057] In some embodiments, as shown in Figure 2, the first sensor assembly includes a first sensor 11 and a detection piece 12, and the detection piece 12 moves as the circumference of the target limb part changes to change the area covered by the detection piece 12 on the detection window 13 of the first sensor 11; obtaining the current first detection value of the first sensor assembly of the wearable device includes: obtaining the detection value of the first sensor 11 to obtain the current first detection value, and the detection value of the first sensor 11 is positively correlated with the area covered by the detection piece 12 on the detection window 13.

[0058] The embodiment of the present disclosure does not impose any special limitation on the first sensor.

[0059] In some embodiments, the first sensor includes a magnetic sensor, and the detection piece includes a magnetic detection piece.

[0060] The embodiments of the present disclosure do not impose any particular limitation on the magnetic sensor. For example, the magnetic sensor may be a Hall sensor.

[0061] In the first sensor assembly shown in Figure 2, the larger the area of ​​the magnetic detection sheet covering the Hall sensor's detection window, the greater the magnetic force detected by the Hall sensor; the smaller the area of ​​the magnetic detection sheet covering the Hall sensor's detection window, the smaller the magnetic force detected by the Hall sensor. As the circumference of the target limb changes, the magnetic detection sheet shifts, causing the magnetic force detected by the Hall sensor to change accordingly, thereby sensing changes in the circumference of the target limb.

[0062] In some embodiments, the first sensor includes an infrared transmitting and receiving tube, and the detection piece includes an infrared reflecting plate.

[0063] In the disclosed embodiment, the infrared transmitting and receiving tube can sense the change in the circumference of the target limb part by detecting the intensity of the infrared light reflected by the infrared reflective plate.

[0064] In the embodiment of the present disclosure, the magnitude of the first detection value of the first sensor assembly can be positively correlated with the circumference of the target limb part, or can be negatively correlated with the circumference of the target limb part. The embodiment of the present disclosure does not specifically limit this.

[0065] In some embodiments, the first sensor component includes an elastic sensor; obtaining a first detection value of the first sensor component of the wearable device includes: obtaining an electrical parameter of the elastic sensor to obtain a current first detection value.

[0066] In the disclosed embodiment, different user hand states correspond to different circumferences of the target limb part, that is, the user hand state corresponds to a specific first detection value, so that the first correspondence can be pre-set. In the disclosed embodiment, the process of pre-setting the first correspondence is the process of calibrating the wearable device.

[0067] Accordingly, in some embodiments, referring to FIG. 3 , before obtaining the current first detection value of the first sensor component of the wearable device, the gesture control method further includes steps S41 and S42.

[0068] S41. Obtain first detection values ​​of the first sensor component corresponding to multiple user hand states respectively.

[0069] S42: Determine a correspondence between a first detection value of the first sensor component and a state of a user's hand to obtain a first correspondence.

[0070] In some implementations, automatic calibration can be performed while the user is wearing the wearable device.

[0071] Accordingly, in some embodiments, before obtaining the current first detection value of the first sensor component of the wearable device, the gesture control method further includes: determining the maximum and minimum values ​​of the first detection value of the first sensor component obtained; and respectively corresponding the maximum and minimum values ​​to different user hand states to obtain a first corresponding relationship.

[0072] For example, the wearable device is a smart watch. After the user wears the smart watch, the smart watch detects the first detection value corresponding to the minimum wrist circumference, which is defined as the first detection value corresponding to the fist-clenched state; and detects the first detection value corresponding to the maximum wrist circumference, which is defined as the first detection value corresponding to the open palm state.

[0073] In the second aspect, referring to Figure 4, an embodiment of the present disclosure provides a wearable device, including a first sensor component 100, at least one processor 200, and a memory 300; at least one computer program is stored on the memory 300, and the at least one computer program is executed by the at least one processor 300, so that the at least one processor 300 implements the gesture control method described in the first aspect of the embodiment of the present disclosure.

[0074] The embodiments of the present disclosure do not specifically limit the wearable devices. For example, wearable devices include smart watches, smart bracelets, etc.

[0075] In some embodiments, referring to Figure 5, the wearable device includes a device body 21 and a wearable part 22, the first end of the wearable part 22 is elastically connected to the first end of the device body 21, and the second end of the wearable part 22 is connected to the second end of the device body 21; the first sensor assembly includes a first sensor 11 and a detection piece 12, the first end of the detection piece 12 is rigidly connected to the first end of the wearable part 22, and the second end of the detection piece 12 is elastically connected to the second end of the wearable part 22; the detection piece 12 can move to change the area covered by the detection piece 12 on the detection window 13 of the first sensor 11.

[0076] As shown in Figure 5, the first end of the wearable part 22 is elastically connected to the first end of the device body 21 through the first elastic material 31; the first end of the detection piece 12 is rigidly connected to the first end of the wearable part 22 through the rigid material 32; the second end of the detection piece 12 is elastically connected to the second end of the wearable part 22 through the second elastic material 33.

[0077] When the circumference of the target limb part changes, the first elastic material 31 and the second elastic material 33 can stretch or contract, thereby causing the detection piece 12 to move relative to the detection window 13 .

[0078] The embodiment of the present disclosure does not impose any special limitation on the first sensor.

[0079] In some embodiments, the first sensor includes a magnetic sensor, and the detection piece includes a magnetic detection piece.

[0080] In some embodiments, the first sensor includes an infrared transmitting and receiving tube, and the detection piece includes an infrared reflecting plate.

[0081] In some embodiments, referring to Figure 6, the wearable device includes a device body 41 and a wearable part 42; the first sensor assembly includes an elastic sensor 5; the first end of the wearable part 42 is elastically connected to the first end of the device body 41 through the elastic sensor 5, and the second end of the wearable part 42 is connected to the second end of the device body 41.

[0082] As shown in FIG6 , the elastic sensor 5 includes a first electrode 51 and a second electrode 52 respectively arranged at both ends of the elastic sensor 5 . A first access point 411 and a second access point 412 are provided on the device body 41 . The first electrode 51 is electrically connected to the first access point 411 , and the second electrode 52 is electrically connected to the second access point 412 .

[0083] In a third aspect, referring to FIG. 7 , an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program is executed by a processor so that the processor implements the gesture control method described in the first aspect of the embodiment of the present disclosure.

[0084] In order to enable those skilled in the art to more clearly understand the technical solutions provided by the embodiments of the present disclosure, the technical solutions provided by the embodiments of the present disclosure are described in detail below through three examples.

[0085] Example 1

[0086] This example uses the first sensor component on the smartwatch to detect the expansion and contraction of the wrist muscles, thereby determining several states of the user's hand. The hand state is combined with the motion state detected by the smartwatch's gravity sensor and accelerometer to parse VR / AR control instructions.

[0087] Take the hand states, including open palm and clenched fist, as an example to illustrate:

[0088] 1. Open your palm and straighten your five fingers. The corresponding wrist muscles will expand and the wrist circumference will lengthen.

[0089] 2. Make a fist, contract your five fingers into a fist shape, the corresponding wrist muscles contract, and the wrist circumference shortens;

[0090] In addition to open palms and clenched fists, more hand states can be detected and analyzed through changes in wrist circumference, such as the grasping state from open palm to clenched fist, the thumb is relaxed and the other four fingers are closed, etc.

[0091] As shown in Figure 5, the smart watch includes a device body 21 and a wearable part 22, the first end of the wearable part 22 is elastically connected to the first end of the device body 21, and the second end of the wearable part 22 is connected to the second end of the device body 21; the first sensor assembly includes a first sensor 11 and a detection piece 12, the first end of the detection piece 12 is rigidly connected to the first end of the wearable part 22, and the second end of the detection piece 12 is elastically connected to the second end of the wearable part 22; the detection piece 12 can move to change the area covered by the detection piece 12 on the detection window 13 of the first sensor 11; the first end of the wearable part 22 is elastically connected to the first end of the device body 21 through a first elastic material 31; the first end of the detection piece 12 is rigidly connected to the first end of the wearable part 22 through a rigid material 32; the second end of the detection piece 12 is elastically connected to the second end of the wearable part 22 through a second elastic material 33.

[0092] When the palm is open, the wrist muscles thicken, the wrist circumference increases, the wristband tension increases, and the detection piece 12 is pulled more displacement. When the fingers are clenched, the wrist muscles thin, the wristband tension decreases, and the displacement caused by the wristband pulling the detection piece 12 is less. The smartwatch can determine whether the hand is clenched or open based on the detection value of the first sensor 11.

[0093] Specifically, the wrist circumference changes due to muscle contraction or expansion caused by the open palm or clenched fist, which drives the circumference of the watchband to change, which is adjusted by the first elastic material 31 and the second elastic material 33.

[0094] When a person's hand moves from a clenched fist to an open palm, the wrist muscles thicken and the wrist circumference increases. The first elastic material 31 and the second elastic material 33 are stretched and lengthened. The rigid material 32 pulls the magnetic detection sheet 12 to the left (i.e., toward the first end of the wearable component 22). The magnetic detection sheet 12 moves away from the detection window 13, and the Hall effect sensor 11 (i.e., the first sensor 11) detects a decrease in magnetic force. This means that the transition from a clenched fist to an open palm corresponds to a decrease in magnetic force.

[0095] When a person's hand moves from an open palm to a clenched fist, the wrist muscles become thinner, the wrist circumference shortens, the first elastic material 31 and the second elastic material 33 contract and shorten, and the magnetic detection piece 12 is pulled to the right (i.e., away from the first end of the wearable component 22) by the rigid material 32. The magnetic detection piece 12 approaches the detection window 13, and the Hall sensor 11 (i.e., the first sensor 11) detects an increase in magnetic force. In other words, the magnetic force increases when the hand moves from an open palm to a clenched fist.

[0096] In this example, the relative positions of the magnetic detection piece 12 and the Hall sensor 11 are different, and the magnetic force may increase when the hand is clenched into a fist and open, and may decrease when the hand is open into a fist.

[0097] In this example, infrared detection technology can also be used. The first sensor 11 in the first sensor assembly is an infrared receiving and transmitting tube, and the detection piece 12 is an infrared reflecting piece.

[0098] In this example, the smartwatch's own sensors can also be used to sense changes in wrist circumference. For example, a sensor that measures heart rate can be used to detect changes in wrist muscle thickness or thinning.

[0099] Example 2

[0100] This example includes: a displacement sensor component configured to detect changes in wrist circumference; a watch strap configured to fix a smart watch and connect to the displacement sensor component; and a smart watch configured to supply power to the displacement sensor component, receive data from the displacement sensor component, analyze the data, determine the control instructions represented by the user's gestures, and transmit the instructions to the VR / AR device.

[0101] The wrist circumference data calibration and detection process includes the following (1) to (7).

[0102] (1) The user wears the smartwatch on their wrist and adjusts it to a fixed position. The strap is tightened to create a certain tension. The smartwatch function is adjusted to enter data calibration mode.

[0103] (2) The user extends his palm and the smartwatch detects the wrist circumference, which is defined as c1a.

[0104] (3) The user stretches out his hand and makes a fist, and the smartwatch detects the wrist circumference, which is defined as c2a.

[0105] (4) After multiple tests, take the average of the wrist circumferences measured. For example, the average of three tests can be taken.

[0106] Wrist circumference with open palm: c1a = (c11 + c12 + c13) / 3, which is the preset value for wrist circumference with open palm; c11, c12, and c13 are the wrist circumference values ​​detected by the smartwatch when the user extends their palm for the first, second, and third time, respectively.

[0107] Wrist circumference when making a fist: c2a = (c21 + c22 + c23) / 3, which is the preset value of the wrist circumference when making a fist; c21, c22, and c23 are the wrist circumference values ​​detected by the smartwatch when the user makes a fist for the first, second, and third time, respectively.

[0108] c1a and c2a satisfy that c1a is greater than c2a.

[0109] The wrist circumference tolerance for an open palm is ce1, and for a clenched fist is ce2. Ce1 and ce2 must be determined based on actual conditions and must satisfy c1a - ce1 > c2a + ce2.

[0110] (5) Entering the detection state, the user makes a hand movement, and the wrist circumference measured by the smartwatch is cn.

[0111] (6) Data analysis and judgment: If the cn value makes c1a+ce1>cn>c1a-ce1, the smart watch can determine that the user is currently in an open palm state; if the cn value makes c2a+ce2>cn>c2a-ce2, the smart watch can determine that the user is currently in a clenched fist state.

[0112] (7) Wrist circumference (open palm, clenched fist) data calibration. In addition to the specific calibration scheme, an adaptive calibration scheme can also be implemented. After the user wears the smart watch, the strap maintains a certain tension. During the user's daily activities, the minimum wrist circumference detected by the smart watch is defined as the wrist circumference when the fist is clenched, and the maximum value detected (excluding abnormal points during wearing) is defined as the wrist circumference when the palm is open. If c1a-ce1>c2a+ce2 is satisfied, the adaptive calibration is valid.

[0113] For example, the wrist circumference data of a user is as follows:

[0114] 1. Initial calibration

[0115] A) The average of three tests of wrist circumference with the palm open is 177 mm, i.e. c1a = 177.

[0116] B) The average of the three tests for wrist circumference in the clenched fist position was 171 mm, i.e., c2a = 171.

[0117] 2. Define ce1=1, ce2=1;

[0118] 3. Testing

[0119] A) Test the current wrist circumference cn = 176. If it is between 177+1 and 177-1, that is, in the range of 178 to 176, it can be determined that the palm is currently open.

[0120] B) If the current wrist circumference cn=170 is between 171+1 and 171-1, that is, in the range of 172 to 170, it can be determined that the current state is a clenched fist.

[0121] To further improve test accuracy, the test position in this example can be adjusted from the wrist toward the arm. As shown in Figure 8, at test position 1, the user's wrist circumference varies between clenched fists and open palms, with a minimum and maximum difference of 6mm. At test position 2, the minimum and maximum difference in arm circumference is 10mm. At test position 2, in addition to clenched fists and open palms, one or two intermediate gestures can also be detected, such as a pointing gesture with the index finger extended and the other four fingers gathered, and an OK gesture with the index finger and thumb touching and the other three fingers extended.

[0122] The arm circumference from small to large is as follows: fist, index finger pointing, OK gesture, and open palm.

[0123] Recommended wearing positions for wearable devices: Test position 1, a general-accuracy position suitable for detecting two states: a clenched fist and an open palm; test position 2, a high-accuracy position suitable for detecting three to four states: a clenched fist, an index finger pointing gesture, an OK gesture, and an open palm.

[0124] The gesture control process in this example includes:

[0125] During initialization, the user puts on the smartwatch and controls the watch to enter the calibration state. The user calibrates the wrist circumference by opening the palm and making a fist.

[0126] In the detection state, the user extends his palm, the muscles at the wrist expand, the displacement sensor detects the increase in wrist circumference, and the sensor component transmits the data back to the smart watch.

[0127] The smartwatch receives the data and analyzes it, and finds that the user's current hand state is an outstretched palm.

[0128] The user contracts their fingers into a fist, the muscles at the wrist contract, the displacement sensor detects the shortening of the wrist circumference, and the sensor component transmits the data back to the smartwatch.

[0129] The smartwatch receives the data and analyzes it, and finds that the user's current hand state is a fist.

[0130] The smartwatch analyzes the state of the hand (open palm, clenched fist), the position of the back of the hand (horizontal, vertical), the direction of the swing (up and down, left and right), and the movement process (switching between clenched fist and open palm, rotation), and maps out the operation instructions.

[0131] The smartwatch transmits mapping instructions to the connected AR / VR terminal to manipulate AR / VR space targets.

[0132] Example 3

[0133] As shown in Figure 6, the wearable device includes a device body 41 and a wearable component 42. The first sensor assembly includes an elastic sensor 5. The first end of the wearable component 42 is elastically connected to the first end of the device body 41 via the elastic sensor 5, and the second end of the wearable component 42 is connected to the second end of the device body 41. The elastic sensor 5 includes a first electrode 51 and a second electrode 52, respectively disposed at both ends of the elastic sensor 5. The device body 41 is provided with a first access point 411 and a second access point 412. The first electrode 51 is electrically connected to the first access point 411, and the second electrode 52 is electrically connected to the second access point 412.

[0134] As the wrist changes between open and clenched positions, its circumference changes, causing the elastic sensor 5 on the wristband to contract and stretch, changing the electrical parameters (e.g., resistance) of the elastic sensor 5. The smartwatch detects the electrical parameters (resistance) of the elastic sensor via the first access point 411, the wire, the first electrode 51, the second access point 412, the wire, and the second electrode 52. This determines the current wrist circumference and, subsequently, whether the wrist is open or clenched.

[0135] For example, the wrist circumference, from smallest to largest, is as follows: fist, index finger pointing, OK gesture, and open palm. The corresponding elastic sensor lengths are length1, length2, length3, and length4, with length1 > length2 > length3 > length4. The corresponding resistance values ​​of the elastic sensors are R1, R2, R3, and R4, with R1 > R2 > R3 > R4. When R1, R2, R3, or R4 is detected, the user's hand state can be determined to be fist, index finger pointing, OK gesture, or open palm.

[0136] It will be appreciated by those skilled in the art that all or some of the steps in the method disclosed above, and the functional modules / units in the device can be implemented as software, firmware, hardware, and appropriate combinations thereof. In a hardware implementation, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some or all physical components may be implemented as software executed by a processor (such as a central processing unit, a digital signal processor, or a microprocessor), or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium). As is well known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable, and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is well known to those skilled in the art that communication media typically embodies computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0137] Example embodiments have been disclosed herein, and although specific terms are employed, they are used and should be interpreted only in a general illustrative sense and not for purposes of limitation. In some instances, it will be apparent to those skilled in the art that, unless otherwise expressly stated, features, characteristics, and / or elements described in conjunction with a particular embodiment may be used alone or in combination with features, characteristics, and / or elements described in conjunction with other embodiments. Therefore, it will be understood by those skilled in the art that various changes in form and detail may be made without departing from the scope of the present disclosure as set forth in the appended claims.

Claims

1. A gesture control method, comprising: Acquire a current first detection value of a first sensor component of the wearable device, wherein the first detection value of the first sensor component represents the circumference of a target limb part of the user; Determine the user's gesture action information according to the current first detection value; Generate a control instruction corresponding to the gesture action information and send it to the device to be controlled.

2. The gesture control method according to claim 1, wherein: Determining the user's gesture action information according to the current first detection value includes: According to the current first detection value and the first corresponding relationship, the hand state information characterizing the user's hand state is determined to obtain the gesture action information, wherein the first corresponding relationship is the corresponding relationship between the first detection value of the first sensor component and the user's hand state.

3. The gesture control method according to claim 1, wherein: Determining the gesture action information of the user according to the first detection value includes: According to the current first detection value and the first corresponding relationship, the hand state change information characterizing the change of the user's hand state is determined to obtain the gesture action information, wherein the first corresponding relationship is the corresponding relationship between the first detection value of the first sensor component and the user's hand state.

4. The gesture control method according to any one of claims 1 to 3, wherein: Determining the gesture action information of the user according to the first detection value includes: Determine, according to the current first detection value and the first corresponding relationship, hand state information representing the hand state of the user, or hand state change information representing the change of the hand state of the user, wherein the first corresponding relationship is the corresponding relationship between the first detection value of the first sensor component and the hand state of the user; Acquire a second detection value of a second sensor component of the wearable device; Determining motion state information representing a motion state of a user's hand according to the second detection value; The hand state information or the hand state change information is combined with the motion state information to obtain the gesture action information.

5. The gesture control method according to claim 4, wherein: Generating a control instruction corresponding to the gesture action information includes at least one of the following: In a case where the hand state information indicates that the hand state is a horizontal palm and the motion state information indicates that the hand motion state is a horizontal wave, generating a control instruction for exiting the application; When the hand state information indicates that the hand state is a vertical palm and the motion state information indicates that the hand motion state is a horizontal waving, generating a control instruction for dragging the page horizontally; When the hand state information indicates that the hand state is a horizontal back of the hand with a fist, and the motion state information indicates that the hand motion state is a horizontal swing, generating a control instruction for horizontally moving the focus frame; When the hand state information indicates that the hand state is a clenched fist with the back of the hand vertical, and the motion state information indicates that the hand motion state is a horizontal swing, generating a control instruction for starting an application; When the hand state information indicates that the hand state is a horizontal palm and the motion state information indicates that the hand motion state is a vertical swing, a control instruction for dragging the page to move vertically is generated; When the hand state information indicates that the hand state is a vertical palm and the motion state information indicates that the hand motion state is a vertical waving, generating a control instruction for exiting the application; When the hand state information indicates that the hand state is a horizontal back of the hand with a fist, and the motion state information indicates that the hand motion state is a vertical swing, generating a control instruction for vertically moving the focus frame; When the hand state information indicates that the hand state is a clenched fist with the back of the hand vertical, and the motion state information indicates that the hand motion state is a vertical swing, a control instruction for starting an application is generated.

6. The gesture control method according to claim 4, wherein: Generating a control instruction corresponding to the gesture action information includes at least one of the following: In the case where the combination of the hand state information and the motion state information indicates that the combination of the hand state and the motion state is left-right rotation of the palm, generating a first custom control instruction; In the case where the combination of the hand state information and the motion state information represents that the combination of the hand state and the motion state is a fist being rotated left and right, a second custom control instruction is generated.

7. The gesture control method according to any one of claims 1 to 3, wherein: The first sensor assembly includes a first sensor and a detection sheet, wherein the detection sheet moves as the circumference of the target limb part changes to change the area covered by the detection sheet on the detection window of the first sensor; Acquiring a current first detection value of a first sensor component of the wearable device includes: The detection value of the first sensor is acquired to obtain a current first detection value, wherein the detection value of the first sensor is positively correlated with the area covered by the detection sheet on the detection window.

8. The gesture control method according to claim 7, wherein: The first sensor includes a magnetic sensor, and the detection sheet includes a magnetic detection sheet; or The first sensor includes an infrared transmitting and receiving tube, and the detection sheet includes an infrared reflecting plate.

9. The gesture control method according to any one of claims 1 to 3, wherein: The first sensor component includes an elastic sensor; obtaining a first detection value of the first sensor component of the wearable device includes: The electrical parameters of the elastic sensor are acquired to obtain a current first detection value.

10. The gesture control method according to any one of claims 1 to 3, further comprising: Before obtaining the current first detection value of the first sensor component of the wearable device, obtaining the first detection value of the first sensor component corresponding to a plurality of user hand states respectively; Determine a correspondence between a first detection value of the first sensor component and a state of a user's hand to obtain a first correspondence.

11. The gesture control method according to any one of claims 1 to 3, further comprising: Before obtaining the current first detection value of the first sensor component of the wearable device, determining a maximum value and a minimum value of the obtained first detection value of the first sensor component; The maximum value and the minimum value are respectively matched with different user hand states to obtain a first corresponding relationship.

12. A wearable device, comprising a first sensor component, at least one processor, and a memory; at least one computer program is stored in the memory, and the at least one computer program is executed by the at least one processor, so that the at least one processor implements the gesture control method according to any one of claims 1 to 11.

13. The wearable device according to claim 12, wherein: The wearable device includes a device body and a wearable part, wherein the first end of the wearable part is elastically connected to the first end of the device body, and the second end of the wearable part is connected to the second end of the device body; the first sensor assembly includes a first sensor and a detection sheet, wherein the first end of the detection sheet is rigidly connected to the first end of the wearable part, and the second end of the detection sheet is elastically connected to the second end of the wearable part; the detection sheet changes the area covered by the detection sheet on the detection window of the first sensor by moving.

14. The wearable device according to claim 13, wherein: The first sensor includes a magnetic sensor, and the detection sheet includes a magnetic detection sheet; or The first sensor includes an infrared transmitting and receiving tube, and the detection piece includes an infrared reflecting Shoot the board.

15. The wearable device according to claim 12, wherein: The wearable device includes a device body and a wearable part; the first sensor component includes an elastic sensor; the first end of the wearable part is elastically connected to the first end of the device body through the elastic sensor, and the second end of the wearable part is connected to the second end of the device body. 16 . A computer-readable storage medium having a computer program stored thereon, wherein the computer program is executed by a processor so that the processor implements the gesture control method according to any one of claims 1 to 11.

Images