Gesture recognition methods, devices, smart wearable devices, media and software products

By setting up a positioning module on the first smart wearable device to communicate with the second smart wearable device, and acquiring and mapping pose information, the problems of low gesture recognition accuracy and high latency of the second smart wearable device are solved, achieving high-precision, low-latency gesture recognition and expanding application scenarios.

CN123114244APending Publication Date: 2026-11-17BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202510622923.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-05-14
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

Existing gesture recognition technologies have shortcomings in terms of recognition accuracy and speed, especially for second smart wearable devices, which suffer from low gesture recognition accuracy and high latency.

Method used

By setting a positioning module at the target location of the first smart wearable device and communicating with the second smart wearable device, the first pose information set of the hand and the positioning data of the second smart wearable device are obtained, the pose mapping relationship is determined, and high-precision, low-latency gesture recognition is achieved.

Benefits of technology

It improves the gesture recognition accuracy of the second smart wearable device, reduces gesture recognition latency, and expands its application scenarios, especially in high-precision scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123114244A_ABST
    Figure CN123114244A_ABST
Patent Text Reader

Abstract

This disclosure provides a gesture recognition method, apparatus, smart wearable device, medium, and program product. The method is applied to a first smart wearable device, where a target location includes a positioning module associated with a second smart wearable device, and the first and second smart wearable devices are communicatively connected. The method includes: acquiring a first pose information set of a hand, wherein the first pose information set represents a collection of first pose information, and the hand includes a target location; acquiring second pose information of the target location in the second smart wearable device; determining a pose mapping relationship based on the first and second pose information corresponding to the target location; determining gesture data based on the pose mapping relationship and the first pose information set; and sending the gesture data to the second smart wearable device. The technical solution of this disclosure can solve the problems of low gesture recognition accuracy and high latency in second smart wearable devices.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to virtual reality technology, and more particularly to a gesture recognition method, apparatus, smart wearable device, medium, and program product. Background Technology

[0002] In the field of virtual reality, gesture control is flexible, natural, intuitive, and can directly simulate actions in the real world, thus finding widespread application in smart wearable devices. Accurate and rapid recognition of gestures is a prerequisite for gesture control. However, current gesture recognition technologies have shortcomings in terms of accuracy and speed. Summary of the Invention

[0003] This disclosure provides a gesture recognition method, apparatus, smart wearable device, medium, and program product that can optimize gesture recognition methods.

[0004] In a first aspect, embodiments of this disclosure provide a gesture recognition method applied to a first smart wearable device, wherein a positioning module associated with a second smart wearable device is included at a target location of the first smart wearable device, and the first smart wearable device and the second smart wearable device are communicatively connected, the method comprising:

[0005] Obtain the first pose information set of the hand, wherein the first pose information set represents the set of first pose information, and the hand includes the target position;

[0006] The second pose information of the target position in the second smart wearable device is obtained, and the pose mapping relationship is determined according to the first pose information and the second pose information corresponding to the target position. The second pose information is determined by the second smart wearable device based on the positioning data collected by the positioning module.

[0007] Gesture data is determined based on the pose mapping relationship and the first pose information set, and the gesture data is sent to the second smart wearable device.

[0008] Secondly, this disclosure also provides a gesture recognition method applied to a second smart wearable device, the second smart wearable device being communicatively connected to a first smart wearable device, wherein a positioning module associated with the second smart wearable device is located at a target position of the first smart wearable device, and the method includes:

[0009] The positioning data sent by the positioning module is obtained, and the second pose information corresponding to the target position is determined based on the positioning data.

[0010] Send the second pose information to the first smart wearable device to obtain the first pose information set of the hand through the first smart wearable device, determine the pose mapping relationship based on the first pose information and the second pose information corresponding to the target position, and determine the gesture data according to the pose mapping relationship and the first pose information set;

[0011] Obtain the gesture data from the first smart wearable device.

[0012] Thirdly, this disclosure also provides a gesture recognition device applied to a first smart wearable device, wherein the target location of the first smart wearable device includes a positioning module associated with a second smart wearable device, and the first smart wearable device and the second smart wearable device are communicatively connected. The device includes:

[0013] The first acquisition module is used to acquire the first pose information set of the hand, wherein the first pose information set represents the set of first pose information, and the hand includes the target position;

[0014] The relationship determination module is used to obtain the second pose information of the target position in the second smart wearable device, and determine the pose mapping relationship based on the first pose information and the second pose information corresponding to the target position, wherein the second pose information is determined by the second smart wearable device based on the positioning data collected by the positioning module;

[0015] The gesture determination module is used to determine gesture data based on the pose mapping relationship and the first pose information set, and send the gesture data to the second smart wearable device.

[0016] Fourthly, this disclosure also provides a gesture recognition device applied to a second smart wearable device, the second smart wearable device being communicatively connected to a first smart wearable device, and a positioning module associated with the second smart wearable device being located at a target position of the first smart wearable device. The device includes:

[0017] The second acquisition module is used to acquire the positioning data sent by the positioning module and determine the second pose information corresponding to the target position based on the positioning data.

[0018] The sending module is used to send the second pose information to the first smart wearable device, so as to obtain the first pose information set of the hand through the first smart wearable device, determine the pose mapping relationship based on the first pose information and the second pose information corresponding to the target position, and determine the gesture data according to the pose mapping relationship and the first pose information set;

[0019] The third acquisition module is used to acquire the gesture data of the first smart wearable device.

[0020] Fifthly, embodiments of this disclosure also provide a smart wearable device, the smart wearable device comprising:

[0021] One or more processors;

[0022] Storage device for storing one or more programs.

[0023] When the one or more programs are executed by the one or more processors, the one or more processors implement the gesture recognition method as described in any embodiment of this disclosure.

[0024] Sixthly, embodiments of this disclosure also provide a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to perform the gesture recognition method as described in any embodiment of this disclosure.

[0025] In a seventh aspect, embodiments of this disclosure also provide a computer program product, including a computer program that, when executed by a processor, implements the gesture recognition method as described in any embodiment of this disclosure.

[0026] This disclosure provides a gesture recognition method. By setting a positioning module at a target location in a first smart wearable device, and associating the positioning module with a second smart wearable device, the method can collect positioning data at the target location and send the positioning data to the second smart wearable device. The first and second smart wearable devices are communicatively connected, enabling data transfer between them. A first pose information set of the hand is obtained, representing a collection of first pose information, with the hand including the target location. Second pose information of the target location in the second smart wearable device is obtained. A pose mapping relationship is determined based on the first and second pose information of the target location. This allows for the determination of the pose mapping relationship from the first pose information set to the second smart wearable device by using pose information recognition results from different smart wearable devices at the same location. Then, gesture data is determined based on the pose mapping relationship and the first pose information set, and the gesture data is sent to the second smart wearable device. Because the gesture recognition method of the first smart wearable device is characterized by high accuracy and low latency, a pose mapping relationship is used to map the first pose information set determined by the first smart wearable device to the second smart wearable device. This allows the second smart wearable device to use the gesture recognition results of the first smart wearable device, solving the problems of low accuracy and high latency in the gesture recognition of the second smart wearable device. Through this embodiment, the accuracy of gesture recognition of the second smart wearable device is improved, and the latency is reduced. This allows the second smart wearable device to be applied to high-precision scenarios, expanding its application scenarios. Attached Figure Description

[0027] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0028] Figure 1 This is a flowchart illustrating a gesture recognition method provided in an embodiment of the present disclosure;

[0029] Figure 2 This is a flowchart illustrating another gesture recognition method provided in an embodiment of the present disclosure;

[0030] Figure 3 This is a schematic diagram illustrating the interaction between a first smart wearable device and a second smart wearable device, provided in an embodiment of this disclosure.

[0031] Figure 4 This is a flowchart illustrating another gesture recognition method provided in an embodiment of the present disclosure;

[0032] Figure 5 This is a schematic diagram of the structure of a gesture recognition device provided in an embodiment of the present disclosure;

[0033] Figure 6 This is a schematic diagram of another gesture recognition device provided in an embodiment of the present disclosure;

[0034] Figure 7 This is a schematic diagram of the structure of a smart wearable device provided in an embodiment of this disclosure. Detailed Implementation

[0035] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0036] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.

[0037] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.

[0038] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0039] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0040] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0041] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0042] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.

[0043] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0044] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0045] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0046] Figure 1 This is a flowchart illustrating a gesture recognition method provided in an embodiment of this disclosure. This embodiment is applicable to virtual reality scenarios, such as virtual simulation or robot control, where high-precision gesture recognition results are required. The method can be executed by a gesture recognition device, which can be implemented in software and / or hardware. The method is applied to a first smart wearable device. Optionally, the first smart wearable device can be a motion capture device worn on the hand. The first smart wearable device is selected as a high-precision, low-latency motion capture device. The motion capture device can capture every subtle movement of the hand with high precision. For example, the motion capture device can be a motion capture glove, etc. The target location of the first smart wearable device includes a positioning module associated with a second smart wearable device, and the first smart wearable device and the second smart wearable device are communicatively connected. For example, the second smart wearable device includes a head-mounted display, etc.

[0047] like Figure 1 As shown, the method includes:

[0048] S110. Obtain the first pose information set of the hand, wherein the first pose information set represents the set of first pose information, and the hand includes the target position.

[0049] The first pose information set represents the set of first pose information corresponding to preset detection points on the hand. Optionally, the preset detection points can be determined based on the joint positions of the hand. For example, preset detection points may include fingertips, finger joints, metacarpophalangeal joints, and wrist-metacarpophalangeal joints. The first pose information set includes the set of first pose information for both hands. It can be understood that the set of first pose information for both hands includes the first pose information set corresponding to the left hand and the first pose information set corresponding to the right hand.

[0050] In some embodiments, the first smart wearable device includes motion capture gloves. Two motion capture gloves are included, one for the left hand and one for the right. Sensors in the motion capture gloves capture motion data at preset detection points and determine the first pose information for the corresponding detection points based on the motion data. For example, the first smart wearable device captures at least one of the motion data of the preset detection points, such as bending, abduction, position, tactile feedback, and force, and determines the first pose information for the preset detection points based on the captured motion data. Since the first smart wearable device determines the first pose information set based on motion data from multiple preset detection points on the hand, it represents gestures from the dimension of joint movement, achieving high gesture recognition accuracy. Furthermore, compared to image recognition methods in related technologies, the first smart wearable device determines the first pose information based on motion data, avoiding complex image processing steps and significantly reducing latency.

[0051] Pose information includes position and orientation. Position can be represented as position coordinates. Orientation can be represented as rotation data. Optionally, quaternions can be used to represent rotation data. It is understood that quaternions can be used to represent the rotation of a preset detection point about any axis of rotation in three-dimensional space.

[0052] The target location is the installation position of the positioning module associated with the second smart wearable device among preset detection points. The first smart wearable device can determine the first pose information of the target location, and the positioning module can also collect the positioning data of the target location. The positioning module sends the positioning data of the target location to the second smart wearable device. The second smart wearable device determines the second pose information of the target location based on the positioning data. Through the embodiments of this disclosure, the pose information of the target location at the same time can be identified by both the first and second smart wearable devices.

[0053] In some embodiments, the positioning module is fixed at a target location on the first smart wearable device. The first smart wearable device stores a correspondence between itself and the positioning module. For example, a first smart wearable device worn on the left hand corresponds to a positioning module fixed on the same device; the device identifier and positioning module identifier can be associated and stored in the first smart wearable device worn on the left hand. Similarly, a first smart wearable device worn on the right hand corresponds to a positioning module fixed on the same device; the device identifier and positioning module identifier can be associated and stored in the first smart wearable device worn on the right hand.

[0054] In some embodiments, the positioning module is communicatively connected to the second smart wearable device. The positioning module can send the collected positioning data to the second smart wearable device. The first smart wearable device and the second smart wearable device are communicatively connected to enable data communication between the first smart wearable device and the second smart wearable device.

[0055] Optionally, the positioning module can be a module with spatial positioning capabilities. For example, the positioning module includes an inertial measurement unit and an infrared sensor. When used in conjunction with a second smart wearable device, the positioning module can determine the second pose information corresponding to the target location.

[0056] S120. Obtain the second pose information of the target position in the second smart wearable device, and determine the pose mapping relationship based on the first pose information and the second pose information corresponding to the target position, wherein the second pose information is determined by the second smart wearable device based on the positioning data collected by the positioning module.

[0057] Since the positioning module is fixedly installed at the target location of the first smart wearable device, it can periodically collect positioning data at the target location. The data collection cycle of the positioning module is related to the data collection cycle of the motion data of the preset detection points of the first smart wearable device. It is understood that the positioning module needs to collect data synchronously with the first smart wearable device. The positioning module sends the positioning data and the collection time to the second smart wearable device, so that the second smart wearable device can determine the second pose information of the target location at the corresponding time based on the positioning data.

[0058] The pose mapping relationship represents the transformation logic upon which the first pose information at the same moment at the target position is transformed into the second pose information. In some embodiments, the pose mapping relationship may include rotation matrices and / or translation matrices, etc. The pose mapping relationship is used to map the first pose information set to a second smart wearable device.

[0059] For example, the number of the first smart wearable devices is two, and each smart wearable device has at least one positioning module set at the target location.

[0060] The step of obtaining the second pose information of the target position in the second smart wearable device includes: obtaining the corresponding second pose information from the second smart wearable device based on the correspondence with the positioning module and the acquisition time of the first pose information set.

[0061] In some embodiments, the first smart wearable device can be worn on both hands to capture motion data at preset detection points. Accordingly, the first smart wearable device corresponding to the left hand is used to capture motion data at preset detection points on the left hand, and the first smart wearable device corresponding to the right hand is used to capture motion data at preset detection points on the right hand. The positioning module at the target position of the first smart wearable device corresponding to the left hand collects positioning data at the target position of the left hand and sends the positioning data at the target position of the left hand to the second smart wearable device. The positioning module at the target position of the first smart wearable device corresponding to the right hand collects positioning data at the target position of the right hand and sends the positioning data at the target position of the right hand to the second smart wearable device. The second smart wearable device determines the second pose information at the target position of the left hand based on the positioning data at the target position of the left hand. The second smart wearable device determines the second pose information at the target position of the right hand based on the positioning data at the target position of the right hand. The second smart wearable device stores the second pose information, the identifier of the positioning module, and the acquisition time in association. The identifier of the positioning module is used to identify the positioning module on the first smart wearable device corresponding to the left or right hand.

[0062] It is understandable that if the first smart wearable device in a single hand has multiple positioning modules, the second smart wearable device will determine the second pose information corresponding to each target position based on the positioning data of each target position determined by each positioning module, and store the identifier, second pose information and sampling time of each positioning module in association.

[0063] Since the positioning modules are fixed at the target position of the first smart wearable device, both the left and right sides of the first smart wearable device have positioning modules, but the identifiers for these modules are different. The corresponding second pose information can be obtained from the second smart wearable device using the identifiers of the positioning modules and the acquisition time of the first pose information. That is, the left-hand first smart wearable device obtains the second pose information corresponding to the target position from the second smart wearable device based on the identifier of the positioning module on the left-hand first smart wearable device and the acquisition time of the first pose information. Similarly, the right-hand first smart wearable device obtains the second pose information corresponding to the target position from the second smart wearable device based on the identifier of the positioning module on the right-hand first smart wearable device and the acquisition time of the first pose information.

[0064] In some embodiments, determining the pose mapping relationship based on the first pose information and the second pose information corresponding to the target position includes: using the first pose information and the second pose information corresponding to the target position at the same time to determine the pose mapping relationship.

[0065] S130. Determine gesture data based on the pose mapping relationship and the first pose information set, and send the gesture data to the second smart wearable device.

[0066] Among them, gesture data represents the gesture recognition results required for the second smart wearable device to perform gesture processing.

[0067] For example, gesture data is obtained by adjusting the first pose information in the first pose information set based on the pose mapping relationship. Optionally, the first pose information includes first position coordinates and first rotation data, etc. The gesture data is written into a preset shared memory, and a first identifier is sent to the second smart wearable device, wherein the first identifier is used to prompt the second smart wearable device to read the gesture data from the preset shared memory.

[0068] The default shared content is the same physical memory region shared by different processes. Optionally, shared memory can be implemented through physical memory mapping. For example, processes in the first smart wearable device and processes in the second smart wearable device can map the same physical memory into their respective virtual address spaces, thereby enabling direct access to the same memory region.

[0069] The first identifier is a pre-defined identifier. This identifier indicates whether the operation of writing gesture data from the first smart wearable device to the preset shared memory has been completed. If completed, the second smart wearable device reads the gesture data from the preset shared memory. Alternatively, if incomplete, the second smart wearable device can wait for the gesture data to be written before reading the gesture data from the preset shared memory.

[0070] The technical solution of this disclosure embodiment, by setting a positioning module at the target location of a first smart wearable device, and having the positioning module associated with a second smart wearable device, enables the collection of positioning data at the target location via the positioning module and the transmission of the positioning data to the second smart wearable device. The first and second smart wearable devices are communicatively connected, enabling data transfer between them. A first pose information set of the hand is obtained, representing a collection of first pose information, with the hand including the target location. Second pose information of the target location in the second smart wearable device is obtained. A pose mapping relationship is determined based on the first and second pose information of the target location. This allows for the determination of the pose mapping relationship from the first pose information set to the second smart wearable device by using pose information recognition results from different smart wearable devices at the same location. Then, gesture data is determined based on the pose mapping relationship and the first pose information set, and the gesture data is sent to the second smart wearable device. Because the gesture recognition method of the first smart wearable device is characterized by high accuracy and low latency, a pose mapping relationship is used to map the first pose information set determined by the first smart wearable device to the second smart wearable device. This allows the second smart wearable device to use the gesture recognition results of the first smart wearable device, solving the problems of low accuracy and high latency in the gesture recognition of the second smart wearable device. Through this embodiment, the accuracy of gesture recognition of the second smart wearable device is improved, and the latency is reduced. This allows the second smart wearable device to be applied to high-precision scenarios, expanding its application scenarios.

[0071] Figure 2 This is a flowchart illustrating another gesture recognition method provided in this embodiment. Based on the above embodiments, this embodiment specifically defines the pose mapping relationship based on the first pose information and the second pose information corresponding to the target position.

[0072] like Figure 2 As shown, the method includes:

[0073] S210. Obtain the first pose information set of the hand, wherein the first pose information set represents the set of first pose information, and the hand includes the target position.

[0074] For example, the first smart wearable device acquires the first pose information set of the hand. The first smart wearable device is one with high gesture recognition accuracy and low gesture recognition latency.

[0075] S220. Obtain the second pose information of the target position in the second smart wearable device, wherein the second pose information is determined by the second smart wearable device based on the positioning data collected by the positioning module.

[0076] S230. Determine the pose mapping relationship based on the first position coordinates, first rotation data, second position coordinates and second rotation data corresponding to the target position, wherein the pose mapping relationship is used to map the first pose information set to the second smart wearable device.

[0077] Pose information may include position coordinates and rotation data. The first pose information at the target position includes the first position coordinates and first rotation data corresponding to the target position. The second pose information includes the second position coordinates and second rotation data corresponding to the target position. Optionally, quaternions can be used to represent the rotation data. Accordingly, the first rotation data can be represented by a first quaternion. The second rotation data can be represented by a second quaternion.

[0078] For example, determining the pose mapping relationship based on the first position coordinates, first rotation data, second position coordinates, and second rotation data corresponding to the target position includes: determining a rotation matrix and a translation matrix based on the first position coordinates, first quaternion, second position coordinates, and second quaternion corresponding to the target position. The rotation matrix and translation matrix can transform the first pose information at the same moment at the target position into the second pose information. The rotation matrix and translation matrix can represent the mapping relationship between the gesture recognition result of the first smart wearable device and the gesture recognition result of the second smart wearable device at the current moment.

[0079] In some embodiments, if there are multiple positioning modules on the first smart wearable device of the left and / or right hand, each target position corresponds to a set of first position coordinates, a first quaternion, a second position coordinate, and a second quaternion. For any target position, the rotation matrix and translation matrix corresponding to the current target position are determined based on the first position coordinates, the first quaternion, the second position coordinates, and the second quaternion. Based on the rotation matrix and translation matrix corresponding to each target position, the rotation matrix and translation matrix required for the transformation of the first pose information set corresponding to the first smart wearable device of the left and / or right hand to the pose transformation of the second smart wearable device are determined. For example, based on the rotation matrix and translation matrix corresponding to each target position, the number of identical rotation matrix and translation matrix is ​​determined, and the rotation matrix and translation matrix required for the pose transformation is determined based on the rotation matrix and translation matrix with the largest number. Alternatively, the rotation matrix and translation matrix required for the pose transformation are determined based on the average value of the rotation matrix and the average value of the translation matrix corresponding to each target position. This disclosure does not specifically limit this aspect.

[0080] S240. Adjust the first position coordinates and / or first rotation data corresponding to the first pose information set based on the pose mapping relationship to obtain the gesture data.

[0081] For example, by adjusting the first pose information in the first pose information set using a rotation matrix and a translation matrix, the position coordinates and / or rotation data corresponding to the first pose information set are adjusted to obtain the position coordinates and rotation data of the first pose in the first pose information set in the second smart wearable device, which are then used as gesture data.

[0082] S250, The gesture data is sent to the second smart wearable device.

[0083] For example, the gesture data is written into a preset shared memory, and a first identifier is sent to the second smart wearable device, wherein the first identifier is used to prompt the second smart wearable device to read the gesture data from the preset shared memory.

[0084] Figure 3 This is a schematic diagram illustrating the interaction between a first smart wearable device and a second smart wearable device, provided as an embodiment of this disclosure. Figure 3 As shown, the first smart wearable device 310 acquires a first pose information set of the hand. A positioning module 320 is fixed at the target position of the first smart wearable device 310. The first smart wearable device 310 acquires second pose information at the target position. A pose mapping relationship is determined based on the first pose information and the second pose information at the target position. The position coordinates and / or rotation data corresponding to the first pose information set are adjusted according to the pose mapping relationship to obtain gesture data. The gesture data is written to a preset shared memory 330. The second smart wearable device 340 reads the gesture data from the preset shared memory 330 and performs gesture processing based on the gesture data. For example, gesture processing includes displaying a hand motion image on an interactive page.

[0085] The technical solution of this disclosure determines the pose mapping relationship between the first pose information and the second pose information corresponding to the target position by using the first position coordinates, first rotation data, second position coordinates, and second rotation data at the same time at the target position. This reduces the complexity of determining the pose mapping relationship and improves the efficiency of determining the pose mapping relationship. Based on the pose mapping relationship, the position coordinates and / or rotation data corresponding to the first pose information set are adjusted to quickly and accurately transform the first pose information set into gesture data for the second smart wearable device. This allows the second smart wearable device to perform gesture processing based on the gesture data, improving the gesture recognition accuracy of the second smart wearable device and reducing gesture recognition latency.

[0086] Figure 4This is a flowchart illustrating another gesture recognition method provided in this embodiment of the present disclosure. This embodiment is applicable to virtual reality scenarios, such as virtual simulation or robot control, where high-precision gesture recognition results are required. The method can be executed by a gesture recognition device, which can be implemented in software and / or hardware. The method is applied to a second smart wearable device. The second smart wearable device is communicatively connected to a first smart wearable device, and the target location of the first smart wearable device includes a positioning module associated with the second smart wearable device.

[0087] like Figure 4 As shown, the method includes:

[0088] S410. Obtain the positioning data sent by the positioning module, and determine the second pose information corresponding to the target position based on the positioning data.

[0089] The positioning module is a spatial positioning module fixed at the target location of the first smart wearable device. The positioning module is communicatively connected to the second smart wearable device. Optionally, the first smart wearable device can be a motion capture device worn on the hand. The first smart wearable device is selected from high-precision and low-latency motion capture devices. The motion capture device can accurately capture every subtle movement of the hand. For example, the motion capture device can be a motion capture glove, etc. The first smart wearable device is communicatively connected to the second smart wearable device. The second smart wearable device includes a head-mounted display, etc.

[0090] The positioning module includes modules with positioning functions for the target positions of the left and right hands on the first smart wearable device. The positioning module works in conjunction with the second smart wearable device to identify the second pose information of the target positions for the left and right hands. Based on the positioning data sent by the positioning module and the acquisition time, the second smart wearable device determines the second pose information of the target positions for the left and right hands. The second smart wearable device associates and stores the identifier of the positioning module, the second pose information, and the sampling time.

[0091] For example, determining the second pose information corresponding to the target position based on the positioning data includes: determining the second position coordinates and second rotation data corresponding to the target position based on the positioning data, and storing the identifier, sampling time, second position coordinates and second rotation data of the positioning module in association.

[0092] Optionally, the positioning module includes an inertial measurement unit and infrared sensors, etc. Based on the positioning data from the inertial measurement unit and infrared sensors, the second position coordinates and second rotation data corresponding to the target position are determined.

[0093] S420. Send the second pose information to the first smart wearable device to obtain the first pose information set of the hand through the first smart wearable device, determine the pose mapping relationship based on the first pose information and the second pose information corresponding to the target position, and determine the gesture data according to the pose mapping relationship and the first pose information set.

[0094] In some embodiments, the first smart wearable device and the second smart wearable device are communicatively connected. In response to a pose acquisition request from the first smart wearable device, the pose acquisition request includes an identifier of the positioning module. Based on the identifier, second pose information is determined and sent to the first smart wearable device. Optionally, the latest determined second pose information is acquired based on the identifier and sent to the first smart wearable device. Optionally, the pose acquisition request also includes a data acquisition time. Based on the identifier and the data acquisition time, the second pose information is determined and sent to the first smart wearable device.

[0095] In some embodiments, in response to determining second pose information based on positioning data, the second pose information is sent to the first smart wearable device. If second pose information is determined based on positioning data, the current second pose information is sent to the corresponding first smart wearable device based on the identifier of the positioning module associated with the current second pose information.

[0096] It is understood that the first smart wearable device acquires the first pose information set of the hand, determines the pose mapping relationship based on the first pose information and the second pose information corresponding to the target position, and determines the gesture data according to the pose mapping relationship and the first pose information set, which has been described in the above embodiments and will not be repeated here.

[0097] S430: Obtain the gesture data of the first smart wearable device.

[0098] Among them, gesture data represents the gesture recognition results required for the second smart wearable device to perform gesture processing.

[0099] For example, acquiring the gesture data of the first smart wearable device includes: in response to receiving a first identifier sent by the first smart wearable device, reading the gesture data from a preset shared memory; in response to the completion of reading the gesture data, sending a second identifier to the first smart wearable device, wherein the second identifier is used to prompt the first smart wearable device to write the gesture data into the preset shared memory.

[0100] For example, the second smart wearable device receives a first identifier from the first smart wearable device and reads gesture data from a preset shared memory. If the gesture data in the preset shared memory has been completely read, the second smart wearable device sends a second identifier to the first smart wearable device to notify it to continue writing new gesture data to the preset shared memory. If the first smart wearable device has completed writing to the preset shared memory, it sends a first identifier to the second smart wearable device to notify it to read gesture data from the preset shared memory. This process continues, mapping the high-precision, low-latency gesture data from the first smart wearable device to the corresponding gesture recognition result of the second smart wearable device, and then sending the gesture recognition result to the second smart wearable device.

[0101] The technical solution of this disclosure involves using a second smart wearable device to determine the second pose information corresponding to the target position of a first smart wearable device based on positioning data sent by a positioning module. The second pose information corresponding to the target position is then sent to the first smart wearable device to obtain a first pose information set of the hand. Based on the first pose information and the second pose information corresponding to the target position in the first pose information set, a pose mapping relationship is determined. This pose mapping relationship maps the first pose information set determined by the first smart wearable device to the second smart wearable device. Since the gesture recognition method of the first smart wearable device has high precision and low latency, the second smart wearable device uses the gesture recognition results from the first smart wearable device, improving the accuracy of gesture recognition and reducing latency. This allows the second smart wearable device to be applied to high-precision scenarios, expanding its application scenarios.

[0102] Figure 5 This is a schematic diagram of a gesture recognition device provided in an embodiment of the present disclosure. The device can be implemented in software and / or hardware, and the method is applied to a first smart wearable device. Optionally, the first smart wearable device can be a motion capture device worn on the hand. The first smart wearable device is selected as a high-precision, low-latency motion capture device. The motion capture device can capture every subtle movement of the hand with high precision. For example, the motion capture device can be a motion capture glove, etc. The target location of the first smart wearable device includes a positioning module associated with a second smart wearable device, and the first smart wearable device and the second smart wearable device are communicatively connected.

[0103] like Figure 5 As shown, the device includes: a first acquisition module 510, a relationship determination module 520, and a gesture determination module 530.

[0104] The first acquisition module 510 is used to acquire a first pose information set of the hand, wherein the first pose information set represents a set of first pose information, and the hand includes the target position;

[0105] The relationship determination module 520 is used to obtain the second pose information of the target position in the second smart wearable device, and determine the pose mapping relationship based on the first pose information and the second pose information corresponding to the target position, wherein the second pose information is determined by the second smart wearable device based on the positioning data collected by the positioning module;

[0106] The gesture determination module 530 is used to determine gesture data based on the pose mapping relationship and the first pose information set, and send the gesture data to the second smart wearable device.

[0107] Optionally, the number of the first smart wearable devices is two, and each smart wearable device is provided with at least one positioning module at the target location.

[0108] The relationship determination module 520 includes a pose acquisition unit;

[0109] The pose acquisition unit is used to acquire the corresponding second pose information from the second smart wearable device based on the correspondence with the positioning module and the acquisition time of the first pose information set.

[0110] Optionally, the relationship determination module 520 includes a relationship determination unit:

[0111] The relationship determination unit is used to determine the pose mapping relationship based on the first position coordinates, first rotation data, second position coordinates and second rotation data corresponding to the target position, wherein the pose mapping relationship is used to map the first pose information set to the second smart wearable device.

[0112] Optionally, the relationship determination unit is specifically used for:

[0113] The rotation matrix and translation matrix are determined based on the first position coordinates, the first quaternion, the second position coordinates, and the second quaternion corresponding to the target position.

[0114] Optionally, the gesture determination module 530 includes a gesture determination unit;

[0115] The gesture determination unit is used to adjust the first position coordinates and / or first rotation data corresponding to the first pose information set based on the pose mapping relationship to obtain the gesture data.

[0116] Optionally, the gesture determination module 530 includes a gesture sending unit;

[0117] A gesture sending unit is used to write the gesture data into a preset shared memory and send a first identifier to the second smart wearable device, wherein the first identifier is used to prompt the second smart wearable device to read the gesture data from the preset shared memory.

[0118] The gesture recognition device provided in this disclosure can execute the gesture recognition method provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

[0119] Figure 6 This is a schematic diagram of another gesture recognition device provided in an embodiment of this disclosure. The device can be implemented in software and / or hardware, and the method is applied to a second smart wearable device. The second smart wearable device is communicatively connected to a first smart wearable device, and the target location of the first smart wearable device includes a positioning module associated with the second smart wearable device.

[0120] like Figure 6 As shown, the device includes: a second acquisition module 610, a sending module 620, and a third acquisition module 630.

[0121] The second acquisition module 610 is used to acquire the positioning data sent by the positioning module and determine the second pose information corresponding to the target position based on the positioning data.

[0122] The sending module 620 is used to send the second pose information to the first smart wearable device, so as to obtain the first pose information set of the hand through the first smart wearable device, determine the pose mapping relationship based on the first pose information and the second pose information corresponding to the target position, and determine the gesture data according to the pose mapping relationship and the first pose information set.

[0123] The third acquisition module 630 is used to acquire the gesture data of the first smart wearable device.

[0124] Optionally, the second acquisition module 610 is specifically used for:

[0125] Based on the positioning data, determine the second position coordinates and second rotation data corresponding to the target position, and store the identifier, sampling time, second position coordinates and second rotation data of the positioning module in association.

[0126] Optionally, the third acquisition module 630 is specifically used for:

[0127] In response to receiving a first identifier sent by the first smart wearable device, the gesture data is read from a preset shared memory;

[0128] In response to the completion of the gesture data reading, a second identifier is sent to the first smart wearable device, wherein the second identifier is used to prompt the first smart wearable device to write the gesture data into the preset shared memory.

[0129] The gesture recognition device provided in this disclosure can execute the gesture recognition method provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

[0130] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments of this disclosure.

[0131] Figure 7 This is a schematic diagram of the structure of a smart wearable device provided in an embodiment of this disclosure. Refer to the following... Figure 7 It illustrates a smart wearable device suitable for implementing embodiments of the present disclosure (e.g., Figure 7 A schematic diagram of the structure of a first smart wearable device or a second smart wearable device 700 is shown. Figure 7 The smart wearable device shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments disclosed herein.

[0132] like Figure 7 As shown, the smart wearable device 700 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage device 708 into a random access memory (RAM) 703. The RAM 703 also stores various programs and data required for the operation of the smart wearable device 700. The processing unit 701, ROM 702, and RAM 703 are interconnected via a bus 704. An edit / output (I / O) interface 705 is also connected to the bus 704.

[0133] Typically, the following devices can be connected to I / O interface 705: input device 706 including at least one of, for example, a touchscreen, touchpad, camera, microphone, accelerometer, gyroscope, etc.; optionally, output device 707 including, for example, liquid crystal display (LCD), speaker, vibrator, etc.; storage device 708 including, for example, magnetic tape, hard disk, etc.; and communication device 709. Communication device 709 allows smart wearable device 700 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 7A smart wearable device 700 with various devices is shown, but it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or included alternatively.

[0134] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 708, or installed from storage device 707, or installed from ROM 702. When the computer program is executed by processing device 701, it performs the functions defined in the methods of embodiments of this disclosure.

[0135] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0136] The smart wearable device provided in this embodiment and the gesture recognition method applied to the second smart wearable device provided in the above embodiment belong to the same inventive concept. Technical details not described in detail in this embodiment can be found in the above embodiments, and this embodiment has the same beneficial effects as the above embodiments.

[0137] This disclosure provides a computer storage medium storing a computer program that, when executed by a processor, implements the gesture recognition method provided in the above embodiments.

[0138] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0139] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0140] The aforementioned computer-readable medium may be included in the aforementioned electronic device; alternatively, it may exist independently and not assembled into the electronic device. The electronic device includes a first smart wearable device and a second smart wearable device. The first smart wearable device includes a positioning module associated with the second smart wearable device at a target location, and the first smart wearable device and the second smart wearable device are communicatively connected.

[0141] The aforementioned computer-readable medium carries one or more programs, which, when executed by the first smart wearable device, cause the first smart wearable device to:

[0142] Obtain the first pose information set of the hand, wherein the first pose information set represents the set of first pose information, and the hand includes the target position;

[0143] The second pose information of the target position in the second smart wearable device is obtained, and the pose mapping relationship is determined according to the first pose information and the second pose information corresponding to the target position. The second pose information is determined by the second smart wearable device based on the positioning data collected by the positioning module.

[0144] Gesture data is determined based on the pose mapping relationship and the first pose information set, and the gesture data is sent to the second smart wearable device.

[0145] Alternatively, the aforementioned computer-readable medium carries one or more programs that, when executed by the second smart wearable device, cause the second smart wearable device to:

[0146] The positioning data sent by the positioning module is obtained, and the second pose information corresponding to the target position is determined based on the positioning data.

[0147] Send the second pose information to the first smart wearable device to obtain the first pose information set of the hand through the first smart wearable device, determine the pose mapping relationship based on the first pose information and the second pose information corresponding to the target position, and determine the gesture data according to the pose mapping relationship and the first pose information set;

[0148] Obtain the gesture data from the first smart wearable device.

[0149] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0150] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0151] The units described in the embodiments of this disclosure can be implemented in software or hardware. The names of the units are not, in some cases, intended to limit the specific unit.

[0152] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0153] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0154] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0155] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0156] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A gesture recognition method, characterized in that, The method, applied to a first smart wearable device, wherein a positioning module associated with a second smart wearable device is located at a target position of the first smart wearable device, and the first smart wearable device and the second smart wearable device are communicatively connected, includes: Obtain the first pose information set of the hand, wherein the first pose information set represents the set of first pose information, and the hand includes the target position; The second pose information of the target position in the second smart wearable device is obtained, and the pose mapping relationship is determined according to the first pose information and the second pose information corresponding to the target position. The second pose information is determined by the second smart wearable device based on the positioning data collected by the positioning module. Gesture data is determined based on the pose mapping relationship and the first pose information set, and the gesture data is sent to the second smart wearable device.

2. The method according to claim 1, characterized in that, The first smart wearable device has two components, and each smart wearable device has at least one positioning module at the target location; The step of obtaining the second pose information of the target position in the second smart wearable device includes: Based on the correspondence with the positioning module and the acquisition time of the first pose information set, the corresponding second pose information is obtained from the second smart wearable device.

3. The method according to claim 1, characterized in that, Determining the pose mapping relationship based on the first pose information and the second pose information corresponding to the target position includes: Based on the first position coordinates, first rotation data, second position coordinates and second rotation data corresponding to the target position, the pose mapping relationship is determined, wherein the pose mapping relationship is used to map the first pose information set to the second smart wearable device.

4. The method according to claim 3, characterized in that, The step of determining the pose mapping relationship based on the first position coordinates, first rotation data, second position coordinates, and second rotation data corresponding to the target position includes: The rotation matrix and translation matrix are determined based on the first position coordinates, the first quaternion, the second position coordinates, and the second quaternion corresponding to the target position.

5. The method according to claim 3, characterized in that, The step of determining gesture data based on the pose mapping relationship and the first pose information set includes: Based on the pose mapping relationship, the first position coordinates and / or first rotation data corresponding to the first pose information set are adjusted to obtain the gesture data.

6. The method according to claim 1, characterized in that, Sending the gesture data to the second smart wearable device includes: The gesture data is written into a preset shared memory, and a first identifier is sent to the second smart wearable device, wherein the first identifier is used to prompt the second smart wearable device to read the gesture data from the preset shared memory.

7. A gesture recognition method, characterized in that, The method is applied to a second smart wearable device, which is communicatively connected to a first smart wearable device. The first smart wearable device has a target location including a positioning module associated with the second smart wearable device. The positioning data sent by the positioning module is obtained, and the second pose information corresponding to the target position is determined based on the positioning data. Send the second pose information to the first smart wearable device to obtain the first pose information set of the hand through the first smart wearable device, determine the pose mapping relationship based on the first pose information and the second pose information corresponding to the target position, and determine the gesture data according to the pose mapping relationship and the first pose information set; Obtain the gesture data from the first smart wearable device.

8. The method according to claim 7, characterized in that, The step of determining the second pose information corresponding to the target position based on the positioning data includes: Based on the positioning data, determine the second position coordinates and second rotation data corresponding to the target position, and store the identifier, sampling time, second position coordinates and second rotation data of the positioning module in association.

9. The method according to claim 7, characterized in that, The step of acquiring the gesture data from the first smart wearable device includes: In response to receiving a first identifier sent by the first smart wearable device, the gesture data is read from a preset shared memory; In response to the completion of the gesture data reading, a second identifier is sent to the first smart wearable device, wherein the second identifier is used to prompt the first smart wearable device to write the gesture data into the preset shared memory.

10. A gesture recognition device, characterized in that, An apparatus for use in a first smart wearable device, wherein a positioning module associated with a second smart wearable device is located at a target position of the first smart wearable device, and the first smart wearable device and the second smart wearable device are communicatively connected, the apparatus comprising: The first acquisition module is used to acquire the first pose information set of the hand, wherein the first pose information set represents the set of first pose information, and the hand includes the target position; The relationship determination module is used to obtain the second pose information of the target position in the second smart wearable device, and determine the pose mapping relationship based on the first pose information and the second pose information corresponding to the target position, wherein the second pose information is determined by the second smart wearable device based on the positioning data collected by the positioning module; The gesture determination module is used to determine gesture data based on the pose mapping relationship and the first pose information set, and send the gesture data to the second smart wearable device.

11. A gesture recognition device, characterized in that, An apparatus for use in a second smart wearable device, the second smart wearable device being communicatively connected to a first smart wearable device, wherein a positioning module associated with the second smart wearable device is located at a target position of the first smart wearable device, the apparatus comprising: The second acquisition module is used to acquire the positioning data sent by the positioning module and determine the second pose information corresponding to the target position based on the positioning data. The sending module is used to send the second pose information to the first smart wearable device, so as to obtain the first pose information set of the hand through the first smart wearable device, determine the pose mapping relationship based on the first pose information and the second pose information corresponding to the target position, and determine the gesture data according to the pose mapping relationship and the first pose information set; The third acquisition module is used to acquire the gesture data of the first smart wearable device.

12. A smart wearable device, characterized in that, The smart wearable device includes: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the gesture recognition method as described in any one of claims 1-9.

13. A storage medium containing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to perform the gesture recognition method as described in any one of claims 1-9.

14. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the gesture recognition method as described in any one of claims 1-9.