Palm contour extraction method and device, control command generation method and device, computer device, and computer program

Abstract

This application relates to a palm contour extraction method, a control command generation method, an apparatus, a computer device, a storage medium, and a computer program product. The method includes a step of acquiring skeleton point information corresponding to each palm skeleton point in a target palm image, the skeleton point information including a skeleton point position and a skeleton point type (step S202), a step of matching each palm skeleton point based on the skeleton point type to obtain a plurality of palm skeleton point sets, the palm skeleton point sets having a corresponding geometric processing type (step S204), and a step of extracting geometrical values ​​corresponding to the palm skeleton point sets based on the skeleton point positions corresponding to each skeleton point in the same palm skeleton point set. The method includes a step of generating a palm contour auxiliary line that matches the geometric processing type to obtain a palm contour auxiliary line corresponding to each palm skeleton point set (step S206); a step of determining palm contour points from the palm contour auxiliary line corresponding to the palm skeleton point set based on a reference step size and skeleton point positions corresponding to the same palm skeleton point set to obtain contour point positions corresponding to the palm contour points (step S208); and a step of generating a palm contour corresponding to the target palm image based on each contour point position (step S210).

Description

[Technical Field]

[0001] (Reference to Related Application) This application claims the benefit of priority to Chinese Patent Application No. 202210587233.0, entitled "Palm Outline Extraction Method, Control Command Generation Method, Apparatus and Computer Device," filed with the State Intellectual Property Office of the People's Republic of China on May 27, 2022, the entire contents of which are incorporated herein by reference.

[0002] (Technical Field) The present application relates to the technical field of computers, and in particular to a palm contour extraction method, a control command generation method, an apparatus, a computer device, a storage medium, and a computer program product. [Background technology]

[0003] With the development of computer technology, palm extraction techniques have emerged, including techniques for recognizing palm contours from palm images.

[0004] In conventional techniques, the palm contour is typically extracted from a palm image by performing various data processing operations on the pixel information of the palm image, for example, by performing binarization and edge detection on the palm image. However, methods that extract the palm contour based on the pixel information of the palm image are prone to interference from the background of the image, making it difficult to extract an accurate palm contour. Summary of the Invention [Problem to be solved by the invention]

[0005] SUMMARY OF THE INVENTION Embodiments of the present application provide a palm contour extraction method, a control command generation method, an apparatus, a computer device, a computer-readable storage medium, and a computer program product. [Means for solving the problem]

[0006] A palm contour extraction method executed by a computer device, comprising: acquiring skeleton point information corresponding to each palm skeleton point in the target palm image, the skeleton point information including a skeleton point position and a skeleton point type; matching each palm skeleton point according to the skeleton point type to obtain a plurality of palm skeleton point sets, each palm skeleton point set having a corresponding geometric processing type; generating palm outline auxiliary lines that match a geometric processing type corresponding to the palm skeleton point set based on skeleton point positions corresponding to each skeleton point in the same palm skeleton point set, thereby obtaining palm outline auxiliary lines corresponding to each palm skeleton point set; determining palm contour points from the palm contour auxiliary line corresponding to the set of palm skeleton points based on the reference step size and skeleton point positions corresponding to the same set of palm skeleton points, and obtaining contour point positions corresponding to the palm contour points; generating a palm contour corresponding to the target palm image based on each contour point position.

[0007] a skeleton point information acquisition module configured to acquire skeleton point information corresponding to each palm skeleton point in the target palm image, the skeleton point information including a skeleton point position and a skeleton point type; a palm skeleton point matching module configured to match each palm skeleton point based on the skeleton point type to obtain a plurality of palm skeleton point sets, the palm skeleton point sets having corresponding geometric processing types; a palm contour extension line determination module configured to generate palm contour extension lines that match a geometric processing type corresponding to the palm skeleton point set based on skeleton point positions corresponding to each skeleton point in the same palm skeleton point set, thereby obtaining palm contour extension lines corresponding to each palm skeleton point set; a palm outline point determination module configured to determine palm outline points from palm outline auxiliary lines corresponding to the same palm skeleton point set based on a reference step size and skeleton point positions corresponding to the same palm skeleton point set, and obtain outline point positions corresponding to the palm outline points; a palm contour generation module configured to generate a palm contour corresponding to the target palm image based on each contour point position.

[0008] The present invention provides a computer device including a memory in which computer-readable instructions are stored and one or more processors, wherein when the computer-readable instructions are executed by the one or more processors, the steps of the palm contour extraction method described above are realized.

[0009] Provided is a computer-readable storage medium having computer-readable instructions stored thereon, which, when executed by one or more processors, causes the steps of the palm contour extraction method to be realized.

[0010] The present invention provides a computer program product including computer-readable instructions, which, when executed by one or more processors, cause the steps of the palm contour extraction method to be realized.

[0011] A control instruction generation method executed by a computer device, comprising: displaying a palm contour determined based on the target palm image; generating a target control command based on the display information of the palm outline; The palm contour extraction process includes: acquiring skeleton point information corresponding to each palm skeleton point in the target palm image, the skeleton point information including a skeleton point position and a skeleton point type; matching each palm skeleton point according to the skeleton point type to obtain a plurality of palm skeleton point sets, each palm skeleton point set having a corresponding geometric processing type; generating palm outline auxiliary lines that match a geometric processing type corresponding to the palm skeleton point set based on skeleton point positions corresponding to each skeleton point in the same palm skeleton point set, thereby obtaining palm outline auxiliary lines corresponding to each palm skeleton point set; determining palm contour points from the palm contour auxiliary line corresponding to the set of palm skeleton points based on the reference step size and skeleton point positions corresponding to the same set of palm skeleton points, and obtaining contour point positions corresponding to the palm contour points; generating a palm contour corresponding to the target palm image based on each contour point position.

[0012] a palm contour display module configured to display a palm contour determined based on the target palm image; a control command generation module configured to generate a target control command based on the palm outline display information; The palm contour extraction process includes: acquiring skeleton point information corresponding to each palm skeleton point in the target palm image, the skeleton point information including a skeleton point position and a skeleton point type; matching each palm skeleton point according to the skeleton point type to obtain a plurality of palm skeleton point sets, each palm skeleton point set having a corresponding geometric processing type; generating palm outline auxiliary lines that match a geometric processing type corresponding to the palm skeleton point set based on skeleton point positions corresponding to each skeleton point in the same palm skeleton point set, thereby obtaining palm outline auxiliary lines corresponding to each palm skeleton point set; determining palm contour points from the palm contour auxiliary line corresponding to the set of palm skeleton points based on the reference step size and skeleton point positions corresponding to the same set of palm skeleton points, and obtaining contour point positions corresponding to the palm contour points; and generating a palm contour corresponding to the target palm image based on each contour point position.

[0013] Provided is a computer device including a memory in which computer-readable instructions are stored and one or more processors, wherein when the computer-readable instructions are executed by the one or more processors, the steps described in the above control instruction generation method are realized.

[0014] A computer-readable storage medium having computer-readable instructions stored thereon is provided, the computer-readable storage medium having computer-readable instructions stored thereon, the computer-readable instructions being capable of realizing the steps described in the control instruction generation method described above when executed by one or more processors.

[0015] A computer program product is provided that includes computer-readable instructions, which, when executed by one or more processors, cause the steps of the control instruction generation method described above to be realized.

[0016] The details of one or more embodiments of the present application are set forth in the drawings and description below. Other features, objects, and advantages of the present application will become apparent from the description, drawings, and claims. [Brief explanation of the drawings]

[0017] In order to more clearly describe the technical means in the embodiments of the present application, the following will briefly describe the drawings that need to be used in the description of the embodiments. It is obvious that the drawings in the following description are only some embodiments of the present application, and those skilled in the art can obtain other drawings based on these drawings without any creative work.

[0018] [Figure 1] FIG. 1 is a diagram illustrating an application environment of a palm contour extraction method and a control command generation method according to an embodiment. [Figure 2] FIG. 1 is a schematic flowchart of a palm contour extraction method according to an embodiment. [Figure 3] FIG. 1 is a schematic diagram of palm skeleton points in one embodiment. [Figure 4] 10A and 10B are schematic diagrams illustrating movement directions corresponding to palm outline extension lines in one embodiment. [Figure 5] FIG. 1 is a schematic diagram of a contour point sort identifier and palm contour in one embodiment. [Figure 6] FIG. 1 is a schematic flow chart diagram of a control command generation method according to an embodiment. [Figure 7A] FIG. 10 is a schematic diagram of a palm skeleton point recognition result according to an embodiment. [Figure 7B] FIG. 10 is a schematic diagram of a recognition result of palm outline points in one embodiment. [Figure 8A] FIG. 10 is a schematic diagram illustrating calculating coordinates of the outer contour of a palm in one embodiment. [Figure 8B] FIG. 10 is a schematic diagram illustrating calculation of interdigital coordinates in one embodiment. [Figure 8C] FIG. 10 is a schematic diagram illustrating calculation of coordinates of an edge of a finger outline in one embodiment. [Figure 8D] FIG. 1 is a schematic diagram of a palm profile in one embodiment. [Figure 9] FIG. 1 is a schematic diagram of palm authentication payment in one embodiment. [Figure 10] 1 is a block diagram illustrating the configuration of a palm contour extraction device according to an embodiment. [Figure 11] FIG. 10 is a block diagram illustrating the configuration of a palm contour extraction device according to another embodiment. [Figure 12] 1 is a block diagram illustrating a configuration of a control command generating device according to an embodiment. [Figure 13] FIG. 2 is a diagram illustrating the internal configuration of a computer device according to an embodiment. [Figure 14] FIG. 10 is a diagram illustrating the internal configuration of a computer device according to another embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0019] In order to make the objectives, technical means and advantages of the present application clearer, the present application will be described in more detail below with reference to the drawings and embodiments. It should be understood that the specific embodiments described herein are only for the purpose of illustrating the present application, and are not intended to limit the present application.

[0020] The palm contour extraction method and control command generation method according to the present embodiment may be applied to an application environment such as that shown in FIG. 1. Here, a terminal 102 communicates with a server 104 via a network. A data storage system may store data required for processing by the server 104. The data storage system may be integrated into the server 104 or may be located in the cloud or another server. The terminal 102 may be, but is not limited to, various desktop computers, laptops, smartphones, tablets, IoT devices, and portable wearable devices. The IoT devices may include smart speakers, smart TVs, smart air conditioners, smart car devices, etc. The portable wearable devices may include smart watches, smart bands, head-mounted devices, etc. The server 104 may be implemented as an independent server, a server cluster consisting of multiple servers, or a cloud server.

[0021] Both the terminal and the server can independently execute the palm contour extraction method and the control command generation method according to the embodiment of the present application.

[0022] For example, the terminal acquires skeleton point information corresponding to each palm skeleton point in the target palm image, the skeleton point information including skeleton point positions and skeleton point types. The terminal matches each palm skeleton point based on the skeleton point types to obtain multiple palm skeleton point sets, each of which has a corresponding geometric processing type. The terminal generates palm outline extension lines corresponding to each palm skeleton point set based on the skeleton point positions corresponding to each skeleton point in the same palm skeleton point set to obtain palm outline extension lines corresponding to each palm skeleton point set. Based on the reference step size and skeleton point positions corresponding to the same palm skeleton point set, the terminal determines palm outline points from the palm outline extension lines corresponding to the palm skeleton point set to obtain outline point positions corresponding to the palm outline points. The terminal generates a palm outline corresponding to the target palm image based on the outline point positions.

[0023] The terminal displays the palm outline determined based on the target palm image, and generates a target control command based on the palm outline display information.

[0024] The terminal and the server may cooperate to execute the palm contour extraction method and the control command generation method according to the embodiment of the present application.

[0025] For example, the server acquires from the terminal skeleton point information corresponding to each palm skeleton point in the target palm image, the skeleton point information including the skeleton point position and the skeleton point type. The server then matches each palm skeleton point based on the skeleton point type to obtain multiple palm skeleton point sets, each of which has a corresponding geometric processing type. The server then generates palm outline extension lines corresponding to each palm skeleton point set based on the skeleton point positions corresponding to each skeleton point in the same palm skeleton point set, and obtains palm outline extension lines corresponding to each palm skeleton point set. Based on the reference step size and skeleton point positions corresponding to the same palm skeleton point set, the server then determines palm outline points from the palm outline extension lines corresponding to the palm skeleton point set, and obtains the outline point positions corresponding to the palm outline points. The server then generates a palm outline corresponding to the target palm image based on the outline point positions.

[0026] The terminal acquires the palm outline determined based on the target palm image from the server, displays the palm outline, and generates a target control command based on the palm outline display information.

[0027] The palm contour extraction method described above does not require complex data processing of pixel information from a palm image. Instead, by performing geometric processing based on skeleton point information corresponding to each palm skeleton point in the palm image, it is possible to easily determine the positions of contour points corresponding to palm contour points from the palm image, and then generate a palm contour based on the positions of the contour points corresponding to each palm contour point. The positions and types of palm skeleton points are less likely to be interfered with by the background of the image, and by extracting the palm contour based on the positions and types of palm skeleton points in the palm image, it is possible to effectively improve the accuracy of palm contour extraction.

[0028] In the above control command generation method, the palm outline is generated based on the outline point positions corresponding to each palm outline point, which are determined by performing geometric processing based on skeleton point information corresponding to each palm outline point in the palm image. Extracting the palm outline not only eliminates the need for complex data processing of the pixel information in the palm image, but also provides high accuracy by being less susceptible to interference from the background of the image. Accurate palm outline extraction helps ensure display accuracy and improves the accuracy of target control command generation. Automatically generating target control commands based on palm outline display information also improves the efficiency of target control command generation.

[0029] In one embodiment, a palm contour extraction method is provided as shown in Figure 2, and the application of the method to a computer device is described as an example, and the computer device may be the terminal 102 or the server 104 in Figure 1 above. As shown in Figure 2, the palm contour extraction method includes the following steps S202 to S210.

[0030] In step S202, skeleton point information corresponding to each palm skeleton point in the target palm image is obtained, and the skeleton point information includes the skeleton point position and the skeleton point type.

[0031] Here, the target palm image is a palm image from which a palm contour is to be extracted. The palm image is an image including a palm. The palm image may include only the palm; for example, the palm image is an image of the palm region. The palm image may include more body parts; for example, the palm image is an image of the upper body of a subject raising their palm. The palm image may be captured in real time; for example, a photograph of the palm captured in real time may be used as the palm image, or a video frame including the palm in a video captured in real time may be used as the palm image. The palm image may also be acquired from data captured in advance; for example, a photograph of the palm stored in an album may be used as the palm image, or a video frame including the palm in a video edited in advance may be used as the palm image. Furthermore, the palm image may be a photograph of a real palm or a photograph of a virtual palm.

[0032] Palm skeleton points are skeleton points on the palm of a hand. A palm includes multiple palm skeleton points. By recognizing palm skeleton points on a palm image, skeleton point information corresponding to each palm skeleton point in the palm image can be obtained. The skeleton point information includes skeleton point positions and skeleton point types. The skeleton point positions are used to identify the positions of palm skeleton points in the palm image, and the skeleton point types are used to identify the types of palm skeleton points.

[0033] Specifically, the computer device may acquire a target palm image locally or from another device and perform palm skeleton point recognition on the target palm image in real time to obtain skeleton point information corresponding to each palm skeleton point in the target palm image, or may directly acquire skeleton point information corresponding to each palm skeleton point in the target palm image that has been recognized in advance locally or from another device. Furthermore, the computer device may perform palm contour recognition on the target palm image based on the skeleton point information corresponding to each palm skeleton point, thereby obtaining the palm contour in the target palm image.

[0034] In step S204, each palm skeleton point is matched according to the skeleton point type to obtain a set of palm skeleton points, and each palm skeleton point set has a corresponding geometric processing type.

[0035] Here, the palm skeleton point set includes at least two palm skeleton points. Each palm skeleton point set has a corresponding geometric processing type. The geometric processing type is used to determine the geometric processing method corresponding to the palm skeleton point set. The palm skeleton point set is geometrically processed using the geometric processing method corresponding to the palm skeleton point set to obtain palm outline points corresponding to the palm skeleton point set. Note that the same palm skeleton point set can correspond to at least one geometric processing type.

[0036] Specifically, the computer device matches each palm skeleton point based on the skeleton point type, and constructs a palm skeleton point set with the successfully matched palm skeleton points, ultimately obtaining multiple palm skeleton point sets, each of which has a corresponding geometric processing type.

[0037] In one embodiment, the computer device can obtain skeleton point type matching information that records the matching relationships between skeleton point types, and the skeleton point type matching information can be used to quickly match each palm skeleton point based on the skeleton point type and quickly obtain each palm skeleton point set. In one embodiment, the skeleton point type matching information can further include a geometric processing type corresponding to each matching relationship, so that when determining the palm skeleton point set based on the matching relationship, the geometric processing type corresponding to the palm skeleton point set can be determined synchronously.

[0038] In one embodiment, a geometric processing type corresponding to the palm skeleton point set can be determined based on the skeleton point type corresponding to each palm skeleton point in the palm skeleton point set. For example, at least one target palm skeleton point type corresponding to each geometric processing type is preset, and if the palm skeleton point set includes the target palm skeleton point type, the geometric processing type corresponding to the target palm skeleton point type is determined as the geometric processing type corresponding to the palm skeleton point set.

[0039] In one embodiment, a geometric processing type corresponding to the palm skeleton point set can be determined based on the skeleton point position corresponding to each palm skeleton point in the palm skeleton point set. For example, the palm portion in the palm image is divided into multiple palm regions, and each palm region has a corresponding geometric processing type. The geometric processing type corresponding to the palm region containing the palm skeleton point set is determined as the geometric processing type corresponding to the palm skeleton point set.

[0040] In one embodiment, there are connectivity relationships between the palm skeleton points. When recognizing the palm skeleton points, the connectivity relationships between the palm skeleton points and the skeleton point information of the palm skeleton points can be recognized simultaneously. The computer device first performs initial matching for each palm skeleton point based on the connectivity relationships to obtain a plurality of first palm skeleton point sets, then performs complementary matching for each palm skeleton point based on the skeleton point type to obtain a plurality of second palm skeleton point sets, and finally obtains a palm skeleton point set based on each of the first palm skeleton point sets and the second palm skeleton point set.

[0041] For example, as shown in Figure 3, the circles in Figure 3 represent palm skeleton points, including a total of 21 palm skeleton points, and the connecting lines between the circles in Figure 3 indicate the connection relationships between the palm skeleton points. A computer device can configure a first palm skeleton point set using adjacent palm skeleton points that have a connection relationship. For example, circle points 0 and 1 configure a first palm skeleton point set, and circle points 1 and 2 configure a second palm skeleton point set. A computer device can configure a second palm skeleton point set using palm skeleton points that correspond to a predetermined skeleton point type. For example, the skeleton point types corresponding to circle points 13 and 17 are predetermined skeleton point types, and circle points 13 and 17 configure a second palm skeleton point set.

[0042] In step S206, palm contour extension lines that match the geometric processing type corresponding to the palm skeleton point set are generated based on the skeleton point positions corresponding to each skeleton point in the same palm skeleton point set, thereby obtaining palm contour extension lines corresponding to each palm skeleton point set.

[0043] Here, the palm outline auxiliary line is a geometric line that is used to determine the palm outline points.

[0044] Specifically, after determining each palm skeleton point set, the computer device can generate a palm outline extension line that matches the geometric processing type corresponding to the palm skeleton point set for any palm skeleton point set based on the skeleton point positions corresponding to each skeleton point in the palm skeleton point set. The computer device determines a geometric processing method and algorithm based on the geometric processing type corresponding to the palm skeleton point set, and processes data on the skeleton point positions corresponding to each skeleton point in the palm skeleton point set using the geometric processing algorithm to generate a palm outline extension line corresponding to the palm skeleton point set. Finally, the computer device can obtain a palm outline extension line corresponding to each palm skeleton point set.

[0045] Note that one palm skeleton point set may correspond to at least one palm outline extension line.

[0046] In step S208, based on the reference step size and skeleton point positions corresponding to the same palm skeleton point set, palm contour points are determined from the palm contour auxiliary line corresponding to the palm skeleton point set, and contour point positions corresponding to the palm contour points are obtained.

[0047] Here, the reference step size is the movement step size on the palm outline extension line. Each palm skeleton point set has a corresponding reference step size. The contour point positions are used to identify the positions of the palm outline points.

[0048] Specifically, for any palm skeleton point set, the computer device determines a palm outline point on the palm outline auxiliary line corresponding to the palm skeleton point set based on the skeleton point positions corresponding to each palm skeleton point in the palm skeleton point set and the reference step size corresponding to the palm skeleton point set, thereby obtaining the outline point positions corresponding to the palm outline points.The computer device determines a movement start point on the palm outline auxiliary line corresponding to the palm skeleton point set based on the skeleton point positions corresponding to each palm skeleton point in the palm skeleton point set, moves the palm outline auxiliary line corresponding to the palm skeleton point set from the movement start point by the reference step size, and sets the movement end point moved by the reference step size as the palm outline point.Finally, the computer device can obtain multiple palm outline points and the outline point positions corresponding to each palm outline point.

[0049] In one embodiment, a palm image with a marked palm outline is acquired as a reference palm image, and a common reference step size is determined based on the reference palm image. Specifically, a palm outline extension line corresponding to the reference palm image is determined based on the reference palm image, and the intersection of the palm outline extension line and the marked palm outline is set as the accurate palm outline point, which is the reference outline point. An accurate movement step size is determined based on the distance between the movement start point and the reference outline point, and the accurate movement step size is set as the reference step size. The computer device acquires multiple reference palm images and calculates statistics of the same type of reference step sizes determined based on different reference palm images to obtain a common reference step size. For example, the common reference step size can be calculated by averaging the reference step sizes. Then, when processing a palm image with an unknown palm contour, the common reference step size can be directly obtained to determine palm contour points in the palm image, or the common reference step size can be fine-tuned based on the personalized information of the palm image to obtain a target reference step size, and palm contour points in the palm image can be determined based on the target reference step size. The personalized information of the palm image includes at least one type of data such as palm size information, palm depth information, etc.

[0050] In one embodiment, the reference step size increases as the palm size information corresponding to the target palm image increases. The palm size information indicates the size of the palm in the target palm image. For larger palms, the palm outline extension line must move by a larger reference step size before reaching the correct palm outline point. In one embodiment, the palm size information includes at least one of palm length information or palm width information.

[0051] In one embodiment, the reference step size increases as the palm depth information corresponding to the target palm image decreases. The palm depth information indicates the distance between the palm and the image collection device; the closer the distance, the smaller the palm depth information; and the farther the distance, the larger the palm depth information. Note that the smaller the palm depth information corresponding to the target palm image, the closer the distance between the palm and the image collection device and the larger the palm area displayed in the target palm image. For larger palm areas, the palm outline auxiliary line must be moved by a larger reference step size before reaching the correct palm outline point. In one embodiment, the target palm image may be a depth map, with each pixel value in the depth map indicating the distance between a point in the captured scene and the image collection device.

[0052] In step S210, a palm contour corresponding to the target palm image is generated based on the positions of each contour point.

[0053] Specifically, after determining the contour point positions corresponding to each of the palm contour points, the computer device can connect the contour point positions to obtain the palm contour corresponding to the target palm image.

[0054] The palm contour extraction method described above acquires skeleton point information corresponding to each palm skeleton point in a target palm image, the skeleton point information including skeleton point positions and skeleton point types. Based on the skeleton point types, each palm skeleton point is matched to obtain multiple palm skeleton point sets. Each palm skeleton point set has a corresponding geometric processing type. Based on the skeleton point positions corresponding to each skeleton point in the palm skeleton point set, a palm contour extension line matching the geometric processing type corresponding to the palm skeleton point set is generated to obtain palm contour extension lines corresponding to each palm skeleton point set. Based on the reference step size and skeleton point positions corresponding to the same palm skeleton point set, palm contour points are determined from the palm contour extension lines corresponding to the palm skeleton point set to obtain contour point positions corresponding to the palm contour points. A palm contour corresponding to the target palm image is then generated based on each contour point position. In this way, there is no need to perform complex data processing on the pixel information of the palm image. By performing geometric processing based on the skeleton point information corresponding to each palm skeleton point in the palm image, it is possible to easily determine the contour point positions corresponding to the palm contour points from the palm image, and then generate a palm contour based on the contour point positions corresponding to each palm contour point. The positions and types of palm skeleton points are less likely to be interfered with by the background of the image, and by extracting the palm contour based on the positions and types of palm skeleton points in the palm image, the accuracy of palm contour extraction can be effectively improved.

[0055] In one embodiment, the skeleton point type is determined by finger parameters and intra-finger joint parameters. The step of matching each palm skeleton point based on the skeleton point type to obtain a plurality of palm skeleton point sets includes:

[0056] The method includes the steps of: establishing a matching relationship between adjacent palm skeleton points whose intra-finger joint parameters are predetermined joint parameters to obtain a palm skeleton point set corresponding to a first geometric processing type; establishing a matching relationship between adjacent palm skeleton points whose intra-finger joint parameters are predetermined joint parameters to obtain a palm skeleton point set corresponding to a second geometric processing type; and determining a palm skeleton point corresponding to a predetermined skeleton point type as a predetermined skeleton point, and establishing a matching relationship between the predetermined skeleton point and a palm skeleton point closest to the predetermined skeleton point to obtain a palm skeleton point set corresponding to a third geometric processing type.

[0057] Here, the skeleton point type is determined by finger parameters and intra-finger joint parameters. The finger parameters indicate the finger to which the palm skeleton point belongs. The finger parameters make it possible to distinguish between palm skeleton points located on different fingers. The intra-finger joint parameters indicate the joint within the finger to which the palm skeleton point belongs. The intra-finger joint parameters make it possible to distinguish between different palm skeleton points located on the same finger.

[0058] The predetermined joint parameters are specific intra-finger joint parameters that have been preset. The predetermined skeleton point types are specific skeleton point types that have been preset. The predetermined joint parameters and the predetermined skeleton point types can be set according to actual needs. Adjacent palm skeleton points refer to two palm skeleton points that are adjacent in position.

[0059] Specifically, when matching palm skeleton points, the computer device obtains, from each palm skeleton point, adjacent palm skeleton points whose intra-finger joint parameters are predetermined joint parameters, and establishes a matching relationship with the adjacent palm skeleton points whose intra-finger joint parameters are predetermined joint parameters, thereby obtaining a set of palm skeleton points corresponding to the first geometric processing type. For example, as shown in FIG. 3, the intra-finger joint parameters corresponding to dots 13, 17, 9, and 5 are metacarpophalangeal joints, i.e., dots 13, 17, 9, and 5 are metacarpophalangeal joints corresponding to different fingers. When a given joint parameter is a metacarpophalangeal joint, a matching relationship is established between the adjacent dots 13 and 17 to obtain a palm skeleton point set A1 corresponding to the first geometric processing type; a matching relationship is established between the adjacent dots 13 and 9 to obtain a palm skeleton point set A2 corresponding to the first geometric processing type; and a matching relationship is established between the adjacent dots 9 and 5 to obtain a palm skeleton point set A3 corresponding to the first geometric processing type.

[0060] To match palm skeleton points, the computer device obtains adjacent palm skeleton points with the same finger parameters from each palm skeleton point and establishes a matching relationship with the adjacent palm skeleton points corresponding to the same finger parameters to obtain a palm skeleton point set corresponding to the second geometric processing type. For example, as shown in Figure 3, the finger parameters corresponding to circle points 1, 2, 3, and 4 are the thumb, i.e., circle points 1, 2, 3, and 4 are different joints of the same finger. A matching relationship is established between adjacent circle points 1 and 2 to obtain palm skeleton point set B1 corresponding to the second geometric processing type. A matching relationship is established between adjacent circle points 2 and 3 to obtain palm skeleton point set B2 corresponding to the second geometric processing type. A matching relationship is established between adjacent circle points 3 and 4 to obtain palm skeleton point set B3 corresponding to the second geometric processing type.

[0061] To match palm skeleton points, the computer device first obtains a palm skeleton point corresponding to a predetermined skeleton point type from each palm skeleton point, obtains the palm skeleton point closest to the predetermined skeleton point, and establishes a matching relationship between the predetermined skeleton point and the palm skeleton point closest to the predetermined skeleton point, thereby obtaining a palm skeleton point set C corresponding to the third geometric processing type. For example, as shown in Figure 3, if the skeleton point type corresponding to circle point 0 is a predetermined skeleton point type, circle point 0 is the predetermined skeleton point and circle point 1 is the palm skeleton point closest to circle point 0, and a matching relationship is established between circle point 0 and circle point 1 to obtain palm skeleton point set C corresponding to the third geometric processing type.

[0062] In the above embodiment, a matching relationship is established between adjacent palm skeleton points whose intra-finger joint parameters are predetermined joint parameters to obtain each palm skeleton point set corresponding to a first geometric processing type, a matching relationship is established between adjacent palm skeleton points whose intra-finger joint parameters are the same joint parameters to obtain each palm skeleton point set corresponding to a second geometric processing type, the palm skeleton point corresponding to the predetermined skeleton point type is set as the predetermined skeleton point, and a matching relationship is established between the predetermined skeleton point and the palm skeleton point closest to the predetermined skeleton point to obtain a palm skeleton point set corresponding to a third geometric processing type. The skeleton point type is determined by the finger parameters and intra-finger joint parameters, and the matching relationship can be quickly established based on the finger parameters, intra-finger joint parameters, and skeleton point type, allowing each palm skeleton point set to be quickly obtained.

[0063] In one embodiment, a first type of geometric processing is used to determine palm contour points on the interdigital regions and the outer palm contour, a second type of geometric processing is used to determine palm contour points on the edges of the finger contour, and a third type of geometric processing is used to determine palm contour points on the edges of the finger contour and the outer palm contour.

[0064] In one embodiment, the step of generating palm outline auxiliary lines that match a geometric processing type corresponding to the palm skeleton point set based on skeleton point positions corresponding to each skeleton point in the same palm skeleton point set to obtain palm outline auxiliary lines corresponding to each palm skeleton point set includes:

[0065] The method includes the steps of: determining a current auxiliary line type based on a geometric processing type corresponding to the current palm skeleton point set; generating a current skeleton point line segment corresponding to the current palm skeleton point set based on skeleton point positions corresponding to each palm skeleton point in the current palm skeleton point set; and performing geometric processing on the current skeleton point line segment based on the current auxiliary line type to obtain a palm contour auxiliary line corresponding to the current palm skeleton point set and belonging to the current auxiliary line type.

[0066] Here, the auxiliary line type is used to determine the type of the auxiliary line. The current auxiliary line type is the auxiliary line type of the palm outline auxiliary line corresponding to the current palm skeleton point set. The skeleton point line segment is a line segment made up of palm skeleton points. The current skeleton point line segment is a skeleton point line segment corresponding to the current palm skeleton point set. Geometric processing is used to generate a specific type of palm outline auxiliary line based on the skeleton point line segment.

[0067] The current palm skeleton point set can be any one of the palm skeleton point sets.

[0068] Specifically, when generating a palm outline auxiliary line, a computer device may determine an auxiliary line type corresponding to the palm outline auxiliary line and then generate the corresponding palm outline auxiliary line. The computer device may determine the current auxiliary line type based on a geometric processing type corresponding to the current palm skeleton point set, with each geometric processing type having a corresponding auxiliary line type. The computer device may generate a current skeleton point line segment corresponding to the current palm skeleton point set based on the skeleton point positions corresponding to each palm skeleton point in the current palm skeleton point set. For example, a line segment may be generated by two points, or two palm skeleton points may be obtained from the current palm skeleton point set and the skeleton point positions corresponding to the two palm skeleton points may be connected to generate the current skeleton point line segment. The order in which the current auxiliary line type is determined and the current skeleton point line segment is generated is not limited herein. Finally, the computer device may perform geometric processing on the current skeleton point line segment based on the current auxiliary line type to obtain a palm outline auxiliary line corresponding to the current auxiliary line type. For example, if the current auxiliary line type is an extension line, the extension line of the current skeleton point line segment can be set as the palm outline auxiliary line.

[0069] In the above embodiment, a current auxiliary line type is determined based on a geometric processing type corresponding to the current palm skeleton point set, current skeleton point line segments corresponding to the current palm skeleton point set are generated based on skeleton point positions corresponding to each palm skeleton point in the current palm skeleton point set, and geometric processing is performed on the current skeleton point line segments based on the current auxiliary line type to obtain palm contour auxiliary lines corresponding to the current palm skeleton point set and belonging to the current auxiliary line type. By determining the auxiliary line type and then performing geometric processing on the skeleton point line segments generated based on the palm skeleton points based on the auxiliary line type, the corresponding palm contour auxiliary lines can be generated quickly.

[0070] In one embodiment, the geometric processing type includes any one of a first geometric processing type, a second geometric processing type, and a third geometric processing type, the auxiliary line type corresponding to the first geometric processing type includes at least one of a perpendicular bisector type or an extension line type, the auxiliary line type corresponding to the second geometric processing type includes a normal line type, and the auxiliary line type corresponding to the third geometric processing type includes at least one of a normal line type or an extension line type.

[0071] Here, the geometric processing type includes any one of the first geometric processing type, the second geometric processing type, and the third geometric processing type. The auxiliary line type corresponding to the first geometric processing type includes at least one of the perpendicular bisector type and the extension line type. The palm outline auxiliary line corresponding to the perpendicular bisector type is a perpendicular bisector. A perpendicular bisector is a straight line that passes through the midpoint of a line segment and is perpendicular to that line segment. The palm outline auxiliary line corresponding to the extension line type is an extension line, which is a straight line that starts from a line segment and extends further from an endpoint. The auxiliary line type corresponding to the second geometric processing type includes the normal line type. The palm outline auxiliary line corresponding to the normal line type is a normal line. The normal line of a line segment may also be called the perpendicular line of the line segment, and the line segment and the corresponding normal line are perpendicular to each other. The auxiliary line type corresponding to the third geometric processing type includes at least one of the normal line type and the extension line type.

[0072] In the above embodiment, different geometric processing types correspond to different auxiliary line types, and the same geometric processing type may correspond to at least one auxiliary line type, which can effectively increase the number of palm contour points and further improve the accuracy of palm contour extraction.

[0073] In one embodiment, the step of performing geometric processing on the current skeleton point line segment based on the current auxiliary line type to obtain a palm outline auxiliary line corresponding to the current palm skeleton point set and belonging to the current auxiliary line type includes:

[0074] The method includes the steps of: if the current auxiliary line type is the perpendicular bisector type, setting the perpendicular bisector corresponding to the current skeleton point line segment as the palm contour auxiliary line; if the current auxiliary line type is the extension line type, determining a target skeleton point from each palm skeleton point corresponding to the current palm skeleton point set, and setting an extension line corresponding to the current skeleton point line segment and having the target skeleton point as its start point as the palm contour auxiliary line; and if the current auxiliary line type is the normal line type, determining a target skeleton point from each palm skeleton point corresponding to the current palm skeleton point set, and setting a normal to the current skeleton point line segment at the target skeleton point as the palm contour auxiliary line.

[0075] Specifically, if the current auxiliary line type is the perpendicular bisector type, the computer device can set the perpendicular bisector corresponding to the current skeleton point line segment as the palm outline auxiliary line.

[0076] If the current auxiliary line type is the extension line type, the computer device selects a palm skeleton point from each palm skeleton point corresponding to the current palm skeleton point set as a target skeleton point, and sets an extension line corresponding to the current skeleton point line segment and starting from the target skeleton point as the palm outline auxiliary line. When determining the target skeleton point, the computer device may set as the target skeleton point a palm skeleton point that is closer to the center of the palm, or a palm skeleton point of a specified skeleton point type in the current palm skeleton point set, or each palm skeleton point in the current palm skeleton point set as a target skeleton point.

[0077] If the current auxiliary line type is a normal line type, the computer device can select a palm skeleton point from each palm skeleton point corresponding to the current palm skeleton point set as a target skeleton point, and use the normal of the current skeleton point line segment at the target skeleton point as the palm contour auxiliary line. When determining the target skeleton point, the computer device can further generate multiple palm contour auxiliary lines using each palm skeleton point as a target skeleton point, and can further generate one palm contour auxiliary line by selecting one palm skeleton point from among them as the target skeleton point. The palm skeleton point can be selected randomly, or the palm skeleton point closest to the fingertips can be selected.

[0078] In the above embodiment, if the current auxiliary line type is the perpendicular bisector type, the perpendicular bisector corresponding to the current skeleton point line segment is used as the palm contour auxiliary line; if the current auxiliary line type is the extension line type, a target skeleton point is determined from each palm skeleton point corresponding to the current palm skeleton point set, and an extension line corresponding to the current skeleton point line segment and starting from the target skeleton point is used as the palm contour auxiliary line; if the current auxiliary line type is the normal line type, a target skeleton point is determined from each palm skeleton point corresponding to the current palm skeleton point set, and the normal to the current skeleton point line segment at the target skeleton point is used as the palm contour auxiliary line. Different geometric methods can be used to quickly generate the corresponding palm contour auxiliary line for different auxiliary line types.

[0079] In one embodiment, the step of determining palm contour points from palm contour auxiliary lines corresponding to the same palm skeleton point set based on a reference step size and skeleton point positions corresponding to the same palm skeleton point set to obtain contour point positions corresponding to the palm contour points includes:

[0080] The method includes the steps of: generating a current skeleton point line segment corresponding to the current palm skeleton point set based on skeleton point positions corresponding to each skeleton point in the current palm skeleton point set; determining a reference point from the current skeleton point line segment; and moving, starting from the reference point on the current palm outline auxiliary line corresponding to the current palm skeleton point set, a reference step size corresponding to the current palm skeleton point set along a movement direction corresponding to the current palm outline auxiliary line, to obtain the current palm outline points and outline point positions corresponding to the current palm outline points.

[0081] Here, the current palm outline extension line is a palm outline extension line that corresponds to the current palm skeleton point set.

[0082] Specifically, when determining palm outline points, the computer device can determine a reference point from a skeleton point line segment, and then move the palm outline extension line from the reference point by a step size along the movement direction, setting the end point of the movement as the palm outline point. First, the computer device can generate a current skeleton point line segment corresponding to the current palm skeleton point set based on the skeleton point positions corresponding to each skeleton point in the current palm skeleton point set. Next, the computer device can determine a reference point from the current skeleton point line segment. For example, the reference point can be one of the endpoints of the current skeleton point line segment, or the intersection of the current skeleton point line segment and the current palm outline extension line. Furthermore, the computer device can determine the current palm outline point and the outline point position corresponding to the current palm outline point by starting from the reference point and moving the current palm outline extension line by a reference step size corresponding to the current palm skeleton point set along the movement direction corresponding to the current palm outline extension line. Different types of palm outline auxiliary lines have corresponding movement directions, and palm outline auxiliary lines of the same type correspond to at least one movement direction.

[0083] In one embodiment, the reference step size increases as the length of the line segment corresponding to the current skeleton point line segment increases. The length of the line segment corresponding to the current skeleton point line segment can reflect personalized palm information from another perspective. The longer the line segment length, the larger the palm. For larger palms, the palm outline auxiliary line needs to move by a larger reference step size before reaching the correct palm outline point.

[0084] In the above embodiment, a current skeleton point line segment corresponding to the current palm skeleton point set is generated based on the skeleton point positions corresponding to each skeleton point in the current palm skeleton point set, a reference point is determined from the current skeleton point line segment, and the current palm outline extension line corresponding to the current palm skeleton point set is moved from the reference point as a starting point along a movement direction corresponding to the current palm outline extension line by a reference step size corresponding to the current palm skeleton point set to obtain the current palm outline points and the outline point positions corresponding to the current palm outline points. In this way, by starting from the reference point determined based on the palm skeleton points on the palm outline extension line and moving by the corresponding reference step size along a movement direction corresponding to the palm outline extension line, accurate palm outline points can be quickly obtained.

[0085] In one embodiment, the current palm outline auxiliary line includes at least one of a perpendicular bisector, an extension line, or a normal line, and the movement direction corresponding to the perpendicular bisector is the direction away from the center of the palm, the movement direction corresponding to the extension line is the extension direction of the extension line, and the movement direction corresponding to the normal line is the perpendicular direction of the current skeleton point line segment.

[0086] Here, the current palm outline extension line includes at least one of a perpendicular bisector, an extension line, or a normal line.

[0087] The movement direction corresponding to the perpendicular bisector is the direction away from the center of the palm, and the direction away from the center of the palm is the direction away from the center of the palm. In other words, on a perpendicular bisector-type palm contour auxiliary line, a palm contour point must be determined by moving the reference step size in the direction away from the center of the palm. For example, as shown in Figure 4(a), the dotted line in (a) indicates the perpendicular bisector, the arrow indicates the direction away from the center of the palm, and the circle 15' indicates the palm contour point determined by moving the reference step size along the perpendicular bisector in the direction away from the center of the palm.

[0088] The movement direction corresponding to the extension line is the extension direction of the extension line, i.e., in an extension line type palm contour auxiliary line, it is necessary to determine the palm contour point by moving the extension line by the standard step size in the extension direction of the extension line. For example, as shown in Figure 4(b), the dotted line in (b) indicates the extension line, the arrow indicates the extension direction of the extension line, and the circle 36' indicates the palm contour point determined by moving the extension line by the standard step size along the extension direction of the extension line.

[0089] The movement direction corresponding to the normal is the vertical direction of the current skeleton point line segment, that is, on the normal type palm outline auxiliary line, it is necessary to determine the palm outline points by moving the normal line by the reference step size in the vertical direction of the skeleton point line segment. For example, as shown in Figure 4(c), the dotted line in (c) indicates the normal line, the arrow indicates the vertical direction of the normal line, and the circled points 3' and 6' indicate the palm outline points determined by moving the normal line by the reference step size along the vertical direction of the skeleton point line segment.

[0090] In the above embodiment, the movement direction corresponding to the perpendicular bisector is the direction away from the center of the palm, the movement direction corresponding to the extension line is the extension direction of the extension line, and the movement direction corresponding to the normal line is the perpendicular direction of the current skeleton point line segment. Different types of palm outline auxiliary lines correspond to different movement directions.

[0091] In one embodiment, each palm skeleton point has a corresponding skeleton point identifier. The step of generating a palm contour corresponding to the target palm image based on each contour point position includes:

[0092] The method includes the steps of: mapping skeleton point identifiers corresponding to palm skeleton points based on predetermined mapping information to obtain contour point sort identifiers corresponding to each palm contour point, where the predetermined mapping information includes identifier mapping relationships between palm skeleton points in the palm skeleton point set and palm contour points generated based on the palm skeleton point set; and ordering and connecting contour point positions corresponding to each palm contour point according to the contour point sort identifiers to obtain a palm contour corresponding to the target palm image.

[0093] Here, the skeleton point identifier is used to uniquely identify the palm skeleton points, and the contour point sort identifier is used to identify the sort order of the palm contour points.

[0094] The predetermined mapping information records an identifier mapping relationship between palm skeleton points in the palm skeleton point set and palm outline points generated based on the palm skeleton point set. For example, a palm outline point generated based on palm skeleton point 0 and palm skeleton point 1 is marked as 1', and palm outline points generated based on palm skeleton point 1 and palm skeleton point 2 are marked as 2' and 7'.

[0095] Specifically, when generating a palm contour based on the contour point positions, the palm contour points can be ordered and connected to obtain the palm contour. When determining sorting information for the palm contour points, the computer device obtains predetermined mapping information, maps skeleton point identifiers corresponding to the palm skeleton points, and generates contour point identifiers corresponding to the palm contour points generated based on the palm skeleton points, ultimately obtaining contour point sort identifiers corresponding to each of the palm contour points. Furthermore, the computer device orders and connects the contour point positions corresponding to each palm contour point according to the contour point sort identifiers to obtain an accurate palm contour.

[0096] To explain this using an example, as shown in Figure 5, the black circles in Figure 5 represent palm skeleton points, and the white circles represent palm outline points. Figure 5(a) shows a target palm image, and palm outline points 1' to 38' can be obtained based on palm skeleton points 0 to 20. Figure 5(b) shows the palm outline, and the palm outline can be obtained by connecting palm outline points 1' to 38' in order.

[0097] In one embodiment, the contour point positions may be connected smoothly or with straight lines.

[0098] In the above embodiment, skeleton point identifiers corresponding to palm skeleton points are mapped based on predetermined mapping information to obtain contour point sort identifiers corresponding to each palm outline point. The predetermined mapping information includes an identifier mapping relationship between the palm skeleton points in the palm skeleton point set and the palm outline points generated based on the palm skeleton point set. The contour point positions corresponding to each palm outline point are then ordered and connected according to the contour point sort identifiers to obtain a palm outline. In this way, the contour point sort identifiers corresponding to the palm outline points can be quickly determined using the predetermined mapping information, and the palm outline points can be ordered and connected based on the contour point sort identifiers to generate an accurate palm outline.

[0099] In one embodiment, the step of acquiring skeleton point information corresponding to each palm skeleton point in the target palm image includes:

[0100] The method includes inputting the target palm image into a target palm skeleton point recognition model to obtain skeleton point information corresponding to each of the palm skeleton points.

[0101] Here, the target palm skeletal point recognition model is a trained palm skeletal point recognition model, whose input data is a palm image and whose output data is skeletal point information corresponding to each palm skeletal point in the palm image.

[0102] Specifically, the computer device can recognize palm skeletal points using a machine learning model. The computer device can obtain a pre-trained target palm skeletal point recognition model, input a target palm image into the target palm skeletal point recognition model, and through data processing by the model, finally output skeletal point information corresponding to each palm skeletal point from the model.

[0103] The training process of the target palm skeleton point recognition model includes the steps of: obtaining a training dataset, where the training dataset includes a plurality of training palm images and training skeleton point information corresponding to each of the training palm images; determining a current palm image from the training dataset; inputting the current palm image into an initial palm skeleton point recognition model to obtain predicted skeleton point information corresponding to the current palm image; adjusting model parameters corresponding to the initial palm skeleton point recognition model based on a difference between the predicted skeleton point information corresponding to the current palm image and the training skeleton point information to obtain an intermediate skeleton point recognition model; and setting the next training palm image as the current palm image, setting the intermediate skeleton point recognition model as the initial palm skeleton point recognition model, and returning to the step of inputting the current palm image into the initial palm skeleton point recognition model until a convergence condition is met, to obtain a target skeleton point recognition model.

[0104] Here, the initial palm skeleton point recognition model is the palm skeleton point recognition model to be trained. The training palm image is a palm image with known skeleton point information. The current palm image is any palm image in the training dataset. The training skeleton point information is accurate skeleton point information. The predicted skeleton point information is skeleton point information predicted by the model.

[0105] Specifically, during model training, a computer device obtains a training dataset and performs model training on the initial palm skeleton point recognition model based on the training dataset to obtain a target palm skeleton point recognition model. The target training images in the training dataset are used as input data for the palm skeleton point recognition model, and the training skeleton point information is used as expected output data for the palm skeleton point recognition model. The training goal of the model is to make the actual output data of the model as close as possible to the expected output data, so that the model can output predicted skeleton point information close to the training skeleton point information and accurately recognize palm skeleton points in palm images.

[0106] The computer randomly selects a training palm image from the training dataset as the current palm image, inputs the current palm image into the initial palm skeleton point recognition model, and processes the data to output predicted skeleton point information corresponding to the current palm image. The computer then generates loss information based on the difference between the predicted skeleton point information corresponding to the current palm image and the training skeleton point information, and performs backpropagation based on the loss information to adjust model parameters of the initial palm skeleton point recognition model to obtain an intermediate palm skeleton point recognition model. The computer then acquires the next training palm image as a new training palm image, sets the intermediate palm skeleton point recognition model as the new initial palm skeleton point recognition model, and performs iterative model training by returning to the step of inputting the current palm image into the initial palm skeleton point recognition model to obtain predicted skeleton point information corresponding to the current palm image. The model parameters are adjusted through multiple model iterations until a second convergence condition is met, resulting in a target palm skeleton point recognition model.

[0107] Here, the second convergence condition may be at least one of the following: the loss information is smaller than a predetermined threshold; the number of model iterations is greater than a predetermined number; etc. For example, if, in a given training session, the loss information calculated based on the difference between the predicted skeleton point information and the training skeleton point information is smaller than a predetermined threshold, the adjustment of the model parameters is stopped, and the most recently adjusted palm skeleton point recognition model is set as the target palm skeleton point recognition model. If the number of model iterations after a given training session is greater than a predetermined number, the most recently adjusted palm skeleton point recognition model is set as the target palm skeleton point recognition model.

[0108] The current palm image determined in each training session may include at least one training palm image.

[0109] In the above embodiment, the palm skeleton points in the palm image are recognized by the target palm skeleton point recognition model, thereby ensuring the accuracy and efficiency of the recognition. An accurate target palm skeleton point recognition model can be obtained by training using a supervised iterative training method.

[0110] In one embodiment, the palm contour is used to generate a palm animation.

[0111] Specifically, after generating a palm outline, a palm moving image can be generated based on the palm outline and displayed.

[0112] In one embodiment, a computing device can collect palm images in real time, recognize palm contours in the palm images in real time, and display dynamic palm contours to form a dynamic palm animation. In one embodiment, the computing device can generate a palm animation by setting display parameters for the palm contour. For example, the palm contour can be displayed in a dynamically changing gradient color. In one embodiment, the computing device can generate a palm animation by setting display parameters for a closed area formed by the palm contour. For example, the closed area formed by the palm contour can be displayed in a dynamically changing rainbow color.

[0113] In the above embodiment, the palm contour extracted from the palm image is used to generate palm animation, which can improve the fun and interactivity.

[0114] In one embodiment, a control command generation method is provided as shown in Figure 6, and the method will be described as being applied to a terminal as an example. Note that the method may also be applied to a server, or to a system including a terminal and a server, and may be realized by interaction between the terminal and the server. In this embodiment, the control command generation method includes the following steps S602 to S604.

[0115] In step S602, the palm outline determined based on the target palm image is displayed.

[0116] Here, the palm contour extraction process includes the steps of: acquiring skeleton point information corresponding to each palm skeleton point in the target palm image, where the skeleton point information includes skeleton point positions and skeleton point types; matching each palm skeleton point based on the skeleton point type to obtain multiple palm skeleton point sets, where each palm skeleton point set has a corresponding geometric processing type; generating palm contour extension lines that match the geometric processing type corresponding to the palm skeleton point set, based on the skeleton point positions corresponding to each skeleton point in the palm skeleton point set, to obtain palm contour extension lines corresponding to each palm skeleton point set; determining palm contour points from the palm contour extension lines corresponding to the palm skeleton point sets, based on the reference step size and skeleton point positions corresponding to the same palm skeleton point set, to obtain contour point positions corresponding to the palm contour points; and generating a palm contour corresponding to the target palm image based on each contour point position.

[0117] For the specific process of extracting the palm outline, please refer to the contents of each embodiment of the palm outline extraction method described above, and a detailed description thereof will be omitted here.

[0118] In step S604, a target control command is generated based on the display information of the palm outline.

[0119] The display information reflects the display status of the palm outline and includes at least one type of data such as display position, display size, display depth, and display attitude.

[0120] An object control instruction is an instruction for controlling or manipulating an object. The controlled object may be a virtual object, such as a virtual resource, a virtual person, or a virtual control. The controlled object may also be a physical object, such as an electronic device or mechanical equipment. The object control instruction may be various control instructions. In one embodiment, the object control instruction may be an instruction to turn on or off certain or several functions of the object. For example, the object control instruction may be a light-on instruction, a light-off instruction, a test start instruction, a test stop instruction, etc. In one embodiment, the object control instruction may be an instruction to control and move the object. For example, the object control instruction may be a virtual resource transfer instruction, a virtual person jump instruction, etc. In one embodiment, the object control instruction may be an instruction to control and adjust attribute parameters of the object. For example, the object control instruction may be a brush color adjustment instruction, a window size adjustment instruction, etc.

[0121] Specifically, the terminal displays a palm outline determined based on the target palm image and generates an object control command based on the palm outline display information. The terminal autonomously executes the object control command and can control the corresponding object by the object control command. The terminal may also transmit the object control command to another device and instruct the other device to control the object by the object control command.

[0122] In one embodiment, if the display information of the palm outline satisfies a predetermined condition, a target control command is generated. If the display information of the palm outline does not satisfy the predetermined condition, prompt information is generated. For example, if the position difference between the display position of the palm outline and the target display position is smaller than a predetermined threshold, a target control command may be generated. If the display size of the palm outline is larger than a predetermined size, a target control command may be generated. For example, if the difference in the display depth of the palm outline is smaller than a predetermined difference, a target control command may be generated. For example, a closed region formed by the palm outline is divided to obtain at least two subregions, and the depth average values ​​corresponding to each subregion are calculated. The data difference between the depth average values ​​is calculated to obtain a display depth difference. If the display depth difference is smaller than a predetermined difference, it indicates that the difference in depth values ​​corresponding to each pixel point on the palm is not large and the palm position is correct, and a target control command may be generated. Here, the prompt information may indicate that the current palm position is incorrect or may suggest that the palm be moved.

[0123] In one embodiment, a target control command corresponding to the display information can be generated based on the display information of the palm outline. For example, a corresponding target control command can be generated based on the display posture of the palm outline. For example, if the display posture of the palm outline is open-fingered, a function-on command is generated, and if the display posture corresponding to the palm outline is closed-fingered, a function-off command is generated.

[0124] In the above control command generation method, the palm outline determined based on the target palm image is displayed, and the target control command is generated based on the display information of the palm outline. Here, the palm contour extraction process includes the steps of: acquiring skeleton point information corresponding to each palm skeleton point in the target palm image, where the skeleton point information includes skeleton point positions and skeleton point types; matching each palm skeleton point based on the skeleton point type to obtain multiple palm skeleton point sets, where each palm skeleton point set has a corresponding geometric processing type; generating palm contour extension lines matching the geometric processing type corresponding to each palm skeleton point set, based on the skeleton point positions corresponding to each skeleton point in the same palm skeleton point set; determining palm contour points from the palm contour extension lines corresponding to the palm skeleton point sets, based on the reference step size and skeleton point positions corresponding to the same palm skeleton point set, to obtain contour point positions corresponding to the palm contour points; and generating a palm contour corresponding to the target palm image based on each contour point position. In this way, the palm outline is generated based on the outline point positions corresponding to each palm outline point, which are determined by performing geometric processing based on skeleton point information corresponding to each palm outline point in the palm image. Extracting the palm outline not only eliminates the need for complex data processing of the pixel information in the palm image, but also provides high accuracy by being less susceptible to interference from the background of the image. Accurate palm outline extraction helps ensure display accuracy and improves the accuracy of target control command generation. Automatically generating target control commands based on palm outline display information also improves the efficiency of target control command generation.

[0125] In one embodiment, the step of generating a target control command based on the display information of the palm outline comprises:

[0126] The method includes generating a target control command when a position difference between the display position of the palm outline and the target display position is smaller than a predetermined threshold, and generating palm movement prompt information based on the position difference when the position difference is equal to or greater than the predetermined threshold, where the palm movement prompt information is for prompting the user to move the palm to reduce the position difference.

[0127] The target display position is a desired display position and can be set according to actual needs. The palm movement prompt information may be displayed in at least one of the following expression forms: text, audio, picture, and video.

[0128] Specifically, the display information includes a display position. If the position difference between the display position of the palm outline and the target display position is smaller than a predetermined threshold, it indicates that the palm outline is displayed at the desired position, the target position, and the terminal triggers the generation of a target control command. If the position difference between the display position of the palm outline and the target display position is equal to or greater than a predetermined threshold, it indicates that the palm outline is not displayed at the desired position, the terminal can generate palm movement prompt information based on the position difference, which prompts the user to move the palm to reduce the position difference so that the palm outline can finally be displayed at the desired position.

[0129] In one embodiment, the terminal can determine the display position of the palm outline based on the spatial position of the palm, for example, if the palm is located directly above the image collection device, the palm outline is displayed in the center of the screen, if the palm is located to the left of the image collection device, the palm outline is displayed on the left side of the screen, and if the palm is located to the right of the image collection device, the palm outline is displayed on the right side of the screen.

[0130] In the above embodiment, if the position difference between the display position of the palm outline and the target display position is smaller than a predetermined threshold, a target control command is generated. If the position difference is equal to or greater than the predetermined threshold, palm movement prompt information is generated based on the position difference. The palm movement prompt information is intended to prompt the user to move their palm to reduce the position difference. In this way, by generating the target control command only when the position difference between the display position of the palm outline and the target display position is small, blind generation of the target control command can be avoided and the target control command can be effectively and accurately triggered. If the position difference between the display position of the palm outline and the target display position is large, palm movement prompt information is generated to prompt the user to move their palm. The palm movement prompt information can provide accurate guidance, allowing the palm outline to be displayed in an accurate position, thereby triggering the target control command.

[0131] In one embodiment, the target palm image is a palm image corresponding to a virtual resource transfer source, the target control command is a virtual resource transfer command, and the virtual resource transfer command is for instructing the transfer of virtual resources from a resource account corresponding to the virtual resource transfer source to a target account.

[0132] Here, the virtual resource transfer source is the party that needs to transfer virtual resources from the resource account. The virtual resource transfer destination is the other party that receives the virtual resources. The resource account is an account that can store virtual resources. The virtual resources are negotiable resources that exist in an electronic account, such as currency, virtual red envelopes, game currency, virtual items, etc. The target account is the account that needs to receive the transferred virtual resources. The target account may be an individual account or an organization account.

[0133] Specifically, in a virtual resource transfer scene, a terminal or other terminal corresponding to the source or destination of the virtual resource can trigger the generation of a virtual resource transfer command by a palm image, and the virtual resource transfer command is for instructing the transfer of the virtual resource from the resource account corresponding to the source of the virtual resource to the target account.

[0134] For example, the terminal collects a palm image corresponding to a virtual resource transfer source as a target palm image, extracts a palm outline from the target palm image, and displays the palm outline determined based on the target palm image. If the position difference between the display position of the palm outline and the target display position is smaller than a predetermined threshold, the terminal verifies the identity information of the virtual resource transfer source based on the target palm image. If the verification is successful, the terminal generates a virtual resource transfer command, which instructs the transfer of virtual resources from a resource account corresponding to the virtual resource transfer source to the target account. If the verification fails, the terminal generates verification failure prompt information. If the position difference is equal to or greater than a predetermined threshold, the terminal generates palm movement prompt information based on the position difference, which prompts the transferee to move their palm to reduce the position difference. After the palm is moved, if the new position difference determined by the terminal based on the new palm image is smaller than a predetermined threshold, the terminal verifies the identity information of the virtual resource transfer source based on the new palm image, and if the verification is successful, generates a virtual resource transfer command.

[0135] In the above embodiment, the palm contour extracted from the palm image can be used to trigger the generation of a virtual resource transfer command, thereby extending the triggering method of the virtual resource transfer command.

[0136] In a specific embodiment, the palm outline extraction method can be applied to a palm authentication payment scenario, specifically, the application of the palm outline extraction method in this scenario is as follows:

[0137] 1. Palm contour recognition

[0138] 1-1. Palm skeleton recognition The system recognizes palm skeletal points in a palm image based on a machine learning algorithm. A palm image is captured using a camera and input into a trained machine learning model, which outputs skeletal point information for the palm skeletal points in the palm image. In one embodiment, the machine learning model can be integrated into a software development kit (SDK). The skeletal point information includes the position coordinates of the palm skeletal points. The position coordinates of the palm skeletal points are mapped to two-dimensional coordinates on the screen of the current operating system using the coordinate system in the SDK, and a palm outline can be generated using the screen coordinates. Current operating systems include the Android system, Windows system, etc.

[0139] 7A is a schematic diagram of the palm skeleton point recognition result. As shown in Fig. 7A, 21 palm skeleton points (palm skeleton point 0 to palm skeleton point 20) are finally recognized in the palm image.

[0140] 1-2. Palm contour recognition

[0141] 7B is a schematic diagram of the palm outline point recognition results. As shown in Fig. 7B, 38 palm outline points (palm outline point 1' to palm outline point 38') are recognized based on 21 palm skeleton points.

[0142] 1-2-1. Calculating the coordinates of the outer contour of the palm

[0143] The coordinates of the palm's outer contour on the extension line are obtained by drawing an extension line of the two palm skeleton points and using a relative coefficient (also called a reference step size). For example, as shown in Figure 8A, palm contour point 37' is determined on the extension line generated based on palm skeleton point 0 and palm skeleton point 1, and palm contour point 37' is the palm's outer contour point.

[0144] The calculation process of the coordinates of the outer contour of the palm is as follows:

[0145] Palm skeleton start coordinates: (Xa, Ya), Palm skeleton end coordinates: (Xb, Yb) Palm contour target point coordinates: (X,Y) Target point coordinate X:

number

number

[0146] As shown in FIG. 7B, palm outline point 37', palm outline point 38', palm outline point 36', and palm outline point 8' are the outer outline points of the palm.

[0147] 1-2-2. Calculation of interdigital coordinates

[0148] The coordinates of the inter-finger area on the perpendicular bisector are obtained using the perpendicular bisector of the two palm skeleton points and their relative coefficients. For example, as shown in Figure 8B, palm outline point 29', which is the palm inter-finger area point, is determined on the perpendicular bisector generated based on palm skeleton point 13 and palm skeleton point 17.

[0149] The calculation process of interdigital coordinates is as follows.

[0150] Palm skeleton start coordinates: (Xa, Ya), Palm skeleton end coordinates: (Xb, Yb) Midpoint coordinates: (Xmid, Ymid) Xmid:

number

number

number

number

number

number

[0151] As shown in FIG. 7B, palm outline point 29', palm outline point 22', and palm outline point 15' are palm interdigital points.

[0152] Taking palm skeleton point 13 and palm skeleton point 17 as an example, palm outline point 29' is determined in a clockwise direction when palm skeleton point 13 is the start point and palm skeleton point 17 is the end point. Palm outline point 29' is determined in a counterclockwise direction when palm skeleton point 17 is the start point and palm skeleton point 13 is the end point.

[0153] 1-2-3. Calculation of finger contour edge coordinates

[0154] For vector AB generated by two palm skeleton points, the coordinates of the finger contour edge on the normal vector are obtained based on the relative coefficient of the normal vector of point A or point B. For example, as shown in Figure 8C, for the normal vector generated based on palm skeleton points 2 and 3, palm contour points 3' and 6' are determined, and palm contour points 3' and 6' are finger contour edge points.

[0155] The process for calculating the coordinates of the finger contour edge is as follows.

[0156] Palm skeleton start coordinates: (Xa, Ya), Palm skeleton end coordinates: (Xb, Yb) Palm contour target point coordinates: (X,Y) If the target point is in the clockwise direction, Target point coordinate X:

number

number

number

number

[0157] As shown in FIG. 7B, palm contour point 2' to palm contour point 7', palm contour point 9' to palm contour point 14', palm contour point 16' to palm contour point 21', palm contour point 23' to palm contour point 28', and palm contour point 30' to palm contour point 35' are finger contour edge points.

[0158] Here, k in the above formula is a relative coefficient.

[0159] 1-3. Palm contour generation

[0160] Each palm contour point is connected to obtain the palm contour. Figure 8D is a schematic diagram of the palm contour. As shown in Figure 8D, 38 palm contour points are connected to obtain the palm contour.

[0161] 2. Palm authentication video generation

[0162] In the scenario of palm authentication payment, after obtaining the palm contour, a palm authentication video can be generated based on the palm contour, which improves the interactive and high-tech feel that palm authentication payment gives to users.

[0163] As shown in Fig. 9, 1002 in Fig. 9 indicates the palm outline displayed on the screen, and 1004 indicates the target display position on the screen. If the palm outline is not displayed at the target display position, the user is prompted to move their palm to the target display position. If the palm outline is displayed at the target display position, the user's identity is verified by the palm image, and payment is made after successful verification.

[0164] In the above embodiment, palm outline points are determined based on palm skeleton points, and then a palm outline is generated. On the one hand, palm skeleton points are less affected by the background of the image, and extracting the palm outline from the image based on the palm skeleton points ensures the accuracy of palm outline extraction. On the other hand, determining palm outline points using a geometric method ensures efficient data processing, ensures recognition performance, and improves the efficiency of palm outline extraction.

[0165] Although the steps in the flowcharts according to the above-described embodiments are shown sequentially as indicated by the arrows, it will be understood that these steps are not necessarily performed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps may be performed in other orders. Furthermore, at least some of the steps in the flowcharts according to the above-described embodiments may include multiple sub-steps or multiple stages, and these sub-steps or stages do not necessarily have to be performed at the same time but may be performed at different times. The order in which these sub-steps or stages are performed does not necessarily have to be sequential, and they may be performed alternately or with other steps or at least some of the sub-steps or stages of other steps.

[0166] Based on a similar inventive concept, embodiments of the present application further provide a palm outline extraction device for implementing the above-described palm outline extraction method, and a control command generation device for implementing the above-described control command generation method. Because the means for solving the problem provided by the device are similar to those described in the above-described method, specific limitations of one or more embodiments of the palm outline extraction device provided below may refer to the limitations described above for the palm outline extraction method, and specific limitations of one or more embodiments of the control command generation device provided below may refer to the limitations described above for the control command generation method, and therefore will not be described again here.

[0167] In one embodiment, as shown in FIG. 10, a palm contour extraction device is provided, which includes a skeleton point information acquisition module 1002, a palm skeleton point matching module 1004, a palm contour extension line determination module 1006, a palm contour point determination module 1008, and a palm contour generation module 1010.

[0168] The skeleton point information acquisition module 1002 is configured to acquire skeleton point information corresponding to each palm skeleton point in the target palm image, where the skeleton point information includes a skeleton point position and a skeleton point type. The palm skeleton point matching module 1004 is configured to match each palm skeleton point based on a skeleton point type to obtain a plurality of palm skeleton point sets, each of which has a corresponding geometric processing type.

[0169] The palm contour extension line determination module 1006 is configured to generate palm contour extension lines that match the geometric processing type corresponding to the palm skeleton point set based on skeleton point positions corresponding to each skeleton point in the same palm skeleton point set, thereby obtaining palm contour extension lines corresponding to each of the palm skeleton point sets.

[0170] The palm contour point determination module 1008 is configured to determine palm contour points from the palm contour auxiliary lines corresponding to the palm skeleton point set based on the reference step size and skeleton point positions corresponding to the same palm skeleton point set, and obtain contour point positions corresponding to the palm contour points.

[0171] The palm contour generation module 1010 is configured to generate a palm contour corresponding to the target palm image based on each contour point position.

[0172] The palm contour extraction device does not require complex data processing of pixel information from a palm image; by performing geometric processing based on skeleton point information corresponding to each palm skeleton point in the palm image, it can easily determine the positions of contour points corresponding to palm contour points from the palm image and generate a palm contour based on the positions of each contour point. The positions and types of palm skeleton points are less likely to be interfered with by the background of the image, and by extracting the palm contour based on the positions and types of palm skeleton points in the palm image, it is possible to effectively improve the accuracy of palm contour extraction.

[0173] In one embodiment, the skeleton point type is determined by the finger parameters and the intra-finger joint parameters. The palm skeleton point matching module 1004 is further configured to: establish a matching relationship between adjacent palm skeleton points, each of which has an intra-finger joint parameter equal to a predetermined joint parameter, to obtain a palm skeleton point set corresponding to a first geometric processing type; establish a matching relationship between adjacent palm skeleton points corresponding to the same finger parameters, to obtain a palm skeleton point set corresponding to a second geometric processing type; define the palm skeleton point corresponding to the predetermined skeleton point type as the predetermined skeleton point; and establish a matching relationship between the predetermined skeleton point and the palm skeleton point closest to the predetermined skeleton point, to obtain a palm skeleton point set corresponding to a third geometric processing type.

[0174] In one embodiment, the palm contour extension line determination module 1006 is further configured to determine a current extension line type based on a geometric processing type corresponding to the current palm skeleton point set, generate a current skeleton point line segment corresponding to the current palm skeleton point set based on skeleton point positions corresponding to each palm skeleton point in the current palm skeleton point set, and perform geometric processing on the current skeleton point line segment based on the current extension line type to obtain a palm contour extension line corresponding to the current palm skeleton point set and belonging to the current extension line type.

[0175] In one embodiment, the geometric processing type includes any one of a first geometric processing type, a second geometric processing type, or a third geometric processing type, the auxiliary line type corresponding to the first geometric processing type includes at least one of a perpendicular bisector type or an extension line type, the auxiliary line type corresponding to the second geometric processing type includes a normal line type, and the auxiliary line type corresponding to the third geometric processing type includes at least one of a normal line type or an extension line type.

[0176] In one embodiment, the palm contour extension line determination module 1006 is further configured to: if the current extension line type is the perpendicular bisector type, determine the perpendicular bisector corresponding to the current skeleton point line segment as the palm contour extension line; if the current extension line type is the extension line type, determine a target skeleton point from each palm skeleton point corresponding to the current palm skeleton point set, and determine an extension line corresponding to the current skeleton point line segment and starting from the target skeleton point as the palm contour extension line; if the current extension line type is the normal line type, determine a target skeleton point from each palm skeleton point corresponding to the current palm skeleton point set, and determine the normal to the current skeleton point line segment at the target skeleton point as the palm contour extension line.

[0177] In one embodiment, the palm contour point determination module 1008 is further configured to generate a current skeleton point line segment corresponding to the current palm skeleton point set based on the skeleton point positions corresponding to each skeleton point in the current palm skeleton point set, determine a reference point from the current skeleton point line segment, and move the current palm contour auxiliary line corresponding to the current palm skeleton point set, starting from the reference point, by a reference step size corresponding to the current palm skeleton point set along the movement direction corresponding to the current palm contour auxiliary line, to obtain the current palm contour points and the contour point positions corresponding to the current palm contour points.

[0178] In one embodiment, the current palm outline auxiliary line includes at least one of a perpendicular bisector, an extension line, or a normal line, and the movement direction corresponding to the perpendicular bisector is the direction away from the center of the palm, the movement direction corresponding to the extension line is the extension direction of the extension line, and the movement direction corresponding to the normal line is the perpendicular direction of the current skeleton point line segment.

[0179] In one embodiment, each palm skeleton point has a corresponding skeleton point identifier. The palm contour generation module 1010 is further configured to: map the skeleton point identifiers corresponding to the palm skeleton points based on predetermined mapping information including an identifier mapping relationship between the palm skeleton points in the palm skeleton point set and the palm contour points generated based on the palm skeleton point set, to obtain a contour point sort identifier corresponding to each palm contour point, and then order and connect the contour point positions corresponding to each palm contour point according to the contour point sort identifier to obtain a palm contour corresponding to the target palm image.

[0180] In one embodiment, the skeleton point information acquisition module 1002 is further configured to input the target palm image into a target palm skeleton point recognition model to obtain skeleton point information corresponding to each palm skeleton point.

[0181] As shown in Figure 11, the palm contour extraction device The system further includes a model training module 1001 that obtains a training dataset including a plurality of training palm images and training skeleton point information corresponding to each of the training palm images, determines a current palm image from the training dataset, inputs the current palm image into an initial palm skeleton point recognition model to obtain predicted skeleton point information corresponding to the current palm image, and adjusts model parameters corresponding to the initial palm skeleton point recognition model based on a difference between the predicted skeleton point information corresponding to the current palm image and the training skeleton point information to obtain an intermediate skeleton point recognition model, and returns to the step of inputting the next training palm image into the initial palm skeleton point recognition model and inputting the current palm image into the initial palm skeleton point recognition model until a convergence condition is met, thereby obtaining a target skeleton point recognition model.

[0182] In one embodiment, the palm contour is used to generate a palm animation.

[0183] In one embodiment, as shown in FIG. 12, a control command generating device is provided, which includes a palm outline display module 1202 and a control command generating module 1204.

[0184] The palm contour display module 1202 is configured to display the palm contour determined based on the target palm image.

[0185] The control command generation module 1204 is configured to generate a target control command based on the palm contour display information.

[0186] The palm contour extraction process includes the steps of: acquiring skeleton point information corresponding to each palm skeleton point in the target palm image, where the skeleton point information includes skeleton point positions and skeleton point types; matching each palm skeleton point based on the skeleton point type to obtain multiple palm skeleton point sets, where each palm skeleton point set has a corresponding geometric processing type; generating palm contour extension lines matching the geometric processing type corresponding to each palm skeleton point set, based on the skeleton point positions corresponding to each skeleton point in the palm skeleton point set; determining palm contour points from the palm contour extension lines corresponding to the palm skeleton point sets, based on the reference step size and skeleton point positions corresponding to the same palm skeleton point set, to obtain contour point positions corresponding to the palm contour points; and generating a palm contour corresponding to the target palm image based on each contour point position.

[0187] In the control command generation device, the palm outline is generated based on the outline point positions corresponding to each palm outline point, which are determined by performing geometric processing based on skeleton point information corresponding to each palm outline point in the palm image. Extracting the palm outline not only eliminates the need for complex data processing of pixel information in the palm image, but also provides high accuracy by being less susceptible to interference from the background of the image. Accurate palm outline extraction helps ensure display accuracy and improves the accuracy of target control command generation. Automatically generating target control commands based on palm outline display information also improves the efficiency of target control command generation.

[0188] In one embodiment, the control command generation module 1204 is further configured to: generate a target control command when a position difference between the display position of the palm outline and the target display position is smaller than a predetermined threshold; and generate palm movement prompt information based on the position difference when the position difference is equal to or greater than the predetermined threshold, where the palm movement prompt information is for prompting a user to move the palm to reduce the position difference.

[0189] In one embodiment, the target palm image is a palm image corresponding to a virtual resource transfer source, the target control command is a virtual resource transfer command, and the virtual resource transfer command is for instructing the transfer of virtual resources from a resource account corresponding to the virtual resource transfer source to a target account.

[0190] Each module in the palm contour extraction device and control command generation device described above may be realized in whole or in part by software, hardware, or a combination thereof. Each module may be incorporated as hardware into one or more processors in a computer device, or may be provided independently of one or more processors in a computer device, or may be stored as software in a memory in a computer device, so that one or more processors call and execute operations corresponding to each module.

[0191] In one embodiment, a computer device is provided. The computer device may be a server, and its internal configuration may be as shown in FIG. 13. The computer device includes a processor, a memory, an input / output interface (I / O), and a communication interface. The processor, memory, and I / O interface are connected via a system bus, and the communication interface is connected to the system bus via the I / O interface. The processor of the computer device is used to provide calculation and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer-readable instructions, and a database. The internal memory provides an environment for the execution of the operating system and the computer-readable instructions in the non-volatile storage medium. The database of the computer device is used to store data such as a target palm skeleton point recognition model, a reference step size, and a predetermined mapping relationship. The I / O interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal via a network connection. When the computer-readable instructions are executed by a processor, a palm contour extraction method or a control command generation method is implemented.

[0192] In one embodiment, a computer device is provided, which may be a terminal, and its internal configuration may be as shown in FIG. 14. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit, and an input device. The processor, memory, and input / output interface are connected via a system bus, and the communication interface, display unit, and input device are connected to the system bus via the input / output interface. The processor of the computer device is used to provide calculation and control capabilities. The memory of the computer device includes a non-volatile storage medium, an internal memory. The non-volatile storage medium stores an operating system and computer-readable instructions. The internal memory provides an environment for executing the operating system and computer-readable instructions in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal via a wired or wireless method, and the wireless method may be realized by Wi-Fi, a mobile cellular network, NFC (Near Field Communication), or other technologies. When the computer-readable instructions are executed by a processor, a palm contour extraction method or a control command generation method is realized. The display unit of the computing device is used to form a viewable screen and may be a display screen, a projection device, or a virtual reality imaging device, the display screen may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computing device may be a touch layer covering the display screen, or may be a button, trackball, or touchpad installed on the housing of the computing device, or an external keyboard, touchpad, or mouse, etc.

[0193] 13 and 14 are merely block diagrams of a portion of the configuration related to the technical means of the present application, and do not limit the computer device to which the technical means of the present application is applied. A specific computer device may include more or fewer components than those shown in the drawings, may combine some components, or may have a different component layout.

[0194] In one embodiment, a computing device is further provided that includes a memory and one or more processors, wherein computer-readable instructions are stored in the memory and, when executed by the one or more processors, the steps in each of the above method embodiments are realized.

[0195] In one embodiment, a computer-readable storage medium is provided having computer-readable instructions stored thereon that, when executed by one or more processors, perform the steps in each of the method embodiments described above.

[0196] The computer program product includes computer-readable instructions that, when executed by one or more processors, perform the steps of each of the method embodiments described above.

[0197] In addition, the user information (including, but not limited to, user device information, user personal information, etc.) and data (including, but not limited to, data used for analysis, stored data, displayed data, etc.) related to this application are all information and data authorized by the user or fully authorized by each party, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0198] It will be apparent to those skilled in the art that all or part of the flow of the methods in the above embodiments may be completed by instructing associated hardware with computer-readable instructions. The computer-readable instructions may be stored in a non-volatile computer-readable storage medium, and when executed, the computer-readable instructions may include the flow of each of the above method embodiments. Any reference to memory, database, or other medium used in each embodiment provided herein may include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, flexible disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory may include random access memory (RAM), external cache memory, etc. By way of example and not limitation, the RAM may be in various forms, such as, for example, static random access memory (SRAM) or dynamic random access memory (DRAM). The database according to the embodiments provided herein may include at least one of a relational database and a non-relational database. The non-relational database may include, but is not limited to, a distributed database based on blockchain. The processor according to the embodiments provided herein may be, but is not limited to, a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc.

[0199] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combinations of these technical features, they should all be considered to be within the scope described in this specification.

[0200] The above embodiments only describe some embodiments of the present application, and although the descriptions are specific and detailed, they should not be construed as limiting the scope of the patent of the present application. It should be noted that those skilled in the art may make various modifications and improvements to the present application without departing from the spirit of the present application, and both of these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be governed by the appended claims.

Claims

1. A palm contour extraction method executed by a computer device, comprising: acquiring skeleton point information corresponding to each palm skeleton point in the target palm image, the skeleton point information including a skeleton point position and a skeleton point type; matching each palm skeleton point according to the skeleton point type to obtain a plurality of palm skeleton point sets, each palm skeleton point set having a corresponding geometric processing type; generating palm outline auxiliary lines that match a geometric processing type corresponding to the palm skeleton point set based on skeleton point positions corresponding to each skeleton point in the same palm skeleton point set, thereby obtaining palm outline auxiliary lines corresponding to each palm skeleton point set; determining palm contour points from the palm contour auxiliary line corresponding to the set of palm skeleton points based on the reference step size and skeleton point positions corresponding to the same set of palm skeleton points, and obtaining contour point positions corresponding to the palm contour points; and generating a palm contour corresponding to the target palm image based on each contour point position. Palm contour extraction method.

2. The skeleton point type is determined by finger parameters and intra-finger joint parameters, The step of matching each palm skeleton point based on the skeleton point type to obtain a plurality of palm skeleton point sets includes: Establishing a matching relationship between adjacent palm skeleton points whose intra-finger joint parameters are predetermined joint parameters to obtain a set of palm skeleton points corresponding to a first geometric processing type; Establishing a matching relationship between adjacent palm skeleton points corresponding to the same finger parameters to obtain a set of palm skeleton points corresponding to a second geometric processing type; and determining a palm skeleton point corresponding to a predetermined skeleton point type as a predetermined skeleton point, and establishing a matching relationship between the predetermined skeleton point and a palm skeleton point closest to the predetermined skeleton point to obtain a palm skeleton point set corresponding to a third geometric processing type. The palm contour extraction method according to claim 1 .

3. The step of generating palm outline auxiliary lines that match a geometric processing type corresponding to the palm skeleton point set based on skeleton point positions corresponding to each skeleton point in the same palm skeleton point set to obtain palm outline auxiliary lines corresponding to each palm skeleton point set includes: determining a current auxiliary line type based on a geometric processing type corresponding to the current palm skeleton point set; generating a current skeleton point line segment corresponding to the current palm skeleton point set based on a skeleton point position corresponding to each palm skeleton point in the current palm skeleton point set; and performing geometric processing on the current skeleton point line segments based on the current auxiliary line type to obtain palm outline auxiliary lines corresponding to the current palm skeleton point set and belonging to the current auxiliary line type. The palm contour extraction method according to claim 1 .

4. the geometric processing type includes any one of a first geometric processing type, a second geometric processing type, or a third geometric processing type; the auxiliary line type corresponding to the first geometric processing type includes at least one of a perpendicular bisector type or an extension line type; The auxiliary line type corresponding to the second geometric processing type includes a normal line type; The auxiliary line type corresponding to the third geometric processing type includes at least one of a normal line type and an extension line type. The palm contour extraction method according to claim 3 .

5. the step of performing geometric processing on the current skeleton point line segments based on the current auxiliary line type to obtain palm contour auxiliary lines corresponding to the current palm skeleton point set and belonging to the current auxiliary line type, If the current auxiliary line type is a perpendicular bisector type, the perpendicular bisector corresponding to the current skeleton point line segment is set as a palm outline auxiliary line; If the current auxiliary line type is an extension line type, determining a target skeleton point from each palm skeleton point corresponding to the current palm skeleton point set, and setting an extension line corresponding to the current skeleton point line segment and having the target skeleton point as a palm contour auxiliary line; If the current auxiliary line type is a normal line type, determining a target skeleton point from each palm skeleton point corresponding to the current palm skeleton point set, and setting a normal line of the current skeleton point line segment at the target skeleton point as a palm contour auxiliary line. The palm contour extraction method according to claim 3 .

6. The step of determining palm contour points from palm contour auxiliary lines corresponding to the same palm skeleton point set based on a reference step size and skeleton point positions corresponding to the same palm skeleton point set to obtain contour point positions corresponding to the palm contour points includes: generating a current skeleton point line segment corresponding to the current palm skeleton point set based on a skeleton point position corresponding to each skeleton point in the current palm skeleton point set; determining a reference point on the current skeleton point line segment; and a step of moving, starting from the reference point on the current palm outline extension line corresponding to the current palm skeleton point set, by a reference step size corresponding to the current palm skeleton point set along a movement direction corresponding to the current palm outline extension line, to obtain the current palm outline points and outline point positions corresponding to the current palm outline points. The palm contour extraction method according to claim 1 .

7. the current palm outline auxiliary line includes at least one of a perpendicular bisector, an extension line, and a normal line; The movement direction corresponding to the perpendicular bisector is a direction opposite to the center of the palm, the movement direction corresponding to the extension line is an extension direction of the extension line, and the movement direction corresponding to the normal line is a perpendicular direction of the current skeleton point line segment. The palm contour extraction method according to claim 6.

8. Each palm skeleton point has a corresponding skeleton point identifier; The step of generating a palm contour corresponding to the target palm image based on each contour point position includes: Mapping skeleton point identifiers corresponding to palm skeleton points based on predetermined mapping information to obtain contour point sort identifiers corresponding to each palm outline point, wherein the predetermined mapping information includes identifier mapping relationships between palm skeleton points in the palm skeleton point set and palm outline points generated based on the palm skeleton point set; and ordering and connecting the contour point positions corresponding to each palm contour point according to the contour point sort identifier to obtain a palm contour corresponding to the target palm image. The palm contour extraction method according to claim 1 .

9. The step of acquiring skeleton point information corresponding to each palm skeleton point in the target palm image includes: inputting the target palm image into a target palm skeleton point recognition model to obtain skeleton point information corresponding to each of the palm skeleton points; The training process of the target palm skeleton point recognition model includes: obtaining a training dataset, the training dataset including a plurality of training palm images and training skeleton point information corresponding to each of the training palm images; determining a current palm image from the training dataset; inputting the current palm image into an initial palm skeleton point recognition model to obtain predicted skeleton point information corresponding to the current palm image; adjusting model parameters corresponding to the initial palm skeleton point recognition model based on a difference between the predicted skeleton point information corresponding to the current palm image and the training skeleton point information to obtain an intermediate skeleton point recognition model; and returning to the step of setting the next training palm image as the current palm image, setting the intermediate skeleton point recognition model as the initial palm skeleton point recognition model, and inputting the current palm image into the initial palm skeleton point recognition model until a convergence condition is met, thereby obtaining the target palm skeleton point recognition model. The palm contour extraction method according to claim 1 .

10. 2. The palm contour extraction method according to claim 1, wherein the reference step size increases as the palm size information corresponding to the target palm image increases.

11. The palm contour extraction method according to claim 1 , wherein the reference step size increases as the palm depth information corresponding to the target palm image decreases.

12. The palm outline extraction method according to any one of claims 1 to 11, wherein the palm outline is used to generate a palm video.

13. A control instruction generation method executed by a computer device, comprising: displaying a palm contour determined based on the target palm image; generating a target control command based on the display information of the palm outline; The palm contour extraction process includes: acquiring skeleton point information corresponding to each palm skeleton point in the target palm image, the skeleton point information including a skeleton point position and a skeleton point type; matching each palm skeleton point according to the skeleton point type to obtain a plurality of palm skeleton point sets, each palm skeleton point set having a corresponding geometric processing type; generating palm outline auxiliary lines that match a geometric processing type corresponding to the palm skeleton point set based on skeleton point positions corresponding to each skeleton point in the same palm skeleton point set, thereby obtaining palm outline auxiliary lines corresponding to each palm skeleton point set; determining palm contour points from the palm contour auxiliary line corresponding to the set of palm skeleton points based on the reference step size and skeleton point positions corresponding to the same set of palm skeleton points, and obtaining contour point positions corresponding to the palm contour points; and generating a palm contour corresponding to the target palm image based on each contour point position. Control instruction generation method.

14. The step of generating a target control command based on the display information of the palm outline includes: generating a target control command when a position difference between the display position of the palm outline and the target display position is smaller than a predetermined threshold; and if the position difference is equal to or greater than the predetermined threshold, generating palm movement prompt information based on the position difference, the palm movement prompt information being for prompting the user to move the palm to reduce the position difference. The control instruction generation method according to claim 13.

15. 15. The control command generation method according to claim 13, wherein the target palm image is a palm image corresponding to a virtual resource transfer source, the target control command is a virtual resource transfer command, and the virtual resource transfer command is for instructing the transfer of virtual resources from a resource account corresponding to the virtual resource transfer source to a target account.

16. a skeleton point information acquisition module configured to acquire skeleton point information corresponding to each palm skeleton point in the target palm image, the skeleton point information including a skeleton point position and a skeleton point type; a palm skeleton point matching module configured to match each palm skeleton point based on the skeleton point type to obtain a plurality of palm skeleton point sets, the palm skeleton point sets having corresponding geometric processing types; a palm contour extension line determination module configured to generate palm contour extension lines that match a geometric processing type corresponding to the palm skeleton point set based on skeleton point positions corresponding to each skeleton point in the same palm skeleton point set, thereby obtaining palm contour extension lines corresponding to each palm skeleton point set; a palm outline point determination module configured to determine palm outline points from palm outline auxiliary lines corresponding to the same palm skeleton point set based on a reference step size and skeleton point positions corresponding to the same palm skeleton point set, and obtain outline point positions corresponding to the palm outline points; a palm contour generation module configured to generate a palm contour corresponding to the target palm image based on each contour point position. Palm contour extraction device.

17. A control command generation device, a palm contour display module configured to display a palm contour determined based on the target palm image; a control command generation module configured to generate a target control command based on the palm outline display information; The palm contour extraction process includes: acquiring skeleton point information corresponding to each palm skeleton point in the target palm image, the skeleton point information including a skeleton point position and a skeleton point type; matching each palm skeleton point according to the skeleton point type to obtain a plurality of palm skeleton point sets, each palm skeleton point set having a corresponding geometric processing type; generating palm outline auxiliary lines that match a geometric processing type corresponding to the palm skeleton point set based on skeleton point positions corresponding to each skeleton point in the same palm skeleton point set, thereby obtaining palm outline auxiliary lines corresponding to each palm skeleton point set; determining palm contour points from the palm contour auxiliary line corresponding to the set of palm skeleton points based on the reference step size and skeleton point positions corresponding to the same set of palm skeleton points, and obtaining contour point positions corresponding to the palm contour points; and generating a palm contour corresponding to the target palm image based on each contour point position. Control command generator.

18. 1. A computing device including a memory having computer-readable instructions stored thereon and one or more processors, When the computer-readable instructions are executed by the one or more processors, the steps of the palm contour extraction method according to any one of claims 1 to 11 are realized. Computer equipment.

19. A computer program configured to cause a computer to execute the palm outline extraction method according to any one of claims 1 to 11.

Images