Finger pointing identification method, device and equipment

Abstract

The invention provides a finger pointing recognition method, device and equipment, and relates to the field of image processing, in particular to an intelligent cabin, automatic driving and computer vision. According to the specific implementation scheme, a hand image is acquired, and key points of fingers in adjacent fingers in the hand image are determined; a first distance and a second distance are determined according to the key points of the fingers in the adjacent fingers, and the first distance represents the distance between the adjacent fingers in the X-axis direction of the hand image; the second distance represents the length of the previous finger in the adjacent fingers in the X-axis direction of the hand image; determining the finger direction of the hand image according to the position state of the top end of the previous finger, the first distance and the second distance; the position state represents the distance relation between the top end of the previous finger and the bottom joint of the previous finger. The finger pointing of the user can be accurately and quickly recognized. The method does not need to manually mark the image training set to train the model, and reduces the labor cost and time cost for recognizing the finger pointing.

Description

Technical Field

[0001] The present disclosure relates to an intelligent cockpit, autonomous driving and computer vision in image processing, and in particular to a finger pointing recognition method, device and equipment. Background Art

[0002] With the development of human-computer interaction, it is often necessary to obtain the user's finger pointing, and then obtain corresponding control instructions based on the finger pointing. For example, in the intelligent cockpit of a vehicle, the user is required to make a gesture to identify the user's finger pointing; then the intelligent cockpit of the vehicle completes the corresponding control process based on the finger pointing.

[0003] Furthermore, there is an urgent need for a solution that can accurately and effectively identify where the user's finger is pointing. Summary of the invention

[0004] The present disclosure provides a finger pointing recognition method, device and equipment that can accurately and effectively recognize the finger pointing of a user.

[0005] According to a first aspect of the present disclosure, a method for identifying finger pointing is provided, comprising:

[0006] Acquire a hand image, and determine key points of fingers among adjacent fingers in the hand image;

[0007] Determine finger information according to key points of fingers among the adjacent fingers; wherein the finger information includes a first distance and a second distance, the first distance representing the distance between adjacent fingers in the X-axis direction of the hand image; the second distance representing the length of a previous finger among the adjacent fingers in the X-axis direction of the hand image;

[0008] The finger direction of the hand image is determined according to the position state of the top of the previous finger, the first distance and the second distance; wherein the position state represents the distance relationship between the top of the previous finger and the bottom joint of the previous finger.

[0009] According to a second aspect of the present disclosure, a device for identifying finger pointing is provided, comprising:

[0010] An acquisition unit, used for acquiring a hand image and determining key points of fingers among adjacent fingers in the hand image;

[0011] A first determining unit, configured to determine finger information according to key points of fingers among the adjacent fingers; wherein the finger information includes a first distance and a second distance, wherein the first distance represents the distance between adjacent fingers in the X-axis direction of the hand image; and the second distance represents the length of a previous finger among the adjacent fingers in the X-axis direction of the hand image;

[0012] The second determination unit is used to determine the finger pointing of the hand image according to the position state of the top of the previous finger, the first distance and the second distance; wherein the position state represents the distance relationship between the top of the previous finger and the bottom joint of the previous finger.

[0013] According to a third aspect of the present disclosure, there is provided an electronic device, including:

[0014] at least one processor; and

[0015] a memory communicatively connected to the at least one processor; wherein,

[0016] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method described in the first aspect.

[0017] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause the computer to execute the method described in the first aspect.

[0018] According to a fifth aspect of the present disclosure, a computer program product is provided, comprising: a computer program, wherein the computer program is stored in a readable storage medium, at least one processor of an electronic device can read the computer program from the readable storage medium, and the at least one processor executes the computer program so that the electronic device executes the method described in the first aspect.

[0019] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0021] Figure 1 is a schematic diagram according to a first embodiment of the present disclosure;

[0022] Figure 2 It is a schematic diagram of the key points of the finger provided by the present disclosure Figure 1 ;

[0023] Figure 3 It is a schematic diagram of the key points of the finger provided by the present disclosure Figure 2 ;

[0024] Figure 4 is a schematic diagram according to a second embodiment of the present disclosure;

[0025] Figure 5 It is a finger pointing indication provided by the present disclosure Figure 1 ;

[0026] Figure 6 It is a finger pointing indication provided by the present disclosure Figure 2 ;

[0027] Figure 7 It is a finger pointing indication provided by the present disclosure Figure 3 ;

[0028] Figure 8 It is a finger pointing indication provided by the present disclosure Figure 4 ;

[0029] Fig. 9 It is a finger pointing indication provided by the present disclosure Figure 5 ;

[0030] Fig.10 It is a finger pointing indication provided by the present disclosure Figure 6 ;

[0031] Fig.11 It is a finger pointing indication provided by the present disclosure Figure 7 ;

[0032] Fig.12 is a schematic diagram according to a third embodiment of the present disclosure;

[0033] Fig.13 is a schematic diagram according to a fourth embodiment of the present disclosure;

[0034] Fig.14 is a schematic diagram according to a fifth embodiment of the present disclosure;

[0035] Fig.15 A schematic block diagram of an example electronic device 1500 is shown that can be used to implement embodiments of the present disclosure. DETAILED DESCRIPTION

[0036] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0037] With the development of human-computer interaction, it is often necessary to obtain the user's finger pointing, and then obtain the corresponding control instructions based on the finger pointing. For example, in the intelligent cockpit of a vehicle, the user is required to make a gesture to identify the user's finger pointing; then the intelligent cockpit of the vehicle completes the corresponding control process based on the finger pointing.

[0038] For example, in the intelligent cockpit of the vehicle, the user is required to make a gesture; then the vehicle recognizes the finger direction of the index finger in the user's hand image, and then the vehicle obtains a control instruction corresponding to the finger direction according to the recognized finger direction; then the vehicle executes the control instruction. For example, if the vehicle recognizes that the finger is pointing upward, it determines and executes the control instruction corresponding to the finger direction, for example, the control instruction is "open the sunroof"; if the vehicle recognizes that the finger is pointing downward, it determines and executes the control instruction corresponding to the finger direction, for example, the control instruction is "close the sunroof"; if the vehicle recognizes that the finger is pointing to the right, it determines and executes the control instruction corresponding to the finger direction, for example, the control instruction is "open the right window, or adjust the right rearview mirror, or turn on the right headlight"; if the vehicle recognizes that the finger is pointing to the left, it determines and executes the control instruction corresponding to the finger direction, for example, the control instruction is "open the left window, or adjust the left rearview mirror, or turn on the left headlight".

[0039] In one example, a large number of hand images can be obtained; then, the finger directions of the hand images are manually marked, for example, the finger directions of the main hand image are marked as upward, downward, left, or right. Then, the artificial intelligence model is trained based on the hand images with marked finger directions to obtain a finger direction recognition model. Then, the hand images to be recognized are recognized based on the finger direction recognition model to obtain the recognition result of the finger direction.

[0040] However, in the above method, after the model is trained, it is necessary to manually mark the finger pointing of the hand image (for example, manually mark the index finger pointing); then the model can be trained based on the marked hand image. Among them, after obtaining the initial hand image, it is necessary to manually screen the collected hand images to remove invalid images; then, it is necessary to manually mark the index finger pointing in the hand image; this whole process requires a lot of manpower and time costs, resulting in high cost and low efficiency for obtaining the finger pointing recognition model.

[0041] Furthermore, when manually marking the finger pointing in a hand image, different markers may mark different results due to their own subjective judgment, which makes it difficult to train the model and causes the trained model to be unable to accurately identify the finger pointing.

[0042] For example, in a hand image, the finger is pointing to the upper left, but some labelers may think it is more upward, while others may think it is more left, which results in marking different finger directions.

[0043] Moreover, for the finger pointing model, the judgment range for the direction of the index finger pointing is different in different practical application scenarios, and thus the ability to be customized or adjusted is required so that the model can be adapted to different application scenarios. However, the model trained based on specific hand images does not have such a capability.

[0044] Furthermore, there is an urgent need for a solution that can accurately and effectively identify where the user's finger is pointing, while reducing labor costs and time costs.

[0045] The present disclosure provides a finger pointing recognition method, device and equipment, which are applied to smart cockpits, autonomous driving and computer vision in image processing to achieve the purpose of accurately and effectively identifying the user's finger pointing and reduce the labor cost and time cost of identifying the finger pointing.

[0046] It should be noted that the hand image in this embodiment is not a hand image of a specific user and cannot reflect the personal information of a specific user. It should be noted that the hand image in this embodiment comes from a public data set.

[0047] In the technical solution of the present disclosure, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0048] In order to enable readers to more deeply understand the implementation principle of the present disclosure, the following Figure 1-Figure 14 right Figure 1 The illustrated embodiment is further refined.

[0049] Figure 1 is a schematic diagram according to the first embodiment of the present disclosure, such as Figure 1 As shown, the present disclosure provides a method for identifying finger pointing, the method comprising:

[0050] 101. Obtain a hand image, and determine key points of fingers among adjacent fingers in the hand image.

[0051] For example, the execution subject of this embodiment may be a controller in a vehicle, or a processor in a vehicle, or a device or equipment for determining the position of a vehicle, or a terminal device, or a server, or other devices or equipment that can implement this embodiment. There is no limitation on this.

[0052] The hand image is collected by a camera. The key points of the hand image are extracted or recognized, and the key points of each finger in the hand image are obtained. If a finger in the hand image is blocked by other fingers, the key points of the blocked finger can be automatically deduced.

[0053] For example, a hand key point model can be used to identify the hand image to obtain the key points of each finger. If a finger in the hand image is blocked by other fingers, the key points of the blocked finger can be automatically deduced based on the hand key point model.

[0054] Figure 2 It is a schematic diagram of the key points of the finger provided by the present disclosure Figure 1 , Figure 2 As shown in FIG, after collecting the hand image, the key points of each finger in the hand image are identified. The key points are labeled as follows: Figure 2 As shown. Among them, Figure 2 The X-axis and Y-axis of the hand image are marked in FIG.

[0055] Figure 2 The key points of each finger are marked in Figure 2 As shown, the key point of the hand is key point 0; along the bottom to the top of the thumb, the key points of the thumb are key point 1, key point 2, key point 3, and key point 4; along the bottom to the top of the index finger, the key points of the index finger are key point 5, key point 6, key point 7, and key point 8; along the bottom to the top of the middle finger, the key points of the middle finger are key point 9, key point 10, key point 11, and key point 12; along the bottom to the top of the ring finger, the key points of the ring finger are key point 13, key point 14, key point 15, and key point 16; along the bottom to the top of the little finger, the key points of the little finger are key point 17, key point 18, key point 19, and key point 20.

[0056] The above key point labeling method can be used to label the same key point in different hand images (images with the hand in different states).

[0057] Figure 3 It is a schematic diagram of the key points of the finger provided by the present disclosure Figure 2 , Figure 3 As shown in FIG, after collecting the hand image, the key points of each finger in the hand image are identified. The key points are labeled as follows: Figure 3 As shown. Among them, Figure 3 The X-axis and Y-axis of the hand image are marked in FIG.

[0058] in, Figure 3 The key points are labeled in the same way as Figure 2same, Figure 3 The figure only shows the key points to make it easier to see the key points.

[0059] Figure 2 and Figure 3 However, if the hand in the hand image is in other postures, or if the fingers in the hand image are blocked by other fingers, the key points of the blocked fingers can be automatically deduced based on the hand key point model.

[0060] In this embodiment, only the key points of the fingers in the adjacent fingers can be extracted from the obtained key points. For example, the key points of the index finger and the middle finger are extracted; or the key points of the thumb and the index finger are extracted; or the key points of the middle finger and the ring finger are extracted; or the key points of the ring finger and the little finger are extracted.

[0061] For example, the previous finger among adjacent fingers is the index finger, and the next finger among adjacent fingers is the middle finger. In the smart cockpit, when the user needs to issue a control command to the smart cockpit, the user issues a gesture; the smart cockpit collects the user's hand image, and then the smart cockpit can extract the key points of the index finger and the key points of the middle finger in the hand image.

[0062] 102. Determine finger information based on key points of fingers among adjacent fingers; wherein the finger information includes a first distance and a second distance, the first distance represents the distance between adjacent fingers in the X-axis direction of the hand image; the second distance represents the length of a previous finger among the adjacent fingers in the X-axis direction of the hand image.

[0063] Exemplarily, based on the key points of each finger in the adjacent fingers, the distance between the adjacent fingers in the X-axis direction of the hand image is calculated, thereby obtaining the first distance. Figure 2 The distance between the key point 5 of the middle index finger and the key point 10 of the middle finger in the X-axis direction of the hand image is used to obtain the first distance.

[0064] Based on the key point of the previous finger among the adjacent fingers, the length of the previous finger in the X-axis direction of the hand image is calculated, thereby obtaining the second distance. Figure 2 The distance between the key point 5 of the middle finger and the key point 8 of the index finger in the X-axis direction of the hand image is used to obtain the second distance.

[0065] Furthermore, the position state of the top of the previous finger can also be determined, wherein the position state represents the distance relationship between the top of the previous finger and the bottom joint of the previous finger. For example, the position state represents that the top of the previous finger is far away from the bottom joint of the previous finger, or the position state represents that the top of the previous finger is close to the bottom joint of the previous finger.

[0066] For example, the adjacent fingers are the index finger and the middle finger, and the preceding finger is the index finger.

[0067] For example, the top of the previous finger is a key point, and the bottom joint of the previous finger is also a key point. The Y-axis coordinate value of the top of the previous finger on the hand image and the Y-axis coordinate value of the bottom joint of the previous finger on the hand image can be determined. If it is determined that the Y-axis coordinate value of the top of the previous finger is much smaller than the Y-axis coordinate value of the bottom joint of the previous finger, then it is determined that the position state represents that the top of the previous finger is far away from the bottom joint of the previous finger; otherwise, it is determined that the position state represents that the top of the previous finger is close to the bottom joint of the previous finger.

[0068] For example, the top of the previous finger is a key point, and the bottom joint of the previous finger is also a key point. The Y-axis coordinate value of the top of the previous finger on the hand image and the Y-axis coordinate value of the bottom joint of the previous finger on the hand image can be determined; if the Y-axis coordinate value of the top of the previous finger is determined to be much greater than the Y-axis coordinate value of the bottom joint of the previous finger, then the position state is determined to represent that the top of the previous finger is far away from the bottom joint of the previous finger; otherwise, the position state is determined to represent that the top of the previous finger is close to the bottom joint of the previous finger.

[0069] For example, the top of the previous finger is a key point, and the bottom joint of the previous finger is also a key point. The X-axis coordinate value of the top of the previous finger on the hand image and the X-axis coordinate value of the bottom joint of the previous finger on the hand image can be determined; if the X-axis coordinate value of the top of the previous finger is determined to be much greater than the X-axis coordinate value of the bottom joint of the previous finger, then the position state is determined to represent that the top of the previous finger is far away from the bottom joint of the previous finger; otherwise, the position state is determined to represent that the top of the previous finger is close to the bottom joint of the previous finger.

[0070] For example, the top of the previous finger is a key point, and the bottom joint of the previous finger is also a key point. The X-axis coordinate value of the top of the previous finger on the hand image and the X-axis coordinate value of the bottom joint of the previous finger on the hand image can be determined; if the X-axis coordinate value of the top of the previous finger is much smaller than the X-axis coordinate value of the bottom joint of the previous finger, the position state is determined to represent that the top of the previous finger is far away from the bottom joint of the previous finger; otherwise, the position state is determined to represent that the top of the previous finger is close to the bottom joint of the previous finger.

[0071] 103. Determine the finger direction of the hand image according to the position state of the top of the previous finger, the first distance, and the second distance; wherein the position state represents the distance relationship between the top of the previous finger and the bottom joint of the previous finger.

[0072] Exemplarily, a comprehensive judgment is made based on the previously obtained position state of the tip of the previous finger, the first distance, and the second distance, thereby obtaining the finger pointing of the hand image.

[0073] For example, if it is determined that the position state of the previous finger represents that the top of the previous finger is away from the bottom joint of the previous finger; and the Y-axis coordinate value of the top of the previous finger is much smaller than the Y-axis coordinate value of the bottom joint of the previous finger; and it is determined that the second distance is smaller than the first distance, then it is determined that the finger is pointing upward.

[0074] If it is determined that the position state of the previous finger represents that the top of the previous finger is away from the bottom joint of the previous finger; and the Y-axis coordinate value of the top of the previous finger is much larger than the Y-axis coordinate value of the bottom joint of the previous finger; and it is determined that the second distance is smaller than the first distance, then it is determined that the finger is pointing upward.

[0075] If it is determined that the position state of the previous finger represents that the top of the previous finger is away from the bottom joint of the previous finger; and the X-axis coordinate value of the top of the previous finger is much larger than the X-axis coordinate value of the bottom joint of the previous finger; and it is determined that the second distance is greater than the first distance, then it is determined that the finger is pointing to the right.

[0076] If it is determined that the position state of the previous finger represents that the top of the previous finger is away from the bottom joint of the previous finger; and the X-axis coordinate value of the top of the previous finger is much smaller than the X-axis coordinate value of the bottom joint of the previous finger; and it is determined that the second distance is greater than the first distance, then it is determined that the finger is pointing to the left.

[0077] In this embodiment, by obtaining the key points of the fingers in the adjacent fingers in the hand image, the positional relationship of the key points of the fingers in the adjacent fingers is determined to obtain the position state of the top of the previous finger; and the distance of the key points of the fingers in the adjacent fingers is calculated to obtain the first distance (the distance between the adjacent fingers in the X-axis direction of the hand image) and the second distance (the length of the previous finger in the X-axis direction of the hand image). Based on the above position state, the first distance and the second distance, the hand direction can be obtained; it can be seen from the introduction of the above embodiment that if the position state of the previous finger represents that the top of the previous finger is far away from the bottom joint of the previous finger; and the Y-axis coordinate value of the top of the previous finger is much smaller than the Y-axis coordinate value of the bottom joint of the previous finger; and it is determined that the second distance is less than the first distance, it can be determined that the finger is upward (for the rest of the directions, see the previous introduction); referring to the previous introduction, it can be known that the user's finger direction can be quickly identified. For example, the above adjacent fingers are the index finger and the ring finger, and the previous finger is the index finger; and the solution of this embodiment can identify the direction of the index finger.

[0078] Furthermore, there is no need for the model to identify the hand image to obtain the finger pointing, and thus there is no need to manually unmark the image training set (i.e., there is no need to manually unmark the finger pointing in the hand image for training the model); the labor cost and time cost of identifying the finger pointing are reduced. When identifying the finger pointing, the finger pointing can be obtained based only on the above-mentioned position state, the first distance and the second distance, and there is no need to use a model to identify the finger pointing; thus, in actual application scenarios, there is no need to deploy the model in the device, thereby reducing the computing power occupied by the device and the memory consumption of the device.

[0079] Figure 4 is a schematic diagram according to the second embodiment of the present disclosure, such as Figure 4 As shown, the present disclosure provides a method for identifying finger pointing, the method comprising:

[0080] 401. Acquire a hand image, and determine key points of fingers among adjacent fingers in the hand image.

[0081] For example, the execution subject of this embodiment may be a controller in a vehicle, or a processor in a vehicle, or a device or equipment for determining the position of a vehicle, or a terminal device, or a server, or other devices or equipment that can implement this embodiment. There is no limitation on this.

[0082] This step refers to the above step 101 and will not be described in detail.

[0083] 402. Determine a first distance according to key points of fingers among the adjacent fingers, wherein the first distance represents the distance between the adjacent fingers in the X-axis direction of the hand image.

[0084] In one example, step 402 includes: determining the distance between a first key point of a front finger and a second key point of a rear finger among adjacent fingers in the X-axis direction as a first distance; wherein the first key point is the bottom joint of the front finger, and the second key point is the key point on the rear finger adjacent to the bottom joint of the rear finger.

[0085] For example, for adjacent fingers, the bottom joint of the previous finger is determined as the first key point, and the key point on the next finger adjacent to the bottom joint of the next finger is determined as the second key point. Then, the distance between the first key point and the second key point on the X-axis of the hand image is calculated, and the first distance can be obtained.

[0086] For example, see Figure 2, the adjacent fingers are the index finger and the middle finger, that is, the previous finger among the adjacent fingers is the index finger, and the next finger among the adjacent fingers is the middle finger. The first key point is determined to be key point 5, and the second key point is key point 10, and then the distance between key point 5 and key point 10 in the X-axis direction of the hand image is calculated as the first distance. In different hand images (images with the hand in different states), for the same key point, the labels of the key point in different images can be the same. Furthermore, no matter what the posture of the hand in the hand image is, for the case where the adjacent fingers are the index finger and the middle finger, the distance between key point 5 and key point 10 in the X-axis direction of the hand image is determined to be the first distance.

[0087] For example, see Figure 2 , the adjacent fingers are the middle finger and the ring finger, that is, the previous finger among the adjacent fingers is the middle finger, and the next finger among the adjacent fingers is the ring finger. The first key point is determined to be key point 9, and the second key point is determined to be key point 14, and then the distance between key point 9 and key point 14 in the X-axis direction of the hand image is calculated as the first distance. In different hand images (images with the hand in different states), for the same key point, the labels of the key point in different images can be the same. Furthermore, no matter what the posture of the hand in the hand image is, for the case where the adjacent fingers are the middle finger and the ring finger, the distance between key point 9 and key point 14 in the X-axis direction of the hand image is determined to be the first distance.

[0088] 403. Determine a second distance according to the key points of the fingers among the adjacent fingers, wherein the second distance represents the length of the previous finger among the adjacent fingers in the X-axis direction of the hand image.

[0089] In one example, step 403 includes: determining the distance between the third key point of the previous finger and the first key point of the previous finger in the adjacent fingers in the X-axis direction as the second distance; wherein the first key point is the bottom joint of the previous finger, and the third key point is the top of the previous finger.

[0090] For example, for adjacent fingers, the bottom joint of the previous finger is determined as the first key point, and the top of the previous finger is determined as the third key point. Then, the distance between the first key point and the third key point on the X-axis of the hand image is calculated, and the second distance can be obtained.

[0091] For example, see Figure 2, the adjacent fingers are the index finger and the middle finger, that is, the previous finger among the adjacent fingers is the index finger, and the next finger among the adjacent fingers is the middle finger. The first key point is determined to be key point 5, and the third key point is determined to be key point 8, and then the distance between key point 5 and key point 8 in the X-axis direction of the hand image is calculated as the second distance. In different hand images (images with the hand in different states), for the same key point, the labels of the key point in different images can be the same. Furthermore, no matter what the posture of the hand in the hand image is, for the case where the adjacent fingers are the index finger and the middle finger, the distance between key point 5 and key point 8 in the X-axis direction of the hand image is determined to be the second distance.

[0092] For example, see Figure 2 , the adjacent fingers are the middle finger and the ring finger, that is, the previous finger among the adjacent fingers is the middle finger, and the next finger among the adjacent fingers is the ring finger. The first key point is determined to be key point 9, and the third key point is determined to be key point 12, and then the distance between key point 9 and key point 12 in the X-axis direction of the hand image is calculated as the second distance. In different hand images (images with the hand in different states), for the same key point, the labels of the key point in different images can be the same. Furthermore, no matter what the posture of the hand in the hand image is, for the case where the adjacent fingers are the middle finger and the ring finger, the distance between key point 9 and key point 12 in the X-axis direction of the hand image is determined to be the second distance.

[0093] 404. Determine a third distance according to the key points of the fingers among the adjacent fingers; the third distance represents the length of the previous finger among the adjacent fingers in the Y-axis direction of the hand image.

[0094] In one example, the first distance, the second distance, and the third distance constitute the above-mentioned finger information.

[0095] In one example, step 404 includes: determining the distance between the third key point of the previous finger and the first key point of the previous finger in the adjacent fingers in the Y-axis direction as the third distance; wherein the first key point is the bottom joint of the previous finger, and the third key point is the top of the previous finger.

[0096] Exemplarily, the length of a previous finger among adjacent fingers in the Y-axis direction of the hand image may also be determined as the third distance.

[0097] For adjacent fingers, the bottom joint of the previous finger is determined as the first key point, and the top of the previous finger is determined as the third key point. Then the distance between the first key point and the third key point on the Y axis of the hand image is calculated, and the third distance can be obtained.

[0098] See also Figure 2, the adjacent fingers are the index finger and the middle finger, that is, the previous finger among the adjacent fingers is the index finger, and the next finger among the adjacent fingers is the middle finger. The first key point is determined to be key point 5, and the third key point is determined to be key point 8, and then the distance between key point 5 and key point 8 in the Y-axis direction of the hand image is calculated as the third distance. In different hand images (images with the hand in different states), for the same key point, the labels of the key point in different images can be the same. Furthermore, no matter what the posture of the hand in the hand image is, for the case where the adjacent fingers are the index finger and the middle finger, the distance between key point 5 and key point 8 in the Y-axis direction of the hand image is determined to be the third distance.

[0099] For example, see Figure 2 , the adjacent fingers are the middle finger and the ring finger, that is, the previous finger among the adjacent fingers is the middle finger, and the next finger among the adjacent fingers is the ring finger. The first key point is determined to be key point 9, and the third key point is determined to be key point 12, and then the distance between key point 9 and key point 12 in the Y-axis direction of the hand image is calculated as the third distance. In different hand images (images with the hand in different states), for the same key point, the labels of the key point in different images can be the same. Furthermore, no matter what the posture of the hand in the hand image is, for the case where the adjacent fingers are the middle finger and the ring finger, the distance between key point 9 and key point 12 in the Y-axis direction of the hand image is determined to be the third distance.

[0100] 405. If it is determined that the position state of the top of the previous finger is a preset state, determine the finger direction of the hand image according to the first distance and the second distance; wherein the preset state indicates that the top of the previous finger is away from the bottom joint of the previous finger.

[0101] Exemplarily, if it is determined that the Y-axis coordinate value of the top of the previous finger is much smaller than the Y-axis coordinate value of the bottom joint of the previous finger, then it is determined that the position state represents that the top of the previous finger is far away from the bottom joint of the previous finger.

[0102] If it is determined that the Y-axis coordinate value of the top of the previous finger is much greater than the Y-axis coordinate value of the bottom joint of the previous finger, then it is determined that the position state represents that the top of the previous finger is far away from the bottom joint of the previous finger.

[0103] If it is determined that the X-axis coordinate value of the top of the previous finger is much greater than the X-axis coordinate value of the bottom joint of the previous finger, then it is determined that the position state represents that the top of the previous finger is far away from the bottom joint of the previous finger.

[0104] If it is determined that the X-axis coordinate value of the top of the previous finger is much smaller than the X-axis coordinate value of the bottom joint of the previous finger, then it is determined that the position state represents that the top of the previous finger is far away from the bottom joint of the previous finger.

[0105] Then, the finger direction of the hand image is determined according to the magnitude relationship between the first distance and the second distance.

[0106] Step 405 includes the following situations, see the following introduction.

[0107] The first case of step 405: if it is determined that the position state of the top of the previous finger is the preset state, then it is determined whether the finger is pointing upward or downward according to the first distance, the second distance and the third distance.

[0108] In one example, the first case of step 405 includes the following steps:

[0109] In the first step of the first case of step 405, if it is determined that the key point set of the previous finger meets the first preset condition, the position state of the top of the previous finger is determined to be the preset state, and when it is determined that the second distance is less than the first distance and the third distance is greater than the first distance, the finger is determined to be pointing upward.

[0110] Among them, the key point set includes the first key point, the third key point, the fourth key point and the fifth key point; the first preset condition is that the Y-axis coordinate value of the third key point is smaller than the Y-axis coordinate value of the fifth key point, the Y-axis coordinate value of the fifth key point is smaller than the Y-axis coordinate value of the fourth key point, and the Y-axis coordinate value of the fourth key point is smaller than the Y-axis coordinate value of the first key point.

[0111] The first key point, the fourth key point, the fifth key point and the third key point are the joint points along the bottom joint point to the top of the previous finger, respectively.

[0112] The second step of the first case of step 405 is to determine that the position state of the top of the previous finger is the preset state if it is determined that the key point set of the previous finger meets the second preset condition, and when it is determined that the second distance is less than the first distance and the third distance is greater than the first distance, determine that the finger is pointing downward.

[0113] Among them, the key point set includes the first key point, the third key point, the fourth key point and the fifth key point; the second preset condition is that the Y-axis coordinate value of the third key point is greater than the Y-axis coordinate value of the fifth key point, the Y-axis coordinate value of the fifth key point is greater than the Y-axis coordinate value of the fourth key point, and the Y-axis coordinate value of the fourth key point is greater than the Y-axis coordinate value of the first key point.

[0114] The first key point, the fourth key point, the fifth key point and the third key point are the joint points along the bottom joint point to the top of the previous finger, respectively.

[0115] In one example, the above “determining that the second distance is less than the first distance” includes: determining that the second distance is less than a first calculated value, wherein the first calculated value is the product of the first distance and a first preset value, and the first preset value is a value less than 1.

[0116] Exemplarily, the first distance, the second distance and the third distance have been calculated according to the above introduction.

[0117] According to the previous introduction, the key points of the previous finger of the adjacent finger have been obtained, and the key points of the previous finger constitute the key point set of the previous finger. Among them, the key point set includes the first key point, the third key point, the fourth key point and the fifth key point; among them, the first key point, the fourth key point, the fifth key point and the third key point are the joint points along the bottom joint point to the top of the previous finger.

[0118] Case 1. If it is determined that the Y-axis coordinate value of the third key point is smaller than the Y-axis coordinate value of the fifth key point, the Y-axis coordinate value of the fifth key point is smaller than the Y-axis coordinate value of the fourth key point, and the Y-axis coordinate value of the fourth key point is smaller than the Y-axis coordinate value of the first key point, then it is determined that the Y-axis coordinate value of the top joint of the previous finger is much smaller than the Y-axis coordinate value of the bottom joint of the previous finger. It can be preliminarily determined that the finger of the previous finger may be pointing upward. However, other conditions are needed to assist in the determination.

[0119] Furthermore, it is also necessary to determine the size relationship between the second distance and the first distance, and the size relationship between the third distance being greater than the first distance.

[0120] If it is determined that the second distance is smaller than the first distance (i.e., the distance between the bottom joint of the previous finger and the top of the previous finger in the X-axis direction is smaller than the distance between the second key point of the next finger and the bottom joint of the previous finger in the X-axis direction).

[0121] Then, if it is determined that the third distance is greater than the first distance (i.e., the distance between the bottom joint of the previous finger and the top of the previous finger in the Y-axis direction is greater than the distance between the second key point of the next finger and the bottom joint of the previous finger in the X-axis direction).

[0122] Combining the above three conditions, it can be determined that the previous finger is pointing upward.

[0123] In case 1, the relationship between the Y-axis coordinate values ​​of each key point of the previous finger is determined, and then it is determined that the previous finger may be pointing upward. At this time, it cannot be directly determined that it is pointing upward. Then it is further determined that the second distance is less than the first distance. At this time, it can be determined that the previous finger is not tilted too much; after further determining that the third distance is greater than the first distance, it can be determined that the previous finger is not bent too much. Based on the three conditions, it is determined that the previous finger is pointing upward; and then it is conveniently and accurately determined that the previous finger is pointing upward.

[0124] Case 2. The only difference from Case 1 is how to determine that "the third distance is greater than the first distance". When it can be determined that the second distance is less than the first calculated value (the first calculated value is the product of the first distance and "a value less than 1"), it is determined that "the third distance is greater than the first distance". Furthermore, in Case 2, the relationship between the Y-axis coordinate values ​​of each key point of the previous finger is judged, and then it is determined that the finger pointing of the previous finger may be upward. At this time, it cannot be directly determined that it is upward. Then it is further determined that the second distance is less than the first calculated value. At this time, it can be determined that the inclination of the previous finger is very small; after further determining that the third distance is greater than the first distance, it can be determined that the previous finger is not bent too much. Based on the three conditions, it is determined that the previous finger is pointing upward; then it is conveniently and accurately determined that the finger pointing of the previous finger is upward.

[0125] Figure 5 It is a finger pointing indication provided by the present disclosure Figure 1 ,like Figure 5 As shown, the adjacent fingers are the index finger and the middle finger, and a key point set of the index finger is obtained, which includes: a first key point 501, a fourth key point 502, a fifth key point 503, and a third key point 504. Among them, the first key point 501 is Figure 2 The fourth key point 502 is Figure 2 The key point 6, the fifth key point 503 is Figure 2 The key point 7, the third key point 504 is Figure 2 The key point 8 of the middle finger can also be obtained.

[0126] The distance between the first key point 501 and the second key point 505 in the X-axis direction of the hand image is calculated to obtain a first distance a.

[0127] The distance between the third key point 504 and the first key point 501 in the X-axis direction of the hand image is calculated to obtain a first distance b.

[0128] The distance between the third key point 504 and the first key point 501 in the Y-axis direction of the hand image is calculated to obtain a third distance c.

[0129] If it is determined that the Y-axis coordinate value of the third key point 504 is less than the Y-axis coordinate value of the fifth key point 503, the Y-axis coordinate value of the fifth key point 503 is less than the Y-axis coordinate value of the fourth key point 502, and the Y-axis coordinate value of the fourth key point 502 is less than the Y-axis coordinate value of the first key point 501; and it is determined that the first distance b is less than the first distance a (or the first distance b is less than the product of the first distance a and the first preset value; wherein the first preset value is, for example, 0.8); and it is determined that the third distance c is greater than the first distance a. Then it is determined that the index finger is pointing upward.

[0130] Figure 6 It is a finger pointing indication provided by the present disclosure Figure 2 ,like Figure 6 As shown, the adjacent fingers are the index finger and the middle finger, and a key point set of the index finger is obtained, which includes: a first key point 601, a fourth key point 602, a fifth key point 603, and a third key point 604. Among them, the first key point 601 is Figure 2 The key point 5, the fourth key point 602 is Figure 2 The key point 6, the fifth key point 603 is Figure 2 The key point 7, the third key point 604 is Figure 2 Key point 8.

[0131] The second key point 605 of the middle finger can also be obtained. Among them, the second key point 605 is Figure 2 Key point 10.

[0132] The distance between the first key point 601 and the second key point 605 in the X-axis direction of the hand image is calculated to obtain a first distance a.

[0133] The distance between the third key point 604 and the first key point 601 in the X-axis direction of the hand image is calculated to obtain a first distance b.

[0134] The distance between the third key point 604 and the first key point 601 in the Y-axis direction of the hand image is calculated to obtain a third distance c.

[0135] If it is determined that the Y-axis coordinate value of the third key point 604 is less than the Y-axis coordinate value of the fifth key point 603, the Y-axis coordinate value of the fifth key point 603 is less than the Y-axis coordinate value of the fourth key point 602, and the Y-axis coordinate value of the fourth key point 602 is less than the Y-axis coordinate value of the first key point 601; and it is determined that the first distance b is less than the first distance a (or the first distance b is less than the product of the first distance a and the first preset value; wherein the first preset value is, for example, 0.8); and it is determined that the third distance c is greater than the first distance a. Then it is determined that the index finger is pointing upward.

[0136] Case 3. If it is determined that the Y-axis coordinate value of the third key point is greater than the Y-axis coordinate value of the fifth key point, the Y-axis coordinate value of the fifth key point is greater than the Y-axis coordinate value of the fourth key point, and the Y-axis coordinate value of the fourth key point is greater than the Y-axis coordinate value of the first key point, then it is determined that the Y-axis coordinate value of the top joint of the previous finger is much greater than the Y-axis coordinate value of the bottom joint of the previous finger. It can be preliminarily determined that the finger of the previous finger may be pointing downward. However, other conditions are needed to assist in the determination.

[0137] Furthermore, it is also necessary to determine the size relationship between the second distance and the first distance, and the size relationship between the third distance being greater than the first distance.

[0138] If it is determined that the second distance is smaller than the first distance (i.e., the distance between the bottom joint of the previous finger and the top of the previous finger in the X-axis direction is smaller than the distance between the second key point of the next finger and the bottom joint of the previous finger in the X-axis direction).

[0139] Then, if it is determined that the third distance is greater than the first distance (i.e., the distance between the bottom joint of the previous finger and the top of the previous finger in the Y-axis direction is greater than the distance between the second key point of the next finger and the bottom joint of the previous finger in the X-axis direction).

[0140] Combining the above three conditions, it can be determined that the previous finger is pointing downward.

[0141] In case 3, the relationship between the Y-axis coordinate values ​​of each key point of the previous finger is determined, and then it is determined that the previous finger may be pointing downward. At this time, it cannot be directly determined that it is downward. Then it is further determined that the second distance is less than the first distance. At this time, it can be determined that the previous finger is not tilted too much; after further determining that the third distance is greater than the first distance, it can be determined that the previous finger is not bent too much. Based on the three conditions, it is determined that the previous finger is pointing downward; and then it is conveniently and accurately determined that the previous finger is pointing downward.

[0142] Case 4. The only difference from Case 3 is how to determine "determine that the second distance is less than the first distance". When it can be determined that the second distance is less than the first calculated value (the first calculated value is the product of the first distance and "a value less than 1"), it is determined that "determine that the second distance is less than the first distance". Furthermore, in Case 4, the relationship between the Y-axis coordinate values ​​of each key point of the previous finger is judged, and then it is determined that the finger pointing of the previous finger may be downward. At this time, it cannot be directly determined that it is downward. Then it is further determined that the second distance is less than the first calculated value. At this time, it can be determined that the inclination of the previous finger is very small; after further determining that the third distance is greater than the first distance, it can be determined that the previous finger is not bent too much. Based on the three conditions, it is determined that the previous finger is pointing downward; then it is conveniently and accurately determined that the finger pointing of the previous finger is downward.

[0143] Figure 7 It is a finger pointing indication provided by the present disclosure Figure 3 ,like Figure 7 As shown, the adjacent fingers are the index finger and the middle finger, and a key point set of the index finger is obtained, which includes: a first key point 701, a fourth key point 702, a fifth key point 703, and a third key point 704. Among them, the first key point 701 is Figure 2 The key point 5, the fourth key point 702 is Figure 2 The key point 6, the fifth key point 703 is Figure 2 The key point 7, the third key point 704 is Figure 2 Key point 8.

[0144] The second key point 705 of the middle finger can also be obtained. Among them, the second key point 705 is Figure 2 Key point 10.

[0145] The distance between the first key point 701 and the second key point 705 in the X-axis direction of the hand image is calculated to obtain a first distance a.

[0146] The distance between the third key point 704 and the first key point 701 in the X-axis direction of the hand image is calculated to obtain a first distance b.

[0147] The distance between the third key point 704 and the first key point 701 in the Y-axis direction of the hand image is calculated to obtain a third distance c.

[0148] If it is determined that the Y-axis coordinate value of the third key point 704 is greater than the Y-axis coordinate value of the fifth key point 703, the Y-axis coordinate value of the fifth key point 703 is greater than the Y-axis coordinate value of the fourth key point 702, and the Y-axis coordinate value of the fourth key point 702 is greater than the Y-axis coordinate value of the first key point 701; and it is determined that the first distance b is less than the first distance a (or the first distance b is less than the product of the first distance a and the first preset value; wherein the first preset value is, for example, 0.8); and it is determined that the third distance c is greater than the first distance a. Then it is determined that the index finger is pointing downward.

[0149] The second situation of step 405 includes the following steps:

[0150] The first step of the second case of step 405 is to determine that the position state of the top of the previous finger is the preset state if it is determined that the key point set of the previous finger meets the third preset condition, and when it is determined that the second distance is greater than the first distance, determine that the finger is pointing to the right.

[0151] Among them, the key point set includes the first key point, the third key point, the fourth key point and the fifth key point; the first key point, the fourth key point, the fifth key point and the third key point are the joint points along the bottom joint point to the top of the previous finger, respectively.

[0152] The third preset condition is that the X-axis coordinate value of the third key point is greater than the X-axis coordinate value of the fifth key point, the X-axis coordinate value of the fifth key point is greater than the X-axis coordinate value of the fourth key point, and the X-axis coordinate value of the fourth key point is greater than the X-axis coordinate value of the first key point.

[0153] In the second step of the second case of step 405, if it is determined that the key point set of the previous finger meets the fourth preset condition, the position state of the top of the previous finger is determined to be the preset state, and when it is determined that the second distance is greater than the first distance, the finger is determined to be pointing to the left;

[0154] The key point set includes a first key point, a third key point, a fourth key point and a fifth key point; the first key point, the fourth key point, the fifth key point and the third key point are, in order, joint points along the bottom joint point to the top joint point on the previous finger;

[0155] The fourth preset condition is that the X-axis coordinate value of the third key point is smaller than the X-axis coordinate value of the fifth key point, the X-axis coordinate value of the fifth key point is smaller than the X-axis coordinate value of the fourth key point, and the X-axis coordinate value of the fourth key point is smaller than the X-axis coordinate value of the first key point.

[0156] In one example, the above “determining that the second distance is greater than the first distance” includes: determining that the second distance is greater than a second calculated value, wherein the second calculated value is the product of the second distance and a second preset value, and the second preset value is a value greater than 1.

[0157] Exemplarily, the first distance, the second distance and the third distance have been calculated according to the above introduction.

[0158] According to the previous introduction, the key points of the previous finger of the adjacent finger have been obtained, and the key points of the previous finger constitute the key point set of the previous finger. Among them, the key point set includes the first key point, the third key point, the fourth key point and the fifth key point; among them, the first key point, the fourth key point, the fifth key point and the third key point are the joint points along the bottom joint point to the top of the previous finger.

[0159] Case 5. If it is determined that the X-axis coordinate value of the third key point is greater than the X-axis coordinate value of the fifth key point, the X-axis coordinate value of the fifth key point is greater than the X-axis coordinate value of the fourth key point, and the X-axis coordinate value of the fourth key point is greater than the X-axis coordinate value of the first key point, then it is determined that the X-axis coordinate value of the top of the previous finger is much greater than the X-axis coordinate value of the bottom joint of the previous finger. It can be preliminarily determined that the finger of the previous finger may be pointing to the right. However, other conditions are needed to assist in the determination.

[0160] Furthermore, it is also necessary to determine the magnitude relationship between the second distance and the first distance.

[0161] If it is determined that the second distance is greater than the first distance (i.e., the distance between the bottom joint of the previous finger and the top of the previous finger in the X-axis direction is greater than the distance between the second key point of the next finger and the bottom joint of the previous finger in the X-axis direction).

[0162] Combining the above two conditions, it can be determined that the previous finger is pointing to the right.

[0163] In case 5, the relationship between the X-axis coordinate values ​​of each key point of the previous finger is determined, and then it is determined that the previous finger may be pointing to the right. At this time, it cannot be directly determined that it is pointing to the right. Then it is further determined that the second distance is greater than the first distance. At this time, it can be determined that the previous finger is not bent too much. Based on the two conditions, it is determined that the previous finger is pointing to the right; and then it is conveniently and accurately determined that the previous finger is pointing to the right.

[0164] Figure 8 It is a finger pointing indication provided by the present disclosure Figure 4 ,like Figure 8 As shown, the adjacent fingers are the index finger and the middle finger, and a key point set of the index finger is obtained, which includes: a first key point 801, a fourth key point 802, a fifth key point 803, and a third key point 804. Among them, the first key point 801 is Figure 2 The key point 5, the fourth key point 802 is Figure 2The key point 6, the fifth key point 803 is Figure 2 The key point 7, the third key point 804 is Figure 2 Key point 8.

[0165] The second key point 805 of the middle finger can also be obtained. Among them, the second key point 805 is Figure 2 Key point 10.

[0166] The distance between the first key point 801 and the second key point 805 in the X-axis direction of the hand image is calculated to obtain a first distance a.

[0167] The distance between the third key point 804 and the first key point 801 in the X-axis direction of the hand image is calculated to obtain a first distance b.

[0168] If it is determined that the X-axis coordinate value of the third key point 804 is greater than the X-axis coordinate value of the fifth key point 803, the X-axis coordinate value of the fifth key point 803 is greater than the X-axis coordinate value of the fourth key point 802, and the X-axis coordinate value of the fourth key point 802 is greater than the X-axis coordinate value of the first key point 801; and it is determined that the first distance b is greater than the first distance a (or the first distance b is greater than the product of the first distance a and the second preset value; wherein the second preset value is, for example, 1.3), it is determined that the index finger is pointing to the right.

[0169] Fig. 9 It is a finger pointing indication provided by the present disclosure Figure 5 ,like Fig. 9 As shown, the adjacent fingers are the index finger and the middle finger, and a key point set of the index finger is obtained, which includes: a first key point 901, a fourth key point 902, a fifth key point 903, and a third key point 904. Among them, the first key point 901 is Figure 2 The key point 5, the fourth key point 902 is Figure 2 The key point 6, the fifth key point 903 is Figure 2 The key point 7, the third key point 904 is Figure 2 Key point 8.

[0170] The second key point 905 of the middle finger can also be obtained. Among them, the second key point 905 is Figure 2 Key point 10.

[0171] The distance between the first key point 901 and the second key point 905 in the X-axis direction of the hand image is calculated to obtain a first distance a.

[0172] The distance between the third key point 904 and the first key point 901 in the X-axis direction of the hand image is calculated to obtain a first distance b.

[0173] If it is determined that the X-axis coordinate value of the third key point 904 is greater than the X-axis coordinate value of the fifth key point 903, the X-axis coordinate value of the fifth key point 903 is greater than the X-axis coordinate value of the fourth key point 902, and the X-axis coordinate value of the fourth key point 902 is greater than the X-axis coordinate value of the first key point 901; and it is determined that the first distance b is greater than the first distance a (or the first distance b is greater than the product of the first distance a and the second preset value; wherein the second preset value is, for example, 1.3), it is determined that the index finger is pointing to the right.

[0174] Case 6. The only difference from Case 5 is how to determine that "the second distance is greater than the first distance". When it can be determined that the second distance is greater than the second calculated value (the second calculated value is the product of the first distance and "a value less than 1"), it is determined that "the second distance is greater than the first distance". Furthermore, in Case 6, the relationship between the X-axis coordinate values ​​of each key point of the previous finger is judged, and then it is determined that the finger pointing of the previous finger may be to the right. At this time, it cannot be directly determined that it is to the right. Then it is further determined that the second distance is greater than the first calculated value. At this time, it can be determined that the curvature of the previous finger is very small. Based on the two conditions, it is determined that the previous finger is pointing to the right; and then it is conveniently and accurately determined that the finger pointing of the previous finger is to the right.

[0175] Case 7. If it is determined that the X-axis coordinate value of the third key point is smaller than the X-axis coordinate value of the fifth key point, the X-axis coordinate value of the fifth key point is smaller than the X-axis coordinate value of the fourth key point, and the X-axis coordinate value of the fourth key point is smaller than the X-axis coordinate value of the first key point, then it is determined that the X-axis coordinate value of the top of the previous finger is much smaller than the X-axis coordinate value of the bottom joint of the previous finger. It can be preliminarily determined that the finger of the previous finger may be pointing to the left. However, other conditions are needed to assist in the determination.

[0176] Furthermore, it is also necessary to determine the magnitude relationship between the second distance and the first distance.

[0177] If it is determined that the second distance is greater than the first distance (i.e., the distance between the bottom joint of the previous finger and the top of the previous finger in the X-axis direction is greater than the distance between the second key point of the next finger and the bottom joint of the previous finger in the X-axis direction).

[0178] Combining the above two conditions, it can be determined that the previous finger is pointing to the left.

[0179] In case 7, the relationship between the X-axis coordinate values ​​of each key point of the previous finger is determined, and then it is determined that the finger of the previous finger may be pointing to the left. At this time, it cannot be directly determined that it is pointing to the left. Then it is further determined that the second distance is greater than the first distance. At this time, it can be determined that the previous finger is not bent too much. Based on the two conditions, it is determined that the finger of the previous finger is pointing to the left; and then it is conveniently and accurately determined that the finger of the previous finger is pointing to the left.

[0180] Case 8. The only difference from Case 7 is how to determine that "the second distance is greater than the first distance". When it can be determined that the second distance is greater than the second calculated value (the second calculated value is the product of the first distance and "a value less than 1"), it is determined that "the second distance is greater than the first distance". Furthermore, in Case 8, the relationship between the X-axis coordinate values ​​of each key point of the previous finger is judged, and then it is determined that the finger pointing of the previous finger may be to the left. At this time, it cannot be directly determined that it is to the left. Then it is further determined that the second distance is greater than the first calculated value. At this time, it can be determined that the curvature of the previous finger is very small. Based on the two conditions, it is determined that the previous finger is pointing to the left; and then it is conveniently and accurately determined that the finger pointing of the previous finger is to the left.

[0181] Fig.10 It is a finger pointing indication provided by the present disclosure Figure 6 ,like Fig.10 As shown, the adjacent fingers are the index finger and the middle finger, and a key point set of the index finger is obtained, which includes: a first key point 1001, a fourth key point 1002, a fifth key point 1003, and a third key point 1004. Among them, the first key point 1001 is Figure 2 The key point 5, the fourth key point 1002 is Figure 2 The key point 6, the fifth key point 1003 is Figure 2 The key point 7, the third key point 1004 is Figure 2 Key point 8.

[0182] The second key point 1005 of the middle finger can also be obtained. Among them, the second key point 1005 is Figure 2 Key point 10.

[0183] The distance between the first key point 1001 and the second key point 1005 in the X-axis direction of the hand image is calculated to obtain a first distance a.

[0184] The distance between the third key point 1004 and the first key point 1001 in the X-axis direction of the hand image is calculated to obtain a first distance b.

[0185] If it is determined that the X-axis coordinate value of the third key point 1004 is less than the X-axis coordinate value of the fifth key point 1003, the X-axis coordinate value of the fifth key point 1003 is less than the X-axis coordinate value of the fourth key point 1002, and the X-axis coordinate value of the fourth key point 1002 is less than the X-axis coordinate value of the first key point 1001; and it is determined that the first distance b is greater than the first distance a (or the first distance b is greater than the product of the first distance a and the second preset value; wherein the second preset value is, for example, 1.3), it is determined that the index finger is pointing to the right.

[0186] Fig.11 It is a finger pointing indication provided by the present disclosure Figure 7 ,like Fig.11 As shown, the adjacent fingers are the index finger and the middle finger, and a key point set of the index finger is obtained, which includes: a first key point 1101, a fourth key point 1102, a fifth key point 1103, and a third key point 1104. Among them, the first key point 1101 is Figure 2 The key point 5, the fourth key point 1102 is Figure 2 The key point 6, the fifth key point 1103 is Figure 2 The key point 7, the third key point 1104 is Figure 2 Key point 8.

[0187] The second key point 1105 of the middle finger can also be obtained. Among them, the second key point 1105 is Figure 2 Key point 10.

[0188] The distance between the first key point 1101 and the second key point 1105 in the X-axis direction of the hand image is calculated to obtain a first distance a.

[0189] The distance between the third key point 1104 and the first key point 1101 in the X-axis direction of the hand image is calculated to obtain a first distance b.

[0190] If it is determined that the X-axis coordinate value of the third key point 1104 is less than the X-axis coordinate value of the fifth key point 1103, the X-axis coordinate value of the fifth key point 1103 is less than the X-axis coordinate value of the fourth key point 1102, and the X-axis coordinate value of the fourth key point 1102 is less than the X-axis coordinate value of the first key point 1101; and it is determined that the first distance b is greater than the first distance a (or the first distance b is greater than the product of the first distance a and the second preset value; wherein the second preset value is, for example, 1.3), then it is determined that the index finger is pointing to the right.

[0191] 406. Generate a control instruction according to the finger pointing, and control the device in the vehicle to complete the action indicated by the control instruction according to the control instruction.

[0192] For example, in the intelligent cockpit of the vehicle, after obtaining the finger pointing, an instruction corresponding to the finger pointing can be generated according to the preset correspondence between the finger pointing and the control instruction. Then the control instruction is executed to control the device in the vehicle to complete the corresponding control action.

[0193] For example, if the vehicle recognizes that the finger is pointing upward, it determines and executes the control instruction corresponding to the finger pointing, for example, the control instruction is "open the sunroof"; if the vehicle recognizes that the finger is pointing downward, it determines and executes the control instruction corresponding to the finger pointing, for example, the control instruction is "close the sunroof"; if the vehicle recognizes that the finger is pointing to the right, it determines and executes the control instruction corresponding to the finger pointing, for example, the control instruction is "open the right window, or adjust the right rearview mirror, or turn on the right headlight"; if the vehicle recognizes that the finger is pointing to the left, it determines and executes the control instruction corresponding to the finger pointing, for example, the control instruction is "open the left window, or adjust the left rearview mirror, or turn on the left headlight".

[0194] In this embodiment, through the above process, referring to the aforementioned process, it is possible to conveniently and accurately determine whether the finger pointing of the previous finger is upward or downward based on three conditions; it is possible to conveniently and accurately determine whether the finger pointing of the previous finger is left or right based on two conditions.

[0195] In addition, in this embodiment, the first preset value and the second preset value can be adjusted according to different requirements; however, it is still necessary to ensure that the first preset value is a positive number greater than 1, and the second preset value is a positive number greater than 1. When judging that "the second distance is less than the first calculated value", the first calculated value is the product of the first distance and the first preset value, and then the determination of "the second distance is less than the first calculated value" is adjusted according to different requirements, that is, whether the inclination of the previous finger is very small is determined according to different requirements. Then, according to different requirements, it is determined whether the finger of the previous finger is pointing upward or downward.

[0196] When judging that "the second distance is greater than the second calculated value", the second calculated value is the product of the first distance and the second preset value, and how to judge that "the second distance is greater than the second calculated value" is adjusted according to different requirements, that is, judging whether the bending degree of the previous finger is very small according to different requirements. And judging whether the finger of the previous finger is pointing right or downward according to different requirements.

[0197] Fig.12 is a schematic diagram according to the third embodiment of the present disclosure, Fig.12 As shown, the present disclosure provides a finger pointing recognition device 1200, comprising:

[0198] The acquisition unit 1201 is used to acquire a hand image and determine key points of fingers among adjacent fingers in the hand image.

[0199] The first determination unit 1202 is used to determine finger information based on key points of fingers among adjacent fingers; wherein the finger information includes a first distance and a second distance, the first distance represents the distance between adjacent fingers in the X-axis direction of the hand image; the second distance represents the length of the previous finger among the adjacent fingers in the X-axis direction of the hand image.

[0200] The second determination unit 1203 is used to determine the finger pointing of the hand image according to the position state of the top of the previous finger, the first distance and the second distance; wherein the position state represents the distance relationship between the top of the previous finger and the bottom joint of the previous finger.

[0201] The device of this embodiment can execute the technical solution in the above method. Its specific implementation process and technical principles are the same and will not be repeated here.

[0202] Fig.13 is a schematic diagram according to a fourth embodiment of the present disclosure, Fig.13 As shown, the present disclosure provides a finger pointing recognition device 1300, comprising:

[0203] The acquisition unit 1301 is used to acquire a hand image and determine key points of fingers among adjacent fingers in the hand image.

[0204] The first determination unit 1302 is used to determine finger information based on key points of fingers among adjacent fingers; wherein the finger information includes a first distance and a second distance, the first distance represents the distance between adjacent fingers in the X-axis direction of the hand image; the second distance represents the length of the previous finger among the adjacent fingers in the X-axis direction of the hand image.

[0205] The second determination unit 1303 is used to determine the finger pointing of the hand image according to the position state of the top of the previous finger, the first distance and the second distance; wherein the position state represents the distance relationship between the top of the previous finger and the bottom joint of the previous finger.

[0206] In one example, the first determining unit 1302 includes:

[0207] The first determination module 13021 is used to determine the distance between the first key point of the previous finger and the second key point of the next finger in the adjacent fingers in the X-axis direction, which is the first distance; wherein the first key point is the bottom joint of the previous finger, and the second key point is the key point on the next finger adjacent to the bottom joint of the next finger.

[0208] In one example, the second determining unit 1302 includes:

[0209] The second determination module 13022 is used to determine the distance between the third key point of the previous finger and the first key point of the previous finger in the adjacent fingers in the X-axis direction, which is the second distance; wherein the first key point is the bottom joint of the previous finger, and the third key point is the top of the previous finger.

[0210] In one example, the second determining unit 1303 is specifically configured to:

[0211] If it is determined that the position state of the top of the previous finger is a preset state, the finger direction of the hand image is determined according to the first distance and the second distance; wherein the preset state indicates that the top of the previous finger is away from the bottom joint of the previous finger.

[0212] In one example, the finger information also includes a third distance; the third distance represents the length of the previous finger among adjacent fingers in the Y-axis direction of the hand image; the second determination unit 1303 is specifically used to: if the position state of the top of the previous finger is determined to be a preset state, then determine whether the finger is pointing up or down based on the first distance, the second distance and the third distance.

[0213] In one example, if it is determined that the position state of the top of the previous finger is a preset state, the second determining unit 1303 is specifically configured to:

[0214] If it is determined that the key point set of the previous finger meets the first preset condition, the position state of the top of the previous finger is determined to be the preset state, and when it is determined that the second distance is less than the first distance and the third distance is greater than the first distance, the finger is determined to be pointing upward.

[0215] Among them, the key point set includes the first key point, the third key point, the fourth key point and the fifth key point; the first preset condition is that the Y-axis coordinate value of the third key point is smaller than the Y-axis coordinate value of the fifth key point, the Y-axis coordinate value of the fifth key point is smaller than the Y-axis coordinate value of the fourth key point, and the Y-axis coordinate value of the fourth key point is smaller than the Y-axis coordinate value of the first key point.

[0216] The first key point, the fourth key point, the fifth key point and the third key point are the joint points along the bottom joint point to the top of the previous finger, respectively.

[0217] In one example, if it is determined that the position state of the top of the previous finger is a preset state, the second determining unit 1303 determines that the finger is pointing downward according to the first distance, the second distance, and the third distance, specifically for:

[0218] If it is determined that the key point set of the previous finger meets the second preset condition, the position state of the top of the previous finger is determined to be the preset state, and when it is determined that the second distance is less than the first distance and the third distance is greater than the first distance, the finger is determined to be pointing downward.

[0219] Among them, the key point set includes the first key point, the third key point, the fourth key point and the fifth key point; the second preset condition is that the Y-axis coordinate value of the third key point is greater than the Y-axis coordinate value of the fifth key point, the Y-axis coordinate value of the fifth key point is greater than the Y-axis coordinate value of the fourth key point, and the Y-axis coordinate value of the fourth key point is greater than the Y-axis coordinate value of the first key point.

[0220] The first key point, the fourth key point, the fifth key point and the third key point are the joint points along the bottom joint point to the top of the previous finger, respectively.

[0221] In one example, the second determining unit 1303, after determining that the second distance is less than the first distance, is specifically configured to:

[0222] It is determined that the second distance is less than a first calculated value, wherein the first calculated value is a product of the first distance and a first preset value, and the first preset value is a value less than 1.

[0223] In one example, when the finger information also includes the third distance, the first determining unit 1302 includes:

[0224] The third determination module 13023 is used to determine the distance between the third key point of the previous finger and the first key point of the previous finger in the adjacent fingers in the Y-axis direction, which is the third distance; wherein the first key point is the bottom joint of the previous finger, and the third key point is the top of the previous finger.

[0225] In one example, the second determining unit 1303, when determining the finger pointing of the hand image according to the first distance and the second distance if the position state of the top of the previous finger is determined to be a preset state, is specifically configured to:

[0226] If it is determined that the key point set of the previous finger meets the third preset condition, the position state of the top of the previous finger is determined to be the preset state, and when it is determined that the second distance is greater than the first distance, the finger is determined to be pointing to the right.

[0227] Among them, the key point set includes the first key point, the third key point, the fourth key point and the fifth key point; the first key point, the fourth key point, the fifth key point and the third key point are the joint points along the bottom joint point to the top of the previous finger, respectively.

[0228] The third preset condition is that the X-axis coordinate value of the third key point is greater than the X-axis coordinate value of the fifth key point, the X-axis coordinate value of the fifth key point is greater than the X-axis coordinate value of the fourth key point, and the X-axis coordinate value of the fourth key point is greater than the X-axis coordinate value of the first key point.

[0229] In one example, the second determining unit 1303, when determining the finger pointing of the hand image according to the first distance and the second distance if the position state of the top of the previous finger is determined to be a preset state, is specifically configured to:

[0230] If it is determined that the key point set of the previous finger meets the fourth preset condition, the position state of the top of the previous finger is determined to be the preset state, and when it is determined that the second distance is greater than the first distance, the finger is determined to be pointing to the left.

[0231] Among them, the key point set includes the first key point, the third key point, the fourth key point and the fifth key point; the first key point, the fourth key point, the fifth key point and the third key point are the joint points along the bottom joint point to the top of the previous finger, respectively.

[0232] The fourth preset condition is that the X-axis coordinate value of the third key point is smaller than the X-axis coordinate value of the fifth key point, the X-axis coordinate value of the fifth key point is smaller than the X-axis coordinate value of the fourth key point, and the X-axis coordinate value of the fourth key point is smaller than the X-axis coordinate value of the first key point.

[0233] In one example, when determining that the second distance is greater than the first distance, the second determining unit 1303 is specifically configured to:

[0234] It is determined that the second distance is greater than a second calculated value, wherein the second calculated value is a product of the second distance and a second preset value, and the second preset value is a value greater than 1.

[0235] In one example, the first finger among the adjacent fingers is the index finger, and the second finger among the adjacent fingers is the middle finger.

[0236] In one example, the present disclosure provides a finger pointing recognition device 1300, further comprising:

[0237] The control unit is used to generate a control instruction according to the finger pointing, and control the equipment in the vehicle to complete the action indicated by the control instruction according to the control instruction.

[0238] The device of this embodiment can execute the technical solution in the above method. Its specific implementation process and technical principles are the same and will not be repeated here.

[0239] Fig.14 is a schematic diagram according to a fifth embodiment of the present disclosure, Fig.14 As shown, the electronic device 1400 in this embodiment may include: a processor 1401 and a memory 1402 .

[0240] The memory 1402 is used to store programs. The memory 1402 may include volatile memory, such as random-access memory (RAM), such as static random-access memory (SRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), etc. The memory may also include non-volatile memory, such as flash memory. The memory 1402 is used to store computer programs (such as applications, functional modules, etc. that implement the above method), computer instructions, etc. The above computer programs, computer instructions, etc. may be partitioned and stored in one or more memories 1402. And the above computer programs, computer instructions, data, etc. may be called by the processor 1401.

[0241] The above-mentioned computer programs, computer instructions, etc. may be stored in one or more memories 1402 in partitions. And the above-mentioned computer programs, computer instructions, etc. may be called by the processor 1401.

[0242] The processor 1401 is used to execute the computer program stored in the memory 1402 to implement each step of the method involved in the above embodiment.

[0243] For details, please refer to the relevant description in the previous method embodiment.

[0244] The processor 1401 and the memory 1402 may be independent structures or integrated structures. When the processor 1401 and the memory 1402 are independent structures, the memory 1402 and the processor 1401 may be coupled and connected via a bus 1403 .

[0245] The electronic device of this embodiment can execute the technical solution in the above method, and its specific implementation process and technical principle are the same, which will not be repeated here.

[0246] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0247] According to an embodiment of the present disclosure, the present disclosure also provides a computer program product, which includes: a computer program, the computer program is stored in a readable storage medium, at least one processor of an electronic device can read the computer program from the readable storage medium, and at least one processor executes the computer program so that the electronic device executes the solution provided by any of the above embodiments.

[0248] Fig.15 A schematic block diagram of an example electronic device 1500 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0249] like Fig.15 As shown, the device 1500 includes a computing unit 1501, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1502 or a computer program loaded from a storage unit 1508 into a random access memory (RAM) 1503. In the RAM 1503, various programs and data required for the operation of the device 1500 can also be stored. The computing unit 1501, the ROM 1502, and the RAM 1503 are connected to each other via a bus 1504. An input / output (I / O) interface 1505 is also connected to the bus 1504.

[0250] A number of components in the device 1500 are connected to the I / O interface 1505, including: an input unit 1506, such as a keyboard, a mouse, etc.; an output unit 1507, such as various types of displays, speakers, etc.; a storage unit 1508, such as a disk, an optical disk, etc.; and a communication unit 1509, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 1509 allows the device 1500 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0251] The computing unit 1501 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 1501 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 1501 performs the various methods and processes described above, such as the finger pointing recognition method. For example, in some embodiments, the finger pointing recognition method may be implemented as a computer software program, which is tangibly included in a machine-readable medium, such as a storage unit 1508. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 1500 via the ROM 1502 and / or the communication unit 1509. When the computer program is loaded into the RAM 1503 and executed by the computing unit 1501, one or more steps of the finger pointing recognition method described above may be performed. Alternatively, in other embodiments, the computing unit 1501 may be configured to execute the finger pointing recognition method in any other appropriate manner (for example, by means of firmware).

[0252] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0253] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0254] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0255] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0256] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0257] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship between the client and the server is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services ("Virtual Private Server", or "VPS" for short). The server may also be a server of a distributed system, or a server combined with a blockchain.

[0258] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0259] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A method for identifying finger pointing, comprising: Acquire a hand image, and determine key points of fingers among adjacent fingers in the hand image; Determine finger information according to key points of fingers among the adjacent fingers; wherein the finger information includes a first distance and a second distance, the first distance representing the distance between adjacent fingers in the X-axis direction of the hand image; the second distance representing the length of a previous finger among the adjacent fingers in the X-axis direction of the hand image; The finger direction of the hand image is determined according to the position state of the top of the previous finger, the first distance and the second distance; wherein the position state represents the distance relationship between the top of the previous finger and the bottom joint of the previous finger.

2. The method according to claim 1, wherein: Determining the first distance according to the key points of the fingers among the adjacent fingers includes: Determine the distance between a first key point of a front finger and a second key point of a rear finger in the adjacent fingers in the X-axis direction as the first distance; wherein the first key point is a bottom joint of the front finger, and the second key point is a key point on the rear finger adjacent to the bottom joint of the rear finger.

3. The method according to claim 1 or 2, wherein: Determining the second distance according to the key points of the fingers among the adjacent fingers includes: Determine the distance between the third key point of the previous finger and the first key point of the previous finger in the adjacent fingers in the X-axis direction as the second distance; wherein the first key point is the bottom joint of the previous finger, and the third key point is the top of the previous finger.

4. The method according to any one of claims 1 to 3, wherein: Determining the finger direction of the hand image according to the position state of the top of the previous finger, the first distance, and the second distance includes: If it is determined that the position state of the top of the previous finger is a preset state, determining the finger direction of the hand image according to the first distance and the second distance; The preset state indicates that the top of the previous finger is away from the bottom joint of the previous finger.

5. The method according to claim 4, wherein: The finger information also includes a third distance; the third distance represents the length of the previous finger in the Y-axis direction of the hand image among the adjacent fingers; If it is determined that the position state of the top of the previous finger is a preset state, determining the finger direction of the hand image according to the first distance and the second distance includes: If it is determined that the position state of the top end of the previous finger is a preset state, then it is determined whether the finger is pointing upward or downward according to the first distance, the second distance, and the third distance.

6. The method according to claim 5, wherein: If it is determined that the position state of the top of the previous finger is a preset state, determining that the finger is pointing upward according to the first distance, the second distance, and the third distance includes: If it is determined that the key point set of the previous finger meets the first preset condition, then the position state of the top of the previous finger is determined to be a preset state, and when it is determined that the second distance is less than the first distance and the third distance is greater than the first distance, the finger is determined to be pointing upward; The key point set includes a first key point, a third key point, a fourth key point and a fifth key point; the first preset condition is that the Y-axis coordinate value of the third key point is smaller than the Y-axis coordinate value of the fifth key point, the Y-axis coordinate value of the fifth key point is smaller than the Y-axis coordinate value of the fourth key point, and the Y-axis coordinate value of the fourth key point is smaller than the Y-axis coordinate value of the first key point; The first key point, the fourth key point, the fifth key point and the third key point are, respectively, joint points along the bottom joint point to the top end of the previous finger.

7. The method according to claim 5 or 6, wherein: If it is determined that the position state of the top of the previous finger is a preset state, determining that the finger is pointing downward according to the first distance, the second distance, and the third distance includes: If it is determined that the key point set of the previous finger meets the second preset condition, then the position state of the top of the previous finger is determined to be a preset state, and when it is determined that the second distance is less than the first distance and the third distance is greater than the first distance, the finger is determined to be pointing downward; The key point set includes a first key point, a third key point, a fourth key point and a fifth key point; the second preset condition is that the Y-axis coordinate value of the third key point is greater than the Y-axis coordinate value of the fifth key point, the Y-axis coordinate value of the fifth key point is greater than the Y-axis coordinate value of the fourth key point, and the Y-axis coordinate value of the fourth key point is greater than the Y-axis coordinate value of the first key point; The first key point, the fourth key point, the fifth key point and the third key point are, respectively, joint points along the bottom joint point to the top end of the previous finger.

8. The method according to claim 6 or 7, wherein: Determining that the second distance is less than the first distance includes: It is determined that the second distance is less than a first calculated value, wherein the first calculated value is the product of the first distance and a first preset value, and the first preset value is a value less than 1.

9. The method according to any one of claims 5 to 8, wherein: When the finger information further includes a third distance, determining the third distance according to key points of fingers among the adjacent fingers includes: Determine the distance between the third key point of the previous finger and the first key point of the previous finger in the adjacent fingers in the Y-axis direction as the third distance; wherein the first key point is the bottom joint of the previous finger, and the third key point is the top of the previous finger.

10. The method according to claim 4, wherein: If it is determined that the position state of the top of the previous finger is a preset state, determining the finger direction of the hand image according to the first distance and the second distance includes: If it is determined that the key point set of the previous finger meets the third preset condition, then determining that the position state of the top of the previous finger is a preset state, and when it is determined that the second distance is greater than the first distance, determining that the finger is pointing to the right; The key point set includes a first key point, a third key point, a fourth key point and a fifth key point; the first key point, the fourth key point, the fifth key point and the third key point are, in order, joint points along the bottom joint point to the top of the previous finger; The third preset condition is that the X-axis coordinate value of the third key point is greater than the X-axis coordinate value of the fifth key point, the X-axis coordinate value of the fifth key point is greater than the X-axis coordinate value of the fourth key point, and the X-axis coordinate value of the fourth key point is greater than the X-axis coordinate value of the first key point.

11. The method according to claim 4, wherein: If it is determined that the position state of the top of the previous finger is a preset state, determining the finger direction of the hand image according to the first distance and the second distance includes: If it is determined that the key point set of the previous finger meets the fourth preset condition, then determining that the position state of the top of the previous finger is a preset state, and when it is determined that the second distance is greater than the first distance, determining that the finger is pointing to the left; The key point set includes a first key point, a third key point, a fourth key point and a fifth key point; the first key point, the fourth key point, the fifth key point and the third key point are, in order, joint points along the bottom joint point to the top of the previous finger; The fourth preset condition is that the X-axis coordinate value of the third key point is smaller than the X-axis coordinate value of the fifth key point, the X-axis coordinate value of the fifth key point is smaller than the X-axis coordinate value of the fourth key point, and the X-axis coordinate value of the fourth key point is smaller than the X-axis coordinate value of the first key point.

12. The method according to claim 10 or 11, wherein: Determining that the second distance is greater than the first distance includes: Determine that the second distance is greater than a second calculated value, wherein the second calculated value is the product of the second distance and a second preset value, and the second preset value is a value greater than 1.

13. The method according to any one of claims 1 to 12, wherein: The front finger among the adjacent fingers is the index finger, and the rear finger among the adjacent fingers is the middle finger.

14. A finger pointing recognition device, comprising: An acquisition unit, used for acquiring a hand image and determining key points of fingers among adjacent fingers in the hand image; A first determining unit, configured to determine finger information according to key points of fingers among the adjacent fingers; wherein the finger information includes a first distance and a second distance, wherein the first distance represents the distance between adjacent fingers in the X-axis direction of the hand image; and the second distance represents the length of a previous finger among the adjacent fingers in the X-axis direction of the hand image; The second determination unit is used to determine the finger pointing of the hand image according to the position state of the top of the previous finger, the first distance and the second distance; wherein the position state represents the distance relationship between the top of the previous finger and the bottom joint of the previous finger.

15. The device according to claim 14, wherein: The first determining unit includes: The first determination module is used to determine the distance between the first key point of the previous finger and the second key point of the next finger in the adjacent fingers in the X-axis direction, which is the first distance; wherein the first key point is the bottom joint of the previous finger, and the second key point is the key point on the next finger adjacent to the bottom joint of the next finger.

16. The device according to claim 14 or 15, wherein: The second determining unit includes: The second determination module is used to determine the distance between the third key point of the previous finger and the first key point of the previous finger in the adjacent fingers in the X-axis direction, which is the second distance; wherein the first key point is the bottom joint of the previous finger, and the third key point is the top of the previous finger.

17. The device according to any one of claims 14 to 16, wherein: The second determining unit is specifically configured to: If it is determined that the position state of the top of the previous finger is a preset state, determining the finger direction of the hand image according to the first distance and the second distance; The preset state indicates that the top of the previous finger is away from the bottom joint of the previous finger.

18. The device according to claim 17, wherein: The finger information also includes a third distance; the third distance represents the length of the previous finger in the Y-axis direction of the hand image among the adjacent fingers; The second determining unit is specifically configured to: If it is determined that the position state of the top end of the previous finger is a preset state, then it is determined whether the finger is pointing upward or downward according to the first distance, the second distance, and the third distance.

19. The device according to claim 18, wherein: The second determining unit, when determining that the position state of the top of the previous finger is a preset state, determines that the finger is pointing upward according to the first distance, the second distance, and the third distance, is specifically configured to: If it is determined that the key point set of the previous finger meets the first preset condition, then the position state of the top of the previous finger is determined to be a preset state, and when it is determined that the second distance is less than the first distance and the third distance is greater than the first distance, the finger is determined to be pointing upward; The key point set includes a first key point, a third key point, a fourth key point and a fifth key point; the first preset condition is that the Y-axis coordinate value of the third key point is smaller than the Y-axis coordinate value of the fifth key point, the Y-axis coordinate value of the fifth key point is smaller than the Y-axis coordinate value of the fourth key point, and the Y-axis coordinate value of the fourth key point is smaller than the Y-axis coordinate value of the first key point; The first key point, the fourth key point, the fifth key point and the third key point are, respectively, joint points along the bottom joint point to the top end of the previous finger.

20. The device according to claim 18 or 19, wherein: The second determining unit, if it is determined that the position state of the top of the previous finger is a preset state, determines that the finger is pointing downward according to the first distance, the second distance, and the third distance, specifically for: If it is determined that the key point set of the previous finger meets the second preset condition, then the position state of the top of the previous finger is determined to be a preset state, and when it is determined that the second distance is less than the first distance and the third distance is greater than the first distance, the finger is determined to be pointing downward; The key point set includes a first key point, a third key point, a fourth key point and a fifth key point; the second preset condition is that the Y-axis coordinate value of the third key point is greater than the Y-axis coordinate value of the fifth key point, the Y-axis coordinate value of the fifth key point is greater than the Y-axis coordinate value of the fourth key point, and the Y-axis coordinate value of the fourth key point is greater than the Y-axis coordinate value of the first key point; The first key point, the fourth key point, the fifth key point and the third key point are, respectively, joint points along the bottom joint point to the top end of the previous finger.

21. The device according to claim 19 or 20, wherein: The second determining unit, when determining that the second distance is smaller than the first distance, is specifically configured to: It is determined that the second distance is less than a first calculated value, wherein the first calculated value is the product of the first distance and a first preset value, and the first preset value is a value less than 1.

22. The device according to any one of claims 18 to 21, wherein: When the finger information further includes a third distance, the first determining unit includes: The third determination module is used to determine the distance between the third key point of the previous finger and the first key point of the previous finger in the adjacent fingers in the Y-axis direction, which is the third distance; wherein the first key point is the bottom joint of the previous finger, and the third key point is the top of the previous finger.

23. The device according to claim 17, wherein: The second determining unit, when determining that the position state of the top of the previous finger is a preset state, determines the finger pointing of the hand image according to the first distance and the second distance, is specifically configured to: If it is determined that the key point set of the previous finger meets the third preset condition, then determining that the position state of the top of the previous finger is a preset state, and when it is determined that the second distance is greater than the first distance, determining that the finger is pointing to the right; The key point set includes a first key point, a third key point, a fourth key point and a fifth key point; the first key point, the fourth key point, the fifth key point and the third key point are, in order, joint points along the bottom joint point to the top of the previous finger; The third preset condition is that the X-axis coordinate value of the third key point is greater than the X-axis coordinate value of the fifth key point, the X-axis coordinate value of the fifth key point is greater than the X-axis coordinate value of the fourth key point, and the X-axis coordinate value of the fourth key point is greater than the X-axis coordinate value of the first key point.

24. The device according to claim 17, wherein: The second determining unit, when determining that the position state of the top of the previous finger is a preset state, determines the finger pointing of the hand image according to the first distance and the second distance, is specifically configured to: If it is determined that the key point set of the previous finger meets the fourth preset condition, then determining that the position state of the top of the previous finger is a preset state, and when it is determined that the second distance is greater than the first distance, determining that the finger is pointing to the left; The key point set includes a first key point, a third key point, a fourth key point and a fifth key point; the first key point, the fourth key point, the fifth key point and the third key point are, in order, joint points along the bottom joint point to the top of the previous finger; The fourth preset condition is that the X-axis coordinate value of the third key point is smaller than the X-axis coordinate value of the fifth key point, the X-axis coordinate value of the fifth key point is smaller than the X-axis coordinate value of the fourth key point, and the X-axis coordinate value of the fourth key point is smaller than the X-axis coordinate value of the first key point.

25. The device according to claim 23 or 24, wherein: The second determining unit is specifically configured to, when determining that the second distance is greater than the first distance: Determine that the second distance is greater than a second calculated value, wherein the second calculated value is the product of the second distance and a second preset value, and the second preset value is a value greater than 1.

26. The device according to any one of claims 14 to 25, wherein: The front finger among the adjacent fingers is the index finger, and the rear finger among the adjacent fingers is the middle finger.

27. An electronic device comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 13.

28. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-14.

29. A computer program product, comprising a computer program, which, when executed by a processor, implements the steps of the method according to any one of claims 1 to 13.

Images