Guiding Method, Device, Terminal, Storage Medium and Program Product for Palm Swiping Verification

Abstract

The present application discloses a guiding method, device, terminal, storage medium and program product for palm-sweeping verification, which relates to the field of computer technology. The method includes: displaying graphical guiding information in a guiding interface, where the graphical guiding information includes a movable element, a moving area corresponding to the movable element, and a display position of the movable element in the moving area, and the display position of the movable element in the moving area is used to indicate the distance between the palm and the detection device; in response to the change in the distance, dynamically adjusting the display position of the movable element in the moving area in the guiding interface; when the display position of the movable element in the moving area meets the conditions, displaying a first prompt message for indicating the start of verification or a second prompt message for indicating the completion of verification. The embodiments of the present application can complete the visual guiding of palm-sweeping verification only based on the distance between the palm and the detection device, reduce the complexity of palm-sweeping verification, and thus improve the efficiency of palm-sweeping verification.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technology, and particularly to a guiding method, device, terminal, storage medium and program product for palm-sweeping verification. Background Art

[0002] With the development of computer technology, the application scenarios of palm-sweeping verification are increasing, such as opening doors by palm-sweeping verification, paying by palm-sweeping verification, punching cards by palm-sweeping verification, etc.

[0003] Taking opening a door by palm-sweeping verification as an example, in the process of palm-sweeping verification, related technologies guide users to control the palm to complete a specified movement trajectory and make an authentication gesture to complete the palm-sweeping verification to open the door. The operation of this solution for palm-sweeping verification is complex and the efficiency of palm-sweeping verification is not high. Summary of the Invention

[0004] The embodiments of the present application provide a guiding method, device, terminal, storage medium and program product for palm-sweeping verification, which can improve the efficiency of palm-sweeping verification. The technical solutions may include the following content.

[0005] According to one aspect of the embodiments of the present application, a guiding method for palm-sweeping verification is provided. The method includes:

[0006] Display a guiding interface for palm-sweeping verification;

[0007] Display graphical guiding information in the guiding interface. The graphical guiding information includes a movable element and a moving area corresponding to the movable element; wherein, the display position of the movable element in the moving area is used to indicate the distance between the palm and the detection device;

[0008] In response to the change of the distance, dynamically adjust the display position of the movable element in the moving area in the guiding interface;

[0009] When the display position of the movable element in the moving area meets the condition, display a first prompt message for indicating the start of verification or the completion of verification.

[0010] According to one aspect of the embodiments of the present application, a guiding device for palm-sweeping verification is provided. The device includes:

[0011] A guiding interface display module, configured to display a guiding interface for palm-sweeping verification;

[0012] A guiding information display module, configured to display graphical guiding information in the guiding interface, where the graphical guiding information includes movable elements and corresponding moving areas for the movable elements; wherein, the display position of the movable element in the moving area is used to indicate the distance between the palm and the detection device;

[0013] An element position adjustment module, configured to dynamically adjust the display position of the movable element in the moving area in the guiding interface in response to the change of the distance;

[0014] A prompt information display module, configured to display a first prompt information for indicating the start of verification or the completion of verification when the display position of the movable element in the moving area meets the conditions.

[0015] In an exemplary embodiment, the graphical guiding information further includes: a marking element displayed in the moving area, and the display position of the marking element in the moving area is used to indicate the target distance or target distance range between the palm and the detection device;

[0016] The prompt information display module is configured to display a first prompt information for indicating the start of verification or the completion of verification when the display position of the movable element in the moving area matches the display position of the marking element in the moving area.

[0017] In an exemplary embodiment, the number of the marking elements is multiple, and different marking elements correspond to different target distances or target distance ranges;

[0018] The prompt information display module is further configured to display a first prompt information for indicating the start of verification or the completion of verification when the display position of the movable element in the moving area matches the display positions of multiple marking elements in the moving area in a target order; wherein, the target order refers to the matching order of multiple marking elements.

[0019] In an exemplary embodiment, prompt information related to the target order is displayed in the guiding interface;

[0020] A palm image acquisition module, configured to acquire an image of the palm through the camera of the detection device when the movable element matches each of the marking elements.

[0021] A verification result acquisition module, configured to perform recognition verification on the palm according to multiple images of the palm at different distances collected, and obtain a verification result.

[0022] In an exemplary embodiment, no prompt information related to the target order is displayed in the guidance interface;

[0023] The prompt information display module is further configured to display first prompt information for indicating the start of verification when the display position of the movable element in the moving area matches the display positions of the multiple marker elements in the moving area in accordance with the target order; the palm image acquisition module is further configured to acquire an image of the palm through a camera of the detection device; the verification result acquisition module is further configured to perform recognition verification on the palm based on the image of the palm to obtain a verification result.

[0024] Alternatively, the prompt information display module is further configured to display first prompt information for indicating the completion of verification when the display position of the movable element in the moving area matches the display positions of the multiple marker elements in the moving area in accordance with the target order.

[0025] In an exemplary embodiment, the prompt information display module is further configured to display second prompt information in the guidance interface for guiding the operations required to be performed by the user.

[0026] In an exemplary embodiment, the display screen of the guidance interface does not overlap with the palm detection plane of the detection device.

[0027] In an exemplary embodiment, the detection device is configured to detect the palm in a non-contact manner, where the non-contact manner means that the palm does not contact the palm detection plane of the detection device.

[0028] In an exemplary embodiment, the palm brushing verification includes a first-stage verification and a second-stage verification. The first-stage verification is completed by the user's first palm, and the second-stage verification is completed by the user's second palm, where the first palm is different from the second palm;

[0029] The movable element moves along a first set track following the distance between the first palm and the detection device to complete the first-stage verification, and the movable element moves along a second set track following the distance between the second palm and the detection device to complete the second-stage verification.

[0030] In an exemplary embodiment, the display position setting module is configured to set the display position ratio of the movable element in the moving area to 1 when the distance between the palm and the detection device is greater than a first distance threshold.

[0031] The display position setting module is further configured to, when the distance between the palm and the detection device is less than or equal to the first distance threshold, determine the display position ratio of the movable element in the moving area based on the ratio of the distance between the palm and the detection device to the first distance threshold.

[0032] In an exemplary embodiment, the display position setting module is further configured to:

[0033] Obtain the initial relative position between the palm and the detection device, and determine the initial display position of the movable element in the moving area according to the initial relative position;

[0034] Alternatively, initialize the display position of the movable element in the moving area to obtain the initial display position of the movable element, and map and associate the initial display position with the initial relative position between the palm and the detection device.

[0035] In an exemplary embodiment, the display position setting module is further configured to, if it is detected that the initial display position of the movable element overlaps with the display position of the marked element in the moving area, adjust the position of the marked element to obtain an adjusted marked element, and the adjusted marked element is used to guide the movement of the movable element.

[0036] In an exemplary embodiment, the palm image acquisition module is further configured to acquire the current frame image of the palm through the camera of the detection device.

[0037] The current image detection module is configured to perform palm detection on the current frame image to obtain the predicted coordinates and predicted size corresponding to the palm.

[0038] The target sensor determination module is configured to determine a target distance sensor from a plurality of distance sensors corresponding to the detection device based on the predicted coordinates and the predicted size.

[0039] The palm distance acquisition module is configured to acquire the distance between the palm and the detection device according to the distance information corresponding to the target distance sensor.

[0040] In an exemplary embodiment, the target sensor determination module is configured to:

[0041] Determine the palm center based on the predicted coordinates and the predicted size;

[0042] Determine the offset between the palm center and the image center of the current frame image based on the palm center and the image center of the current frame image;

[0043] Determine a target quadrant corresponding to the palm in a coordinate system with the detection device as the origin according to the offset;

[0044] Determine the distance sensors within the target quadrant and the distance sensors on the coordinate axes corresponding to the target quadrant as the target distance sensors.

[0045] In an exemplary embodiment, the prompt information display module is further configured to display third prompt information in response to the palm moving out of the verification area corresponding to the detection device, where the third prompt information is used to prompt the user to re-perform palm verification.

[0046] According to one aspect of the embodiments of the present application, a terminal device is provided. The terminal device includes a processor and a memory, and a computer program is stored in the memory. The computer program is loaded and executed by the processor to implement the above-mentioned guiding method for palm brushing verification.

[0047] According to one aspect of the embodiments of the present application, a computer-readable storage medium is provided. A computer program is stored in the readable storage medium, and the computer program is loaded and executed by a processor to implement the above-mentioned guiding method for palm brushing verification.

[0048] According to one aspect of the embodiments of the present application, a computer program product or a computer program is provided. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the terminal device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the terminal device executes the above-mentioned guiding method for palm brushing verification.

[0049] The technical solutions provided by the embodiments of the present application at least include the following beneficial effects.

[0050] By using the display position of a movable element in a moving area to indicate the distance between the palm and the detection device, and dynamically adjusting the display position of the movable element in the moving area in the guiding interface in response to the change of this distance, a visual guidance for palm brushing verification can be completed only based on the distance between the palm and the detection device, reducing the complexity of palm brushing verification, and thus improving the efficiency of palm brushing verification.

[0051] In addition, since the embodiments of the present application only need to guide the user to adjust the distance between the palm and the detection device, the understanding cost of the user during palm brushing verification is greatly reduced, thereby improving the user experience during palm brushing verification. Description of the Drawings

[0052] To more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the accompanying drawings required for the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other accompanying drawings can be obtained based on these drawings.

[0053] Figure 1 It is a schematic diagram of the solution implementation environment provided by an embodiment of the present application;

[0054] Figure 2 It is a schematic diagram of the detection device provided by an embodiment of the present application;

[0055] Figure 3 It is a schematic diagram of the guiding method for palm brushing verification provided by an embodiment of the present application;

[0056] Figure 4 It is a schematic diagram of the guiding interface in the initial state provided by an embodiment of the present application;

[0057] Figures 5 to 9 Exemplarily shows a schematic diagram of the change of the guiding interface during the palm brushing verification process;

[0058] Figure 10 It is a schematic diagram of the method for obtaining the palm brushing distance provided by an embodiment of the present application;

[0059] Figure 11 It is a schematic diagram of the palm detection plane provided by an embodiment of the present application;

[0060] Figure 12 It is a schematic diagram of the method for obtaining the palm bounding box provided by an embodiment of the present application;

[0061] Figure 13 It is a schematic diagram of the palm detection method provided by an embodiment of the present application;

[0062] Figure 14 It is a schematic diagram of the palm detection model provided by an embodiment of the present application;

[0063] Figure 15 It is a schematic diagram of the method for obtaining the offset provided by an embodiment of the present application;

[0064] Figure 16 It is a block diagram of the guiding device for palm brushing verification provided by an embodiment of the present application;

[0065] Figure 17 It is a block diagram of the guiding device for palm brushing verification provided by another embodiment of the present application;

[0066] Figure 18It is a schematic structural diagram of a terminal device provided by an embodiment of the present application. Detailed implementation manners

[0067] To make the objectives, technical solutions, and advantages of the present application clearer, the following will further describe the embodiments of the present application in detail with reference to the accompanying drawings.

[0068] Please refer to Figure 1 , which shows a schematic diagram of a solution implementation environment provided by an embodiment of the present application. The implementation environment may include: a terminal 10 and a server 20.

[0069] The terminal 10 may be an electronic device such as a mobile phone, a tablet computer, a multimedia playback device, a PC (Personal Computer), an intelligent robot, a vehicle-mounted terminal, an access control device, a payment device, a security inspection device, and any device with an image acquisition function, etc. A client of a target application program may be installed in the terminal 10, such as a client of a palm verification application program, a payment application program, a social entertainment application program, a simulation learning application program, etc.

[0070] The server 20 is used to provide a background service for the client of the target application program (such as a palm verification application program) in the terminal 10. For example, the server 20 may be the background server of the above application program (such as a palm verification application program). The server 20 may be a single server, a server cluster composed of multiple servers, or a cloud computing service center.

[0071] The terminal 10 and the server 20 may communicate with each other through a network 30. The network 30 may be a wired network or a wireless network.

[0072] Exemplarily, referring to Figure 2 , a client of a target application program (such as a palm verification application program) is installed and run in the detection device 210. The detection device 210 includes a display screen 211 and a palm detection plane 212. A guidance interface for palm brushing verification is displayed on the display screen 211. The guidance interface displays graphical guidance information, and the graphical guidance information includes a movable element and a movement area corresponding to the movable element; wherein, the display position of the movable element in the movement area is used to indicate the distance between the palm and the detection device. The client dynamically adjusts the display position of the movable element in the movement area in the guidance interface in response to the change of the distance; when the display position of the movable element in the movement area meets the condition, the client displays a first prompt message indicating the start of verification or a second prompt message indicating the completion of verification.

[0073] Optionally, a camera is provided in the palm detection plane 212 to obtain an image of the palm. The image of the palm can be used to obtain the distance between the palm 220 and the detection device 210, and for the recognition and verification of the palm 220.

[0074] Please refer to Figure 3 , which shows a flowchart of a guiding method for palm brushing verification provided by an embodiment of the present application. The execution subject of each step of this method can be Figure 1 the terminal 10 in the implementation environment of the solution shown, such as the client in the terminal 10. This method may include the following steps (301 to 304).

[0075] Step 301, display a guiding interface for palm brushing verification.

[0076] Palm brushing verification refers to a process of recognizing and verifying a palm image. Exemplarily, the client recognizes a palm image by recognizing palm print features, palm vein patterns, palm brushing trajectories, etc., obtains a recognition result, and then compares it with the palm print features, palm vein patterns, palm brushing trajectories, etc. pre-stored in the verification system to achieve palm brushing verification.

[0077] The guiding interface is an interface for guiding users on how to perform palm brushing verification. The guiding interface may refer to the display interface corresponding to the above-mentioned target application, such as a palm verification application, a payment application, a social entertainment application, a simulation learning application, etc.

[0078] In one example, the detection device corresponding to palm brushing verification may include a display screen and a palm detection plane. The display screen is used to display the guiding interface corresponding to the target application, and the palm detection plane is used to obtain information related to the palm, such as a palm image, a palm brushing trajectory, a palm brushing distance, a palm brushing height, etc.

[0079] Optionally, the display screen of the above-mentioned guiding interface and the palm detection plane of the detection device are not overlapped. Exemplarily, the display screen and the palm detection plane can be arranged in parallel, or the display screen and the palm detection plane can be arranged in a staggered manner. The embodiments of the present application do not limit this. For example, refer to Figure 2 , the display screen 211 and the palm detection plane 212 can be arranged horizontally. In this way, during the palm brushing verification process, the visibility of the guiding interface is not affected, which is convenient for users to obtain the guiding information provided by the guiding interface, avoiding the problem that the guiding information is blocked during the palm brushing verification process due to the display screen being set below the palm detection plane, thereby reducing the difficulty for users to obtain the guiding information, improving the convenience of palm brushing verification, and further improving the user experience of palm brushing verification.

[0080] In one example, the above detection device is used to detect the palm in a non-contact manner, which means that the palm does not contact the palm detection plane of the detection device. Exemplarily, the detection device has a detection area, which can refer to the area where the detection device can acquire the palm image. For example, the range of the detection area can be determined based on the shooting range of the camera corresponding to the detection device. When the user places the palm within this detection area, palm brushing verification can be performed. Performing palm brushing verification in a non-contact manner can avoid contact between the user and the detection device (such as clicking on the display screen), thereby reducing the risk of palm brushing verification and improving the security of palm brushing verification.

[0081] Exemplarily, referring to Figure 4 , taking palm brushing verification for opening a door as an example, in the initialized guidance interface 400, there is a second prompt message for guiding the operations that the user needs to perform, such as the prompt message "Please brush your palm to open the door" 401 displayed in text form, and the prompt message 402 displayed in graphical form. This prompt message 402 is used to prompt the user to perform non-contact palm brushing verification with the palm detection plane of the detection device.

[0082] Step 302, display graphical guidance information in the guidance interface. The graphical guidance information includes a movable element and a moving area corresponding to the movable element; wherein, the display position of the movable element in the moving area is used to indicate the distance between the palm and the detection device.

[0083] Optionally, in response to the user's palm brushing operation, the client enters the palm brushing guidance stage, and graphical guidance information is displayed on the guidance interface corresponding to the client. For example, in response to the user placing the palm within the monitoring area corresponding to the detection device, graphical guidance information can be displayed in the guidance interface. This graphical guidance information guides the user in the form of a graph on how to adjust the distance between the palm and the detection device to complete the palm brushing verification.

[0084] Among them, the distance between the palm and the detection device can also be referred to as the palm brushing distance, palm brushing height, etc. Exemplarily, when the detection device is horizontally set, the palm brushing height can more intuitively reflect the relationship between the palm and the detection device.

[0085] The movable element can be used to characterize the palm. The moving area corresponding to the movable element is a physical mapping of the range of the distance between the palm and the detection device. The display position of the movable element in the moving area can be used to indicate the distance between the palm and the detection device. By corresponding the height of palm brushing to a single element in the graphical guiding information and physically mapping the distance between the palm and the detection device to the graphical guiding information, it is beneficial for the user to understand the real-time height of palm brushing, thereby improving the user experience of palm-brushing verification. Compared with guiding the position between the palm and the detection device, the operation difficulty of the palm-brushing verification in the embodiment of the present application is lower, thus improving the efficiency of palm-brushing verification.

[0086] The display position of the movable element in the moving area changes following the change of the distance between the palm and the detection device.

[0087] In one example, the graphical guiding information further includes: a marking element displayed in the moving area, and the display position of the marking element in the moving area is used to indicate the target distance or target distance range between the palm and the detection device.

[0088] Wherein, the marking element is used to indicate the appropriate distance between the palm and the detection device, and can also be used to indicate the final distance between the palm and the detection device. The embodiment of the present application does not limit this. The above target distance or target distance range is the appropriate distance or final distance between the palm and the detection device.

[0089] Exemplarily, referring to Figure 5 , in response to the user starting palm-brushing verification, the graphical guiding information 404 is displayed in the guiding interface 400. The graphical guiding information 404 includes a movable element 405, a moving area 406 corresponding to the movable element 405, and a marking element 407. Among them, the moving area 406 is a bar-shaped area, and different positions in the moving area 406 correspond to different distances. The display position of the movable element 405 in the moving area 406 is used to indicate the current distance between the palm and the detection device. The display position of the marking element 407 in the moving area is used to indicate the target distance or target distance range between the palm and the detection device that the user needs to adjust to. At the same time, the function of the prompt information 401 is adjusted to guide the user to adjust the palm, such as the prompt information 401 displayed in text form: "Lifting the palm is completed for recognition".

[0090] Optionally, the moving area is corresponding to a numerical mark, and the numerical mark is the real distance between the palm and the detection device or a physical mapping of the real distance. Exemplarily, referring to Figure 6, in the boot interface 600, graphical boot information 601 is displayed. The graphical boot information 601 corresponds to numerical markers. The numerical marker corresponding to the display position of the movable element 602 in the moving area indicates that the current distance between the palm and the detection device is 24 cm.

[0091] Step 303, in response to the change in distance, dynamically adjust the display position of the movable element in the moving area in the boot interface.

[0092] Optionally, in response to the distance between the palm and the detection device increasing, a screen showing the movable element moving to the highest position in the moving area is displayed in the boot interface; in response to the distance between the palm and the detection device decreasing, a screen showing the movable element moving to the lowest position in the moving area is displayed in the boot interface.

[0093] For example, referring to Figure 5 , in response to the palm moving away from the detection device, a screen showing the movable element 405 moving to the highest position of the moving area 406 is displayed in the boot interface 400, so that the movable element 405 moves closer to the marker element 407.

[0094] For another example, referring to Figure 6 , assume that the numerical marker corresponding to the marker element is 0, and this 0 refers to the target distance under the physical mapping corresponding to the appropriate distance. The numerical markers above the marker element are used to indicate that the palm is in the detection area greater than the appropriate distance, and the numerical markers below the marker element are used to indicate that the palm is in the detection area between the appropriate distance and the detection device. In response to the palm moving away from the appropriate distance corresponding to the marker element, the movable element 602 is shown moving away from the marker element in the boot interface 600.

[0095] Step 304, when the display position of the movable element in the moving area meets the condition, display a first prompt message for indicating the start of verification or the completion of verification.

[0096] The palm can be guided to an appropriate height before starting the verification. It is also possible to perform verification during the movement of the palm. The embodiments of the present application do not limit this.

[0097] In one example, when the display position of the movable element in the moving area matches the display position of the marker element in the moving area, a first prompt message for indicating the start of verification or the completion of verification is displayed.

[0098] Exemplarily, referring to Figure 7 and Figure 8, when the display position of the movable element 405 matches the display position of the marker element 407, the guidance interface 400 displays a first prompt message 408 indicating that the verification is completed. Here, "matching" can mean that the numerical marker corresponding to the display position of the movable element 405 is the same as the numerical marker corresponding to the display position of the marker element 407, or it can mean that the numerical marker corresponding to the display position of the movable element 405 is within the numerical marker range corresponding to the display position of the marker element 407. At the same time, the second prompt message is used to prompt the user to stop moving the palm.

[0099] Optionally, when the palm-sweeping verification is successful, the movable area can be highlighted to indicate to the user that the palm-sweeping verification is successful. For example, referring to Figure 8 , the movable area 406 is filled and displayed. The transition of the guidance information is completed with the same elements, improving the fluency of the user's subjective understanding.

[0100] Optionally, after the palm-sweeping verification is successful, the graphical guidance information is cancelled, and the user interaction interface, such as the door-opening success interface, payment success interface, clock-in success interface, etc., and information related to the user are displayed. For example, referring to Figure 9 , after the graphical guidance information is cancelled, the user nickname, user image, prompt message, etc. are displayed in the guidance interface 400.

[0101] In another example, the number of the above-mentioned marker elements is multiple, and different marker elements correspond to different target distances or target distance ranges; when the display position of the movable element in the movable area matches the display positions of the multiple marker elements in the movable area in the target order, a first prompt message indicating the start of verification or verification completion is displayed; where the target order refers to the matching order of the multiple marker elements.

[0102] Exemplarily, assume that 3 marker elements appear in sequence: A, B, and C. A, B, and C respectively correspond to different target distances or target distance ranges, and the target order is A, B, and C in sequence. First, A is displayed in the guidance interface. When the display position of the movable element in the movable area matches the display position of A in the movable area, B is displayed in the guidance interface. The user adjusts the palm to change the display position of the movable area. When the display position of the movable element in the movable area matches the display position of B in the movable area, C is displayed in the guidance interface. The user continues to adjust the palm to change the display position of the movable area. When the display position of the movable element in the movable area matches the display position of C in the movable area, a first prompt message indicating the start of verification or verification completion is displayed in the guidance interface.

[0103] Optionally, when prompt information related to the target order is displayed on the guidance interface, when the movable element matches each marked element, an image of the palm can be captured by detecting the camera of the device; based on the images of multiple palms at different distances captured, the palm is identified and verified to obtain a verification result.

[0104] That is, the palm is identified and verified in multiple target distances or target distance intervals in sequence to obtain multiple verification results. If all of these multiple verification results are passed, it can be determined that the palm brushing verification is passed.

[0105] Exemplarily, in this case, the overall feature information and local feature information of the palm can also be captured through multiple marked elements. For example, the palm can be first guided away from the detection device to capture the overall image of the palm, and then the palm can be guided closer to the detection device to capture the local image of the palm, so as to obtain the overall feature information and local feature information of the palm, and complete the identity verification of the user corresponding to the palm. Compared with only completing the identity verification through the overall feature information or local feature information of the palm, the technical solution provided by the embodiments of the present application can improve the security of the palm brushing verification.

[0106] Optionally, when prompt information related to the target order is not displayed on the guidance interface, when the display position of the movable element in the moving area matches the display positions of multiple marked elements in the moving area in the target order, a first prompt information for indicating the start of verification is displayed; an image of the palm is captured by detecting the camera of the device; based on the image of the palm, the palm is identified and verified to obtain a verification result. For example, by sequentially completing the matching with multiple marked elements, the palm is guided to a position at an appropriate distance from the detection device, and then the palm is identified and verified to obtain a verification result.

[0107] Alternatively, when the display position of the movable element in the moving area matches the display positions of multiple marked elements in the moving area in the target order, a first prompt information for indicating the completion of verification is displayed. For example, the palm can be identified and verified at each of the multiple marked elements, or the palm can be identified and verified during the movement of the palm, so that when the matching of the last marked element is completed in the palm brushing verification, the verification result can be directly displayed. In this way, the complexity of the palm brushing verification can be reduced, and the efficiency of the palm brushing verification can be further improved.

[0108] In this scenario, this target sequence can be understood as a password. Only when the user knows this "password" and triggers it in sequence can the verification be successful. And in this case, during the palm movement, it is not necessary to perform palm recognition verification to confirm the user's identity to complete the palm-sweeping verification. It is also possible to perform palm recognition verification during the palm movement, so as to achieve the dual verification of "password" + "palmprint", which is beneficial to the security of palm-sweeping verification.

[0109] In another example, the above-mentioned palm-sweeping verification includes a first-stage verification and a second-stage verification. The first-stage verification is completed by the user's first palm, and the second-stage verification is completed by the user's second palm, and the first palm is different from the second palm. Among them, the movable element follows the distance between the first palm and the detection device and moves along the first set track to complete the first-stage verification. The movable element follows the distance between the second palm and the detection device and moves along the second set track to complete the second-stage verification. Among them, the first set track or the second set moving track can refer to moving away from the detection device, moving closer to the detection device, a combination of moving away from the detection device and moving closer to the detection device, etc.

[0110] Exemplarily, two graphical guidance messages can be displayed simultaneously in the guidance interface. One is used to guide the user's left palm for palm-sweeping verification, and the other is used to guide the user's right palm for palm-sweeping verification. When both the first-stage verification and the second-stage verification are completed, a first prompt message for indicating the start of verification or the completion of verification is displayed. Or, a graphical guidance message can be displayed in the guidance interface. This graphical guidance message is used to guide the user's left palm for palm-sweeping verification. When the left palm completes the verification, another graphical guidance message is displayed. This graphical guidance message is used to guide the user's right palm for palm-sweeping verification. When the right palm completes the verification, a first prompt message for indicating the start of verification or the completion of verification is displayed. In this way, the combined verification of the left palm and the right palm can be achieved, thereby improving the security of palm-sweeping verification.

[0111] In one example, in response to the palm moving out of the verification area corresponding to the detection device, a third prompt message is displayed, and this third prompt message is used to prompt the user to re-perform palm verification. That is, during the process of palm-sweeping verification, if the detection device cannot collect the image of the palm, the user needs to be prompted to move the palm back to the monitoring area and start the palm-sweeping verification again.

[0112] In summary, the technical solution provided by the embodiments of the present application uses the display position of the movable element in the moving area to indicate the distance between the palm and the detection device, and in response to the change in this distance, dynamically adjusts the display position of the movable element in the moving area in the guidance interface, realizing the visual guidance for palm brushing verification based only on the distance between the palm and the detection device, reducing the complexity of palm brushing verification, and thus improving the efficiency of palm brushing verification.

[0113] In addition, since the embodiments of the present application only need to guide the user to adjust the distance between the palm and the detection device, the understanding cost of the user during palm brushing verification is greatly reduced, and thus the user experience during palm brushing verification is improved.

[0114] In addition, the embodiments of the present application use multiple marker elements to combine the overall feature information and local feature information of the palm to complete palm brushing verification, thereby improving the security of palm brushing verification.

[0115] In addition, the embodiments of the present application complete palm brushing verification by combining the user's left palm and right palm, improving the security of palm brushing verification.

[0116] The above has described in detail the guidance method for palm brushing verification. The following will describe in detail the method for obtaining the distance between the palm and the detection device.

[0117] Please refer to Figure 10 , which shows a flowchart of a method for obtaining the palm brushing distance provided by an embodiment of the present application. The execution subject of each step of this method can be Figure 1 the terminal 10 in the implementation environment of the solution shown, such as the client in the terminal 10. This method may include the following steps (1001 to 1004).

[0118] Step 1001, collect the current frame image of the palm through the camera of the detection device.

[0119] During the palm brushing verification process, the camera of the detection device captures the palm in real time to obtain the palm image. The current frame image refers to the palm image at the current moment. The detection device is the same as that introduced in the above embodiments. For the parts not described in the embodiments of the present application, reference can be made to the above embodiments, and details will not be repeated here.

[0120] Exemplarily, refer to Figure 11, in the palm detection plane 1100 of the detection device, a camera 1101 and a plurality of distance sensors 1102 are provided, and the plurality of distance sensors 1102 can be symmetrically distributed with the camera as the center of the circle. The current frame image of the palm can be collected through the camera 1101, and the distance between the palm and the detection device can be obtained through the distance sensors 1102. In some feasible embodiments, the camera 1101 is a depth camera, which can simultaneously obtain the color image and the depth image of the palm, and then obtain the distance between the palm and the detection device through an algorithm.

[0121] Step 1002, perform palm detection on the current frame image to obtain the predicted coordinates and predicted size corresponding to the palm.

[0122] Among them, the predicted coordinates are used to represent the position of the palm in the current frame image, and the predicted size is used to represent the size of the palm in the current frame image.

[0123] In order to measure the brushing palm distance, the embodiment of the present application uses a distance sensor to detect the brushing palm distance. However, since the distance sensor is only used to test the brushing palm distance, in complex scenarios (such as when the user's arm blocks the distance sensor), only using the distance sensor to measure the brushing palm distance will result in inaccurate distance judgment, and then lead to incorrect guidance for brushing palm verification. Based on this, the embodiment of the present application uses a distance estimation method based on palm position detection + distance sensor to improve the measurement accuracy of the brushing palm distance, and then improve the guidance accuracy of the brushing palm verification.

[0124] In one example, the palm detection model can be used to perform palm detection on the current frame image to obtain the predicted coordinates and predicted size corresponding to the palm. Among them, the palm detection model can be constructed based on SSD (Single Shot Detector, a target detection network), or can be constructed based on other detection networks such as YOLO (You Only Look Once, a target detection network), CNN (Convolutional Neural Network), R-CNN (Region-CNN, region-based convolutional neural network), Faster R-CNN, etc. The embodiment of the present application does not limit this. The palm detection model can be trained based on sample data with palm box annotations.

[0125] Exemplarily, refer to Figure 12, first, the current frame image 1201 is input into the palm detection model 1202. The palm detection model 1202 divides the current frame image 1201 into S*S grids, and then predicts B Bounding Boxes for each grid. Each bounding box contains five predicted values: x, y, w, h, and confidence (i.e., confidence). x and y are the center coordinates of the bounding box, and w and h are the dimensions of the bounding box.

[0126] The confidence is used to represent the possibility that the palm is included in the bounding box. Exemplarily, each grid predicts the probabilities of C assumed categories (in the embodiments of the present application, only the probability of the palm category needs to be predicted), and the prediction result of the model is a tensor of S*S*(B*5 + C).

[0127] For example, referring to Figure 13 , the current frame image 1301 is divided into 7*7 grids, i.e., S = 7. Each grid corresponds to 2 bounding boxes, i.e., B = 2. Suppose there are 20 assumed categories in total, i.e., C = 20, then the prediction result of the model is a tensor of 7*7*30.

[0128] Optionally, the calculation formula of the confidence can be as follows: where Pr is used to represent whether there is a target in the corresponding grid (if there is, Pr = 1; if not, Pr = 0), is the intersection over union between the palm bounding box output by the palm detection model and the true palm bounding box. If there is no target in the grid, the confidence is 0; if there is a target in the grid, the confidence is the intersection over union between the palm bounding box output by the palm detection model and the true palm bounding box.

[0129] Optionally, the palm detection model mainly uses GoogleNet (a deep learning network). For example, referring to Figure 14 , the palm detection model 1400 includes a convolutional layer and a fully connected layer. The convolutional layer is used to extract the features of the current image frame, and the fully connected layer is used to predict categories, coordinates, dimensions, confidence, etc. based on the features output by the convolutional layer.

[0130] In one example, since the assumed category of the palm detection model is only the palm, the bounding box with the maximum confidence can be determined as the palm bounding box (such as Figure 12 the palm bounding box 1203 in), and the center point or corner point of the palm bounding box can be determined as the predicted coordinates of the palm, and the dimensions of the palm bounding box can be determined as the predicted dimensions of the palm. Based on the predicted coordinates and predicted dimensions, the position of the palm in the current frame image can be determined.

[0131] After obtaining the predicted coordinates and predicted dimensions, the predicted coordinates can be aligned with the grid corresponding to the palm bounding box (i.e., the offset value relative to the grid), so that the range adjustment value of the predicted coordinates is from 0 to 1. At the same time, the predicted dimensions can also be normalized. For example, divide w and h by the width and height of the current frame image respectively, so that the range of w and h is adjusted to 0 to 1.

[0132] Step 1003, based on the predicted coordinates and predicted dimensions, determine the target distance sensor from multiple distance sensors corresponding to the detection device.

[0133] The distance sensor is used to obtain the real distance between the palm and the detection device. Taking the camera of the detection device as the origin to construct a coordinate system, the target distance sensor can be determined based on the target quadrant of the palm in this coordinate system. In one example, the determination process of the target distance sensor can be as follows:

[0134] 1. Based on the predicted coordinates and predicted dimensions, determine the palm center.

[0135] Optionally, refer to Figure 15 , in the case where the coordinates (x, y) of the upper left corner point of the palm bounding box 1501 are used as the predicted coordinates, and the width and height of the palm bounding box 1501 (i.e., w and h) are used as the predicted dimensions, the coordinates of the palm center (i.e., the center point of the palm box) can be expressed as follows: (x + w / 2, y + h / 2).

[0136] 2. Based on the palm center and the center of the current frame image, determine the offset between the palm center and the center of the image.

[0137] This offset includes the offset dx in the x direction and the offset dy in the y direction. For example, refer to Figure 15 , taking the center point (W / 2, H / 2) of the current frame image as the coordinate origin, where W and H are the width and height of the image respectively. The horizontal right is the positive direction of the x-axis, and the vertical down is the positive direction of the y-axis. Then the offset of the palm center relative to the coordinate origin is dx = x + w / 2 - W / 2, dy = y + h / 2 - H / 2.

[0138] 3. According to the offset, determine the target quadrant corresponding to the palm in the coordinate system with the detection device as the origin.

[0139] Under normal circumstances, the distance between the palm and the detection device can be obtained by calculating the average value of the distance information corresponding to all distance sensors. For a distance sensor, when there is no object blocking, the distance sensor will measure and return a specific distance. By determining whether the distance information is valid, invalid distance information can be excluded, and then the average value can be calculated. However, in actual situations, due to the occlusion of the user's arm, etc., there may be incorrect distance information detected by the distance sensor due to the occlusion of the arm, resulting in interference with the distance data. In the embodiments of the present application, the target quadrant corresponding to the palm can be used to exclude incorrect distance information, thereby improving the accuracy of the distance data.

[0140] Exemplarily, a coordinate system is constructed with the camera corresponding to the detection device as the origin. For example, referring to Figure 11 , a coordinate system is constructed with the camera 1101 as the origin. Based on the position of the current frame image relative to the camera 1101 and the offset vector between the palm center corresponding to the palm bounding box 1103 and the center of the image, the target quadrant corresponding to the palm in the coordinate system with the camera as the origin can be determined. Among them, the coordinate system in the current frame image and the coordinate system under the camera are in the same plane.

[0141] Optionally, the quadrant of the palm center in the current frame image can also be determined based on the sign information (such as positive or negative) corresponding to the above offset vector, and this quadrant can be determined as the target quadrant.

[0142] 4. Determine the distance sensors within the target quadrant and the distance sensors on the coordinate axes corresponding to the target quadrant as the target distance sensors.

[0143] Step 1004, obtain the distance between the palm and the detection device according to the distance information corresponding to the target distance sensors.

[0144] Optionally, the distance information corresponding to the target distance sensors can be averaged to obtain the distance between the palm and the detection device. In this way, incorrect distance information caused by the occlusion of the arm can be avoided from being considered in the distance calculation process, thereby improving the accuracy of distance acquisition.

[0145] Optionally, after obtaining the distance between the palm and the detection device, this distance can be physically mapped to a movable element.

[0146] In one example, the display position of the movable element in the movement area has a positive correlation with the distance. Exemplarily, this relationship can be expressed as follows: When the distance between the palm and the detection device is greater than the first distance threshold, the display position ratio of the movable element in the movement area is set to 1; when the distance between the palm and the detection device is less than or equal to the first distance threshold, based on the ratio of the distance between the palm and the detection device to the first distance threshold, the display position ratio of the movable element in the movement area is determined.

[0147] Among them, the first distance threshold can be set and adjusted according to empirical values, such as 400mm, 500mm, 600mm, etc. The display position ratio is used to indicate the display position of the movable element in the movement area, and a display position ratio of 1 means that the movable element is located at the maximum value of the movement area.

[0148] For example, the display position ratio can be expressed by the following formula:

[0149]

[0150] Among them, P represents the distance between the palm and the detection device, with the unit of mm, and f is the display position ratio, which is used to represent the distance of the movable element from the bottom of the movable area. When the distance > 500mm, the display position ratio corresponding to the movable element is 1, indicating that the small ball is located at the top of the corresponding area; when the distance is less than 500mm, such as 50mm, the display position ratio corresponding to the movable element is 0.1, that is, the display position of the movable element is at a distance of 10% of the movable area from the bottom of the movable area.

[0151] In one example, the process of determining the initial display position of the movable element can be as follows: Obtain the initial relative position between the palm and the detection device, and based on the initial relative position, determine the initial display position of the movable element in the movement area. For example, use the above method of obtaining the display ratio to determine the initial display position of the movable element.

[0152] In this case, if it is detected that the initial display position of the movable element overlaps with the display position of the marked element in the movement area, the position of the marked element is adjusted to obtain the adjusted marked element, and the adjusted marked element is used to guide the movement of the movable element.

[0153] Alternatively, initialize the display position of the movable element in the movement area to obtain the initial display position of the movable element, and map and associate the initial display position with the initial relative position between the palm and the detection device. For example, the initial display position of the movable element is fixed. After obtaining the initial relative position between the palm and the detection device, determine the display position of the marked element, thereby realizing the guidance of palm brushing verification.

[0154] In summary, the technical solution provided by the embodiments of the present application uses the display position of the movable element in the moving area to indicate the distance between the palm and the detection device, and in response to the change of this distance, dynamically adjusts the display position of the movable element in the moving area in the guidance interface, realizing the visual guidance for palm-sweeping verification based only on the distance between the palm and the detection device, reducing the complexity of palm-sweeping verification, and thus improving the efficiency of palm-sweeping verification.

[0155] In addition, since the embodiments of the present application only need to guide the user to adjust the distance between the palm and the detection device, the understanding cost of the user during palm-sweeping verification is greatly reduced, and thus the user experience during palm-sweeping verification is improved.

[0156] In addition, the embodiments of the present application adopt a distance estimation method based on palm position detection + distance sensor, improving the measurement accuracy of the palm-sweeping distance, and thus improving the guidance accuracy of palm-sweeping verification.

[0157] The following is an embodiment of the device of the present application, which can be used to execute the method embodiment of the present application. For the details not disclosed in the device embodiment of the present application, please refer to the method embodiment of the present application.

[0158] Please refer to Figure 16 , which shows a block diagram of a guidance device for palm-sweeping verification provided by an embodiment of the present application. This device can be used to implement the above-mentioned guidance method for palm-sweeping verification. The device 1600 may include: a guidance interface display module 1601, a guidance information display module 1602, an element position adjustment module 1603, and a prompt information display module 1604.

[0159] The guidance interface display module 1601 is used to display a guidance interface for palm-sweeping verification.

[0160] The guidance information display module 1602 is used to display graphical guidance information in the guidance interface. The graphical guidance information includes a movable element and a moving area corresponding to the movable element; wherein, the display position of the movable element in the moving area is used to indicate the distance between the palm and the detection device.

[0161] The element position adjustment module 1603 is used to dynamically adjust the display position of the movable element in the moving area in the guidance interface in response to the change of the distance.

[0162] The prompt information display module 1604 is used to display a first prompt information for indicating the start of verification or the completion of verification when the display position of the movable element in the moving area meets the conditions.

[0163] In an exemplary embodiment, the graphical guidance information further includes: a marking element displayed in the moving area, and a display position of the marking element in the moving area, which is used to indicate a target distance or a target distance range between the palm and the detection device;

[0164] The prompt information display module 1604 is configured to display a first prompt information for indicating the start of verification or the completion of verification when the display position of the movable element in the moving area matches the display position of the marking element in the moving area.

[0165] In an exemplary embodiment, the number of the marking elements is multiple, and different marking elements correspond to different target distances or target distance ranges;

[0166] The prompt information display module 1604 is further configured to display a first prompt information for indicating the start of verification or the completion of verification when the display position of the movable element in the moving area matches the display positions of multiple marking elements in the moving area in a target order; wherein, the target order refers to the matching order of multiple marking elements.

[0167] In an exemplary embodiment, prompt information related to the target order is displayed in the guidance interface; as Figure 17 shown, the device 1600 further includes: a palm image acquisition module 1605 and a verification result acquisition module 1606.

[0168] The palm image acquisition module 1605 is configured to acquire an image of the palm through a camera of the detection device when the movable element matches each of the marking elements.

[0169] The verification result acquisition module 1606 is configured to perform recognition verification on the palm according to multiple images of the palm at different distances acquired, and obtain a verification result.

[0170] In an exemplary embodiment, the prompt information related to the target order is not displayed in the guidance interface;

[0171] The prompt information display module 1604 is further configured to display a first prompt information for indicating the start of verification when the display position of the movable element in the moving area matches the display positions of multiple marking elements in the moving area in the target order; the palm image acquisition module 1605 is further configured to acquire an image of the palm through a camera of the detection device; the verification result acquisition module 1606 is further configured to perform recognition verification on the palm according to the image of the palm, and obtain a verification result.

[0172] Alternatively, the prompt information display module 1604 is further configured to display a first prompt information for indicating that the verification is completed when the display position of the movable element in the moving area matches the display positions of the multiple marker elements in the moving area in the target order.

[0173] In an exemplary embodiment, the prompt information display module 1604 is further configured to display second prompt information for guiding the operations that the user needs to perform in the guiding interface.

[0174] In an exemplary embodiment, the display screen of the guiding interface does not overlap with the palm detection plane of the detection device.

[0175] In an exemplary embodiment, the detection device is configured to detect the palm in a non-contact manner, where the non-contact manner means that the palm does not contact the palm detection plane of the detection device.

[0176] In an exemplary embodiment, the palm brushing verification includes a first-stage verification and a second-stage verification. The first-stage verification is completed by the user's first palm, and the second-stage verification is completed by the user's second palm, where the first palm is different from the second palm;

[0177] The movable element moves along a first set track following the distance between the first palm and the detection device to complete the first-stage verification, and the movable element moves along a second set track following the distance between the second palm and the detection device to complete the second-stage verification.

[0178] In an exemplary embodiment, as Figure 17 shown, the device 1600 further includes: a display position setting module 1607.

[0179] The display position setting module 1607 is configured to set the display position ratio of the movable element in the moving area to 1 when the distance between the palm and the detection device is greater than a first distance threshold.

[0180] The display position setting module 1607 is further configured to determine the display position ratio of the movable element in the moving area based on the ratio of the distance between the palm and the detection device to the first distance threshold when the distance between the palm and the detection device is less than or equal to the first distance threshold.

[0181] In an exemplary embodiment, the display position setting module 1607 is further configured to:

[0182] Obtain the initial relative position between the palm and the detection device, and determine the initial display position of the movable element in the moving area according to the initial relative position;

[0183] Alternatively, initialize the display position of the movable element in the moving area to obtain the initial display position of the movable element, and map and associate the initial display position with the initial relative position between the palm and the detection device.

[0184] In an exemplary embodiment, the display position setting module 1607 is further configured to, if it is detected that the initial display position of the movable element overlaps with the display position of the marked element in the moving area, adjust the position of the marked element to obtain an adjusted marked element, and the adjusted marked element is used to guide the movement of the movable element.

[0185] In an exemplary embodiment, as Figure 17 shown, the device 1600 further includes: a current image detection module 1608, a target sensor determination module 1609, and a palm distance acquisition module 1610.

[0186] The palm image acquisition module 1605 is further configured to collect a current frame image of the palm through the camera of the detection device.

[0187] The current image detection module 1608 is configured to perform palm detection on the current frame image to obtain the predicted coordinates and predicted size corresponding to the palm.

[0188] The target sensor determination module 1609 is configured to determine a target distance sensor from a plurality of distance sensors corresponding to the detection device based on the predicted coordinates and the predicted size.

[0189] The palm distance acquisition module 1610 is configured to obtain the distance between the palm and the detection device according to the distance information corresponding to the target distance sensor.

[0190] In an exemplary embodiment, the target sensor determination module 1609 is configured to:

[0191] Determine the palm center based on the predicted coordinates and the predicted size;

[0192] Determine the offset between the palm center and the image center of the current frame image based on the palm center and the image center;

[0193] Determine the target quadrant corresponding to the palm in the coordinate system with the detection device as the origin according to the offset;

[0194] Determine the distance sensors within the target quadrant and the distance sensors on the coordinate axes corresponding to the target quadrant as the target distance sensors.

[0195] In an exemplary embodiment, the prompt information display module 1604 is further configured to display third prompt information in response to the palm moving out of the verification area corresponding to the detection device, where the third prompt information is used to prompt the user to re-perform palm verification.

[0196] In summary, the technical solution provided in the embodiments of the present application indicates the distance between the palm and the detection device through the display position of the movable element in the moving area, and dynamically adjusts the display position of the movable element in the moving area in the guidance interface in response to the change of this distance, realizing the visual guidance for completing palm brushing verification only based on the distance between the palm and the detection device, reducing the complexity of palm brushing verification, and thus improving the efficiency of palm brushing verification.

[0197] In addition, since the embodiments of the present application only need to guide the user to adjust the distance between the palm and the detection device, it greatly reduces the understanding cost of the user during palm brushing verification, and further improves the user experience during palm brushing verification.

[0198] It should be noted that when the device provided in the above embodiments realizes its functions, only the division of the above functional modules is used for illustration. In actual applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device provided in the above embodiments and the method embodiments belong to the same concept, and the specific implementation process is detailed in the method embodiments, which will not be repeated here.

[0199] Please refer to Figure 18 , which shows a schematic structural diagram of a terminal device provided in an embodiment of the present application. The terminal device can be any electronic device with data calculation, processing, and storage functions, and the terminal device is used to implement the guidance method for palm brushing verification provided in the above embodiments. The terminal device can be Figure 1 the terminal 10 in the shown implementation environment. Specifically.

[0200] Generally, the terminal device 1800 includes a processor 1801 and a memory 1802.

[0201] Optionally, the processor 1801 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1801 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), or PLA (Programmable Logic Array). The processor 1801 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the wake state, also known as the CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1801 may be integrated with a GPU (Graphics Processing Unit), and the GPU is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1801 may further include an AI (Artificial Intelligence) processor, and the AI processor is used to process computational operations related to machine learning.

[0202] Optionally, the memory 1802 may include one or more computer-readable storage media, and the computer-readable storage media may be non-transitory. The memory 1802 may further include high-speed random access memory and non-volatile memory, such as one or more disk storage devices and flash storage devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1802 is used to store a computer program, and the computer program is configured to be executed by one or more processors to implement the above-mentioned guiding method for palm brushing verification.

[0203] In some embodiments, the terminal device 1800 may further optionally include: a peripheral device interface 1803 and at least one peripheral device. The processor 1801, the memory 1802, and the peripheral device interface 1803 may be connected through a bus or signal lines. Each peripheral device may be connected to the peripheral device interface 1803 through a bus, signal lines, or a circuit board. Specifically, the peripheral devices include at least one of a radio frequency circuit 1804, a display screen 1805, an audio circuit 1806, and a power supply 1807.

[0204] Those skilled in the art can understand that Figure 18 the structure shown in does not constitute a limitation on the terminal device 1800, and it may include more or fewer components than shown in the figure, or combine certain components, or adopt a different component layout.

[0205] In an exemplary embodiment, a computer-readable storage medium is further provided. A computer program is stored in the storage medium, and when the computer program is executed by a processor, the guiding method for palm brushing verification described above is implemented.

[0206] Optionally, the computer-readable storage medium may include: ROM (Read-Only Memory), RAM (Random-Access Memory), SSD (Solid State Drives), or optical discs, etc. Among them, the random access memory may include ReRAM (Resistance Random Access Memory) and DRAM (Dynamic Random Access Memory).

[0207] In an exemplary embodiment, a computer program product or a computer program is further provided. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the terminal device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the terminal device executes the guiding method for palm brushing verification described above.

[0208] It should be noted that the information (including but not limited to object device information, object personal information, etc.), data (including but not limited to data for analysis, stored data, displayed data, etc.), and signals involved in this application are all authorized by the object or fully authorized by all parties, and the collection, use, and processing of relevant data need to comply with the relevant laws, regulations, and standards of relevant countries and regions. For example, the palms, images, etc. involved in this application are obtained under full authorization.

[0209] It should be understood that the term "plurality" mentioned herein refers to two or more. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after. In addition, the step numbers described in this article only exemplarily show a possible execution sequence between steps. In some other embodiments, the above steps may not be executed in the order of the numbers. For example, two steps with different numbers are executed simultaneously, or two steps with different numbers are executed in the reverse order of the illustration. The embodiments of this application do not limit this.

[0210] The foregoing are only exemplary embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present application shall be included within the protection scope of the present application.

Claims

1. A guiding method for palm brushing verification, characterized in that, The method includes: Displaying a guiding interface for palm brushing verification; Displaying graphical guiding information in the guiding interface, the graphical guiding information including a movable element, a moving area corresponding to the movable element, and a marking element displayed in the moving area; wherein, the display position of the movable element in the moving area is used to indicate the distance between the palm and the detection device, and the display position of the marking element in the moving area is used to indicate a target distance or a target distance range between the palm and the detection device, and the number of the marking elements is multiple, and different marking elements correspond to different target distances or target distance ranges; In response to the change of the distance, dynamically adjusting the display position of the movable element in the moving area in the guiding interface; When the display position of the movable element in the moving area matches the display positions of the multiple marking elements in the moving area in a target order, displaying a first prompt message for indicating the start of verification or the completion of verification; Wherein, the target order refers to the matching order of the multiple marking elements.

2. The method according to claim 1, characterized in that Prompt information related to the target order is displayed in the guiding interface; The method further includes: When the movable element matches each of the marking elements, collecting an image of the palm through a camera of the detection device; Performing recognition verification on the palm according to multiple images of the palm at different distances collected, to obtain a verification result.

3. The method according to claim 1, wherein Prompt information related to the target order is not displayed in the guiding interface; The step of, when the display position of the movable element in the moving area matches the display positions of the multiple marking elements in the moving area in a target order, displaying a first prompt message for indicating the start of verification or the completion of verification includes: When the display position of the movable element in the moving area matches the display positions of the multiple marking elements in the moving area in the target order, displaying a first prompt message for indicating the start of verification; collecting an image of the palm through a camera of the detection device; performing recognition verification on the palm according to the image of the palm, to obtain a verification result; Or, When the display position of the movable element in the moving area matches the display positions of the multiple marking elements in the moving area in the target order, displaying a first prompt message for indicating the completion of verification.

4. The method according to claim 1, wherein The method further includes: In the guiding interface, displaying a second prompt message for guiding the operation that the user needs to perform.

5. The method according to claim 1, characterized in that, The display screen of the guiding interface does not overlap with the palm detection plane of the detection device.

6. The method according to claim 1, characterized in that, The detection device is used to detect the palm in a non-contact manner, and the non-contact manner means that the palm does not contact the palm detection plane of the detection device.

7. The method according to claim 1, wherein The method further includes: When the distance between the palm and the detection device is greater than a first distance threshold, setting the display position ratio of the movable element in the moving area to 1; When the distance between the palm and the detection device is less than or equal to the first distance threshold, determine the display position ratio of the movable element in the movement area based on the ratio of the distance between the palm and the detection device to the first distance threshold.

8. The method according to claim 1, wherein The method further includes: Obtain the initial relative position between the palm and the detection device, and determine the initial display position of the movable element in the movement area according to the initial relative position; Or, Initialize the display position of the movable element in the movement area to obtain the initial display position of the movable element, and map and associate the initial display position with the initial relative position between the palm and the detection device.

9. The method according to claim 8, wherein The method further includes: If it is detected that the initial display position of the movable element overlaps with the display position of the marked element in the movement area, adjust the position of the marked element to obtain an adjusted marked element, and the adjusted marked element is used to guide the movement of the movable element.

10. The method according to claim 1, wherein The method further includes: Collect a current frame image of the palm through the camera of the detection device; Perform palm detection on the current frame image to obtain the predicted coordinates and predicted size corresponding to the palm; Based on the predicted coordinates and the predicted size, determine a target distance sensor from a plurality of distance sensors corresponding to the detection device; Obtain the distance between the palm and the detection device according to the distance information corresponding to the target distance sensor.

11. The method according to claim 10, wherein The determining the target distance sensor from a plurality of distance sensors corresponding to the detection device based on the predicted coordinates and the predicted size includes: Based on the predicted coordinates and the predicted size, determine the palm center of the palm; Based on the palm center and the center of the current frame image, determine the offset between the palm center and the center of the image; According to the offset, determine the target quadrant corresponding to the palm in the coordinate system with the detection device as the origin; Determine the distance sensors within the target quadrant and the distance sensors on the coordinate axis corresponding to the target quadrant as the target distance sensors.

12. The method according to claim 1, characterized in that, The method further includes: In response to the palm moving out of the verification area corresponding to the detection device, display a third prompt message for prompting the user to re-perform palm verification.

13. A guiding device for palm brushing verification, characterized in that, The device includes: A guiding interface display module for displaying a guiding interface for palm brushing verification; A guiding information display module for displaying graphical guiding information in the guiding interface, where the graphical guiding information includes a movable element, a movement area corresponding to the movable element, and a marked element displayed in the movement area; wherein, the display position of the movable element in the movement area is used to indicate the distance between the palm and the detection device, the display position of the marked element in the movement area is used to indicate the target distance or target distance range between the palm and the detection device, the number of marked elements is multiple, and different marked elements correspond to different target distances or target distance ranges; An element position adjustment module, configured to dynamically adjust the display position of the movable element in the moving area in the guiding interface in response to the change of the distance; A prompt message display module, configured to display a first prompt message for indicating the start of verification or the completion of verification when the display position of the movable element in the moving area matches the display positions of the multiple marker elements in the moving area in a target order; Wherein, the target order refers to the matching order of the multiple marker elements.

14. The device according to claim 13, characterized in that Prompt messages related to the target order are displayed in the guiding interface; The device further includes: A palm image acquisition module, configured to acquire an image of the palm through the camera of the detection device when the movable element matches each of the marker elements; A verification result acquisition module, configured to perform identification and verification on the palm based on multiple images of the palm at different distances collected, and obtain a verification result.

15. The device according to claim 13, characterized in that, Prompt messages related to the target order are not displayed in the guiding interface; The prompt message display module is further configured to display a first prompt message for indicating the start of verification when the display position of the movable element in the moving area matches the display positions of the multiple marker elements in the moving area in the target order; Acquire an image of the palm through the camera of the detection device; perform identification and verification on the palm based on the image of the palm, and obtain a verification result; Or, The prompt message display module is further configured to display a first prompt message for indicating the completion of verification when the display position of the movable element in the moving area matches the display positions of the multiple marker elements in the moving area in the target order.

16. The device according to claim 13, wherein The prompt message display module is further configured to display a second prompt message in the guiding interface for guiding the operation that the user needs to perform.

17. The device according to claim 13, characterized in that, The display screen of the guiding interface and the palm detection plane of the detection device are not overlapped.

18. The device according to claim 13, characterized in that, The detection device is configured to detect the palm in a non-contact manner, and the non-contact manner means that the palm does not contact the palm detection plane of the detection device.

19. The device according to claim 13, characterized in that, The device further includes: A display position setting module, configured to set the display position ratio of the movable element in the moving area to 1 when the distance between the palm and the detection device is greater than a first distance threshold; The display position setting module is further configured to determine the display position ratio of the movable element in the moving area based on the ratio of the distance between the palm and the detection device to the first distance threshold when the distance between the palm and the detection device is less than or equal to the first distance threshold.

20. The device according to claim 13, characterized in that, The device further includes: A display position setting module, configured to obtain the initial relative position between the palm and the detection device, and determine the initial display position of the movable element in the moving area according to the initial relative position; Or, The display position setting module is further configured to initialize the display position of the movable element in the movement area to obtain the initial display position of the movable element, and map and associate the initial display position with the initial relative position between the palm and the detection device.

21. The apparatus according to claim 20, wherein the display position setting module is further configured to, if it is detected that the initial display position of the movable element overlaps with the display position of the marked element in the movement area, adjust the position of the marked element to obtain an adjusted marked element, and the adjusted marked element is used to guide the movement of the movable element.

22. The device according to claim 13, characterized in that The apparatus further includes: a palm image acquisition module, configured to acquire a current frame image of the palm through a camera of the detection device; a current image detection module, configured to perform palm detection on the current frame image to obtain the predicted coordinates and predicted size corresponding to the palm; a target sensor determination module, configured to determine a target distance sensor from a plurality of distance sensors corresponding to the detection device based on the predicted coordinates and the predicted size; a palm distance acquisition module, configured to acquire the distance between the palm and the detection device according to the distance information corresponding to the target distance sensor.

23. The device according to claim 22, wherein, The target sensor determination module is configured to: determine the palm center of the palm based on the predicted coordinates and the predicted size; determine the offset between the palm center and the image center of the current frame image based on the palm center and the image center of the current frame image; determine the target quadrant corresponding to the palm in the coordinate system with the detection device as the origin according to the offset; determine the distance sensors within the target quadrant and the distance sensors on the coordinate axis corresponding to the target quadrant as the target distance sensors.

24. The apparatus according to claim 13, wherein the prompt information display module is further configured to, in response to the palm moving out of the verification area corresponding to the detection device, display third prompt information, and the third prompt information is used to prompt the user to re-perform palm verification.

25. A terminal device, characterized in that, The terminal device includes a processor and a memory, and a computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the guiding method for palm brushing verification according to any one of claims 1 to 12.

26. A computer-readable storage medium, characterized in that, A computer program is stored in the computer-readable storage medium, and the computer program is loaded and executed by a processor to implement the guiding method for palm brushing verification according to any one of claims 1 to 12.

27. A computer program product, characterized in that, The computer program product includes computer instructions, the computer instructions are stored in the computer-readable storage medium, and the processor reads and executes the computer instructions from the computer-readable storage medium to implement the guiding method for palm brushing verification according to any one of claims 1 to 12.

Images