Palm scanning service provisioning method and related apparatus
Patent Information
- Application Number
- MYPI2026003162
- Authority / Receiving Office
- MY · MY
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-03-27
- Filing Date
- 2025-03-07
- Publication Date
- 2025-09-27
AI Technical Summary
The existing palm-swiping service activation process is inefficient, has a poor user experience, and has high display requirements for the palm-swiping device, resulting in high equipment deployment and maintenance costs.
The palm data is pre-recorded through the terminal device, and the correspondence between the target account and the pre-recorded palm data is recorded on the server. The palm data collected by the palm-swiping device is combined to complete the automatic activation of the palm-swiping service, reducing offline interactions.
It improves the activation efficiency and user experience of the palm-swiping service, reduces the display requirements for the palm-swiping device, and thus reduces the cost of device deployment and maintenance.
Smart Images

Figure PI2026003162_DRAWING_001 
Figure PI2026003162_DRAWING_002 
Figure PI2026003162_DRAWING_003
Abstract
Description
Palm swiping service activation method and related device
[0001] This application claims priority to a Chinese patent application filed with the Patent Office of China on March 27, 2024, with application number 202410372173X and application name “A method for activating a palm-swiping service and related devices”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of computer technology, and in particular to technologies related to palm-swiping services. Background Art
[0003] Palm-swiping services refer to services based on user palm feature information. Common palm-swiping services include, but are not limited to, palm-swiping payment, palm-swiping check-in, and palm-swiping membership identification. Due to their high security and convenience, palm-swiping services have rapidly gained widespread adoption in many scenarios.
[0004] Currently, users who wish to use the palm-swiping service must first activate it offline through a dedicated palm-swiping device. For example, to activate the palm-swiping payment service, users must use the palm-swiping device deployed at offline merchants to collect their palm features. After the palm-swiping device collects the palm features, it will display a corresponding QR code. At this point, the user must scan the QR code using a specific application to associate their account logged into the application with the palm features collected by the palm-swiping device, making it easier to deduct funds from the account when using the palm-swiping payment service. This activates the palm-swiping payment service.
[0005] During the aforementioned activation process, users need to spend a significant amount of time offline interacting with the device to successfully activate the service. This results in low activation efficiency, a poor user experience, and may also affect other users' ability to use the device. Furthermore, the device supporting the activation of the palm-swiping service has high display requirements, requiring a large screen to clearly display the QR code used to trigger account binding. This increases the deployment and maintenance costs of the device. Summary of the Invention
[0006] The embodiments of the present application provide a palm-swiping service activation method and related devices, which can improve the activation efficiency of the palm-swiping service, improve the user experience of activating the palm-swiping service, and no longer have special display requirements for the palm-swiping devices that support the activation of the palm-swiping service, which can reduce the related equipment deployment and maintenance costs.
[0007] In a first aspect, the present application provides a palm-swiping service activation method, which is executed by a terminal. The method includes:
[0008] In response to a pre-activation operation for the palm-swiping service, displaying a palm entry interface through a target application running in the terminal; a target account is logged in to the target application;
[0009] Displaying an image captured by the camera of the terminal in the palm entry interface;
[0010] When it is determined that the palm information of the object in the image meets the palm entry conditions, the server is notified to record the palm pre-entry data corresponding to the target account; the palm pre-entry data is determined based on the image; the server is used to activate the palm swiping service for the target account based on the palm data when it detects that the palm swiping device has collected palm data that matches the palm pre-entry data.
[0011] A second aspect of the present application provides a palm-swiping service activation method, which is executed by a server, and the method includes:
[0012] Obtain palm data collected through a palm scanning device;
[0013] detecting whether there is target palm pre-recorded data matching the palm data in a pre-recorded database; the pre-recorded database is used to store a correspondence between the palm pre-recorded data and an account, the palm pre-recorded data being determined based on an image captured by the terminal, the image being captured by the terminal in response to a pre-activation operation for the palm-swiping service, and the account corresponding to the palm pre-recorded data being an account logged into a target application running on the terminal;
[0014] If the target palm pre-recorded data is detected, the target account corresponding to the target palm pre-recorded data is determined, and a corresponding relationship between the target account and the palm data is established, and the palm swiping service is activated for the target account.
[0015] A third aspect of the present application provides a device for activating a palm-swiping service, the device comprising:
[0016] A display module is configured to display a palm input interface via a target application running in the terminal in response to a pre-activation operation for the palm swiping service; the target application has a target account logged in;
[0017] The display module is further configured to display an image captured by the camera of the terminal in the palm entry interface;
[0018] The notification module is used to notify the server to record the palm pre-entry data corresponding to the target account when it is determined that the palm information of the object in the image meets the palm entry conditions; the palm pre-entry data is determined based on the image; the server is used to activate the palm swiping service for the target account based on the palm data when it detects that the palm swiping device has collected palm data that matches the palm pre-entry data.
[0019] A fourth aspect of the present application provides a palm-swiping service activation device, the device comprising:
[0020] An acquisition module is used to acquire palm data collected by a palm-swiping device;
[0021] a detection module, configured to detect whether target palm pre-recorded data matching the palm data exists in a pre-recorded database; the pre-recorded database is configured to store a correspondence between the palm pre-recorded data and an account number, the palm pre-recorded data being determined based on an image captured by a terminal, the image being captured by the terminal in response to a pre-activation operation for a palm-swiping service, and the account number corresponding to the palm pre-recorded data being an account logged into a target application running on the terminal;
[0022] The activation module is used to determine the target account corresponding to the target palm pre-entered data if the target palm pre-entered data is detected, establish a corresponding relationship between the target account and the palm data, and activate the palm swiping service for the target account.
[0023] A fifth aspect of the present application provides a computer device, the device comprising a processor and a memory:
[0024] The memory is used to store computer programs;
[0025] The processor is configured to execute the steps of the palm-swiping service activation method as described in the first aspect or the second aspect according to the computer program.
[0026] In a sixth aspect, the present application provides a computer-readable storage medium for storing a computer program for executing the steps of the palm-swiping service activation method described in the first or second aspect.
[0027] In a seventh aspect, the present application provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the steps of the palm-swiping service activation method described in the first or second aspect.
[0028] It can be seen from the above technical solutions that the embodiments of the present application have the following advantages:
[0029] The embodiment of the present application provides a method for activating a palm-swiping service, which innovatively proposes a mechanism for pre-activating the palm-swiping service through a personal terminal. In this method, the subject can pre-enter palm data through the target application in the terminal in advance, so that the server can preliminarily record the correspondence between the target account currently logged in on the target application and the palm pre-entered data collected by the terminal. When the subject uses the palm-swiping device offline, the server can automatically determine and record the correspondence between the palm data and the target account based on the matching relationship between the palm data collected by the palm-swiping device and the pre-recorded palm pre-entered data, as well as the correspondence between the palm pre-entered data and the target account, thereby completing the palm-swiping service activation operation for the target account. For the subject, it can conveniently pre-enter palm data through a personal terminal in advance. When using the palm-swiping device, the palm-swiping service activation can be completed without perception, without the need for excessive offline interaction with the palm-swiping device. The palm-swiping service activation efficiency is high, the experience is good, and it will not affect other subjects using the palm-swiping device. Furthermore, since the palm-swiping service activation process does not require the palm-swiping device to display special content, the display requirements for the palm-swiping device can be reduced, and the deployment and maintenance costs of the device can be reduced accordingly. BRIEF DESCRIPTION OF THE DRAWINGS
[0030] FIG1 is a schematic diagram of an application scenario of a palm-swiping service activation method provided in an embodiment of the present application;
[0031] FIG2 is a flow chart of a palm-swiping service activation method provided in an embodiment of the present application;
[0032] FIG3 is a schematic diagram of an exemplary palm input interface according to an embodiment of the present application;
[0033] FIG4 is a second schematic diagram of an exemplary palm input interface provided in an embodiment of the present application;
[0034] FIG5 is a third schematic diagram of an exemplary palm input interface provided in an embodiment of the present application;
[0035] FIG6 is a fourth schematic diagram of an exemplary palm input interface provided in an embodiment of the present application;
[0036] FIG7 is a schematic diagram of a process for a server to record pre-entered palm data according to an embodiment of the present application;
[0037] FIG8 is a schematic diagram of the interface on the terminal side during the pre-activation process of the palm-swiping service provided in an embodiment of the present application;
[0038] FIG9 is a schematic diagram of detecting palm input conditions provided by an embodiment of the present application;
[0039] FIG10 is a schematic diagram of determining the positional relationship between a palm and a reference boundary according to an embodiment of the present application;
[0040] FIG11 is a schematic diagram of a first key point provided in an embodiment of the present application;
[0041] FIG12 is a schematic diagram of determining palm direction information according to an embodiment of the present application;
[0042] FIG13 is a schematic diagram of determining image quality information according to an embodiment of the present application;
[0043] FIG14 is a schematic diagram of live palm detection provided by an embodiment of the present application;
[0044] FIG15 is a schematic diagram of a second key point provided in an embodiment of the present application;
[0045] FIG16 is a schematic diagram of determining a gesture based on a second key point according to an embodiment of the present application;
[0046] FIG17 is a flow chart of another palm-swiping service activation method provided in an embodiment of the present application;
[0047] FIG18 is a schematic diagram of a process for providing a palm-swiping service by a server according to an embodiment of the present application;
[0048] FIG19 is a schematic diagram of an interface of a palm brushing device provided in an embodiment of the present application;
[0049] FIG20 is a schematic diagram of the structure of a palm-swiping service activation device provided in an embodiment of the present application;
[0050] FIG21 is a schematic diagram of the structure of another device for activating a palm-swiping service provided in an embodiment of the present application;
[0051] FIG22 is a schematic diagram of the structure of a terminal device provided in an embodiment of the present application;
[0052] Figure 23 is a structural diagram of the server provided in an embodiment of the present application. DETAILED DESCRIPTION
[0053] In order to help those skilled in the art better understand the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0054] The terms "first," "second," "third," "fourth," etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequential sequence. It should be understood that the numbers used in this way are interchangeable where appropriate so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having," as well as any variations thereof, are intended to cover non-exclusive inclusions, e.g., a process, method, system, product, or apparatus comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or apparatus.
[0055] The palm-swiping service activation method provided in the embodiments of the present application can be executed by a computer device, which can be a terminal device or a server. Terminal devices include, but are not limited to, mobile phones, computers, intelligent voice interaction devices, smart home appliances, vehicle-mounted terminals, aircraft, etc. The server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server.
[0056] In addition, the information (such as account information, etc.), data (such as palm data, etc.) and signals involved in the embodiments of this application are all authorized by the relevant objects or fully authorized by all parties, and the collection, use and processing of relevant data comply with the relevant laws, regulations and standards of relevant countries and regions.
[0057] In order to facilitate understanding of the palm-swiping service activation method provided in the embodiment of the present application, the application scenario of the palm-swiping service activation method provided in the embodiment of the present application is first exemplarily introduced below.
[0058] See Figure 1, which is a schematic diagram of an application scenario of the palm-swiping service activation method provided in an embodiment of the present application. As shown in Figure 1, the application scenario includes a terminal 110, a server 120, and a palm-swiping device 130. The terminal 110 and the server 120 can communicate via a network, and the palm-swiping device 130 and the server 120 can also communicate via a network.
[0059] Among them, the terminal 110 is the personal terminal of the object, in which the target application associated with the palm-swiping service is running, such as a payment application that supports the registration account to activate the palm-swiping payment service; the terminal 110 is used to execute the terminal-side palm-swiping service activation method provided in the embodiment of the present application. The server 120 is used to execute the server-side palm-swiping service activation method provided in the embodiment of the present application to activate and provide the palm-swiping service for the user of the target application. The palm-swiping device 130 is an offline device dedicated to collecting palm data. The server 120 needs to activate and provide the palm-swiping service for the user of the target application based on the palm data collected by the palm-swiping device 130.
[0060] In actual applications, the subject can trigger a pre-activation operation for the palm swiping service through a target application running on the terminal 110. In response to the pre-activation operation, the terminal 110 will display a palm entry interface through the target application, and the palm entry interface will display an image captured by the camera of the terminal 110. When the palm information of the subject in the image is detected and determined to meet the palm entry conditions, the terminal 110 can notify the server to record the palm pre-entry data corresponding to the target account currently logged in on the target application. The palm pre-entry data can be determined based on the above image. For example, the terminal 110 can send a notification message carrying the palm pre-entry data determined based on the image to the server 120, thereby notifying the server 120 to record the correspondence between the target account logged in on the target application in the terminal 110 and the palm pre-entry data.
[0061] After receiving the notification from the terminal 110 , the server 120 may record the target account and its corresponding palm pre-recording data into the pre-recording database, thereby completing the palm pre-recording operation for the target account.
[0062] Afterwards, the subject can go to the offline palm-swiping device 130 and swipe their palm with the palm-swiping device 130, so that the palm-swiping device 130 collects the subject's palm data and transmits the palm data to the server 120 via the network. After obtaining the palm data, the server 120 can check in the pre-entry database whether there is target palm pre-entry data that matches the palm data. If the target palm pre-entry data is detected, it means that the subject currently swiping their palm with the palm-swiping device 130 has previously completed the palm pre-entry operation. At this time, the target account corresponding to the target palm pre-entry data can be determined, and a corresponding relationship between the target account and the palm data collected by the palm-swiping device 130 can be established and stored, thereby completing the palm-swiping service activation operation for the target account.
[0063] It should be understood that since the palm-swiping device 130 is usually equipped with an image acquisition device with better performance, such as an RGB (Red Green Blue) image acquisition camera and an infrared camera, the palm data collected by the palm-swiping device 130 is more reliable than the pre-entered palm data collected by the terminal 110. Accordingly, the correspondence between the target account and the palm data is recorded in the background, and the palm-swiping service is provided to the object accordingly, which can ensure the reliability of the palm-swiping service.
[0064] During the aforementioned palm-swiping service activation process, the user can conveniently pre-enter their palm data using their personal terminal 110. When they use the palm-swiping device 130 offline, the palm-swiping service activation can be completed without them noticing, without requiring extensive offline interaction with the palm-swiping device 130. This highly efficient palm-swiping service activation provides a good user experience and does not affect other users' use of the palm-swiping device 130. Furthermore, since the palm-swiping service activation process does not require the palm-swiping device 130 to display special content, it reduces display requirements for the palm-swiping device, thereby reducing device deployment and maintenance costs.
[0065] It should be understood that the application scenario shown in Figure 1 is only an example. In actual applications, the palm-swiping service activation method provided in the embodiment of the present application can also be applied to other scenarios. No limitation is made to the application scenario of the palm-swiping service activation method provided in the embodiment of the present application.
[0066] The following is a detailed introduction to the palm-swiping service activation method provided by this application through a method embodiment.
[0067] Refer to Figure 2, which is a flow chart of a method for activating a palm-swipe service provided by an embodiment of the present application. The palm-swipe service activation method can be executed by a terminal or by a terminal and a server in collaboration. As shown in Figure 2, the palm-swipe service activation method includes the following steps:
[0068] Step 201: In response to a pre-activation operation for a palm-swiping service, a palm entry interface is displayed through a target application running in a terminal; a target account is logged into the target application.
[0069] In an embodiment of the present application, the terminal can respond to the pre-activation operation triggered by the object for the palm swiping service, and display the palm entry interface through the target application running therein, so as to interact with the object through the palm entry interface and pre-enter the palm data of the object.
[0070] The terminal is a terminal device for personal objects, such as a smartphone, tablet computer, smart wearable device, etc. for personal use; in this application, the personal object oriented by the target terminal is referred to as the target object. A target application is running in the terminal, and the target application can be any application associated with the palm-swiping service; for example, the target application can be an application with a payment function, and supports the user to activate and use the palm-swiping payment service. When the user uses the palm-swiping payment service offline, the money can be automatically deducted from the user's account on the target application. In this application, the account currently logged in on the target application running in the terminal is referred to as the target account.
[0071] The palm-swiping service can be any service based on palm data, such as a palm-swiping payment service, a palm-swiping check-in service, a palm-swiping identity recognition service, a palm-swiping ride service, a palm-swiping resource borrowing service, etc. The embodiments of this application do not impose any restrictions on the specific service content of the palm-swiping service. The pre-activation operation of the palm-swiping service refers to the operation of activating the palm-swiping service triggered by a personal terminal. Since the operation of activating the palm-swiping service triggered by a personal terminal cannot complete the activation of the palm-swiping service, it is only a link in the process of activating the palm-swiping service. Therefore, the operation of activating the palm-swiping service triggered by a personal terminal is called the pre-activation operation of the palm-swiping service; if the activation of the palm-swiping service is to be truly completed, the relevant objects are required to go to the offline palm-swiping device to complete the more reliable entry of palm data.
[0072] As an example, the object can trigger the pre-activation operation for the palm-swiping service in the following ways: the object can use the scanning function provided by the target application running in the terminal to scan the QR code used to trigger the activation of the palm-swiping service, thereby triggering the pre-activation operation for the palm-swiping service. Alternatively, the object can search for the activation entrance of the palm-swiping service in the target application, and then trigger the pre-activation operation for the palm-swiping service by clicking on the activation entrance; for example, the object can search for the mini-program that provides the palm-swiping service in the target application, and then trigger the pre-activation operation for the palm-swiping service through the activation entrance of the palm-swiping service provided by the mini-program. Alternatively, a palm-swiping service promotion link can be displayed on a specific page of the target application (such as a payment voucher page, a payment code payment page, a payment result page, a public account page, a mini-program page, etc.), and the object can trigger the display of an introduction page for the palm-swiping service by clicking on the palm-swiping service promotion link, and the activation entrance for the palm-swiping service can be deployed on the introduction page, and the object can trigger the pre-activation operation for the palm-swiping service by clicking on the activation entrance.
[0073] It should be understood that the above-mentioned pre-activation operation method for the palm-swiping service is only an example. In actual applications, other pre-activation operation triggering methods can also be set according to actual business needs. The embodiment of this application does not impose any limitation on the triggering method of the pre-activation operation.
[0074] The palm entry interface is the interface displayed by the target application in response to the pre-activation operation for the palm swiping service. The palm entry interface is used to collect the palm data of the object by interacting with the object; that is, relevant prompt information can be displayed in the palm entry interface to instruct the object to place his or her palm in a specific data collection area and in a specific state, so as to facilitate the terminal to collect the palm data of the object.
[0075] Step 202: Displaying an image captured by the camera of the terminal in the palm entry interface.
[0076] The palm input interface displayed by the target application displays an image captured by the terminal's camera. It should be understood that the terminal's camera can be a camera component integrated into the terminal or an external camera component. The image captured by the terminal's camera and displayed in the palm input interface is also referred to as the base image.
[0077] In an embodiment of the present application, to complete the pre-activation operation of the palm swiping service, it is necessary to capture an image including the subject's palm through the terminal. To facilitate the subject's palm entry, that is, to facilitate the terminal to accurately capture an image including the subject's palm, the image captured by the terminal's camera can be visually displayed in the palm entry interface. This allows the subject to know the image currently captured by the terminal's camera, and allows the subject to specifically place their palm within the image capture area of the terminal's camera to facilitate the terminal to capture an image including the subject's palm.
[0078] In addition, in order to ensure that the palm pre-entered data collected through the pre-activation operation of the palm swiping service can be accurately matched with the palm data collected by the palm swiping device in the future, it is also necessary to set the palm entry conditions, that is, only when the palm information in the image captured by the terminal camera meets the palm entry conditions, can the background recording of the corresponding palm pre-entered data be triggered. The palm entry conditions can specify a standard palm placement state, that is, only when the palm in the image meets the palm placement state can the subsequent data entry process be executed; in addition, the palm entry conditions can also specify a liveness detection condition, that is, only when the palm in the basic image is detected as a live palm (that is, the palm of a living person object) can the subsequent data entry process be executed.
[0079] In one possible implementation, in order to facilitate the subject to efficiently complete the pre-entry of palm data through the terminal, the method provided in the embodiment of the present application further includes:
[0080] A prompt message is displayed in the palm entry interface; the prompt message is used to indicate the action that the palm should perform in order to meet the palm entry conditions.
[0081] That is, the terminal can further display prompt information in the palm entry interface, and the prompt information is used to help the subject to make the palm information in the image meet the palm entry conditions. The prompt information can specifically indicate the action that the subject needs to control his palm to perform, such as controlling his palm to be placed in a specific position, controlling his palm to adjust to a specific state, controlling his palm to perform a specific action, etc.
[0082] In this way, by displaying prompt information in the palm entry interface, the subject can be helped to control his palm more quickly to reach the state specified by the palm entry conditions, so that the palm information in the image meets the palm entry conditions, thereby improving the palm data pre-entry efficiency on the terminal side.
[0083] As an example, when the image captured by the camera does not include the palm, position prompt information may be displayed in the palm entry interface; the position prompt information is used to indicate the position of the palm relative to the terminal.
[0084] Specifically, the terminal can detect whether the image currently captured by the camera includes a palm. If the detection determines that the image does not include a palm, a position prompt is displayed on the palm entry interface to prompt the target user to place their palm within the camera's image capture area. To facilitate the user's determination of the specific palm placement, the position prompt can indicate the palm's position relative to the terminal, allowing the user to accurately place their palm within the camera's image capture area using the terminal as a reference.
[0085] Figure 3 is a schematic diagram of an exemplary palm entry interface provided in an embodiment of the present application. As shown in Figure 3, the image displayed in the palm entry interface does not include the palm, which means that the subject's palm is not currently within the image acquisition area of the terminal's camera. At this time, a position prompt message "Please place your commonly used palm behind the phone" can be displayed in the palm entry interface to achieve the purpose of prompting the subject to place his or her palm within the image acquisition area of the camera and making the image acquired by the camera include the subject's palm.
[0086] As another example, when the image captured by the camera includes a palm, but the current placement state of the palm does not match the standard placement state, adjustment prompt information can be displayed in the palm entry interface; the adjustment prompt information is used to indicate the action that the palm should perform from the current placement state to the standard placement state.
[0087] That is, when the terminal determines that the image currently captured by the camera includes a palm, it can further detect the placement of the palm in the image to determine whether the current placement of the palm matches the standard placement. The standard placement here can be pre-set, for example, a standard distance range can be set for the distance between the palm and the camera, a standard angle range can be set for the palm's placement angle, and so on. It should be understood that the palm placement meeting this standard placement is a prerequisite for the palm information in the image to meet the palm entry conditions.
[0088] If the detection determines that the current palm placement state does not match the standard placement state, an adjustment prompt will be displayed in the palm input interface to prompt the subject to adjust the palm placement state. To facilitate the subject's understanding of the specific adjustment method, the adjustment prompt can indicate the palm's action to be performed from its current placement state to the standard placement state. In other words, the adjustment prompt is automatically designed based on the difference between the current palm placement state and the standard placement state, helping the subject to more quickly control the palm to reach the standard placement state.
[0089] FIG4 is a schematic diagram of another exemplary palm entry interface provided in an embodiment of the present application. As shown in FIG4 (a), the image displayed in the palm entry interface includes a palm, but the current placement state of the palm does not conform to the standard placement state (such as the angle of the palm in the image should be within a specific angle range). In this case, an adjustment prompt message "Please straighten your palm" can be displayed in the palm entry interface to prompt the subject to adjust the placement angle of the palm. As shown in FIG4 (b), the image displayed in the palm entry interface includes a palm, but the current placement state of the palm does not conform to the standard placement state (such as the palm of the hand facing the camera). In this case, an adjustment prompt message "Please open your palm and face the camera" can be displayed in the palm entry interface to prompt the subject to adjust the placement posture of the palm.
[0090] Furthermore, in order to facilitate the subject to adjust the placement state of his palm to the standard placement state more quickly and accurately, the terminal can display the first reference identifier corresponding to the standard placement state and the second reference identifier corresponding to the current placement state in the palm entry interface; then, based on the relationship between the first reference identifier and the second reference identifier, adjustment prompt information is displayed; the adjustment prompt information is used to indicate the action that the palm should perform in order to adjust the second reference identifier to match the first reference identifier.
[0091] That is, the terminal can display a first reference identifier for indicating the standard placement state and a second reference identifier for indicating the current placement state of the subject's palm in the palm entry interface. The subject can intuitively know the difference between the current placement state of its palm and the required standard placement state through the above-mentioned first reference identifier and second reference identifier. In order to make the object more clear about the adjustment method for the palm, adjustment prompt information can also be displayed based on the relationship between the first reference identifier and the second reference identifier. For example, an arrow indicator mark (such as indicating the movement direction, rotation direction, etc. of the palm) and text indicator information (such as indicating that the palm is close to the camera, away from the camera, etc.) for indicating that the second reference identifier is matched with the first reference identifier are displayed.
[0092] Figure 5 is a schematic diagram of another exemplary palm input interface provided by an embodiment of the present application. As shown in Figures 5(a) to (d), the palm input interface displays a first reference marker 500 with a blank background corresponding to the standard placement state, and also displays a second reference marker 501 with a blank background corresponding to the current placement state (Figure (a)), a second reference marker 502 (Figure (b)), a second reference marker 503 (Figure (c)), and a second reference marker 504 (Figure (d)).
[0093] In Figure (a), there is a positional deviation between second reference marker 501 and first reference marker 500. In this case, an arrow-shaped adjustment prompt is displayed in the palm input interface, instructing the subject to control the palm to move in the direction indicated by the arrow. Specifically, the arrow can be an arrow with the center of the second reference marker 501 pointing to the center of the first reference marker 500.
[0094] In Figure (b), the area of the second reference marker 502 is smaller than the area of the first reference marker 500, indicating that the current placement of the palm is too far from the camera. At this time, a text-based adjustment prompt message "Pull your palm close to the camera, align the gray circle with the standard ring" is displayed in the palm input interface to instruct the subject to control the palm to move closer to the camera. The diameter of the above-mentioned second reference marker 502 can be determined based on the current distance from the palm to the camera and the distance from the standard placement position to the camera. Specifically, the ratio between the current distance from the palm to the camera and the distance from the standard placement position to the camera can be calculated, and the ratio can be multiplied by the focal length of the camera to calculate the diameter of the second reference marker 502; alternatively, the coverage area ratio of the palm in the base image in the first reference marker 500 can be calculated, and the diameter of the second reference marker 502 can be calculated based on the ratio and the diameter of the first reference marker 500.
[0095] In Figure (c), the area of second reference marker 503 is larger than that of first reference marker 500, indicating that the palm is currently positioned too close to the camera. In this case, a textual adjustment prompt, "Move your palm away from the camera. Align the gray circle with the standard ring," is displayed on the palm entry interface to instruct the user to control the palm's movement away from the camera. Furthermore, when the palm's current position is too close to the camera, the background color of second reference marker 503 can be changed to be different from the background color of second reference marker 502, making it easier to distinguish whether the palm needs to be moved closer to or away from the camera.
[0096] In Figure (d), second reference marker 504 matches first reference marker 500, but the palm's placement angle in the image does not conform to the standard placement angle. In this case, an arrow-shaped adjustment prompt is displayed on the palm input interface, instructing the subject to rotate the palm in the direction indicated by the arrow. The rotation direction indicated by the arrow can be determined based on the relative relationship between the current palm placement angle and the standard placement angle.
[0097] In this way, through the first reference identifier for indicating the standard placement state and the second reference identifier for indicating the current placement state, the subject can more intuitively know the difference between the current placement state of his palm and the required standard placement state, so that the placement state of the palm can be more accurately adjusted according to the gap between the second reference identifier and the first reference identifier, so that the palm placement state in the image reaches the required standard placement state more quickly, thereby improving the efficiency of palm data pre-entry.
[0098] As another example, when the image includes a palm and the current placement state of the palm matches the standard placement state, verification prompt information can be displayed in the palm entry interface; the verification prompt information is used to indicate the liveness verification action that the palm should perform.
[0099] That is, when the terminal detects that the image currently captured by the camera includes a palm and the current placement state of the palm is consistent with the standard placement state, it can further perform liveness verification on the palm in the image to verify whether the palm belongs to a living object.
[0100] When performing liveness verification, the terminal can display a verification prompt in the palm entry interface, which instructs the subject to control their palm to perform a specific liveness verification action, such as instructing the subject to control their palm to make a fist. It should be understood that a non-live palm cannot perform a specific liveness verification action. For example, a palm used in an image attack (i.e., a palm displayed in an image) cannot be controlled to perform a specific hand movement. Therefore, by verifying whether the palm in the image can successfully perform the instructed liveness verification action, it can be determined whether the subject currently performing palm data pre-entry is a live object.
[0101] Figure 6 is a schematic diagram of another exemplary palm entry interface provided in an embodiment of the present application. As shown in Figure 6 (a), a verification prompt message "Please make a fist" can be displayed in the palm entry interface to instruct the subject to control the palm to perform a fist-making action; when the palm in the image is in a fist-making state, as shown in Figure 6 (b), a verification prompt message "Please keep making a fist" can be displayed in the palm entry interface to instruct the subject to continue to control the palm to perform a fist-making action; if the palm in the image continues to be in the indicated fist-making state, it can be considered that the palm entry is currently being performed by a living subject, and the liveness verification is confirmed to have passed.
[0102] In this way, by providing corresponding interactive guidance prompts to the object through the above-mentioned position prompt information, adjustment prompt information, verification prompt information and other prompt information, the object can be helped to quickly and accurately control its palm to reach the specified state, so that the palm information in the image can quickly meet the palm entry conditions, thereby improving the pre-entry efficiency of palm data.
[0103] It should be understood that the forms of prompt information shown in Figures 3 to 6 above are only examples. In actual applications, various forms of prompt information can be set according to actual needs, and the embodiments of the present application do not impose any limitations on this.
[0104] Optionally, before the image is displayed on the palm entry interface, a palm entry selection control may be displayed on the palm entry interface, so that the subject can select whether the currently entered palm is the left hand or the right hand through the palm entry selection control. This can enhance the subject's memory of the palm entered through the terminal, and avoid the subject forgetting the entered palm when completing the palm swiping service activation operation at an offline palm swiping device, resulting in failure to successfully activate the palm swiping service, or taking a long time to activate the palm swiping service.
[0105] Step 203: When it is determined that the palm information of the object in the image meets the palm entry conditions, notify the server to record the palm pre-entry data corresponding to the target account; the palm pre-entry data is determined based on the image; the server is used to activate the palm swiping service for the target account based on the palm data when it detects that the palm swiping device has collected palm data that matches the palm pre-entry data.
[0106] While capturing images through the camera, the terminal can also detect palms in the image, specifically whether the palm information of the subject in the image meets the palm entry conditions. As described above, the palm entry conditions are the fundamental conditions that trigger the backend server to record the pre-entered palm data. This means that only when the palm information in the image meets these conditions will the backend server be triggered to record the palm data collected by the terminal as pre-entered palm data. Typically, these conditions can include image quality conditions and palm liveness conditions. The image quality condition requires that the palm in the image be clearly displayed, while the palm liveness condition requires that the palm in the image be that of a living subject. The mechanism for detecting whether the palm entry conditions are met will be described in detail below and will not be elaborated on here.
[0107] When the terminal detects and determines that the palm information of the object in the image meets the palm entry conditions, it can send a notification message to the server in the background that is used to manage and provide palm swiping services, so as to notify the server to record the correspondence between the target account (that is, the account currently logged in on the target application running in the target terminal) and the palm pre-entry data, thereby completing the pre-activation of the palm swiping service for the target account; here, the palm pre-entry data corresponding to the target account can be determined based on the image collected by the terminal, and can be obtained specifically by performing palm feature extraction processing on the image that meets the image quality conditions.
[0108] For example, Figure 7 illustrates a process flow for recording pre-entered palm data on a server according to an embodiment of the present application. As shown in Figure 7, a terminal can send a notification message to the server containing a target account number and an image that meets image quality requirements. Upon receiving the notification message, the server can perform palm feature extraction on the image in the notification message to obtain the corresponding palm feature data. Furthermore, in the pre-recorded database for storing the correspondence between pre-recorded palm data and accounts, it is detected whether there is palm pre-recorded data that matches the palm feature data, and whether the account corresponding to the palm pre-recorded data is the target account; if it is detected that there is matching palm pre-recorded data, and its corresponding account is the target account, it means that the object has previously pre-activated the palm swiping service. At this time, the terminal can be directly controlled to display a prompt message of successful entry; if no matching palm pre-recorded data is detected, or the account corresponding to the detected matching palm pre-recorded data is not the target account, the palm feature data can be used as the palm pre-recorded data corresponding to the target account, and the correspondence between the palm pre-recorded data and the target account is stored in the above-mentioned pre-recorded database, and then the terminal is controlled to display a prompt message of successful entry, thereby completing the pre-activation operation of the palm swiping service for the target account.
[0109] When the subject subsequently uses an offline palm-swiping device, the palm-swiping device can collect the subject's palm data accordingly and transmit the collected palm data to the server used to manage and provide the palm-swiping service. Based on the palm data, the server can detect the previously recorded palm pre-entered data that matches the palm data. At this time, the server can confirm that the subject who has pre-activated the palm-swiping service through the terminal is currently using the palm-swiping device. Accordingly, the server can complete the corresponding palm-swiping service activation operation based on the palm data collected by the palm-swiping device, that is, use the palm data collected by the palm-swiping device to replace the previously recorded palm pre-entered data, save the correspondence between the target account and the palm data, and thus complete the palm-swiping service activation operation for the target account.
[0110] It should be understood that the terminal's camera configuration is typically low, so the pre-entered palm data determined based on images captured by the terminal's camera is often unreliable. However, palm-swiping devices are typically equipped with higher-configuration cameras, such as cameras that capture RGB images and infrared cameras. Therefore, the dual-factor palm data collected by the palm-swiping device is more reliable. The embodiments of the present application use the palm data collected by the palm-swiping device to replace the pre-entered palm data, and only then is the activation of the palm-swiping service considered complete, which can effectively ensure the reliability of the palm-swiping service.
[0111] In one possible implementation, the method provided in the embodiment of the present application may further include:
[0112] The target application displays an authentication interface for verifying the association between the object and the target account. If the association between the object and the target account is verified, the server is notified to record the pre-entered palm data corresponding to the target account.
[0113] That is, in the process of entering the pre-entered palm data corresponding to the target account through the terminal, the identity authentication interface can also be displayed through the target application to verify the association relationship between the object and the target account through the identity authentication interface, that is, to verify whether the object is the legitimate user of the target account.
[0114] In the identity authentication interface, any verification method that can verify the association between the object and the target account can be used for verification. For example, the identity authentication interface can verify the association between the object and the target account by entering a password; for example, a password input control is displayed in the identity authentication interface, and the object currently performing palm data pre-entry is required to enter the password of the target account (such as the password of the payment service), and then verify whether the entered password is consistent with the actual password of the target account. Alternatively, the identity authentication interface can also verify the association between the object and the target account by face verification; for example, a facial image of the object currently performing palm data entry is collected based on the identity authentication interface, and then verify whether the facial features in the facial image match the standard facial features corresponding to the target account (the facial features pre-entered by the legitimate user of the target account). Of course, in actual applications, other verification methods can also be used to verify the association between the object and the target account, and the embodiments of the present application do not impose any restrictions on this.
[0115] It should be understood that the identity verification interface can be displayed before the palm entry interface, that is, after the terminal receives the pre-activation operation for the palm swiping service, the identity verification interface is first displayed, and the association relationship between the object and the target account is verified through the identity verification interface; if the verification is successful, the palm entry interface is displayed to pre-enter the palm data of the object; if the verification fails, the subsequent palm data pre-entry process is not executed. Alternatively, the identity verification interface can also be displayed after the palm entry interface, that is, after the terminal collects an image that meets the image quality conditions through the palm entry interface, the identity verification interface can be displayed, and the association relationship between the object and the target account is verified through the identity verification interface; if the verification is successful, the image that meets the image quality conditions is transmitted to the server to notify the server to record the palm pre-entry data corresponding to the target account accordingly; if the verification fails, no notification message is sent to the server, and it is considered that the pre-activation operation for the palm swiping service has failed.
[0116] In this way, in the process of pre-activating the palm-swiping service through the terminal, the association between the object currently entering palm data and the target account currently logged in on the target application is verified through the identity authentication interface, which can ensure that the pre-entered palm data is the palm data of the legitimate user of the target account, thereby ensuring the security of the palm-swiping service.
[0117] In one possible implementation, the method provided in the embodiment of the present application may further include:
[0118] Display the palm-swiping device prompt information; the palm-swiping device prompt information is used to indicate the device usage conditions that should be met when activating the palm-swiping service for the target account based on the pre-entered palm data. The device usage conditions are used to indicate at least one of the geographical location range or usage time range corresponding to the palm-swiping device to be used.
[0119] That is, in the palm-swiping service activation mechanism provided in the embodiments of the present application, if the palm-swiping service activation operation is to be completed based on the pre-entered palm data entered through the terminal, the subject is required to go to an offline palm-swiping device to complete the collection of higher-quality palm data. On this basis, the embodiments of the present application can further specify device usage conditions, that is, if the subject wants to complete the palm-swiping service activation for the target account based on the previously entered pre-entered palm data, it needs to use the offline palm-swiping device in accordance with the device usage conditions; that is, the backend server will only complete the palm-swiping service activation for the target account based on the palm data collected by the palm-swiping device if it detects that the subject's use of the palm-swiping device meets the device usage conditions.
[0120] Specifically, the device usage conditions may indicate at least one of the geographical location range or usage time range corresponding to the palm-swiping device to be used. For example, the displayed palm-swiping device prompt information may be "Within 24 hours, the offline palm-swiping device senses the recorded palm and officially activates this service", thereby limiting the object to complete the activation of the palm-swiping service for the target account, and it is necessary to go to the offline palm-swiping device to enter the palm data within 24 hours; or, the displayed palm-swiping device prompt information may also be "Within 24 hours, the palm-swiping device in the XX store senses the recorded palm and officially activates this service", thereby limiting the object to complete the activation of the palm-swiping service for the target account, and it is necessary to go to the palm-swiping device in a specific store to enter the palm data within 24 hours. Of course, the above-mentioned geographical location range and usage time range are only examples, and they can be set according to actual business needs. The embodiments of this application do not impose any restrictions on this.
[0121] It should be understood that in actual applications, the above-mentioned palm-swiping device prompt information can be displayed through a separate prompt interface; for example, in response to the pre-activation operation of the palm-swiping service triggered by the response object, a prompt interface can be first displayed to prompt the object that it is currently pre-entering the palm to activate the palm-swiping service, and the above-mentioned palm-swiping device prompt information is displayed in the prompt interface. Alternatively, the above-mentioned palm-swiping device prompt information can also be displayed directly in the palm entry interface. The embodiment of the present application does not impose any restrictions on the display location and display method of the palm-swiping device prompt information.
[0122] In this way, the device usage conditions that need to be met when activating the palm-swiping service for the target account are further set. The device usage conditions are used to limit the object to using the palm-swiping device to enter palm data within a specific geographical location range and / or usage time range, thereby completing the activation of the palm-swiping service for the target account. This can further improve the activation requirements of the palm-swiping service, thereby improving the security of activating the palm-swiping service. And by specifying the usage time range through the device usage conditions, it is equivalent to setting a storage time for the background server for the pre-entered palm data. If the object does not go to the offline palm-swiping device to enter palm data within the usage time range, the server can consider the pre-entered palm data previously entered through the terminal to be invalid and clean it up, thereby achieving the timely release of storage space and rational use of storage resources.
[0123] In one possible implementation, the method provided in the embodiment of the present application may further include:
[0124] Display a trigger gesture entry prompt; the trigger gesture entry prompt is used to prompt the user to enter a trigger gesture, which is a gesture used to instruct the server to complete the palm swiping service activation operation. The target trigger gesture made by the subject is collected through the palm entry interface.
[0125] That is, in the palm-swiping service activation mechanism provided in the embodiment of the present application, it is also possible to support the object's customized target trigger gesture. For example, after the terminal determines that the palm information in the image meets the palm entry conditions and collects an image that meets the image quality conditions, it can display a trigger gesture entry prompt in the palm entry interface, such as displaying "Please make a customized trigger gesture in front of the camera, and make the trigger gesture again when using the offline palm-swiping device to complete the palm-swiping service activation"; accordingly, the object can make a customized target trigger gesture in the image collection area of the camera, and the palm entry interface will also display the image collected by the camera including the target trigger gesture; the object can confirm the target trigger gesture displayed in the palm entry interface, thereby completing the definition of the target trigger gesture.
[0126] When the subject goes to an offline palm-scanning device to activate the palm-scanning service for the target account, they can make their previously customized target trigger gesture within the image capture area of the palm-scanning device. Based on the palm data collected by the palm-scanning device, the server detects the target trigger gesture and assumes that the subject has previously completed the palm-scanning service pre-activation operation through the terminal. At this time, the server can directly use the palm data collected by the palm-scanning device to search for matching pre-entered palm data to complete the palm-scanning service activation for the corresponding account.
[0127] It should be understood that in actual applications, a specific trigger gesture can also be directly specified without the need for customization by the target object. For example, the terminal can directly display trigger gesture prompt information, indicate a specific trigger gesture through the trigger gesture prompt information, and prompt the object to make the trigger gesture when using the palm-swiping device for the first time offline to complete the activation of the palm-swiping service.
[0128] In this way, by setting a trigger gesture, such as customizing a trigger gesture by an object, or specifying a specific trigger gesture, the background server can more quickly learn that the palm-swiping service activation process needs to be executed. That is, the server can directly execute the corresponding palm-swiping service activation process based on the detected trigger gesture, without having to determine whether the palm-swiping service needs to be provided or the palm-swiping service needs to be activated, thereby improving the activation efficiency of the palm-swiping service.
[0129] The palm-swiping service activation method provided in the embodiment of the present application innovatively proposes a mechanism for pre-activating the palm-swiping service through a personal terminal. In this method, the subject can pre-enter palm data through the target application in the terminal in advance, so that the server can preliminarily record the correspondence between the target account currently logged in on the target application and the palm pre-entered data collected by the terminal. When the subject uses the palm-swiping device offline, the server can automatically determine and record the correspondence between the palm data collected by the palm-swiping device and the target account based on the matching relationship between the palm data collected by the palm-swiping device and the pre-recorded palm pre-entered data, as well as the correspondence between the palm pre-entered data and the target account, thereby completing the palm-swiping service activation operation for the target account. For the subject, it can conveniently pre-enter palm data through a personal terminal in advance. When using the palm-swiping device, the palm-swiping service activation can be completed without perception, without the need for excessive offline interaction with the palm-swiping device. The palm-swiping service activation efficiency is high, the experience is good, and it will not affect other subjects' use of the palm-swiping device. Furthermore, since the palm-swiping service activation process does not require the palm-swiping device to display special content, the display requirements for the palm-swiping device can be reduced, and the deployment and maintenance costs of the device can be reduced accordingly.
[0130] In order to facilitate further understanding of the above-mentioned terminal-side palm-swiping service activation method, the following takes the activation of the palm-swiping payment service as an example, combined with the terminal-side interface diagram during the palm-swiping service pre-activation process shown in Figure 8, to provide an overall exemplary introduction to the terminal-side palm-swiping service activation method.
[0131] As shown in FIG8 , a subject can use the code scanning function provided by the target application running on the terminal to scan a QR code 810 used to trigger the activation of the palm-swipe payment service. This QR code 810 can be deployed on a promotional poster in a store, for example. After the terminal successfully scans and identifies QR code 810, a prompt interface 820 can be displayed. This prompt interface 820 may include information about the palm-swipe payment service and the activation steps for the palm-swipe payment service. The activation steps may specifically include "Enter your palm on your phone" and a palm-swipe device prompt message "Within 24 hours, an offline palm-swipe device will sense the entered palm to officially activate this service." The subject can trigger the pre-activation operation for the palm-swipe service by clicking the "Enter Palm" control in prompt interface 820.
[0132] In response to the object's click operation on the "Enter Palm" control, the terminal can display a palm entry interface 830 through the target application, and display the image captured by the terminal's camera in the palm entry interface 830; in the palm entry interface 830, corresponding prompt information can be displayed according to the object's current palm state to prompt the object to control the palm to be in the desired state.
[0133] The terminal detects whether the palm information in the image captured by the camera meets the palm entry conditions. If the palm information is detected to meet the palm entry conditions, the identity authentication interface 840 can be displayed. In the identity authentication interface 840, the subject is required to enter the payment password of the target account currently logged in on the target application to verify the association between the subject and the target account. If the verification is successful, the terminal can display the entry result interface 850. The entry result interface 850 includes a pre-entry success prompt message to prompt the subject that the server has notified the server to record the palm pre-entry data corresponding to the target account; the entry result interface 850 also includes a palm swiping device prompt message to remind the subject again to complete the activation of the palm swiping service for the target account, and to go to the offline palm swiping device within a specific time to enter higher quality palm data.
[0134] Next, the detection mechanism for determining whether the palm information of the object in the image meets the palm entry conditions is introduced in detail. As described above, the palm entry conditions in the embodiment of the present application may include image quality conditions and palm liveness conditions; the image quality conditions can be used to control the quality of the recorded palm pre-entry data, that is, the image quality conditions can be used to screen out images with higher quality of palm feature information, and the palm pre-entry data is determined based on this image, which can ensure that the palm pre-entry data has higher quality, making it convenient to complete the activation of the palm swiping service by matching the palm data collected by the palm swiping device based on this. The palm liveness condition can be used to judge whether the palm in the currently collected image is alive, thereby preventing criminals from using non-living palms to attack, that is, to ensure that the recorded palm pre-entry data corresponds to a living palm.
[0135] In practical applications, the image quality condition detection and the palm liveness condition detection can be performed in stages for the image. Figure 9 is a schematic diagram of the palm entry condition detection provided by the embodiment of the present application. As shown in Figure 9, the image quality condition detection can be performed in the first stage to detect whether the palm information in the image collected by the terminal in the first stage meets the image quality condition, thereby obtaining an image that meets the image quality condition. The image can be used as the basis for the server to determine the palm pre-entry data in the future; then, the palm liveness condition detection can be performed in the second stage to detect whether the palm in the image collected by the terminal in the second stage is a live palm. If the palm is determined to be a live palm, the image that meets the image quality condition obtained in the first stage can be transmitted to the server to enable the server to complete the entry of the palm pre-entry data.
[0136] It should be noted that during the first and second phases, if the hand is detected to have left the scene based on the image captured by the terminal, the system returns to the initial state and re-executes the first and second phases from this initial state to sequentially identify images that meet the image quality requirements and detect whether the hand in the image is live. In other words, once the hand is detected to have left the scene, the image quality and liveness checks are re-executed to prevent attacks by non-live hands during this process.
[0137] The following will introduce in detail the detection mechanism of image quality conditions and the detection mechanism of palm liveness conditions.
[0138] When detecting image quality conditions, the quality evaluation results of each of the multiple frames of images taken by the terminal's camera can be determined based on the reference indicator information corresponding to each of the multiple frames of images; and based on the quality evaluation results of each of the multiple frames of images, it can be determined whether the palm information of the object in the image meets the image quality conditions.
[0139] That is, for the multiple frames of images captured by the terminal's camera in the first phase, reference indicator information corresponding to each of these frames can be determined. This reference indicator information is indicator information that can measure whether the image meets the image quality condition, and can include, for example, information related to the palm in the image, image quality information of the image itself, etc. A preset quality evaluation mechanism can then be used to perform quality evaluations on the multiple frames of images captured by the camera based on the reference indicator information corresponding to each of these frames, thereby obtaining quality evaluation results corresponding to each of these frames of images. Furthermore, based on the quality evaluation results corresponding to each of the multiple frames of images and the reference quality evaluation results indicated by the image quality condition (satisfaction of this reference quality evaluation result indicates that the image quality condition is satisfied), it can be determined whether there is an image whose corresponding quality evaluation result meets the reference quality evaluation result. If so, the image whose corresponding quality evaluation result meets the reference quality evaluation result is considered to meet the image quality condition, thus confirming that the palm information of the object in the image meets the image quality condition.
[0140] In one possible implementation, the image quality evaluation result may be determined in the following manner:
[0141] For each frame of image, the quality evaluation result of the image is determined based on the palm direction information, palm movement speed information, positional relationship information between the palm and the reference boundary, or at least one reference indicator information in the image quality information of the image.
[0142] Palm orientation information refers to the orientation of the palm in the image. Specifically, it can be the angle between the line connecting two specific key points on the palm and the image's x-axis, or the angle between the line connecting two specific key points on the palm and the image's y-axis. It should be understood that the orientation of the palm in the image can, to a certain extent, determine whether the subsequent palm feature extraction algorithm can accurately extract palm feature data from the image. Therefore, when evaluating the quality of the base image, the palm orientation information in the image can be used as a reference.
[0143] Palm movement speed information refers to the speed of the palm's movement within an image. This information can be calculated based on the change in the palm's position in the image relative to the position of the palm in the adjacent frame, as well as the sampling interval between the two frames. It should be understood that in practical applications, excessive palm movement will result in blurred camera sampling, which in turn will cause the palm to appear blurred in the image. This blurred palm display will affect the subsequent extraction of palm feature data, making it difficult to accurately extract palm feature data. Therefore, when evaluating image quality, the palm movement speed information in the image can be used as a reference.
[0144] The positional relationship information between the palm and the reference boundary is used to characterize whether the palm is completely within the preset reference boundary. For example, Figure 10 is a schematic diagram of determining the positional relationship between the palm and the reference boundary provided by an embodiment of the present application. As shown in Figure 10, frame 1001 is the image frame size, frame 1002 is the preset reference boundary, and frame 1003 indicates the area where the palm is currently located in the image; detecting the positional relationship between the palm and the reference boundary is essentially detecting whether frame 1003 is completely located within frame 1002. It should be understood that whether the palm is in the central area of the image can, to a certain extent, determine whether the subsequent palm feature extraction algorithm can accurately extract palm feature data from the image. Therefore, when evaluating the quality of an image, the palm direction information in the image can be used as a reference for evaluation.
[0145] Image quality information refers to the image quality of the image itself, such as image quality reflected by indicators such as image clarity, resolution, mean square error, and peak signal-to-noise ratio. In embodiments of the present application, image quality can be evaluated using an image quality evaluation algorithm or model. It should be understood that the image quality of an image determines the display quality of the palm. If the image quality is low, the display quality of the palm will also be low. Therefore, when evaluating the quality of an image, the image quality information of the image can be used as a reference.
[0146] It should be noted that when specifically determining the quality evaluation result of an image, reference can be made to at least one of the above-mentioned palm direction information, palm movement speed information, positional relationship information between the palm and the reference boundary, and image quality information of the image; preferably, the above-mentioned palm direction information, palm movement speed information, positional relationship information between the palm and the reference boundary, and image quality information of the image can be simultaneously referred to to evaluate the image, so as to more comprehensively determine the quality evaluation result of the image from multiple angles.
[0147] For example, when simultaneously referencing palm direction information, palm movement speed information, information about the positional relationship between the palm and the reference boundary, and image quality information to evaluate an image, a corresponding direction scoring mechanism can be pre-set for the palm direction information, a corresponding movement speed scoring mechanism can be pre-set for the palm movement speed information, a position scoring mechanism can be pre-set for the positional relationship between the palm and the reference boundary, and an image quality scoring mechanism can be pre-set for the image quality information. Accordingly, the above-mentioned scoring mechanism can be used to determine the palm direction score, movement speed score, position score, and image quality score corresponding to the image based on the actual palm direction information, palm movement speed information, information about the positional relationship between the palm and the reference boundary, and image quality information in the image, and these scores can be weighted and summed according to a preset weighting mechanism to obtain an overall quality score corresponding to the image as the quality evaluation result of the image.
[0148] In this way, through the above method, the image can be evaluated from at least one angle of the palm direction, palm movement speed, palm position in the image, and image quality of the image itself to determine whether the image meets the image quality conditions and whether it is suitable as a basis for extracting pre-entered palm data, providing a reliable mechanism for evaluating images.
[0149] As an example, the palm direction information in the above image can be determined in the following way:
[0150] Determine palm positioning information in the image through a depth detection algorithm; determine position information of a first key point in the image based on the palm positioning information; and determine palm direction information in the image based on the position information of the first key point in the image.
[0151] Specifically, a depth detection algorithm may be first used to detect and locate the palm in the image. For example, a YOLO (You Only Look Once) target detection algorithm or an SSD (Single Shot MultiBox Detector) target detection algorithm may be used to detect the palm in the image, determine whether the palm exists in the image, and, if the palm exists, determine the coordinate information of the center and boundary of the palm in the image.
[0152] Then, palm registration can be performed to determine the position information of the first key point in the image based on the previously obtained palm positioning information. The first key point here can be specifically referred to as points 1101, 1102, 1103, and 1104 in Figure 11, that is, the four finger joints can be used as the first key point. Specifically, the first key point in the above image can be determined using the DeepPose algorithm.
[0153] Furthermore, the palm direction information in the image can be determined based on the position information of the above-mentioned first key points. Figure 12 is a schematic diagram of determining the palm direction information provided by an embodiment of the present application. As shown in Figure 12, two first key points can be selected from the four determined first key points to determine the palm direction information, such as selecting point 1102 and point 1104 to determine the palm direction information; when determining the palm direction information, the angle between the line connecting the two selected first key points and the x-axis of the image can be calculated, and the angle can be used as the palm direction information. When specifically calculating, it can be calculated using the following formula:
[0154] Among them, θ is the palm direction information, v 13 is the distance between the two first key points, v x is the distance between the projection points of the two first key points on the x-axis.
[0155] As an example, the palm movement speed information in the above image can be determined in the following manner:
[0156] The palm positioning information in the image is determined by a depth detection algorithm; based on the palm positioning information, the position information of the first key point in the image is determined; and the palm movement speed information is determined according to the position information of the first key point in the image and the position information of the first key point in the image of the adjacent frame.
[0157] Specifically, the method for determining the position information of the first key points in the image has been described in detail above and will not be repeated here. After determining the position information of the four first key points in the image, the palm movement speed information in the image can be determined based on the position change of the four first key points in the image relative to the four first key points in the previous frame of the image; specifically, the corresponding movement speed of each first key point can be calculated using the following formula:
[0158] Where v is the moving speed corresponding to a single first key point, x1 and x2 are the horizontal coordinates of the first key point in the image of the current frame and the image of the previous frame, y1 and y2 are the vertical coordinates of the first key point in the image of the current frame and the image of the previous frame, and t is the time interval between the image of the current frame and the image of the previous frame.
[0159] After the movement speeds corresponding to the four first key points are calculated in the above manner, the movement speeds corresponding to the four first key points can be averaged, and the obtained average speed is used as the palm movement speed information in the image.
[0160] It should be understood that when it is necessary to determine the quality evaluation result of an image based on palm direction information and palm movement speed information, the detection processing of the first key point of the image can be performed only once, and then the palm direction information and palm movement speed information can be determined based on the detected first key point.
[0161] In this way, through the above method, a depth detection algorithm is used to detect the palm in the image, and then the first key point on the palm is determined, and the palm direction and / or palm movement speed in the image are determined accordingly. This can ensure that the determined palm direction and / or palm movement speed is relatively accurate, which is conducive to accurate image evaluation.
[0162] As an example, the image quality information of an image may be determined in the following manner:
[0163] The image quality score of the image is determined based on the image through a palm image evaluation model; the palm image evaluation model is trained based on training palm images and their corresponding annotation scores, and the annotation scores are determined based on the differences between the training palm images and their corresponding reference palm images.
[0164] Specifically, Figure 13 is a schematic diagram of determining image quality information according to an embodiment of the present application. As shown in Figure 13, an image can be directly input into a pre-trained palm image evaluation model. The palm image evaluation model analyzes and processes the image and outputs an image quality score corresponding to the image. The image quality score is used to characterize the overall quality of the image.
[0165] It should be noted that the above-mentioned palm image evaluation model is trained based on a pre-constructed training sample set, which includes a large number of training samples. Each training sample includes a training palm image and its corresponding annotation score. The annotation score is determined based on the difference between the training palm image and its corresponding reference palm image (that is, a palm image with higher quality as a reference standard, in which the palm included is the same as the palm in its corresponding training palm image). For example, the annotation score corresponding to the training palm image can be determined based on information such as the exposure difference, distortion degree, etc. of the training palm image relative to the reference palm image.
[0166] When training the palm image evaluation model, the training palm images in the training samples can be input into the palm image evaluation model to be trained to obtain the predicted scores output by the palm image evaluation model; furthermore, a loss function can be constructed based on the difference between the predicted scores and the labeled scores in the training samples, and the model parameters of the palm image evaluation model can be adjusted based on the loss function, thereby achieving the purpose of training the palm image evaluation model.
[0167] It should be understood that the above-mentioned palm image evaluation model can be any neural network model that can analyze and process images, such as a neural network model for evaluating the quality of facial images, etc. The embodiment of the present application does not impose any limitation on the model structure of the palm image evaluation model.
[0168] In this way, the overall image quality of the image is determined by a pre-trained palm image evaluation model. Since the palm image evaluation model usually has high robustness and can accurately evaluate palm images collected in various scenarios, the robustness of the image quality evaluation system can be improved.
[0169] As described above, when the server records the palm pre-entry data corresponding to the target account, it needs to extract palm features based on images that meet the image quality requirements and use the extracted palm feature data as the palm pre-entry data. Based on the quality evaluation results of each of the multiple frames of images obtained in the above method, the palm pre-entry data corresponding to the target account can be determined by the following method:
[0170] Based on the quality evaluation results of each of the multiple frames of images, a preferred image is determined in the multiple frames of images; and palm feature data in the preferred image is extracted as pre-entered palm data corresponding to the target account.
[0171] Specifically, if, based on the quality evaluation results of multiple frames of images, it is determined that an image satisfies a preset image quality condition, a preferred image can be determined from among the images that meet the image quality condition. For example, assuming that the image quality evaluation result is an overall quality score, the image with the highest overall quality score can be selected from among the frames of images as the preferred image. This preferred image is then sent to the server, which performs palm feature extraction on the preferred image to obtain palm feature data, which is then used as the pre-registered palm data corresponding to the target account.
[0172] In this way, the preferred image with the best quality is selected, and the server determines the palm pre-entered data corresponding to the target account based on the preferred image, which can ensure that the palm pre-entered data has a high quality, thereby helping to accurately detect the object using an offline palm-swiping device based on the palm pre-entered data and activate the palm-swiping service for it accordingly.
[0173] When detecting palm liveness conditions, a liveness detection mechanism may be used to detect whether the palm information of the object in the image meets the palm liveness conditions based on the palm information of the object in the image.
[0174] Specifically, a liveness detection mechanism can be first set up to detect whether a palm in an image is live. This liveness detection mechanism can be based on features of the image itself or based on palm movements in the image, and this embodiment of the application does not impose any limitations on this. The palm in the image is then detected based on the liveness detection mechanism to determine whether the palm is live, thereby determining whether the palm information in the image meets the palm liveness condition.
[0175] As an example, the following method can be used to detect whether the palm information in the image meets the palm liveness condition:
[0176] Determine the image features of the image in a preset color space; and determine whether the palm in the image is a living palm based on the image features using a living body discrimination model.
[0177] Specifically, considering that live and non-live hands are generally difficult to distinguish in RGB space, but have more distinct texture differences in other color spaces, such as HSV (Hue, Saturation, Value) and YCbCr, we can determine the image features in these color spaces. A pre-trained liveness discrimination model can then be used to determine whether the hand in the image is live based on these image features.
[0178] Figure 14 is a schematic diagram of live palm detection provided in an embodiment of the present application; it should be understood that for ease of display, Figure 14 takes the detected image as an example of a face image, but the image to be detected in the embodiment of the present application should be a palm image. As shown in Figure 14, for the RGB image collected by the terminal, it can be subjected to color space conversion processing to obtain corresponding Y, Cb, and Cr images, and the histogram representation corresponding to each of the Y, Cb, and Cr images can be determined. Then, the histogram representation corresponding to each of the Y, Cb, and Cr images can be spliced to obtain an overall histogram representation. Furthermore, the overall histogram representation can be input into a pre-trained support vector machine (SVM) for live discrimination, and the support vector machine is used to determine whether the palm in the base image is a live palm.
[0179] In this way, by detecting whether the palm information in the image meets the palm liveness condition in the above manner, it can be ensured that the obtained detection result has a high accuracy, and there is no need to instruct the object that triggers the palm swiping service through the terminal to perform a specific liveness verification action, thereby simplifying the palm entry process on the terminal side.
[0180] As another example, the palm information in the image can be detected as follows to determine whether it meets the palm liveness condition:
[0181] Through the gesture detection algorithm, the second key points in the image are determined, and the gesture in the image is determined based on the relative position relationship between the second key points; if the gesture in the image matches the liveness verification action instructed to be performed, the palm in the image is determined to be a live palm.
[0182] As described above, during the palm registration process using the palm registration interface, a verification prompt can be displayed to instruct the subject currently registering their palm to control their palm to perform a specific liveness verification action. Accordingly, to verify whether the action actually performed by the subject controlling their palm is consistent with the instructed liveness verification action, the above-mentioned method can be used to determine.
[0183] That is, a gesture detection algorithm, such as the MediaPipe hands algorithm, can be used to detect the second key points on the palm of the hand in the image. The second key points here can be specifically referred to as points 0 to 20 in Figure 15 . As shown in Figure 16 , based on the relative positional relationships between the twenty second key points, the hand gesture in the image can be accurately determined. Furthermore, by determining whether the hand gesture in the image is the same as the gesture corresponding to the liveness verification action, it can be determined whether the palm in the image is live. For example, assuming the liveness verification action instructed to be performed is a fist, the relative positional relationships between the twenty second key points in the image can be used to determine whether the hand gesture in the image is a fist.
[0184] In this way, through the above method, by using a gesture detection algorithm to detect the gesture in the image and judging whether the gesture is the same as the gesture indicated by the liveness verification action, it is possible to judge whether the palm in the image is a live palm. This allows for quick judgment of a live palm without the need to deploy a complex liveness detection algorithm.
[0185] It should be understood that in actual applications, the liveness detection methods provided in the above two examples can be used to detect whether the palm in the image is live; for example, liveness detection can be performed based on image features in a preset color space, and then based on whether the gesture matches the liveness verification action. Alternatively, only the liveness detection method provided in any of the examples can be used to detect whether the palm in the image is live. This embodiment of the application does not impose any limitations on this.
[0186] It should be noted that the above-mentioned operation of detecting whether the palm information in the image meets the palm entry conditions can be performed by the terminal or the server. The embodiment of the present application does not impose any limitation on the execution entity of the operation.
[0187] Refer to Figure 17, which is a flow chart of a method for activating a palm-swipe service provided in an embodiment of the present application. The palm-swipe service activation method can be executed by a server for managing and activating palm-swipe services. As shown in Figure 17, the palm-swipe service activation method includes the following steps:
[0188] Step 1701: Acquire palm data collected by a palm-swiping device.
[0189] As described above, after completing the pre-activation process for the palm-swiping service through the target application on the terminal, the user can then go to an offline palm-swiping device to officially activate the palm-swiping service. When the user uses the offline palm-swiping device, the device can collect the user's palm data accordingly. The palm-swiping device can then transmit the collected palm data to the server.
[0190] Step 1702: Detect whether there is target palm pre-entry data matching the palm data in the pre-entry database; the pre-entry database is used to store the correspondence between the palm pre-entry data and the account, the palm pre-entry data is determined based on the image captured by the terminal, the image is captured by the terminal in response to the pre-activation operation triggered for the palm swiping service, and the account corresponding to the palm pre-entry data is the account logged in on the target application running in the terminal.
[0191] Step 1703: If the target palm pre-recorded data is detected, the target account corresponding to the target palm pre-recorded data is determined, and a corresponding relationship between the target account and the palm data is established, and the palm swiping service is activated for the target account.
[0192] Since the above steps 1702 and 1703 are strongly related, the implementation of these two steps will be introduced in general below.
[0193] After the server receives the palm data transmitted by the palm-swiping device, it can check in the pre-recorded database whether there is target palm pre-recorded data that matches the palm data. If it is detected that there is target palm pre-recorded data that matches the palm data, it means that the person currently using the palm-swiping device has previously completed the pre-activation operation of the palm-swiping service through the terminal. At this time, the server can determine the target account corresponding to the detected target palm pre-recorded data in the pre-recorded database, and determine that the palm data currently collected by the palm-swiping device corresponds to the target account. Therefore, a corresponding relationship between the target account and the palm data can be established and stored, thereby completing the activation of the palm-swiping service for the target account.
[0194] It should be understood that in actual applications, the object using the palm-swiping device may also be an object that has successfully activated the palm-swiping service, and currently needs to use the palm-swiping service, and the server needs to take into account both providing the palm-swiping service and activating the palm-swiping service, and the priority of providing the palm-swiping service is higher than the priority of activating the palm-swiping service. Therefore, the server can specifically respond to the palm data transmitted by the palm-swiping device through the process shown in Figure 18 and provide it with corresponding services.
[0195] As shown in Figure 18, after receiving the palm data transmitted by the palm-swiping device, the server can first check whether there is palm data matching the palm data in the target entry database. The target entry database stores the correspondence between the palm data entered by the palm-swiping device and the account number, that is, the target entry database stores the correspondence between the account number that has activated the palm-swiping service and the palm data. It should be understood that the target entry database takes priority over the pre-entry database as the detection data source for matching palm data. That is, the server first performs a match check on the palm data transmitted by the palm-swiping device in the target entry database. If no match is detected, it then performs a match check in the pre-entry database.
[0196] If palm data matching the palm data transmitted by the palm-swiping device is detected in the target entry database, it means that the person currently using the palm-swiping device has activated the palm-swiping service and currently needs to use the palm-swiping service. Based on this, the server can provide the palm-swiping service accordingly. If palm data matching the palm data is not detected in the target entry database, it means that the person currently using the palm-swiping device has not yet successfully activated the palm-swiping service. In this case, the server can check in the pre-entry database whether there is pre-entered palm data matching the palm data.
[0197] If pre-recorded palm data matching the palm data is detected in the pre-recorded database, it means that the subject currently using the palm-swiping device has completed the pre-activation operation of the palm-swiping service through the terminal. At this time, the palm data collected by the palm-swiping device can be used to complete the activation operation of the palm-swiping service for the subject, that is, a correspondence is established between the account corresponding to the pre-recorded palm data and the palm data, and the correspondence is stored. If pre-recorded palm data matching the palm data is not detected in the pre-recorded database, it means that the subject is currently unable to use the palm-swiping device, and a palm-swiping service activation prompt message can be displayed through the palm-swiping device to prompt the subject to activate the palm-swiping service.
[0198] After establishing the correspondence between the target account and the palm data, the server can store the correspondence between the target account and the palm data in the target entry database and delete the correspondence between the target account and the target palm pre-entered data in the pre-entry database. This reduces stored redundant data and achieves efficient and reasonable utilization of storage resources.
[0199] In one possible implementation, the target palm pre-recorded data may be associated with a device usage condition that should be met when activating the palm-swiping service for the target account. The device usage condition is used to indicate at least one of a geographical location range or a usage time range corresponding to the palm-swiping device to be used. Accordingly, the method provided in the embodiment of the present application further includes:
[0200] Detect whether the palm-swiping device that collects palm data meets the above-mentioned device usage conditions; if the palm-swiping device that collects palm data meets the device usage conditions, establish a corresponding relationship between the target account and the palm data.
[0201] As introduced above, when the subject pre-activates the palm-swiping service, the device usage conditions for the subsequent formal activation of the palm-swiping service can also be specified for it. In the case where the device usage conditions are specified, the server can detect whether the palm-swiping device that uploaded the palm data meets the device usage conditions, that is, it can detect whether the palm-swiping device is located within the geographical location range specified by the device usage conditions, and / or detect whether the object's use time of the palm-swiping device is within the usage time range specified by the device usage conditions. If the detection determines that the device usage conditions are met, the server can complete the palm-swiping service activation operation for the target account, that is, establish and store the corresponding relationship between the target account and the palm data. Conversely, if the detection determines that the device usage conditions are not met, it is deemed that the palm-swiping service activation has failed.
[0202] In this way, by detecting whether the palm-swiping device that collects palm data meets the corresponding device usage conditions, the palm-swiping service activation mechanism can strengthen its defense capability against illegal attacks and improve the security of activating the palm-swiping service.
[0203] In one possible implementation, the method provided in the embodiment of the present application may further include:
[0204] The server controls the palm-swiping device to display activation verification information, which is used to indicate the triggering of the verification operation; receives the operation content corresponding to the verification operation uploaded by the palm-swiping device; and determines whether to execute the operation of establishing a corresponding relationship between the target account and the palm data based on the operation content.
[0205] Specifically, after the server detects the target palm pre-entered data that matches the palm data in the pre-entered database, it can control the palm-swiping device to display activation verification information, which is used to instruct the target object to trigger the verification operation; for example, the palm-swiping device can be controlled to display the activation verification information "Hello, please confirm to activate the palm-swiping service", and display the confirmation control and rejection control accordingly. The object can trigger the activation of the palm-swiping service by clicking the confirmation control; for another example, the palm-swiping device can be controlled to display the activation verification information "Hello, please enter the last digit of the mobile phone number bound to the target account", and display the number input control accordingly. The object can enter the last digit of the mobile phone number bound to the target account through the number input control.
[0206] After the palm-swiping device receives the verification operation triggered by the object based on the activation verification information, it can send the operation content of the verification operation to the server; for example, the operation content indicating the click operation on the confirmation control is sent to the server; for another example, the input mobile phone number is sent to the server. After receiving the operation content, the server can determine whether to activate the palm-swiping service for the target account based on the operation content; for example, assuming that the operation content indicates that the object has triggered a click operation on the confirmation control, the server can activate the palm-swiping service for the target account accordingly; for another example, assuming that the server verifies the mobile phone number carried in the operation content and confirms that the mobile phone number is the last number of the mobile phone number bound to the target account, the server can activate the palm-swiping service for the target account accordingly.
[0207] In this way, the server can further determine whether the object is confirmed to be the target account to activate the palm-swiping service, and whether the identity of the object is legal based on the verification operation triggered by the object's response to the activation verification information, thereby further improving the reliability of the palm-swiping service activation operation and avoiding the occurrence of accidental activation of the palm-swiping service or activation of the palm-swiping service by criminals.
[0208] In one possible implementation, after the server establishes a correspondence between the target account and the palm data and activates the palm swiping service for the target account, the method provided in the embodiment of the present application may further include:
[0209] Provide palm-swiping service based on the target account; control the palm-swiping device to display the service results corresponding to the palm-swiping service.
[0210] In an embodiment of the present application, after the object completes the pre-activation operation of the palm-swiping service through the terminal, it can go directly to the offline palm-swiping device to use the corresponding palm-swiping service. During the use of the palm-swiping service, the server can complete the above-mentioned process of activating the palm-swiping service for the target account based on the palm data collected by the palm-swiping device, and this process of activating the palm-swiping service for the target account can be imperceptible to the target object, that is, after the server activates the palm-swiping service for the target account, it can directly provide the palm-swiping service to the object currently using the palm-swiping device based on the target account, and control the palm-swiping device to display the service results corresponding to the palm-swiping service.
[0211] In this way, after the palm-swiping service is activated for the target account, the corresponding palm-swiping service is provided directly based on the target account, realizing seamless connection between the activation of the palm-swiping service and the provision of the palm-swiping service, which can improve the efficiency of providing the palm-swiping service while avoiding affecting other users' use of the palm-swiping device.
[0212] Taking the palm-swipe service as an example of the palm-swipe payment service, Figure 19 is a schematic diagram of the interface of the palm-swipe device side provided in an embodiment of the present application. As shown in Figure 19, after the subject completes the pre-activation operation of the palm-swipe payment service through the terminal, the subject can go to the merchant and use the palm-swipe payment service through the palm-swipe device deployed at the merchant; after the subject completes the palm-swipe operation through the palm-swipe device, the palm-swipe device interacts with the server and can display the activation verification message "Hello, please confirm to activate the palm-swipe service" on interface 1910 and display a confirmation control accordingly; if the subject clicks on the confirmation control, the server can interact with the server to directly provide the palm-swipe payment service to the subject, deduct the corresponding amount from the associated target account, complete the payment, and display interface 1920.
[0213] The palm-swiping service activation method provided in the embodiment of the present application innovatively proposes a mechanism for pre-activating the palm-swiping service through a personal terminal. In this method, the subject can pre-enter the palm data through the target application in the terminal in advance, so that the server can preliminarily record the correspondence between the target account currently logged in on the target application and the palm pre-entered data collected by the terminal. When the subject uses the palm-swiping device offline, the server can automatically determine and record the correspondence between the palm data and the target account based on the matching relationship between the palm data collected by the palm-swiping device and the pre-recorded palm pre-entered data, as well as the correspondence between the palm pre-entered data and the target account, thereby completing the palm-swiping service activation operation for the target account. For the subject, it can conveniently pre-enter the palm data through the personal terminal in advance. When using the palm-swiping device, the palm-swiping service activation can be completed without perception, without the need for excessive offline interaction with the palm-swiping device. The palm-swiping service activation efficiency is high, the experience is good, and it will not affect other subjects' use of the palm-swiping device. Furthermore, since the palm-swiping service activation process does not require the palm-swiping device to display special content, the display requirements for the palm-swiping device can be reduced, and the deployment and maintenance costs of the device can be reduced accordingly.
[0214] With respect to the palm-swiping service activation method described above, the present application also provides a corresponding palm-swiping service activation device, so that the palm-swiping service activation method can be applied and implemented in practice.
[0215] Refer to Figure 20, which is a schematic diagram of the structure of a palm-swipe service activation device 2000 corresponding to the palm-swipe service activation method shown in Figure 2 above. As shown in Figure 12, the palm-swipe service activation device 2000 includes:
[0216] Display module 2001, for displaying a palm input interface via a target application running in the terminal in response to a pre-activation operation for the palm swiping service; the target application has a target account logged in;
[0217] The display module 2001 is further configured to display an image captured by the camera of the terminal in the palm entry interface;
[0218] Notification module 2002 is used to notify the server to record the palm pre-entry data corresponding to the target account when it is determined that the palm information of the target object in the image meets the palm entry conditions; the palm pre-entry data is determined based on the image; the server is used to activate the palm swiping service for the target account based on the palm data when it detects that the palm swiping device has collected palm data that matches the palm pre-entry data.
[0219] Optionally, the display module 2001 is further configured to:
[0220] Prompt information is displayed in the palm input interface; the prompt information is used to indicate the action that the palm should perform in order to meet the palm input conditions.
[0221] Optionally, the display module 2001 is specifically used for:
[0222] When the image does not include a palm, position prompt information is displayed in the palm entry interface; the position prompt information is used to indicate the position of the palm relative to the terminal;
[0223] When the image includes a palm and the current placement state of the palm does not conform to the standard placement state, an adjustment prompt message is displayed in the palm input interface; the adjustment prompt message is used to indicate the action that the palm should perform from the current placement state to the standard placement state;
[0224] When the image includes a palm and the current placement state of the palm matches the standard placement state, verification prompt information is displayed in the palm entry interface; the verification prompt information is used to indicate the liveness verification action that the palm should perform.
[0225] Optionally, the display module 2001 is specifically used for:
[0226] Displaying a first reference marker corresponding to the standard placement state and a second reference marker corresponding to the current placement state in the palm input interface;
[0227] The adjustment prompt information is displayed according to the relationship between the first reference identifier and the second reference identifier; the adjustment prompt information is used to indicate the action that the palm should perform in order to adjust the second reference identifier to match the first reference identifier.
[0228] Optionally, the display module 2001 is further configured to:
[0229] Displaying an identity verification interface through the target application; the identity verification interface is used to verify the association between the object and the target account;
[0230] The notification module 2002 is specifically used for:
[0231] When it is determined that the association relationship between the object and the target account is verified, the server is notified to record the palm pre-entered data corresponding to the target account.
[0232] Optionally, the display module 2001 is further configured to:
[0233] Display palm-swiping device prompt information; the palm-swiping device prompt information is used to indicate the device usage conditions that should be met when activating the palm-swiping service for the target account based on the pre-entered palm data, and the device usage conditions are used to indicate at least one of the geographical location range or usage time range corresponding to the palm-swiping device to be used.
[0234] Optionally, the palm recording condition includes an image quality condition and a palm liveness condition; the device further includes a detection module, the detection module being configured to determine whether the palm information of the object in the image meets the palm recording condition by:
[0235] Determining, based on reference indicator information corresponding to each of the multiple frames of images captured by the camera, a quality evaluation result of each of the multiple frames of images; and determining, based on the quality evaluation results of each of the multiple frames of images, whether the palm information of the object in the image meets the image quality condition;
[0236] A liveness detection mechanism is adopted to detect whether the palm information of the object in the image meets the palm liveness condition based on the palm information of the object in the image.
[0237] Optionally, the detection module is specifically used to:
[0238] For each frame of the image, the quality evaluation result of the image is determined based on the palm direction information, palm movement speed information, positional relationship information between the palm and the reference boundary in the image, or at least one reference indicator information in the image quality information of the image.
[0239] Optionally, the detection module is specifically used to:
[0240] Determining palm positioning information in the image using a depth detection algorithm;
[0241] Determining position information of a first key point in the image based on the palm positioning information;
[0242] The palm direction information is determined based on the position information of the first key point in the image; and / or the palm movement speed information is determined based on the position information of the first key point in the image and the position information of the first key point in the image of the adjacent frame.
[0243] Optionally, the detection module is specifically used to:
[0244] An image quality score of the image is determined based on the image through a palm image evaluation model; the palm image evaluation model is trained based on training palm images and their corresponding annotation scores, and the annotation scores are determined based on the differences between the training palm images and their corresponding reference palm images.
[0245] Optionally, the detection module is specifically used to:
[0246] According to the quality evaluation results of each of the multiple frames of basic images, a preferred basic image is determined in the multiple frames of basic images; and palm feature data in the preferred basic image is extracted as the palm pre-entered data corresponding to the target account.
[0247] Optionally, the detection module is specifically used to:
[0248] Determining image features of the image in a preset color space;
[0249] Whether the palm in the image is a living palm is determined according to the image features using a living body discrimination model.
[0250] Optionally, the detection module is specifically used to:
[0251] determining, by a gesture detection algorithm, second key points in the image, and determining a gesture in the image based on relative positional relationships between the second key points;
[0252] If the gesture in the image matches the liveness authentication action instructed to be performed, it is determined that the palm in the image is a live palm.
[0253] Refer to Figure 21, which is a schematic diagram of the structure of a palm-swipe service activation device 2100 corresponding to the palm-swipe service activation method shown in Figure 17 above. As shown in Figure 21, the palm-swipe service activation device 2100 includes:
[0254] An acquisition module 2101 is used to acquire palm data collected by a palm-swiping device;
[0255] Detection module 2102 is configured to detect whether target palm pre-recorded data matching the palm data exists in a pre-recorded database; the pre-recorded database is configured to store a correspondence between palm pre-recorded data and an account number, the palm pre-recorded data being determined based on an image captured by a terminal, the image being captured by the terminal in response to a pre-activation operation for a palm-swiping service, and the account number corresponding to the palm pre-recorded data being the account logged into the target application running on the terminal;
[0256] The activation module 2103 is used to determine the target account corresponding to the target palm pre-entered data if the target palm pre-entered data is detected, establish a corresponding relationship between the target account and the palm data, and activate the palm swiping service for the target account.
[0257] Optionally, the target palm pre-recorded data is associated with a device usage condition that should be met when the palm-swiping service is activated for the target account, the device usage condition being used to indicate at least one of a geographical location range or a usage time range corresponding to the palm-swiping device to be used; the detection module 2102 is further configured to:
[0258] Detecting whether the palm scanning device for collecting the palm data meets the device usage conditions;
[0259] The activation module 2103 is specifically used to:
[0260] When the palm-swiping device for collecting the palm data meets the device usage conditions, a corresponding relationship between the target account and the palm data is established.
[0261] Optionally, the device further includes a verification module, wherein the verification module is configured to:
[0262] Controlling the palm-swiping device to display activation verification information; the activation verification information is used to indicate triggering a verification operation;
[0263] receiving operation content corresponding to the verification operation uploaded by the palm-swiping device;
[0264] According to the operation content, it is determined whether to execute the establishment of the correspondence between the target account and the palm data.
[0265] Optionally, the device further includes a service providing module, wherein the service providing module is configured to:
[0266] After establishing the correspondence between the target account and the palm data and activating the palm swiping service for the target account, the palm swiping service is provided based on the target account; and the palm swiping device is controlled to display a service result corresponding to the palm swiping service.
[0267] Optionally, the device further includes a data management module, wherein the data management module is configured to:
[0268] storing the correspondence between the target account and the palm data in a target entry database, and deleting the correspondence between the target account and the target palm pre-entered data in the pre-entered database;
[0269] The target entry database is used to store the correspondence between accounts that have activated the palm-swiping service and palm data. The target entry database is prioritized over the pre-entry database as a detection data source for matching palm data.
[0270] The embodiment of the present application also provides a computer device for activating the palm-swiping service. The computer device can specifically be a terminal device or a server. The terminal device and server provided in the embodiment of the present application will be introduced below from the perspective of hardware entity.
[0271] See Figure 22, which is a schematic diagram of the structure of the terminal device provided in the embodiment of the present application. As shown in Figure 22, for the sake of convenience, only the parts related to the embodiment of the present application are shown. For specific technical details not disclosed, please refer to the method section of the embodiment of the present application. The terminal can be any terminal device including a mobile phone, tablet computer, personal digital assistant (PDA), point of sales (POS), car computer, etc., taking the terminal as a smartphone as an example:
[0272] FIG22 is a block diagram showing a partial structure of a smartphone related to a terminal provided in an embodiment of the present application. Referring to FIG22 , the smartphone includes components such as a radio frequency (RF) circuit 2210, a memory 2220, an input unit 2230 (including a touch panel 2231 and other input devices 2232), a display unit 2240 (including a display panel 2241), a sensor 2250, an audio circuit 2260 (which can be connected to a speaker 2261 and a microphone 2262), a wireless fidelity (WiFi) module 2270, a processor 2280, and a power supply 2290. It will be understood by those skilled in the art that the smartphone structure shown in FIG22 does not constitute a limitation on the smartphone, and may include more or fewer components than shown, or combine certain components, or arrange the components differently.
[0273] The memory 2220 can be used to store software programs and modules. The processor 2280 executes the various functional applications and data processing of the smartphone by running the software programs and modules stored in the memory 2220. The memory 2220 may mainly include a program storage area and a data storage area. The program storage area may store an operating system, at least one application required for a function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created based on the use of the smartphone (such as audio data, a phone book, etc.). In addition, the memory 2220 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device.
[0274] The processor 2280 is the control center of the smartphone, connecting all components of the smartphone using various interfaces and circuits. It executes software programs and / or modules stored in the memory 2220 and accesses data stored in the memory 2220 to perform various smartphone functions and process data. Optionally, the processor 2280 may include one or more processing units. Preferably, the processor 2280 may integrate an application processor and a modem processor. The application processor primarily handles the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into the processor 2280.
[0275] In an embodiment of the present application, the processor 2280 included in the terminal is also used to execute the steps of any implementation method of the terminal-side palm-swiping service activation method provided in an embodiment of the present application.
[0276] Referring to Figure 23, Figure 23 is a schematic diagram of the structure of a server 2300 provided in an embodiment of the present application. The server 2300 may have relatively large differences due to different configurations or performances, and may include one or more central processing units (CPU) 2322 (for example, one or more processors) and memory 2332, one or more storage media 2330 (for example, one or more mass storage devices) storing application programs 2342 or data 2344. Among them, the memory 2332 and the storage medium 2330 can be temporary storage or persistent storage. The program stored in the storage medium 2330 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the server. Furthermore, the central processing unit 2322 can be configured to communicate with the storage medium 2330 to execute a series of instruction operations in the storage medium 2330 on the server 2300.
[0277] The server 2300 may also include one or more power supplies 2326, one or more wired or wireless network interfaces 2350, one or more input and output interfaces 2358, and / or one or more operating systems, such as Windows Server 2003. TM , Mac OS X TM , Unix TM ,Linux TM , FreeBSD TM etc.
[0278] The steps executed by the server in the above embodiment can be based on the server structure shown in Figure 23. The CPU 2322 can also be used to execute the steps of any implementation of the server-side palm-swiping service activation method provided in the embodiments of the present application.
[0279] An embodiment of the present application further provides a computer-readable storage medium for storing a computer program, wherein the computer program is used to execute any one of the implementation methods of the palm-swiping service activation method described in the aforementioned embodiments.
[0280] The present application also provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to execute any one of the implementations of the palm-swiping service activation method described in the aforementioned embodiments.
[0281] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0282] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.
[0283] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.
[0284] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.
[0285] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store computer programs, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0286] It should be understood that in this application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.
[0287] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims
1. A method for activating a palm-swipe service, executed by a terminal, comprising: In response to a pre-activation operation for the palm-swiping service, displaying a palm entry interface through a target application running in the terminal; A target account is logged into the target application; Displaying an image captured by the camera of the terminal in the palm entry interface; When it is determined that the palm information of the object in the image meets the palm recording condition, notifying the server to record the palm pre-recorded data corresponding to the target account; The pre-recorded palm data is determined based on the image; and when the server detects that the palm-swiping device has collected palm data that matches the pre-recorded palm data, it activates the palm-swiping service for the target account based on the palm data.
2. The method according to claim 1, further comprising: Displaying prompt information in the palm input interface; The prompt information is used to indicate the action that the palm should perform in order to meet the palm entry condition.
3. The method according to claim 2, wherein the prompt information displayed in the palm input interface comprises at least one of the following: When the image does not include a palm, displaying position prompt information in the palm entry interface; The position prompt information is used to indicate the position of the palm relative to the terminal; When the image includes a palm and the current placement state of the palm does not conform to the standard placement state, an adjustment prompt message is displayed in the palm input interface; The adjustment prompt information is used to indicate the action that the palm should perform from the current placement state to the standard placement state; When the image includes a palm and the current placement state of the palm matches the standard placement state, verification prompt information is displayed in the palm entry interface; the verification prompt information is used to indicate the liveness verification action that the palm should perform.
4. The method according to claim 3, wherein displaying adjustment prompt information in the palm input interface comprises: Displaying a first reference marker corresponding to the standard placement state and a second reference marker corresponding to the current placement state in the palm input interface; The adjustment prompt information is displayed according to the relationship between the first reference identifier and the second reference identifier; the adjustment prompt information is used to indicate the action that the palm should perform in order to adjust the second reference identifier to match the first reference identifier.
5. The method according to any one of claims 1 to 4, further comprising: Displaying an authentication interface via the target application; The identity verification interface is used to verify the association between the object and the target account; The notification server records the palm pre-entered data corresponding to the target account, including: When it is determined that the association relationship between the object and the target account is verified, the server is notified to record the palm pre-entered data corresponding to the target account.
6. The method according to any one of claims 1 to 5, further comprising: Display the palm-swiping device prompt information; The palm-swiping device prompt information is used to indicate the device usage conditions that should be met when activating the palm-swiping service for the target account based on the pre-entered palm data. The device usage conditions are used to indicate at least one of the geographical location range or usage time range corresponding to the palm-swiping device to be used.
7. The method according to any one of claims 1 to 6, wherein the palm recording condition comprises an image quality condition and a palm liveness condition; Determine whether the palm information of the object in the image meets the palm entry condition by: Determining quality evaluation results of each of the multiple frames of images captured by the camera according to reference indicator information corresponding to each of the multiple frames of images; and determining whether the palm information of the object in the image meets the image quality condition based on the quality evaluation results of each of the multiple frames of image; A liveness detection mechanism is adopted to detect whether the palm information of the object in the image meets the palm liveness condition based on the palm information of the object in the image.
8. The method according to claim 7, wherein determining the quality evaluation results of each of the multiple frames of images captured by the camera based on the reference indicator information corresponding to each of the multiple frames of images comprises: For each frame of the image, the quality evaluation result of the image is determined based on the palm direction information, palm movement speed information, positional relationship information between the palm and the reference boundary in the image, or at least one reference indicator information in the image quality information of the image.
9. The method according to claim 8, characterized in that At least one of the palm direction information or the palm movement speed information is determined by: Determining palm positioning information in the image using a depth detection algorithm; Determining position information of a first key point in the image based on the palm positioning information; determining the palm direction information according to the position information of the first key point in the image; And / or, the palm movement speed information is determined based on the position information of the first key point in the image and the position information of the first key point in the image of an adjacent frame.
10. The method according to claim 8 or 9, wherein the image quality information is determined by: An image quality score of the image is determined based on the image through a palm image evaluation model; the palm image evaluation model is trained based on training palm images and their corresponding annotation scores, and the annotation scores are determined based on the differences between the training palm images and their corresponding reference palm images.
11. The method according to any one of claims 7 to 10, wherein the palm pre-recorded data is determined by: According to the quality evaluation results of each of the multiple frames of images, a preferred image is determined in the multiple frames of images; and palm feature data in the preferred image is extracted as the pre-entered palm data corresponding to the target account.
12. The method according to any one of claims 7 to 11, wherein the adopting a liveness detection mechanism to detect whether the palm information of the object in the image meets the palm liveness condition based on the palm information of the object in the image comprises: Determining image features of the image in a preset color space; Whether the palm in the image is a living palm is determined according to the image features using a living body discrimination model.
13. The method according to any one of claims 7 to 12, wherein the adopting a liveness detection mechanism to detect whether the palm information of the object in the image meets the palm liveness condition based on the palm information of the object in the image comprises: determining, by a gesture detection algorithm, second key points in the image, and determining a gesture in the image based on relative positional relationships between the second key points; If the gesture in the image matches the liveness authentication action instructed to be performed, it is determined that the palm in the image is a live palm.
14. A method for activating a palm-swiping service, executed by a server, comprising: Obtain palm data collected through a palm scanning device; Detecting whether there is target palm pre-recorded data matching the palm data in the pre-recorded database; The pre-entry database is used to store a correspondence between palm pre-entry data and an account, the palm pre-entry data being determined based on an image captured by a terminal, the image being captured by the terminal in response to a pre-activation operation for the palm-swiping service, and the account corresponding to the palm pre-entry data being the account logged into the target application running on the terminal; If the target palm pre-recorded data is detected, the target account corresponding to the target palm pre-recorded data is determined, and a corresponding relationship between the target account and the palm data is established, and the palm swiping service is activated for the target account.
15. The method according to claim 14, wherein the target palm pre-recorded data is associated with a device usage condition that should be met when activating the palm-swiping service for the target account, the device usage condition being used to indicate at least one of a geographical location range or a usage time range corresponding to the palm-swiping device to be used; the method further comprising: Detecting whether the palm scanning device for collecting the palm data meets the device usage conditions; The establishing of a correspondence between the target account and the palm data includes: When the palm-swiping device for collecting the palm data meets the device usage conditions, a corresponding relationship between the target account and the palm data is established.
16. The method according to claim 14 or 15, further comprising: Controlling the palm-swiping device to display activation verification information; The activation verification information is used to indicate triggering of a verification operation; receiving operation content corresponding to the verification operation uploaded by the palm-swiping device; According to the operation content, it is determined whether to execute the establishment of the correspondence between the target account and the palm data.
17. The method according to any one of claims 14 to 16, further comprising: after establishing a correspondence between the target account and the palm data and activating the palm swiping service for the target account; Based on the target account, providing the palm-swiping service; The palm-swiping device is controlled to display a service result corresponding to the palm-swiping service.
18. The method according to any one of claims 14 to 17, further comprising, after establishing the correspondence between the target account and the palm data: storing the correspondence between the target account and the palm data in a target entry database, and deleting the correspondence between the target account and the target palm pre-entered data in the pre-entered database; The target entry database is used to store the correspondence between accounts that have activated the palm-swiping service and palm data. The target entry database is prioritized over the pre-entry database as a detection data source for matching palm data.
19. A device for activating a palm-swiping service, comprising: A display module is configured to display a palm input interface through a target application running in the terminal in response to a pre-activation operation for the palm swiping service; A target account is logged into the target application; The display module is further configured to display an image captured by the camera of the terminal in the palm entry interface; a notification module, configured to notify a server to record the palm pre-recorded data corresponding to the target account when determining that the palm information of the object in the image meets the palm recording condition; The pre-recorded palm data is determined based on the image; and when the server detects that the palm-swiping device has collected palm data that matches the pre-recorded palm data, it activates the palm-swiping service for the target account based on the palm data.
20. A device for activating a palm-swiping service, comprising: An acquisition module is used to acquire palm data collected by a palm-swiping device; A detection module, configured to detect whether there is target palm pre-recorded data matching the palm data in the pre-recorded database; The pre-entry database is used to store a correspondence between palm pre-entry data and an account, the palm pre-entry data being determined based on an image captured by a terminal, the image being captured by the terminal in response to a pre-activation operation for the palm-swiping service, and the account corresponding to the palm pre-entry data being the account logged into the target application running on the terminal; The activation module is used to determine the target account corresponding to the target palm pre-entered data if the target palm pre-entered data is detected, establish a corresponding relationship between the target account and the palm data, and activate the palm swiping service for the target account.
21. A computer device comprising a processor and a memory; The memory is used to store computer programs; The processor is configured to execute the palm-swiping service activation method according to any one of claims 1 to 18 according to the computer program.
22. A computer-readable storage medium for storing a computer program for executing the palm-swiping service activation method according to any one of claims 1 to 18.
23. A computer program product, comprising a computer program or instructions, which, when executed by a processor, implements the palm-swiping service activation method according to any one of claims 1 to 18.
