Face-based payment method, terminal, server, electronic device, and medium

Abstract

Embodiments of the present disclosure provide a face-based payment method, a terminal, a server, an electronic device and a computer readable medium. The method comprises: receiving, by a payment terminal, a first face payment request of a first user, the first face payment request comprising at least part of identity information of the first user and a first payment amount; obtaining, by the payment terminal, a locally cached face image of the payment terminal, the locally cached face image being cached in a local cache of the payment terminal before receiving the first face payment request, the locally cached face image comprising a locally cached face image of the first user; sending, by the payment terminal, at least part of the identity information and the locally cached face image to a payment server, so that the payment server determines a first payment account according to at least part of the identity information and the cached face image; and performing a deduction operation on the first payment account. The technical solution provided by the embodiments of the present disclosure can realize an efficient and secure face payment method.

Description

Technical Field

[0001] This disclosure relates to the field of payment technology, and more specifically, to a face-based payment method, terminal, server, electronic device, and computer-readable medium. Background Technology

[0002] With the development of internet security technology, online payment methods, such as facial recognition payment, have been widely adopted by various merchants. Facial recognition payment is a new payment method based on technologies such as artificial intelligence, machine vision, 3D sensing, and big data, offering advantages such as greater convenience, security, and a better user experience. The current facial recognition payment process involves several steps after receiving a payment request: face capture, face detection, and transmission to the backend for facial recognition to retrieve account information. While face capture after receiving the payment request is a necessary step, the process of acquiring a high-quality facial image is often time-consuming due to factors such as the customer's shooting posture, shooting angle, and shooting environment. Furthermore, face detection and requesting backend facial recognition can only be performed after successful image capture, and both face detection and recognition consume significant time. Therefore, how to achieve an efficient and secure facial recognition payment method is a problem worthy of further research.

[0003] Therefore, there is a need for a new face-based payment method, terminal, server, electronic device, and computer-readable medium.

[0004] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this disclosure. Summary of the Invention

[0005] This disclosure provides a face-based payment method, terminal, server, electronic device, and computer-readable medium, thereby enabling at least a certain degree of efficient and secure face payment.

[0006] Other features and advantages of this disclosure will become apparent from the following detailed description, or may be learned in part from practice of this disclosure.

[0007] This disclosure proposes a face-based payment method, comprising: receiving a first face payment request from a first user via a payment terminal, the first face payment request including at least partial identity information of the first user and a first payment amount; acquiring a locally cached face image of the payment terminal via the payment terminal, the locally cached face image being cached in the local cache of the payment terminal before receiving the first face payment request, the locally cached face image including the first user's locally cached face image; sending the at least partial identity information and the locally cached face image to a payment server via the payment terminal, so that the payment server determines a first payment account of the first user based on the at least partial identity information and the cached face image; and performing a deduction operation corresponding to the first payment amount on the first payment account.

[0008] This disclosure proposes a face-based payment terminal, comprising: a first request acquisition unit configured to receive a first face payment request from a first user, the first face payment request including at least some identity information of the first user and a first payment amount; a cached image acquisition unit configured to acquire a locally cached face image of the payment terminal, the locally cached face image being cached in the local cache of the payment terminal before receiving the first face payment request, the locally cached face image including the first user's locally cached face image; and a payment request sending unit configured to send the at least some identity information and the locally cached face image to a payment server, so that the payment server determines the first user's first payment account based on the at least some identity information and the cached face image; and performs a deduction operation corresponding to the first payment amount on the first payment account.

[0009] In one exemplary embodiment of this disclosure, the payment terminal includes an image acquisition device, and further includes: a second request acquisition unit configured to receive a second face payment request from a second user before receiving a first face payment request from a first user; a first face acquisition unit configured to obtain a first acquired face image through the image acquisition device, the first acquired face image including the second user's first acquired face image and the first user's first acquired face image; and a first caching unit configured to cache the first user's first acquired face image as the first user's local cache face image in the local cache of the payment terminal if the maximum value of the k first face similarities between the first user's first acquired face image and the k locally cached face images of the payment terminal is less than a face similarity threshold.

[0010] In an exemplary embodiment of this disclosure, the at least partial identity information includes the full identity information of the first user; wherein, the payment request sending unit includes: a verification information acquisition subunit, configured to send the full identity information of the first user and the locally cached face image to the payment server, so that the payment server determines the target verification face and the account information to be verified of the first user based on the full identity information; and a first account confirmation subunit, configured to determine the account information to be verified as the first user's first payment account if the maximum value of the similarity between the target verification face and the k second faces of the k locally cached face images is less than a face similarity threshold.

[0011] In one exemplary embodiment of this disclosure, the payment terminal further includes: a deduction message response unit, configured to delete the local cached face image of the first user from the local cache of the payment terminal if the payment terminal receives a successful deduction message for the first payment account.

[0012] In one exemplary embodiment of this disclosure, the first face acquisition unit includes: a first device acquisition subunit configured to acquire a first real-time image through the image acquisition device; a first face detection subunit configured to perform face detection on the first real-time image to obtain at least one first initial face image; a first dimension value determination subunit configured to determine the evaluation dimension value of the first initial face image under each evaluation dimension, wherein the evaluation dimension includes one or more of face image size, face angle, image contrast, image brightness, and image sharpness; a first quality score determination subunit configured to determine the face image quality score of the first initial face image based on the evaluation dimension value of the first initial face image under each evaluation dimension; and a first acquired image determination subunit configured to determine the first initial face image whose face image quality score is greater than a face image quality score threshold as the first acquired face image.

[0013] In one exemplary embodiment of this disclosure, the payment terminal includes an image acquisition device, and further includes: a third request acquisition unit configured to receive a third face payment request from a first user through the payment terminal before receiving a verification request from a target user; a second face acquisition unit configured to obtain a second face image of the first user through the image acquisition device; a third request sending unit configured to send the second face image of the first user to a payment server; and a cancellation instruction receiving unit configured to, if receiving a cancellation instruction from the first user before receiving a payment success message returned by the payment server in response to the third face payment request, cache the second face image of the first user as a local cached face image of the first user in the local cache of the payment terminal.

[0014] In one exemplary embodiment of this disclosure, the payment terminal further includes: a periodic acquisition unit configured to receive periodic images acquired by the image acquisition device according to a preset time period during the time interval between receiving the first user's cancellation payment instruction at time t1 and receiving the first face payment request at time t2; a periodic image detection unit configured to perform face detection on the periodic images to obtain periodic face images; and a first threshold comparison unit configured to determine the first user's first payment account using the local cached face image if the third face similarity between the periodic face image and the locally cached face image is greater than or equal to a face similarity threshold.

[0015] In one exemplary embodiment of this disclosure, the payment terminal further includes: a second threshold comparison unit configured to display a face acquisition interface in response to the first face payment request if the third face similarity is less than a face similarity threshold; a third face acquisition unit configured to acquire a third face image of the first user through the image acquisition device of the payment terminal; and a third face image recognition unit configured to send the third face image to the payment server so that the payment server can determine the first user's first payment account based on the third face image.

[0016] In one exemplary embodiment of this disclosure, when the payment request sending unit "sends the at least part of the identity information and the locally cached face image to the payment server", it is configured to send the at least part of the identity information to the payment server, so that the payment server determines the target account identifier code based on the first payment account; compares the at least part of the identity information and the target account identifier code; and performs a deduction operation corresponding to the first payment amount on the first payment account when the comparison results are consistent.

[0017] In one exemplary embodiment of this disclosure, the second face acquisition unit includes: a second device acquisition subunit configured to acquire a second real-time image through the image acquisition device; a second face detection subunit configured to perform face detection on the second real-time image to obtain at least one second initial face image; a second dimension value determination subunit configured to determine the evaluation dimension value of the second initial face image under each evaluation dimension, wherein the evaluation dimension includes one or more of face image size, face angle, image contrast, image brightness, and image sharpness; a second quality score determination subunit configured to determine the face image quality score of the second initial face image based on the evaluation dimension value of the second initial face image under each evaluation dimension; and a second acquired image determination subunit configured to determine the second initial face image whose face image quality score is greater than a face image quality score threshold as the second acquired face image.

[0018] This disclosure proposes a face-based payment server, comprising: a payment request receiving unit configured to receive at least partial identity information and a locally cached face image sent by a payment terminal, wherein the at least partial identity information is obtained by the payment terminal upon receiving a first face payment request from a first user, the first face payment request including at least partial identity information of the first user and a first payment amount, and the locally cached face image is cached locally on the payment terminal before receiving the first face payment request, the locally cached face image including the first user's locally cached face image; and a payment request execution unit configured to determine a first payment account of the first user based on the at least partial identity information and the cached face image; and to perform a deduction operation corresponding to the first payment amount on the first payment account.

[0019] This disclosure provides an electronic device, including: at least one processor; and a storage device for storing at least one program, which, when executed by the at least one processor, causes the at least one processor to implement the face-based payment method as described in the above embodiments.

[0020] This disclosure provides a computer-readable medium having a computer program stored thereon, which, when executed by a processor, implements the face-based payment method as described in the above embodiments.

[0021] In some embodiments of this disclosure, when a payment terminal receives a first face payment request, it directly obtains a locally cached face image from its local cache. Since this locally cached face image includes the first user's locally cached face image, the payment terminal does not need to perform face capture on the first user after receiving the first face payment request, saving time spent on face capture and enabling an efficient face payment method. Simultaneously, at least some of the identity information in the first face payment request and the locally cached face image are sent to the payment server. This allows the payment server to further verify the first face payment request and determine the first payment account based on the at least some identity information and the locally cached face image, ensuring the security of the face payment method.

[0022] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0023] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure. It is obvious that the drawings described below are merely some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort. In the drawings:

[0024] Figure 1 A schematic diagram of an exemplary system architecture 100 to which the face-based payment method of the present disclosure can be applied is shown.

[0025] Figure 2 A flowchart illustrating a face-based payment method according to an embodiment of the present disclosure is shown.

[0026] Figure 3 A flowchart illustrating a face-based payment method according to another embodiment of the present disclosure is shown.

[0027] Figure 4 Based on Figure 3 Step S360 is a flowchart in an exemplary embodiment.

[0028] Figure 5 A flowchart illustrating a face-based payment method according to yet another embodiment of the present disclosure is shown.

[0029] Figure 6 A flowchart illustrating a face-based payment method according to another embodiment of the present disclosure is shown.

[0030] Figure 7A schematic diagram of a payment terminal according to an embodiment of the present disclosure is shown.

[0031] Figure 8 A block diagram of a face-based payment terminal according to an embodiment of the present disclosure is shown schematically.

[0032] Figure 9 A block diagram of a face-based payment server according to one embodiment of the present disclosure is shown schematically.

[0033] Figure 10 A block diagram of a face-based payment system according to an embodiment of the present disclosure is illustrated.

[0034] Figure 11 A block diagram of a face-based payment system according to another embodiment of the present disclosure is shown schematically.

[0035] Figure 12 A schematic diagram of the structure of an electronic device suitable for implementing embodiments of the present disclosure is shown. Detailed Implementation

[0036] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be more thorough and complete, and will fully convey the concept of the exemplary embodiments to those skilled in the art.

[0037] Furthermore, the described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. Numerous specific details are provided in the following description to give a thorough understanding of embodiments of this disclosure. However, those skilled in the art will recognize that the technical solutions of this disclosure can be practiced without one or more of the specific details, or other methods, components, apparatuses, steps, etc., can be employed. In other instances, well-known methods, terminals, servers, implementations, or operations are not shown or described in detail to avoid obscuring various aspects of this disclosure.

[0038] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software, in at least one hardware module or integrated circuit, or in different network and / or processor devices and / or microcontroller devices.

[0039] The flowcharts shown in the accompanying drawings are merely illustrative and do not necessarily include all content and operations / steps, nor do they necessarily need to be performed in the described order. For example, some operations / steps can be broken down, while others can be combined or partially combined; therefore, the actual execution order may change depending on the specific circumstances.

[0040] It should be noted that all information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this application are authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data comply with the relevant laws, regulations, and standards of the relevant countries and regions. In particular, facial images, payment request information, identity information, and locally cached data involved in this application are all obtained and used with the user's full knowledge and explicit consent.

[0041] Figure 1 A schematic diagram of an exemplary system architecture 100 to which the face-based payment method of the present disclosure can be applied is shown.

[0042] like Figure 1 As shown, system architecture 100 may include one or more of payment terminals 101, 102, and 103, a network 104, and a payment server 105. Network 104 serves as the medium for providing communication links between payment terminals 101, 102, and 103 and payment server 105. Network 104 may include various connection types, such as wired or wireless communication links or fiber optic cables, etc.

[0043] It should be understood that Figure 1 The number of payment terminals, networks, and payment servers shown is merely illustrative. Depending on implementation needs, any number of payment terminals, networks, and payment servers can be included. For example, payment server 105 could be a server cluster consisting of multiple servers.

[0044] Users can use payment terminals 101, 102, and 103 to interact with server 105 via network 104 to receive or send messages, etc. Payment terminals 101, 102, and 103 can be various electronic devices with displays and web browsing capabilities, including but not limited to smartphones, tablets, laptops, desktop computers, wearable devices, virtual reality devices, smart home devices, etc.

[0045] Payment server 105 can be a server providing various services. For example, payment terminal 103 (or payment terminal 101 or 102) can receive a first face payment request from a first user, the first face payment request including at least part of the first user's identity information and a first payment amount; acquire a locally cached face image of the payment terminal, the locally cached face image being cached in the payment terminal's local cache before receiving the first face payment request, the locally cached face image including the first user's locally cached face image; send the at least part of the identity information and the locally cached face image to payment server 105, so that payment server 105 can determine the first user's first payment account based on the at least part of the identity information and the cached face image; perform a deduction operation corresponding to the first payment amount on the first payment account; and feed back the deduction result to payment terminal 103, which can then display the deduction result, thereby achieving an efficient and secure face payment method. Figure 2 A flowchart illustrating a face-based payment method according to an embodiment of the present disclosure is shown. The method provided in this disclosure can be processed by any electronic device with computing power, such as the one described above. Figure 1 In the embodiments, the payment terminal 101, 102, or 103 is used as an example to illustrate the following embodiments, but this disclosure is not limited thereto.

[0046] like Figure 2 As shown, the face-based payment method provided in this embodiment may include the following steps.

[0047] In step S210, a first face payment request from a first user is received through a payment terminal. The first face payment request includes at least part of the first user's identity information and a first payment amount.

[0048] In this embodiment of the disclosure, the payment terminal can be as follows: Figure 7 As shown in Figure 700. Figure 7As shown, the payment terminal may include a display screen panel 710 and an image acquisition device 720. A first user can generate a first facial payment request by operating the display screen panel 710. For example, the first user can select goods through the display screen panel 710, and after completing the selection, click the facial payment button on the display screen panel 710 and input at least part of their identity information in the input area displayed on the display screen panel 710. The payment terminal will determine the first payment amount based on the price of the goods selected by the first user. The payment terminal can be connected to a payment server. The payment server is used to interact with the payment terminal to realize a complete response process to the first facial payment request. This response process will be described in step S230 and will not be repeated here.

[0049] At least some of the first user's identity information can be obtained by the first user through operations on the payment terminal, such as the first user's mobile phone number, ID card number, etc. When it is a mobile phone number, the at least some identity information can be, for example, the full information of the mobile phone number, or a portion of the mobile phone number (e.g., the last four digits). This disclosure does not impose any special limitations on this.

[0050] In step S220, the local cached face image of the payment terminal is obtained through the payment terminal. The local cached face image is cached in the local cache of the payment terminal before receiving the first face payment request. The local cached face image includes the local cached face image of the first user.

[0051] In this embodiment of the disclosure, before receiving the first user's first facial payment request, the first user may be in the following facial payment scenario 1: the first user is in a queue as a person waiting in line for a shopping checkout, and is waiting behind another user (e.g., the second user below) to complete the payment through the payment terminal, and then uses the payment terminal to complete the shopping checkout payment. The second user generates a second facial payment request through the payment terminal and passes the image acquisition device (e.g., [image acquisition device name missing]) through the payment terminal. Figure 7 When the 720 device performs face collection, it simultaneously collects the face images of multiple people queuing in the shopping checkout line (including the face image of the first user), and caches the face images of multiple people queuing as local cache face images in the local cache of the payment terminal.

[0052] The first user is also, for example, in the following face payment scenario 2: before receiving the first user's first face payment request, the first user has generated a third face payment request by operating the payment terminal, and the payment terminal responds to the third face payment request through the payment terminal's image acquisition device (e.g., Figure 7The system (720) acquires the facial image of the first user and sends it to the payment server to request facial recognition service. Before receiving the facial recognition result from the payment server, if the first user generates a payment cancellation instruction by operating the payment terminal, the first user's facial image is cached locally in the payment terminal's local cache.

[0053] In step S230, at least some identity information and locally cached facial images are sent to the payment server through the payment terminal, so that the payment server can determine the first user's first payment account based on the at least some identity information and cached facial images; and perform a deduction operation corresponding to the first payment amount on the first payment account.

[0054] In this embodiment of the disclosure, the payment server can provide a face recognition service. For example, when at least some of the identity information includes the full identity information of the first user, the payment server can determine a target verification face for an account to be verified based on the full identity information. The target verification face is generated during the registration of the payment account to be verified and corresponds to the payment account to be verified. The server then calculates the face similarity of the face features based on the target verification face and the locally cached face image. If there is a face similarity greater than the face similarity threshold, the server determines that the account to be verified is the first payment account.

[0055] For example, when at least some of the identity information is not the full identity information, and the number of locally cached face images is 1, the payment server can perform a match on the server-side face database based on the locally cached face images to determine a successfully matched target verification face and the account information to be verified corresponding to the target verification face. When the full identity information corresponding to the account information to be verified matches the at least some of the identity information, the account information to be verified is confirmed to be the first payment account.

[0056] The face-based payment method provided in this disclosure allows the payment terminal to directly obtain a locally cached face image from its local cache upon receiving a first face payment request. Since this locally cached face image includes the first user's locally cached face image, the payment terminal does not need to perform face capture on the first user after receiving the first face payment request, saving time spent on face capture and enabling an efficient face payment method. Simultaneously, at least some of the identity information in the first face payment request and the locally cached face image are sent to the payment server. This allows the payment server to further verify the first face payment request and determine the first payment account based on the at least some identity information and the locally cached face image, ensuring the security of the face payment method.

[0057] Figure 3 A flowchart illustrating a face-based payment method according to another embodiment of the present disclosure is shown.

[0058] In this embodiment of the disclosure, the payment terminal includes an image acquisition device (e.g., Figure 7 (720). For example Figure 3 As shown, face-based payment in this embodiment of the disclosure may include the following steps.

[0059] In step S310, the second user's second face payment request is received through the payment terminal.

[0060] In this embodiment, the second user can be in the same checkout queue as the first user, and the second user is ahead of the first user, i.e., the aforementioned facial recognition payment scenario 1. At least some of the second user's identity information can be obtained by the first user through operations on the payment terminal, such as the second user's mobile phone number, ID card number, etc.

[0061] In step S320, a first captured face image is obtained through an image acquisition device. The first captured face image includes the first captured face image of the second user and the first captured face image of the first user.

[0062] In this embodiment of the disclosure, a second face payment request can be responded to by sending a signal to an image acquisition device (e.g., Figure 7 (720) sends a collection command so that the image acquisition device can acquire the first face image.

[0063] In this process, when acquiring the first captured face image, a first real-time image can be obtained through an image acquisition device; face detection is performed on the first real-time image to obtain at least one first initial face image; the evaluation dimension values ​​of the first initial face image under each evaluation dimension are determined, and the evaluation dimensions include one or more of face image size, face angle, image contrast, image brightness, and image sharpness; the face image quality score of the first initial face image is determined based on the evaluation dimension values ​​of the first initial face image under each evaluation dimension; the first initial face image with a face image quality score greater than a face image quality score threshold is determined as the first captured face image. The face image quality score can be obtained, for example, based on the weighted calculation result of the evaluation dimension values ​​under each evaluation dimension.

[0064] In an exemplary embodiment, the second facial payment request may include at least some of the second user's identity information and a second payment amount. The payment terminal may respond by sending the second user's first captured facial image and the second facial payment request to the payment server, so that the payment server can determine the second user's second payment account based on at least some of the identity information in the first captured facial image and the second facial payment request, and perform a deduction operation corresponding to the second payment amount into the second payment account.

[0065] In step S330, if the maximum value of the first face similarity between the first user's first collected face image and the k local cached face images of the payment terminal is less than the face similarity threshold, then the first collected face image of the first user is cached as the first user's local cached face image in the local cache of the payment terminal.

[0066] In this embodiment of the present disclosure, the judgment step in step S330 can be executed by either the payment terminal or the payment server. For example, when the payment terminal is the executing entity, it can calculate the k first face similarities between the first user's captured face image and k locally cached face images of the payment terminal, where k is an integer greater than 0; the first captured face image of the first user whose maximum value among the k first face similarities is less than the face similarity threshold is cached as the first user's local cache face image in the payment terminal. When the payment server is the executing entity, the payment terminal can send the first captured face image of the first user and the k locally cached face images to the payment server, so that the payment server can calculate the k first face similarities between the first user's captured face image and the k locally cached face images of the payment terminal, where k is an integer greater than 0; and return the first captured face image of the first user whose maximum value among the k first face similarities is less than the face similarity threshold to the payment terminal; the payment terminal caches the first captured face image of the first user as the first user's local cache face image in its local cache.

[0067] In step S340, the first face payment request of the first user is received through the payment terminal. The first face payment request includes at least part of the first user's identity information and the first payment amount.

[0068] Step S340 of this embodiment can be taken in a similar manner to step S210, and will not be described again here.

[0069] In step S350, the local cached face image of the payment terminal is obtained through the payment terminal. The local cached face image is cached in the local cache of the payment terminal before receiving the first face payment request. The local cached face image includes the local cached face image of the first user.

[0070] Step S350 of this embodiment can be taken in a similar manner to step S220, and will not be described again here.

[0071] In step S360, at least some identity information and locally cached facial images are sent to the payment server through the payment terminal, so that the payment server can determine the first user's first payment account based on the at least some identity information and cached facial images; and perform a deduction operation corresponding to the first payment amount on the first payment account.

[0072] In an exemplary embodiment, the face-based payment method of this disclosure may further include the following step: if the payment terminal receives a successful deduction message for the first payment account, then the locally cached face image of the first user is deleted from the local cache of the payment terminal. In this embodiment, since the first payment account corresponding to the first user has already been successfully deducted, the probability of the first user making another attempt is almost zero. By deleting the locally cached face image of the first user from the local cache of the payment terminal, the cache pressure can be effectively reduced, and the false recognition rate can be reduced.

[0073] Figure 4 Based on Figure 3 Step S360 is a flowchart in an exemplary embodiment.

[0074] In this embodiment of the disclosure, at least a portion of the identity information may include the full identity information of the first user. For example... Figure 4 As shown above, Figure 3 Step S360 in the embodiment may further include the following steps.

[0075] In step S410, the full identity information of the first user and the locally cached face image are sent to the payment server so that the payment server can determine the target verification face and the account information to be verified for the first user based on the full identity information.

[0076] In this embodiment of the disclosure, the payment server may, for example, match the full set of identity information in the database on the payment server side, determine the account information to be verified based on the successfully matched account information, and determine the face image corresponding to the account information to be verified as the target verification face of the first user.

[0077] In step S420, if the maximum value of the similarity between the target face and the k second faces of the k locally cached face images is less than the face similarity threshold, then the account information to be verified is determined as the first payment account of the first user.

[0078] In this embodiment of the disclosure, the judgment step in step S420 can be executed by either the payment terminal or the payment server. For example, when the payment terminal is the executing entity, it can calculate the similarity between the target verification face and k second faces in k locally cached face images of the payment terminal, where k is an integer greater than 0; if the maximum value among the k second face similarities is less than the face similarity threshold, then the target verification account is determined to be the first payment account. When the payment server is the executing entity, it can calculate the similarity between the target verification face and k second faces in k locally cached face images of the payment terminal, where k is an integer greater than 0; if the maximum value among the k second face similarities is less than the face similarity threshold, then the target verification account is returned to the payment terminal as the first payment account.

[0079] In an exemplary embodiment, if the maximum value among the k second face similarities is less than the face similarity threshold, the cache duration of the local cached face image corresponding to the maximum value can also be obtained. When the cache duration is greater than the cache duration threshold, the account information to be verified is confirmed as the first payment account.

[0080] Figure 5 A flowchart illustrating a face-based payment method according to yet another embodiment of the present disclosure is shown.

[0081] In this embodiment of the disclosure, the payment terminal includes an image acquisition device. For example... Figure 5 As shown, the face-based payment method of this disclosure embodiment may further include the following steps.

[0082] In step S510, the third-party face payment request from the first user is received through the payment terminal.

[0083] In this embodiment of the disclosure, the first user can generate a third-party face payment request by operating the payment terminal, i.e., the aforementioned face payment scenario 2.

[0084] In step S520, the second captured face image of the first user is obtained through the image acquisition device.

[0085] In an exemplary embodiment, a second real-time image can be obtained through an image acquisition device; face detection is performed on the second real-time image to obtain at least one second initial face image; evaluation dimension values ​​of the second initial face image are determined under each evaluation dimension, where the evaluation dimensions include one or more of face image size, face angle, image contrast, image brightness, and image sharpness; a face image quality score of the second initial face image is determined based on the evaluation dimension values ​​of the second initial face image under each evaluation dimension; and the second initial face image with a face image quality score greater than a face image quality score threshold is determined as the second acquired face image. The face image quality score can be obtained, for example, based on a weighted calculation of the evaluation dimension values ​​under each evaluation dimension.

[0086] In step S530, the second captured facial image of the first user is sent to the payment server.

[0087] In step S540, if a payment cancellation instruction from the first user is received before the payment server receives a payment success message in response to the third face payment request, then the second captured face image of the first user is cached as the first user's local cache face image in the local cache of the payment terminal.

[0088] In this embodiment, before the payment server deducts funds from the first payment account, the payment terminal's display screen can show a "Cancel Payment" button. If the first user finds there are still items to order, they can click the "Cancel Payment" button to generate a cancellation instruction. The payment terminal sends this cancellation instruction to the payment server to intercept the deduction operation from the first payment account and returns a "Cancel Payment Successful" message to the payment terminal. In response to this message, the payment terminal caches the first user's second captured facial image as a local cached facial image in its local cache.

[0089] In step S550, a first face payment request from the first user is received through the payment terminal. The first face payment request includes at least part of the first user's identity information and a first payment amount.

[0090] Step S550 of this embodiment can be taken in a similar manner to step S210, and will not be described again here.

[0091] In step S560, the local cached face image of the payment terminal is obtained through the payment terminal. The local cached face image is cached in the local cache of the payment terminal before receiving the first face payment request. The local cached face image includes the local cached face image of the first user.

[0092] Step S560 of this embodiment can be taken in a similar manner to step S220, and will not be described again here.

[0093] In step S570, at least some identity information and locally cached facial images are sent to the payment server through the payment terminal, so that the payment server can determine the first user's first payment account based on the at least some identity information and cached facial images; and perform a deduction operation corresponding to the first payment amount on the first payment account.

[0094] Step S570 of this embodiment can be taken in a similar manner to step S230, and will not be described again here.

[0095] Figure 6 A flowchart illustrating a face-based payment method according to another embodiment of the present disclosure is shown.

[0096] like Figure 6 As shown, based on Figure 5 The face-based payment method in this embodiment may further include the following steps.

[0097] In step S610, during the time interval between receiving the first user's cancellation payment instruction at time t1 and receiving the first face payment request at time t2, periodic images acquired by the image acquisition device are received according to a preset time period.

[0098] In this embodiment, the preset time period can be, for example, 5 seconds, 10 seconds, etc., and this disclosure does not impose any special limitation on it. In this embodiment, namely the aforementioned face payment scenario 2, after time t1, the first user may operate the payment terminal to return to the merchant interface to continue selecting goods, and after completing the selection, operate the payment terminal to generate the first face payment request. Therefore, during the continued selection of goods, the periodic images are acquired by the image acquisition device of the payment terminal and used for subsequent comparison, which can further improve the security of the face payment method.

[0099] In step S620, face detection is performed on the periodic image to obtain a periodic face image.

[0100] In step S630, if the third face similarity between the periodic face image and the locally cached face image is greater than or equal to the face similarity threshold, then the first payment account of the first user is determined using the locally cached face image.

[0101] In this embodiment of the disclosure, when the similarity between the periodic face image and the locally cached face image is greater than or equal to the face similarity threshold, it can be confirmed that the first user is still operating the payment terminal, that is, the locally cached face image is still available. Determining the first user's first payment account using the locally cached face image can, for example, be done when responding to a third-party face payment request, even if a payment cancellation instruction has been received and the deduction operation from the first payment account has been intercepted; the determined first payment account can still be recorded. Alternatively, the first user's first payment account can be determined during time t1 to t2, or after receiving the first face payment request at time t2, by responding to the first face payment request and sending a request to the payment server to obtain it.

[0102] In an exemplary embodiment, the following steps may also be included: if the similarity of the third face is less than the face similarity threshold, then display the face acquisition interface in response to the first face payment request; acquire the third face image of the first user through the image acquisition device of the payment terminal; send the third face image to the payment server so that the payment server can determine the first user's first payment account based on the third face image.

[0103] In an exemplary embodiment, Figure 5 When performing the step S570 of the embodiment, which involves sending at least part of the identity information and the locally cached face image to the payment server, the following steps may also be included: sending at least part of the identity information to the payment server so that the payment server can determine the target account identifier code based on the first payment account; comparing the at least part of the identity information and the target account identifier code; and performing a deduction operation corresponding to the first payment amount on the first payment account when the comparison results are consistent.

[0104] When comparing the at least partial identity identifier and the target account identifier, a specified number of digits in the target account identifier can be compared with the at least partial identity identifier. If they are completely identical, the comparison result is confirmed to be consistent. The specified number of digits can be, for example, the last four digits. This specified number of digits can be determined by the payment terminal and sent simultaneously when sending the at least partial identity identifier information and the locally cached face image.

[0105] The following describes an embodiment of the apparatus disclosed herein, which can be used to execute the face-based payment method described above. For details not disclosed in the apparatus embodiments of this disclosure, please refer to the embodiments of the face-based payment method described above.

[0106] Figure 8 A block diagram of a face-based payment terminal according to an embodiment of the present disclosure is shown schematically.

[0107] Reference Figure 8As shown, a face-based payment terminal 800 according to an embodiment of the present disclosure may include: a first request acquisition unit 810, a cached image acquisition unit 820, and a payment request sending unit 830.

[0108] The first request acquisition unit 810 can be configured to receive a first face payment request from a first user, wherein the first face payment request includes at least part of the first user's identity information and a first payment amount.

[0109] The cached image acquisition unit 820 can be configured to acquire the locally cached face image of the payment terminal. The locally cached face image is cached in the local cache of the payment terminal before receiving the first face payment request. The locally cached face image includes the locally cached face image of the first user.

[0110] The payment request sending unit 830 can be configured to send the at least part of the identity information and the locally cached face image to the payment server, so that the payment server can determine the first user's first payment account based on the at least part of the identity information and the cached face image; and perform a deduction operation corresponding to the first payment amount on the first payment account.

[0111] The face-based payment terminal provided in this disclosure, upon receiving a first face payment request, directly retrieves a locally cached face image from its local cache. Since this locally cached face image includes the first user's locally cached face image, the payment terminal does not need to perform face capture on the first user after receiving the first face payment request, saving time spent on face capture and enabling an efficient face payment method. Simultaneously, at least a portion of the identity information in the first face payment request and the locally cached face image are sent to the payment server. This allows the payment server to further verify the first face payment request and determine the first payment account based on the at least a portion of the identity information and the locally cached face image, ensuring the security of the face payment method.

[0112] In an exemplary embodiment, the payment terminal may include an image acquisition device, and the payment terminal further includes: a second request acquisition unit, configurable to receive a second face payment request from a second user before receiving a first face payment request from a first user; a first face acquisition unit, configurable to obtain a first acquired face image through the image acquisition device, the first acquired face image including the first acquired face image of the second user and the first acquired face image of the first user; and a first caching unit, configurable to cache the first acquired face image of the first user as the first user's local cache face image in the local cache of the payment terminal if the maximum value of the first face similarity among the k first face similarities between the first acquired face image of the first user and the k locally cached face images of the payment terminal is less than a face similarity threshold.

[0113] In an exemplary embodiment, the at least partial identity information includes the full identity information of the first user; wherein, the payment request sending unit 830 may include: a verification information acquisition subunit, which may be configured to send the full identity information of the first user and the locally cached face image to the payment server, so that the payment server can determine the target verification face and the account information to be verified of the first user based on the full identity information; and a first account confirmation subunit, which may be configured to determine the account information to be verified as the first payment account of the first user if the maximum value of the similarity between the target verification face and the k second faces of the k locally cached face images is less than the face similarity threshold.

[0114] In an exemplary embodiment, the payment terminal 800 may further include a deduction message response unit, which is configured to delete the local cached face image of the first user from the local cache of the payment terminal if the payment terminal receives a successful deduction message for the first payment account.

[0115] In an exemplary embodiment, the first face acquisition unit may include: a first device acquisition subunit, configured to acquire a first real-time image through the image acquisition device; a first face detection subunit, configured to perform face detection on the first real-time image to obtain at least one first initial face image; a first dimension value determination subunit, configured to determine the evaluation dimension value of the first initial face image under each evaluation dimension, wherein the evaluation dimension includes one or more of face image size, face angle, image contrast, image brightness, and image sharpness; a first quality score determination subunit, configured to determine the face image quality score of the first initial face image based on the evaluation dimension value of the first initial face image under each evaluation dimension; and a first acquired image determination subunit, configured to determine the first initial face image whose face image quality score is greater than a face image quality score threshold as the first acquired face image.

[0116] In an exemplary embodiment, the payment terminal may include an image acquisition device, and the face-based payment terminal 800 may further include: a third request acquisition unit, configured to receive a third face payment request from a first user through the payment terminal before the payment terminal receives a verification request from a target user; a second face acquisition unit, configured to obtain a second face image of the first user through the image acquisition device; a third request sending unit, configured to send the second face image of the first user to a payment server; and a cancellation instruction receiving unit, configured to, if a cancellation instruction from the first user is received before receiving a payment success message returned by the payment server in response to the third face payment request, cache the second face image of the first user as a local cached face image in the local cache of the payment terminal.

[0117] In an exemplary embodiment, the payment terminal 800 may further include: a periodic acquisition unit, configured to receive periodic images acquired by the image acquisition device according to a preset time period during the time interval between receiving the first user's cancellation payment instruction at time t1 and receiving the first face payment request at time t2; a periodic image detection unit, configured to perform face detection on the periodic images to obtain periodic face images; and a first threshold comparison unit, configured to determine the first user's first payment account using the local cached face image if the third face similarity between the periodic face image and the locally cached face image is greater than or equal to a face similarity threshold.

[0118] In an exemplary embodiment, the payment terminal 800 may further include: a second threshold comparison unit, configured to display a face acquisition interface in response to the first face payment request if the third face similarity is less than a face similarity threshold; a third face acquisition unit, configured to acquire a third face image of the first user through the image acquisition device of the payment terminal; and a third face image recognition unit, configured to send the third face image to the payment server so that the payment server can determine the first user's first payment account based on the third face image.

[0119] In an exemplary embodiment, when the payment request sending unit 830 "sends the at least part of the identity information and the locally cached face image to the payment server", it can be configured to send the at least part of the identity information to the payment server, so that the payment server determines the target account identifier code based on the first payment account; compares the at least part of the identity information and the target account identifier code; and performs a deduction operation corresponding to the first payment amount on the first payment account when the comparison results are consistent.

[0120] In an exemplary embodiment, the second face acquisition unit may include: a second device acquisition subunit, configured to acquire a second real-time image through the image acquisition device; a second face detection subunit, configured to perform face detection on the second real-time image to obtain at least one second initial face image; a second dimension value determination subunit, configured to determine the evaluation dimension value of the second initial face image under each evaluation dimension, wherein the evaluation dimension includes one or more of face image size, face angle, image contrast, image brightness, and image sharpness; a second quality score determination subunit, configured to determine the face image quality score of the second initial face image based on the evaluation dimension value of the second initial face image under each evaluation dimension; and a second acquired image determination subunit, configured to determine the second initial face image whose face image quality score is greater than a face image quality score threshold as the second acquired face image.

[0121] Figure 9 A block diagram of a face-based payment server according to one embodiment of the present disclosure is shown schematically.

[0122] Reference Figure 9 As shown, a face-based payment server 900 according to an embodiment of the present disclosure may include: a payment request receiving unit 910 and a payment request execution unit 920.

[0123] The payment request receiving unit 910 can be configured to receive at least part of the identity information and a locally cached face image sent by the payment terminal. The at least part of the identity information is obtained by the payment terminal upon receiving a first face payment request from a first user. The first face payment request includes at least part of the identity information of the first user and a first payment amount. The locally cached face image is cached in the local cache of the payment terminal before receiving the first face payment request. The locally cached face image includes the locally cached face image of the first user.

[0124] The payment request execution unit 920 can be configured to determine the first user's first payment account based on the at least part of the identity information and the cached face image; and to perform a deduction operation on the first payment account corresponding to the first payment amount.

[0125] The face-based payment server provided in this embodiment receives at least partial identity information and a locally cached face image from a payment terminal. The at least partial identity information is obtained by the payment terminal upon receiving a first face payment request from a first user. Since the payment terminal directly obtains the locally cached face image from its local cache upon receiving the first face payment request, and this locally cached face image includes the first user's locally cached face image, the payment terminal does not need to perform face capture on the first user after receiving the first face payment request, saving time spent on face capture and enabling an efficient face payment method. Simultaneously, sending at least partial identity information and the locally cached face image from the first face payment request to the payment server allows the payment server to further verify the first face payment request and determine the first payment account based on the at least partial identity information and the locally cached face image, ensuring the security of the face payment method.

[0126] Figure 10 A block diagram of a face-based payment system according to an embodiment of the present disclosure is illustrated.

[0127] like Figure 10 As shown, the face-based payment system 1000 may include a payment terminal 1010 and a payment server 1020. The payment terminal 1010 is equipped with a face recognition application 1011, which includes a silent face recognition module 1012, a face data caching module 1013, a local face image set 1014, a face data cleaning module 1015, a mobile phone number verification module 1016, and a visible face recognition module 1017. The face-based payment system of this disclosure can be applied, for example, to the aforementioned face payment scenario 1.

[0128] The silent face recognition module 1012 includes a face acquisition unit 10121 and a face selection unit 10122. The face data caching module 1013 includes a validity verification timer 10131, a time verification unit 10132, and a different person verification unit 10133.

[0129] The silent face recognition module 1012 controls the image acquisition device (e.g., the payment terminal 1010) of the payment terminal 1010. Figure 10A 3D camera (in the middle) is always on and periodically collects image data, focusing on facial information collection and optimization. The core includes a face acquisition unit 10121 and a face optimization unit 10122. A face recognition application 1011 calls the image acquisition device to collect the current facial streaming data of a second user. After the face acquisition unit 10121 acquires the facial streaming data, the face optimization unit 10122 optimizes the data. The optimization selects the optimal facial image (i.e., the first acquired facial image) through a comprehensive evaluation of factors such as face size, face angle, image contrast, image brightness, and clarity. This image is then sent to a non-identity verification unit 10133 for verification. If the verification result is non-identity (see reference...), the user is considered to have acquired the image. Figure 3 In step S330 of the embodiment, if "the maximum value of the similarity between the first collected face image of the first user and the k local cached face images of the payment terminal is less than the face similarity threshold", then the verification is successful, and the face image is cached as a local cached face image in the local face image set 1014.

[0130] The face data caching module 1013 needs to be called for effective verification after face image collection or when a user enters a mobile phone number (which is at least part of the identity information) for payment. The core of the verification after face image collection is to verify whether it is the same person, that is, whether the local face image set 1014 already has the face image. If it does, there is no need to re-enter it into the database. The comparison strategy is to calculate the first face similarity between the collected face image and all face images in the local face image set 1014 one by one. If the first face similarity is greater than the face similarity threshold (for example, 97), it is determined that it is the same person, and there is no need to re-enter it into the database.

[0131] When the first user enters a mobile phone number (i.e., at least some identity information), the mobile phone number verification module 1016 requests the payment server to obtain the target verification face corresponding to the mobile phone number stored in the database of the payment server 1020. The payment server 1020 then returns the local cached face image corresponding to the maximum similarity among the k second face similarities of the target verification face and k locally cached face images (see reference). Figure 4In the embodiments, steps S410 to S420 are used to name the current face image. The core of the time verification unit 10132 is to determine the caching time of the current face image on the device to reduce false recognition. The caching time threshold can be, for example, 30 minutes. For face images in the local face image set 1014, if the caching time exceeds 30 minutes, the face image data is judged to be illegal, and the user needs to perform explicit face collection and recognition and payment (see the relevant description of the explicit face recognition module 1017 below). That is, the deduction operation can only be performed on the first payment account if and only if the caching time of the current face image on the payment terminal 1010 is less than 30 minutes, and the second face similarity between the target verification face corresponding to the mobile phone number entered by the first user and any face image in the local face image set 1014 is higher than the face similarity threshold.

[0132] The local face image set 1014 is used to accept and store relevant requests from the face data caching module 1013, and to store face images in the terminal's database (e.g., SQLite).

[0133] The face data cleaning module 1015 is used to erase the current face image of the first user cached in the local face image set 1014 after receiving the successful deduction message from the first user's first payment account. Since the probability of the first user making a second payment within this time window is not high, removing the cached data of the first user can effectively reduce the database size and reduce false recognition.

[0134] The mobile phone number verification module 1016 is used to display the user's mobile phone number input interface on the display screen panel of the payment terminal 1010 by default. After the user inputs the mobile phone number, the payment terminal 1010 requests the face recognition service from the payment server 1020 with the mobile phone number and all the face images in the local face image set 1014.

[0135] The explicit face recognition module 1017 is used to perform face payment recognition using the original process when the first user requests the face recognition service of the payment server 1020 by entering a mobile phone number but there is no result. That is, after the image acquisition device of the payment terminal 1010 performs single face acquisition and selection of the first user, the user enters a mobile phone number, and requests the payment server 1020 to recognize and pay the current face image and mobile phone number of the first user.

[0136] The payment server 1020 includes a face recognition service 1021, a basic account service 1021, and a basic payment service 1022.

[0137] The face recognition service 1021 is used to receive face information query requests from the payment terminal 1010 (e.g., by the face explicit recognition module 1017 during the explicit face acquisition, recognition, and payment process). After the payment terminal 1010 uploads face data, the face recognition service 1021 extracts features from the face data and calculates the fourth face similarity between the features and the features in the database. It then returns the feature data with the highest fourth face similarity in the database, along with the account information corresponding to this feature data, as the first payment account to the payment terminal 1010. For example, within the WeChat Pay system, this ultimately returns the user's WeChat account or WeChat Pay payment code information. In this embodiment, the payment terminal 1010 sends all locally cached face images and the first user's mobile phone number to the payment server 1020 for face recognition. The recognition logic of payment server 1020 is as follows: it finds the target verification face corresponding to the current mobile phone number through the mobile phone number, and compares the target verification face with all local cached face images uploaded by payment terminal 1010 (assuming there are k local cached face images) one-to-k. It calculates the similarity of the target verification face with the k second faces of the local cached face images. If the second face similarity is greater than the face similarity threshold of the local cached face images, the comparison is considered successful. Basic account service 1022 returns the WeChat payment code (i.e., the first payment account) of the user corresponding to the mobile phone number, and basic payment service 1023 performs a deduction operation on the WeChat payment code.

[0138] Figure 11 A block diagram of a face-based payment system according to another embodiment of the present disclosure is shown schematically.

[0139] like Figure 11 As shown, the face-based payment system 1100 may include a payment terminal 1110 and a payment server 1120. The payment terminal 1110 is equipped with a merchant ERP application 1111 and a face application 1112.

[0140] The payment terminal 1110 may include an image acquisition device 1113, which may be, for example, a three-dimensional (3D) camera. The data output by the 3D camera includes not only RGB images but also depth maps and other relevant information, thereby enhancing the security of user facial recognition. The face-based payment system of this disclosure embodiment can be applied, for example, to the aforementioned face payment scenario 2.

[0141] The face recognition application 1112 includes a face recognition module (not shown in the figure), a data cache comparison module 1116, a verification module 1117, and a results page module 1118.

[0142] The face recognition module includes a face acquisition unit 1114 and a face selection unit 1115. The face acquisition unit 1114 can acquire faces in two ways: one requires active triggering by the user (e.g., the first user), such as when shopping in the merchant ERP application 1111, the user actively clicks the face payment button on the display screen panel of the payment terminal 1110 to acquire faces and make payment (as opposed to...). Figure 10 (Similar to the explicit face capture and recognition process in payment). Another method is one where the face recognition application's background service continuously performs silent data collection without requiring user intervention.

[0143] The face acquisition unit 1114 is configured to use a 3D camera to acquire RGB image streams and depth image streams, including the second acquired face image. The face selection unit 1115 can be configured to select the optimal face image through comprehensive evaluation based on factors such as face size, face angle, image contrast, image brightness, and sharpness. After successful acquisition and selection, the payment terminal 1110 will send the optimal face image to the face recognition service 1126 of the payment server 1120 via the network for face recognition. The face application 1112 interface will enter a waiting state, waiting for the payment server 1120 to return the final result of the payment query.

[0144] After the face capture selection is completed, while the face application 1112 is in a waiting state, the first user can click the "Cancel Face Payment" button on the display screen panel, and the payment terminal 1110 will generate a cancellation payment instruction.

[0145] When the data cache comparison module 1116 receives a payment cancellation instruction, it caches the best facial image of the first user as a local cached facial image in the data cache module, such as an SQLite database. After clicking the "Cancel Facial Payment" button, the first user can return to the merchant ERP application 1111 to continue selecting goods.

[0146] After the first user clicks the "Cancel Face Payment" button and returns to the merchant ERP application 1111, the face payment application 1112 continuously collects and optimizes faces according to a preset time period, then compares them with locally cached face images. When the first user continues shopping in the merchant ERP application 1111 and clicks face payment again, if the current recognition result is the same person, the locally cached face image is directly used as the face collection result, and the verification module 1117 is displayed. The user only needs to enter the last four digits to complete the payment. If the current recognition result is not the same person, the face collection and payment process is displayed.

[0147] The verification module 1117 is configured to perform additional verification based on the last four digits of the user's mobile phone number (i.e., at least part of the identity information) entered by the first user. Payment can only be executed after the backend verification is successful. This module, combined with the silent identification process for identical persons, can further control risks and prevent misidentification.

[0148] The results page module 1118 is configured to display the current payment result status of the user, which can be success, failure, or uncertain.

[0149] The payment server 1120 includes at least a face recognition service 1126, a basic account service 1127, a face payment service 1128, and a backend face database 1124.

[0150] The face recognition service 1126 is used to receive a locally cached face image uploaded from the payment terminal 1110, extract features from the locally cached face image, calculate the face similarity between the features and the features in the backend face database 1124, find the feature data with the highest face similarity, and return the account corresponding to the feature data with the highest similarity as the first payment account to the payment terminal 1110.

[0151] Basic account service 1127 is configured to receive user identifiers (such as full or partial identifier information) to retrieve basic information related to that user identifier.

[0152] For example, within the WeChat ecosystem, the facial recognition payment service 1128 returns the first user's WeChat account (i.e., the first payment account) and executes the deduction operation for the first payment amount.

[0153] Figure 12 A schematic diagram of an electronic device suitable for implementing embodiments of the present disclosure is shown. It should be noted that... Figure 12 The illustrated electronic device 1200 is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments disclosed herein.

[0154] like Figure 12 As shown, the electronic device 1200 includes a central processing unit (CPU) 1201, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1202 or a program loaded from a storage section 1208 into a random access memory (RAM) 1203. The RAM 1203 also stores various programs and data required for system operation. The CPU 1201, ROM 1202, and RAM 1203 are interconnected via a bus 1204. An input / output (I / O) interface 1205 is also connected to the bus 1204.

[0155] The following components are connected to I / O interface 1205: an input section 1206 including a keyboard, mouse, etc.; an output section 1207 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 1208 including a hard disk, etc.; and a communication section 1209 including a network interface card such as a LAN card, modem, etc. The communication section 1209 performs communication processing via a network such as the Internet. A drive 1210 is also connected to I / O interface 1205 as needed. Removable media 1211, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., are installed on drive 1210 as needed so that computer programs read from them can be installed into storage section 1208 as needed.

[0156] In particular, according to embodiments of this disclosure, the processes described below with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 1209, and / or installed from removable medium 1211. When the computer program is executed by central processing unit (CPU) 1201, it performs various functions defined in the system of this application.

[0157] It should be noted that the computer-readable medium disclosed herein may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium may be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having at least one wire, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media can also be any computer-readable medium other than computer-readable storage media, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0158] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing at least one executable instruction for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0159] The modules and / or units and / or sub-units described in the embodiments of this disclosure can be implemented in software or hardware, and the described modules and / or units and / or sub-units can also be located in a processor. The names of these modules and / or units and / or sub-units do not, in some cases, constitute a limitation on the module and / or unit and / or sub-unit itself.

[0160] On the other hand, this application also provides a computer-readable medium, which may be included in the electronic device described in the above embodiments; or it may exist independently and not assembled into the electronic device. The computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to perform the methods described in the following embodiments. For example, the electronic device may perform... Figure 2 or Figure 3 or Figure 4 or Figure 5 or Figure 6 The steps shown.

[0161] It should be noted that although several modules, units, or sub-units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to embodiments of this disclosure, the features and functions of two or more modules, units, or sub-units described above can be embodied in one module, unit, or sub-unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules, units, or sub-units.

[0162] From the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, touch terminal, or network device, etc.) to execute the methods according to the embodiments of this disclosure.

[0163] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0164] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A face-based payment method, characterized in that, include: The payment terminal receives a third-party facial payment request from a first user, and the payment terminal includes an image acquisition device. The second captured facial image of the first user is obtained through the image acquisition device; If a payment cancellation instruction from the first user is received before the payment success message returned in response to the third face payment request is received, then the second captured face image of the first user is cached as the first user's local cache face image in the local cache of the payment terminal. Within the time interval between receiving the first user's cancellation payment instruction and receiving the first face payment request including the first payment amount from the payment terminal, periodic face images are obtained through the image acquisition device according to a preset time period; if the third face similarity between the periodic face image and the locally cached face image is greater than or equal to the face similarity threshold, it is determined that the current recognition result is the same person, and the verification module is displayed to receive at least part of the first user's identity information through the payment terminal; The payment terminal sends at least part of the first user's identity information and the locally cached facial image to the payment server, so that the payment server can determine the first user's first payment account based on the first user's at least part of the identity information and the locally cached facial image; and perform a deduction operation on the first payment account corresponding to the first payment amount.

2. The method as described in claim 1, characterized in that, Before receiving the first user's first face payment request through the payment terminal, the method further includes: The payment terminal receives a second user's second facial payment request. A first captured face image is obtained through the image acquisition device, the first captured face image including the first captured face image of the second user and the first captured face image of the first user; If the maximum value of the first face similarity among the k first face similarities between the first user's first captured face image and the k locally cached face images of the payment terminal is less than the face similarity threshold, then the first captured face image of the first user is cached as the first user's local cached face image in the local cache of the payment terminal.

3. The method as described in claim 2, characterized in that, The at least partial identity information includes the full identity information of the first user; wherein sending the at least partial identity information of the first user and the locally cached face image to the payment server includes: The payment server sends the first user's full identity information and the locally cached face image to the payment server, so that the payment server can determine the target verification face and the account information to be verified for the first user based on the full identity information. If the maximum value of the similarity between the target verification face and the k second faces of the k locally cached face images is less than the face similarity threshold, then the account information to be verified is determined to be the first payment account of the first user.

4. The method as described in claim 3, characterized in that, Also includes: If the payment terminal receives a successful deduction message for the first payment account, it will delete the first user's locally cached face image from the payment terminal's local cache.

5. The method as described in claim 2, characterized in that, Obtaining the first captured face image through the image acquisition device includes: A first real-time image is obtained through the image acquisition device; Perform face detection on the first real-time image to obtain at least one first initial face image; Determine the evaluation dimension values ​​of the first initial face image under each evaluation dimension, wherein the evaluation dimension includes one or more of face image size, face angle, image contrast, image brightness, and image sharpness; The face image quality score of the first initial face image is determined based on the evaluation dimension values ​​of the first initial face image under each evaluation dimension. The first initial face image whose face image quality score is greater than the face image quality score threshold is determined as the first acquired face image.

6. The method as described in claim 1, characterized in that, Before the payment terminal receives the verification request from the target user, the method further includes: Send the second captured facial image of the first user to the payment server; If a payment cancellation instruction from the first user is received before the payment server receives the payment success message in response to the third face payment request, then the second captured face image of the first user is cached as the first user's local cache face image in the local cache of the payment terminal.

7. The method as described in claim 6, characterized in that, Also includes: During the time interval between receiving the first user's cancellation payment instruction t1 and receiving the first face payment request t2, the image acquisition device acquires periodic images according to a preset time period. Perform face detection on the periodic images to obtain periodic face images; If the third face similarity between the periodic face image and the locally cached face image is greater than or equal to the face similarity threshold, then the first payment account of the first user is determined using the locally cached face image.

8. The method as described in claim 7, characterized in that, Also includes: If the similarity of the third face is less than the face similarity threshold, then the face collection interface is displayed in response to the first face payment request. The image acquisition device of the payment terminal acquires a third facial image of the first user; The third facial image is sent to the payment server so that the payment server can determine the first user's first payment account based on the third facial image.

9. The method as described in claim 8, characterized in that, Sending the at least part of the identity information and the locally cached face image to the payment server includes: The at least partial identity identifier is sent to the payment server, so that the payment server determines the target account identifier code based on the first payment account; compares the at least partial identity identifier and the target account identifier code; and if the comparison results match, performs a deduction operation on the first payment account corresponding to the first payment amount.

10. The method as described in claim 6, characterized in that, Obtaining the second captured facial image of the first user through the image acquisition device includes: A second real-time image is obtained through the image acquisition device; Perform face detection on the second real-time image to obtain at least one second initial face image; Determine the evaluation dimension values ​​of the second initial face image under each evaluation dimension, wherein the evaluation dimension includes one or more of face image size, face angle, image contrast, image brightness, and image sharpness; The face image quality score of the second initial face image is determined based on the evaluation dimension values ​​of the second initial face image under each evaluation dimension; The second initial face image with a face image quality score greater than the face image quality score threshold is determined as the second acquired face image.

11. A face-based payment terminal, characterized in that, include: The third request acquisition unit is configured to receive a third face payment request from the first user through a payment terminal, wherein the payment terminal includes an image acquisition device. The second face acquisition unit is configured to acquire a second face image of the first user through the image acquisition device; The cancellation instruction receiving unit is configured to, if it receives the first user's cancellation instruction before receiving the payment success message returned in response to the third face payment request, cache the first user's second collected face image as the first user's local cache face image in the local cache of the payment terminal; The first request acquisition unit is configured to acquire periodic face images through an image acquisition device within a time period between the moment the first user cancels payment instruction and the moment the payment terminal receives the first face payment request including the first payment amount; if the third face similarity between the periodic face image and the locally cached face image is greater than or equal to the face similarity threshold, it is determined that the current recognition result is the same person, and the verification module is displayed to receive at least part of the identity information of the first user through the payment terminal; The payment request sending unit is configured to send at least part of the identity information of the first user and the locally cached face image to the payment server, so that the payment server can determine the first user's first payment account based on the first user's at least part of the identity information and the locally cached face image; and perform a deduction operation corresponding to the first payment amount on the first payment account.

12. A face-based payment server, characterized in that, The payment terminal includes an image acquisition device. The second captured facial image of the first user is obtained by the payment terminal through the image acquisition device when it receives a third facial payment request from the first user. If the payment terminal receives a payment cancellation instruction from the first user before receiving a payment success message in response to the third facial payment request, it will cache the second captured facial image of the first user as a local cached facial image in the payment terminal's local cache. The payment server includes: The payment request receiving unit is configured to, within the time period between receiving the first user's cancellation payment instruction and the time when the payment terminal receives the first face payment request including the first payment amount, obtain periodic face images through an image acquisition device according to a preset time period; if the third face similarity between the periodic face image and the locally cached face image is greater than or equal to the face similarity threshold, it is determined that the current recognition result is the same person, and the verification module receives at least part of the identity information of the first user sent by the payment terminal. The payment request execution unit is configured to determine the first user's first payment account based on at least part of the first user's identity information and the locally cached face image; and to perform a deduction operation on the first payment account corresponding to the first payment amount.

13. An electronic device, characterized in that, include: At least one processor; Storage device for storing at least one program; When the at least one program is executed by the at least one processor, the at least one processor implements the method as described in any one of claims 1-10.

14. A computer-readable medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 1-10.

15. A computer program product comprising a computer program, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 1-10.

Images