Authentication settlement system, staff member terminal, and authentication settlement method

Abstract

To enable a work load of staff members such as sales clerks, while boosting security of settlement.SOLUTION: An authentication settlement system is configured to be able to execute face collation processing (ST103) of selecting candidates of an authenticated person on the basis of a degree of similarity of a face image of the authenticated person to a face image for each registered person, PIN collation (ST106) based on a PIN the authenticated person inputs, settlement amount determination processing (ST105) of determining whether this settlement amount is equal to or more than a prescribed reference value, or not, multi-matching determination processing (ST112) of determining whether multi-matching having a plurality of candidates selected in the face collation processing occurs, or not, staff member collation processing (ST114) of, when the multi-matching occurs, causing a staff member to perform collation by a visual inspection, and acquire a result of the collation; staff member authorization processing (ST109) of asking the staff member to authorize an advance to settlement processing, and acquire a reply of the request; and, when a prescribed omission condition is executable, the face collation processing is succeeded, and the prescribed omission condition is satisfied, omit the staff member authorization processing.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an authentication and payment system in which one or more processors perform a process of matching an authenticated person based on at least biometric information, identifying the authenticated person based on the matching results, and instructing the execution of a payment process, an employee terminal in which a processor performs the processes necessary for authentication and payment in response to operations by an employee, and an authentication and payment method. [Background technology]

[0002] When making a cashless payment such as paying for a product purchased at a store, authentication payment systems that perform various types of identity authentication to identify the user are becoming widespread. In particular, as the accuracy of face matching has improved in recent years, face recognition is being adopted to improve user convenience. In addition, authentication payment systems that use multi-factor authentication are becoming widespread because authentication using a single factor has a high risk of payment due to mismatching.

[0003] As an example of an authentication payment system that employs such multi-factor authentication, a technology is known in which an IC card that stores a PIN and biometric information (fingerprint) is used, and if the payment amount is less than a set value, the PIN entered by the person to be authenticated is compared with the PIN stored on the IC card, and if the payment amount is more than the set value, the biometric information obtained from the person to be authenticated is compared with the biometric information stored on the IC card (see Patent Document 1).

[0004] In addition, there is known technology in which, if facial authentication fails at a counter terminal at a financial institution, a clerk visually checks the customer's face or asks the customer questions to verify the customer's identity or identity as an agent, and if the identity and agent verification are successful, the payment process proceeds (see Patent Document 1). [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2006-155636 A [Patent Document 2] JP 2005-301539 A Summary of the Invention [Problem to be solved by the invention]

[0006] The security of payments can be improved by adopting multi-factor authentication, as in the technology disclosed in Patent Document 1. Furthermore, the security of payments can be further improved by adding a confirmation task by a store clerk before proceeding with the payment process, as in the technology disclosed in Patent Document 2. However, there is a problem in that the workload of store clerks increases if a confirmation task is required every time authentication is performed.

[0007] Therefore, the main object of the present invention is to provide an authentication and payment system, an employee terminal, and an authentication and payment method that can increase the security of payments while reducing the workload of employees such as store clerks. [Means for solving the problem]

[0008] The authentication and payment system of the present invention is an authentication and payment system in which one or more processors execute a process of performing a match based on at least biometric information on a person to be authenticated, identifying the person to be authenticated based on the match result, and instructing the execution of a payment process, wherein the processor is capable of executing a first matching process that selects a candidate person to be authenticated based on the similarity between the biometric information of the person to be authenticated and the biometric information of each registered person, a second matching process based on information different from the first matching process, a payment amount determination process that determines whether the current payment amount is equal to or exceeds a predetermined reference value, a multi-match determination process that determines whether a multi-match has occurred in the first matching process, in which multiple candidates are selected, an employee matching process that, if a multi-match has occurred, has an employee visually match the candidate persons to be authenticated with registered persons and obtains the matching results, and an employee approval process that requests the employee's approval to proceed to the payment process and obtains the response, and is configured to omit the employee approval process if the first matching process is successful and a predetermined omission condition is satisfied.

[0009] In addition, the employee terminal of the present invention is an employee terminal equipped with a processor that performs the processes necessary for authentication and settlement in response to employee operation, and when a multi-match occurs in which multiple candidates are selected in a first matching process that selects candidates for the person to be authenticated based on the similarity between the biometric information of the person to be authenticated and the biometric information of each registered employee, the processor is capable of executing an employee matching process that has the employee visually match the candidates for the person to be authenticated with the registered employee and obtains the matching result, and an employee approval process that asks the employee for approval to proceed to the payment process and obtains the response, and is configured to omit the employee approval process if the first matching process is successful and specified omission conditions are met.

[0010] In addition, the authentication and payment method of the present invention is an authentication and payment method in which one or more processors execute a process of performing a match based on at least biometric information on a person to be authenticated, identifying the person to be authenticated based on the match result, and instructing the execution of a payment process, and is capable of executing the following: a first matching process that selects a candidate person to be authenticated based on the similarity between the biometric information of the person to be authenticated and the biometric information of each registered person; a second matching process based on information different from the first matching process; a payment amount determination process that determines whether the current payment amount is equal to or exceeds a predetermined reference value; a multi-match determination process that determines whether a multi-match has occurred in the first matching process, in which multiple candidates are selected; an employee matching process that, if a multi-match has occurred, has an employee visually match the candidate persons to be authenticated with the registered person and obtains the matching results; and an employee approval process that requests the employee's approval to proceed to the payment process and obtains the response, and is configured to omit the employee approval process if the first matching process is successful and a predetermined omission condition is satisfied. Effect of the Invention

[0011] According to the present invention, if the first matching process (e.g., face matching) is successful and the omission condition is met, approval by a staff member (e.g., a store clerk) is omitted and the payment process proceeds. On the other hand, if the omission condition is not met, approval by a staff member is obtained before the payment process proceeds. This can increase the security of the payment while reducing the workload of staff members such as store clerks. [Brief description of the drawings]

[0012] [Figure 1] Overall configuration diagram of authentication and payment system 1 according to the first embodiment [Diagram 2] FIG. 1 is a block diagram showing the schematic configuration of a customer terminal, a store clerk terminal, and an authentication server according to a first embodiment. [Diagram 3] FIG. 1 is an explanatory diagram showing a screen displayed on a store clerk terminal according to the first embodiment; [Figure 4] FIG. 1 is an explanatory diagram showing a screen displayed on a customer terminal according to the first embodiment; [Diagram 5]FIG. 1 is a flow diagram showing a procedure of processing performed in the authentication and payment system according to the first embodiment. [Figure 6] FIG. 1 is a flow diagram showing a procedure of processing performed in the authentication and payment system according to the first embodiment. [Figure 7] FIG. 1 is a sequence diagram showing an example of a procedure of processes performed by a customer terminal, a store clerk terminal, an authentication server, and a payment server according to the first embodiment; [Figure 8] FIG. 1 is a sequence diagram showing an example of a procedure of processes performed by a customer terminal, a store clerk terminal, an authentication server, and a payment server according to the first embodiment; [Figure 9] FIG. 1 is a sequence diagram showing an example of a procedure of processes performed by a customer terminal, a store clerk terminal, an authentication server, and a payment server according to the first embodiment; [Figure 10] FIG. 1 is a sequence diagram showing an example of a procedure of processes performed by a customer terminal, a store clerk terminal, an authentication server, and a payment server according to the first embodiment; [Figure 11] FIG. 11 is a flowchart showing a procedure of a process performed in an authentication and settlement system according to a first modified example of the first embodiment. [Figure 12] FIG. 11 is an explanatory diagram showing a store clerk verification screen displayed on a store clerk terminal according to a second modified example of the first embodiment; [Figure 13] FIG. 13 is a block diagram showing a schematic configuration of a customer terminal, a store clerk terminal, and an authentication server according to a third modified example of the first embodiment. [Figure 14] Overall configuration diagram of an authentication and payment system according to a second embodiment [Figure 15] Overall configuration diagram of an authentication and payment system according to the third embodiment DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] The first invention made to solve the above problem is an authentication and payment system in which one or more processors execute a process of performing a match based on at least biometric information on a person to be authenticated, identifying the person to be authenticated based on the match result, and instructing the execution of a payment process, wherein the processor is capable of executing a first matching process that selects candidates for the person to be authenticated based on the similarity between the biometric information of the person to be authenticated and the biometric information of each registered person, a second matching process based on information different from the first matching process, a payment amount determination process that determines whether the current payment amount is equal to or exceeds a predetermined reference value, a multi-match determination process that determines whether a multi-match has occurred in the first matching process, in which multiple candidates are selected, an employee matching process that, if a multi-match has occurred, has an employee visually match the candidates for the person to be authenticated with the registered person and obtains the matching results, and an employee approval process that requests the employee's approval to proceed to the payment process and obtains the response, and is configured to omit the employee approval process if the first matching process is successful and a predetermined omission condition is satisfied.

[0014] According to this, if the first matching process (e.g., face matching) is successful and the omission condition is met, approval by a staff member (e.g., a store clerk) is omitted and the payment process proceeds. On the other hand, if the omission condition is not met, approval by a staff member is obtained before the payment process proceeds. This makes it possible to reduce the workload of staff members such as store clerks while increasing the security of the payment process.

[0015] In addition, in the second invention, the processor reads the omission conditions contained in setting information previously stored in a predetermined memory unit immediately before instructing the execution of the payment processing, and if it is determined based on the omission conditions that the execution of the payment processing corresponds to a case in which the approval of an employee is not required, the processor omits the employee approval processing.

[0016] This makes it possible to change the omission conditions relatively easily without changing the process flow.

[0017] In addition, in a third invention, the processor is configured to omit the employee approval process when the omission condition is that the current payment amount is determined to be less than a predetermined reference value in the payment amount determination process and that there is no multi-match in the multi-match determination process.

[0018] According to this, since the payment amount this time is small, the risk of the payment is low, and since a multi-match has not occurred, it is highly likely that the person to be authenticated is the identified registered user, so the security of the payment can be ensured even if the employee approval process is not executed.

[0019] In a fourth aspect of the present invention, the processor is configured to omit the employee approval process when the omission condition is that the matching is successful in the second matching process.

[0020] According to this, since matching is successful in the second matching process as well as the first matching process, it is highly likely that the person to be authenticated is the identified registered person, and therefore the security of payment can be ensured even if the employee approval process is not executed.

[0021] In addition, in a fifth invention, the processor is configured to omit the employee approval process when the omission condition is that a multi-match is determined in the multi-match determination process and matching is successful in the employee matching process.

[0022] According to this, since the employee has confirmed that the person to be authenticated is the registrant, it is highly likely that the person to be authenticated is the identified registrant, and therefore the security of payment can be ensured even if the employee approval process is not executed.

[0023] In a sixth aspect of the present invention, the processor determines whether or not to omit the employee approval process based on the omission condition set for each facility or each terminal.

[0024] This allows the determination of whether or not to omit the employee approval process to be appropriately performed depending on the facility (eg, store) and the terminal.

[0025] In addition, a seventh aspect of the present invention is configured such that the processor determines whether or not to execute the employee matching process based on setting information set for each facility or each terminal.

[0026] This allows the determination of whether or not to execute the employee verification process to be appropriately performed depending on the facility (eg, store) and the terminal.

[0027] In addition, in an eighth invention, the processor is configured to omit the employee approval process when the omission condition is that the person to be authenticated is an individual whose number of uses at the current usage location within a specified period of time is equal to or exceeds a specified threshold value.

[0028] According to this, if the person to be authenticated identified by one registrant frequently uses the current location (the location where the current authentication was received), there is a high possibility that the person to be authenticated is the identified registrant himself / herself, so the security of payment can be ensured even if the employee approval process is omitted.

[0029] In addition, in a ninth invention, the processor is configured to omit the employee approval process when the omission condition is that an authenticated person identified as a single registered person in the first matching process or the employee matching process is present among people who have entered the facility through an entrance within a specified time period.

[0030] According to this, if the person to be authenticated is identified as one registered person and if a long time has not passed since a person assumed to be the same person as the person to be authenticated entered the facility through the entrance, it is highly likely that the person to be authenticated is the identified registered person, so the security of payment can be ensured even if the employee approval process is omitted. In this case, information on the person who entered the facility through the entrance may be obtained from an external system that manages people who use the facility.

[0031] In addition, the tenth invention includes a user terminal and an employee terminal, and the processor is configured to output a screen displaying information about the multiple candidates only to the employee terminal when the multi-match occurs and multiple candidates are selected, and not to the user terminal.

[0032] This makes it possible to protect the personal information of registrants.

[0033] In addition, an eleventh invention is configured to include an employee terminal, and the processor is configured to output a screen on the employee terminal in which multiple candidates selected in the first matching process are listed in order of highest similarity.

[0034] This allows staff to quickly perform visual comparison.

[0035] In addition, the 12th invention is configured to include a user terminal, an employee terminal, and an authentication server, wherein the processor provided in the user terminal executes the payment amount determination process, the processor provided in the employee terminal executes the employee matching process and the employee approval process, and the processor provided in the authentication server executes the first matching process, the second matching process, and the multi-match determination process.

[0036] This allows the processing to be appropriately shared among the user terminal, staff terminal, and authentication server.

[0037] In addition, a thirteenth invention is an employee terminal equipped with a processor which performs processing necessary for authentication and settlement in response to operation by an employee, wherein the processor is capable of executing an employee matching process in which an employee visually matches the candidates for the person to be authenticated with the registered person and obtains the matching result when a multi-match occurs in which multiple candidates are selected in a first matching process which selects candidates for the person to be authenticated based on the similarity between the biometric information of the person to be authenticated and the biometric information of each registered person, and an employee approval process in which the employee is asked for approval to proceed to the settlement process and a response is obtained, and wherein the employee approval process is omitted if the first matching process is successful and a predetermined omission condition is satisfied.

[0038] This, like the first invention, can increase the security of payments while reducing the workload of store clerks and other employees.

[0039] In addition, a fourteenth invention is an authentication and payment method in which one or more processors execute a process of performing a match based on at least biometric information on a person to be authenticated, identifying the person to be authenticated based on the match result, and instructing the execution of a payment process, the method being capable of executing a first matching process of selecting a candidate person to be authenticated based on the similarity between the biometric information of the person to be authenticated and the biometric information of each registered person, a second matching process based on information different from the first matching process, a payment amount determination process of determining whether the current payment amount is equal to or exceeds a predetermined reference value, a multi-match determination process of determining whether a multi-match has occurred in the first matching process, in which multiple candidates are selected, an employee matching process of having an employee visually match the candidates for the person to be authenticated with the registered person and obtaining the matching result if a multi-match has occurred, and an employee approval process of requesting the employee's approval to proceed to the payment process and obtaining the response, and being configured to omit the employee approval process if the first matching process is successful and a predetermined omission condition is satisfied.

[0040] This, like the first invention, can increase the security of payments while reducing the workload of store clerks and other employees.

[0041] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0042] (First embodiment) FIG. 1 is a diagram showing the overall configuration of an authentication and settlement system 1 according to the first embodiment.

[0043] The authentication and payment system 1 performs cashless payment such as payment for products purchased at a store, and in particular performs payment by identifying the customer (user) through facial recognition. The authentication and payment system 1 comprises multiple customer terminals 2 (user terminals), a store clerk terminal 3 (staff terminal), an authentication server 4, and a payment server 5. The customer terminals 2, the store clerk terminals 3, the authentication server 4, and the payment server 5 are connected to a network such as the Internet.

[0044] The customer terminal 2 is installed in the store at a location where payment is made (such as a checkout counter). The customer terminal 2 displays a screen related to authentication and payment. When paying for a purchase, the customer can perform the operations required for authentication and payment on the screen displayed on the customer terminal 2.

[0045] The store clerk terminal 3 is operated by a store clerk (employee) in the store. The store clerk terminal 3 displays a screen related to authentication and payment. When paying for a purchase, the store clerk can perform operations required for authentication and payment on the screen displayed on the store clerk terminal 3.

[0046] The authentication server 4 performs face matching based on an image of the face of the person to be authenticated (customer) who performs authentication and payment operations at the customer terminal 2. Furthermore, the authentication server 4 performs PIN matching based on a PIN (Personal Identification Number) entered by the person to be authenticated, if necessary. Furthermore, if the authentication is successful, the authentication server 4 notifies the payment server 5 that the authentication of the customer (person to be authenticated) has been successful, and instructs the payment server 5 to execute payment processing for the identified customer.

[0047] If the authentication is successful in the authentication server 4, the payment server 5 executes a payment process for the customer (person to be authenticated) notified by the authentication server 4, based on pre-registered information such as the customer's credit card.

[0048] The customer terminal 2 and the clerk terminal 3 may be integrated. That is, a shared terminal having the functions of both the customer terminal 2 and the clerk terminal 3 may be provided. In this case, the shared terminal may have a display and an input device on both the clerk side and the customer side.

[0049] The authentication server 4 may be configured in the cloud and connected to the customer terminal 2 and the clerk terminal 3 via a network such as the Internet, or the authentication server 4 may be configured on-premise and installed in a facility and connected to the customer terminal 2 and the clerk terminal 3 via a network such as a LAN. A cloud computer and an edge computer may be provided as the authentication server 4, with the cloud computer managing information of registrants (face information, name, etc.) and the edge computer executing processing related to individual authentication (face matching processing, etc.) in response to a request from the customer terminal 2.

[0050] In addition, in this embodiment, an authentication server 4 is provided, but it is also possible to omit the authentication server 4 by including the functions of the authentication server 4 in the customer terminal 2 or the store clerk terminal 3. In this configuration, authentication-related processes (such as face matching process) can be performed offline.

[0051] Next, a description will be given of the schematic configuration of the customer terminal 2, the clerk terminal 3, and the authentication server 4 according to the first embodiment. FIG.

[0052] The customer terminal 2 includes a camera 21, a display 22, an input device 23, a communication unit 24, a storage unit 25, and a processor 26.

[0053] The camera 21 captures the face of the customer (person to be authenticated).

[0054] The display 22 displays a screen related to authentication and payment. The input device 23 is used by a customer to perform input operations. A touch panel display in which a display panel as the display 22 and a touch panel as the input device 23 are integrated may be provided.

[0055] The communication unit 24 communicates between the store clerk terminal 3 and the authentication server 4 .

[0056] The storage unit 25 stores programs and the like executed by the processor 26. The storage unit 25 also stores setting information including processing conditions and the like related to each process executed by the processor 26.

[0057] Processor 26 performs various processes by executing programs stored in storage unit 25. In this embodiment, processor 26 performs a payment amount determination process, a PIN input process, and the like.

[0058] In the payment amount determination process, processor 26 determines whether the payment amount is equal to or exceeds a predetermined reference value.

[0059] In the PIN input process, processor 26 acquires a PIN in response to a PIN input operation performed by a customer using input device 23. Specifically, PIN input screen 231 (see FIG. 4(D)) is displayed on display 22, and a PIN is acquired in response to an operation by the customer on PIN input screen 231.

[0060] The store clerk terminal 3 includes a display 31, an input device 32, a communication unit 33, a storage unit 34, and a processor 35.

[0061] The display 31 displays a screen related to authentication and payment. The input device 32 is used by a store clerk to perform input operations. A touch panel display in which a display panel as the display 31 and a touch panel as the input device 32 are integrated may be provided.

[0062] The communication unit 33 communicates between the customer terminal 2 and the authentication server 4 .

[0063] The storage unit 34 stores programs and the like executed by the processor 35. The storage unit 34 also stores setting information including processing conditions for each process executed by the processor 35.

[0064] The processor 35 performs various processes by executing the programs stored in the storage unit 34. In this embodiment, the processor 35 performs a payment amount input process, a store clerk matching possibility determination process, a store clerk matching process (staff matching process), a store clerk approval possibility determination process, and a store clerk approval process (staff approval process).

[0065] In the payment amount input process, processor 35 acquires the payment amount in response to the operation of inputting the payment amount performed by the store clerk using input device 32. Specifically, payment amount input screen 101 (see FIG. 3(A)) is displayed on display 31, and the payment amount is acquired in response to the operation of the store clerk on payment amount input screen 101.

[0066] In the store clerk verification availability determination process, the processor 35 determines whether the store clerk verification process is available (whether it is valid or invalid) based on the setting information.

[0067] In the store clerk matching process, when a multiple match occurs, processor 35 has the store clerk perform visual matching, that is, visually compare the multiple registrants selected as candidates for the person to be authenticated in the face matching process with the person to be authenticated one by one to identify the person to be authenticated, and obtains the matching result. Specifically, store clerk matching screen 111 (see FIG. 3(B)) is displayed on display 31, and depending on the operation of the store clerk on store clerk matching screen 111, information on whether the matching was successful or not, that is, whether the person to be authenticated was identified as one person, and information on the registrants when one person was identified are obtained.

[0068] In the store clerk approval determination process, the processor 35 determines whether the store clerk approval process can be omitted (whether it is valid or invalid) based on the setting information.

[0069] In the clerk approval process, processor 35 requests the clerk for approval to proceed to the payment process and obtains the response. Specifically, clerk approval screen 121 (see FIG. 3(C)) is displayed on display 31, and the clerk's response as to whether or not to approve the payment is obtained according to the clerk's operation on clerk approval screen 121.

[0070] In this embodiment, the process for determining whether or not store clerk matching is enabled / disabled determines whether or not store clerk matching is to be performed, and the process for determining whether or not store clerk approval is enabled / disabled determines whether or not store clerk approval skip is enabled / disabled, that is, whether or not store clerk approval is to be omitted, but these determinations are made based on the determination conditions set in response to the operation of the manager. The determination conditions are stored as setting information in the storage unit 34 of the store clerk terminal 3, etc. Also, the determination conditions may be set for each facility (e.g., store), or may be set for each store clerk terminal 3.

[0071] The authentication server 4 includes a communication unit 41, a storage unit 42, and a processor 43.

[0072] The communication unit 41 communicates with the customer terminal 2, the store clerk terminal 3, and the payment server 5.

[0073] The storage unit 42 stores programs executed by the processor 43, etc. The storage unit 42 also stores registration information of a face information database. In the face information database, face information (facial feature amounts extracted from face images) of each person (registered person) who has undergone a registration process in advance is registered. The storage unit 42 also stores setting information including processing conditions related to each process executed by the processor 43, etc.

[0074] The processor 43 performs various processes by executing the programs stored in the storage unit 42. In this embodiment, the processor 43 performs face matching, multi-match determination, PIN matching, and the like.

[0075] In the face matching process, the processor 43 compares the face information (face feature amount) extracted from the face image of the person to be authenticated with the face information (face feature amount) of each person registered in the face information database (1:N matching) to obtain a matching score that indicates the similarity between the two. The matching score is compared with a predetermined threshold, and people with a matching score equal to or greater than the threshold are selected as candidates.

[0076] In the multi-match determination process, processor 43 determines whether or not a state (multi-match) has occurred in which multiple people have been selected as candidates for the person to be authenticated in the face matching process.

[0077] In the PIN matching process, the processor 43 compares the PIN entered by the person to be authenticated at the customer terminal 2 with the PIN of the registered person identified as the person to be authenticated in the face matching process or the store clerk matching process, and determines whether the two match.

[0078] Next, a description will be given of the screens displayed on the clerk terminal 3 according to the first embodiment. Fig. 3 is an explanatory diagram showing the screens displayed on the clerk terminal 3. Note that, in the clerk terminal 3, a standby screen (not shown) is appropriately displayed to notify the clerk that a predetermined process is being executed.

[0079] At the store clerk terminal 3, a payment amount input screen 101 shown in FIG. 3(A) is displayed on the display 31. The store clerk inputs the payment amount on the payment amount input screen 101. The store clerk can input the payment amount by operating the numeric keypad 102 on the payment amount input screen 101. When the store clerk confirms the input payment amount, he or she operates the "Confirm amount" button 103. This sends the input payment amount to the customer terminal 2.

[0080] In addition, in the store clerk terminal 3, a store clerk matching screen 111 shown in Fig. 3(B) is displayed on the display 31. When a multiple match occurs, the store clerk uses the store clerk matching screen 111 to visually match the face image (matching image) of the person to be authenticated with the face images (registered images) of registered people selected as candidates for the person to be authenticated in the face matching, thereby identifying the person to be authenticated.

[0081] The store clerk matching screen 111 is provided with a first face image display section 112 and a second face image display section 113. The first face image display section 112 displays the face image of the person to be authenticated, which is the source of matching, i.e., the face image of the person to be authenticated captured by the camera 21 of the customer terminal 2. The second face image display section 113 displays the face image of a registered person selected as a candidate for the person to be authenticated in the face matching. The store clerk visually compares the face of the person to be authenticated, the face image of the person to be authenticated, and the face image of the registered person to determine whether they are the same person.

[0082] In addition, the store clerk matching screen 111 is provided with a forward button 114 and a back button 115. When the store clerk operates the forward button 114, the facial image of the next registrant is displayed in the second facial image display section 113. When the store clerk operates the back button 115, the facial image of the previous registrant is displayed in the second facial image display section 113. This allows the store clerk to sequentially check the facial images of all registrants selected as candidates for the person to be authenticated.

[0083] Furthermore, the store clerk matching screen 111 is provided with a "Determine" button 117 and a "Cancel" button 118. If the store clerk finds a person identical to the person to be authenticated among the candidates for the person to be authenticated, the store clerk operates the determine button 117. On the other hand, if the store clerk does not find a person identical to the person to be authenticated among the candidates for the person to be authenticated, the store clerk operates the cancel button 118.

[0084] In addition, in the store clerk terminal 3, a store clerk approval screen 121 shown in Fig. 3(C) is displayed on the display 31. The store clerk approval screen 121 is used for inputting whether or not the store clerk approves proceeding with the payment.

[0085] The store clerk approval screen 121 is provided with a face image display section 122, a "Registered image" button 123, and a "Match image" button 124. When the store clerk operates the "Registered image" button 123, a face image of a registered person selected as a candidate for the person to be authenticated in face matching is displayed in the face image display section 122. When the store clerk operates the "Match image" button 124, a face image of the person to be authenticated that is to be the source of matching, i.e., a face image of the person to be authenticated captured by the camera 21 of the customer terminal 2, is displayed in the face image display section 122.

[0086] Additionally, the store clerk approval screen 121 is provided with a "Make facial payment" button 126, a "Cancel payment" button 127, and a "Take a new photo" button 128. If the store clerk approves that payment should proceed, he or she operates the "Make facial payment" button 126. On the other hand, if the store clerk does not approve that payment should proceed, he or she operates the "Cancel payment" button 127. Furthermore, if the store clerk operates the "Take a new photo" button 128, the process returns to face photography, and face matching is performed again using the retaken face image.

[0087] Furthermore, at the store clerk terminal 3, a payment completion screen 131 shown in FIG. 3(D) is displayed on the display 31. The payment completion screen 131 notifies the store clerk that the payment has been completed. The payment completion screen 131 has a "return to payment amount input" button 132. When the store clerk operates the "return to payment amount input" button 132, the screen returns to the payment amount input screen 101 (see FIG. 3(A)).

[0088] Meanwhile, on the clerk matching screen 111 (see FIG. 3(B)) and the clerk approval screen 121 (see FIG. 3(C)) displayed on the clerk terminal 3, an ID is displayed as identification information of a registered person who is a candidate for authentication, but the name of the registered person may also be displayed. Also, a nickname or membership number may be displayed as the identification information of a registered person. Also, the identification information of a registered person may not be displayed. Also, it may be possible for an administrator to specify whether or not to display the identification information of a registered person, and the content of the information.

[0089] In this embodiment, a store clerk (staff member) stationed at the store visually checks the person to be authenticated in person to determine whether or not the person to be authenticated is the registrant. However, for example, a staff member (staff member) stationed at an operation center may perform visual matching remotely. In this case, there is a possibility of fraudulent acts of impersonating another person. Therefore, in order to prevent impersonation, visual matching may be performed using video, or an image captured by a surveillance camera that captures the person to be authenticated in real time from a direction different from that of the camera 21 of the customer terminal 2 may be displayed together with the face image of the person to be authenticated.

[0090] Next, a description will be given of screens displayed on the customer terminal 2 according to the first embodiment. Fig. 4 is an explanatory diagram showing screens displayed on the customer terminal 2. Note that, in the customer terminal 2, a standby screen (not shown) is appropriately displayed to notify the customer that a predetermined process is being executed.

[0091] At the customer terminal 2, a payment amount confirmation screen 201 shown in FIG. 4(A) is displayed on the display 22. The payment amount confirmation screen 201 allows the customer to check whether there are any errors in the payment amount entered by the store clerk. When the customer confirms that there are no errors in the payment amount (amount to be paid), they press the "Confirm" button 202. However, if there is an error in the payment amount, the customer presses the "Cancel" button 203. In this case, the store clerk terminal 3 returns to the payment amount input screen 101 (see FIG. 3(A)).

[0092] Furthermore, in the customer terminal 2, a face matching screen 211 shown in Fig. 4(B) is displayed on the display 22. The face matching screen 211 allows the customer to confirm that face matching processing has started. The face matching screen 211 displays the face of the customer (person to be authenticated) photographed by the camera 21. Furthermore, if face matching is successful, the name of the person identified by face matching is displayed on the face matching screen 211.

[0093] Furthermore, in the customer terminal 2, a face matching failure screen 221 shown in Fig. 4(C) is displayed on the display 22. The face matching failure screen 221 notifies the customer that face matching has failed.

[0094] Furthermore, in the customer terminal 2, a PIN input screen 231 shown in Fig. 4(D) is displayed on the display 22. The PIN input screen 231 is used by the customer to input a PIN. The customer can input a PIN by operating the numeric keypad 232 on the PIN input screen 231. After inputting the PIN, the customer operates the "OK" button 233. Note that if the PIN verification fails, a PIN verification failure screen (not shown) is displayed.

[0095] Furthermore, in the customer terminal 2, a payment completion screen 241 shown in Fig. 4(E) is displayed on the display 22. The payment completion screen 241 notifies the customer that the payment has been completed.

[0096] Furthermore, in the customer terminal 2, a payment failure screen 251 shown in Fig. 4(F) is displayed on the display 22. The payment failure screen 251 notifies the customer that the payment has failed.

[0097] Here, in this embodiment, as shown in Fig. 3, when a multiple match occurs and multiple candidates are selected, the clerk terminal 3 displays a face image for each of the selected multiple candidates. Meanwhile, as shown in Fig. 4, the customer terminal 2 displays a face image of the person being authenticated who is viewing the screen, but does not display face images of anyone other than the person being authenticated, i.e., face images of each of the multiple candidates. This makes it possible to protect the personal information of registered persons. Furthermore, since the customer terminal 2 displays a face image of the person being authenticated who is viewing the screen, the customer can recognize that face matching is being performed appropriately.

[0098] Next, a procedure of processing performed in the authentication and payment system 1 according to the first embodiment will be described. Fig. 5 and Fig. 6 are flow diagrams showing a procedure of processing performed in the authentication and payment system 1. Fig. 5 shows the case of the first mode. Fig. 6 shows the case of the second mode.

[0099] 5, in the first mode, first, the payment amount is input by the store clerk at the store clerk terminal 3 (ST101). At this time, the store clerk terminal 3 displays a payment amount input screen 101 (see FIG. 3(A)).

[0100] Next, the customer confirms the payment amount at the customer terminal 2 (ST102). At this time, the customer terminal 2 receives the payment amount transmitted from the clerk terminal 3, and displays a payment amount confirmation screen 201 (see FIG. 4(A)).

[0101] Next, in the customer terminal 2, the camera 21 captures an image of the face of the person to be authenticated, and the authentication server 4 performs face matching on the facial image of the person to be authenticated (ST103). At this time, a face matching request is transmitted from the customer terminal 2 to the authentication server 4. The face matching request includes the facial image of the person to be authenticated. In addition, in the customer terminal 2, a face matching screen 211 (see FIG. 4(B)) is displayed.

[0102] Next, the customer terminal 2 judges whether or not face matching has been successful based on the face matching result transmitted from the authentication server 4 (ST104). If face matching has failed (No in ST104), the customer terminal 2 then displays a result indicating that face matching has failed (ST111). At this time, the customer terminal 2 displays a face matching failure screen 221 (see FIG. 4(C)).

[0103] On the other hand, if face matching is successful (Yes in ST104), the customer terminal 2 then determines whether the payment amount is equal to or exceeds a predetermined reference value (ST105).

[0104] If the payment amount is equal to or greater than the reference amount (Yes in ST105), the customer then inputs a PIN into the customer terminal 2, and the authentication server 4 performs PIN verification based on the input PIN (ST106). At this time, a PIN verification request is sent from the customer terminal 2 to the authentication server 4. Also, a PIN input screen 231 (see FIG. 4(D)) is displayed on the customer terminal 2.

[0105] Next, the store clerk terminal 3 determines whether or not the PIN verification has been successful based on the PIN verification result transmitted from the authentication server 4 (ST107).

[0106] If the PIN verification is successful (Yes in ST107), the store clerk terminal 3 then determines whether or not a store clerk approval skip (omission of the store clerk approval process) is valid (ST108).

[0107] If the clerk approval skip is disabled (No in ST108), the clerk terminal 3 then determines whether the clerk approved the current payment (ST109). At this time, the clerk terminal 3 displays the clerk approval screen 121 (see FIG. 3(C)).

[0108] If the store clerk approves this payment (Yes in ST109), the process proceeds to the payment process (ST110). On the other hand, if the store clerk approval skip is enabled (Yes in ST109), the process skips the payment process (ST110) and proceeds to the result display (ST111).

[0109] In ST110, the authentication server 4 notifies the payment server 5 that authentication of the customer (person to be authenticated) has been successful, and instructs the payment server 5 to execute a payment process for the identified customer (person to be authenticated). The payment server 5 executes the payment process for the identified customer.

[0110] If the payment is completed normally, the payment server 5 notifies the authentication server 4 that the payment is completed, and the authentication server 4 notifies the customer terminal 2 that the payment is completed. Next, the customer terminal 2 displays a result that the payment is completed (ST111). At this time, the customer terminal 2 displays a payment completion screen 241 (see FIG. 4(E)).

[0111] On the other hand, if the PIN verification fails, the authentication server 4 notifies the customer terminal 2 that the authentication has failed. Furthermore, if the payment server 5 fails, it notifies the authentication server 4 that the payment has failed, and the authentication server 4 notifies the customer terminal 2 that the payment has failed. Next, the customer terminal 2 displays the result that the payment has failed (ST111). At this time, a payment failure screen 251 (see FIG. 4(F)) is displayed on the customer terminal 2.

[0112] If the payment amount is less than the reference value (No in ST105), the authentication server 4 then determines whether the current face matching result is a multiple match (ST112).

[0113] If the current face matching result is not a multiple match (No in ST112), the process proceeds to the payment process (ST110).

[0114] On the other hand, if the current face matching result is a multiple match (Yes in ST112), the store clerk terminal 3 then determines whether the store clerk matching is valid (ST104).

[0115] If the clerk verification is valid (Yes in ST113), the clerk terminal 3 then determines whether the clerk verification was successful (ST114). At this time, the clerk terminal 3 displays a clerk verification screen 111 (see FIG. 3(B)).

[0116] If the store clerk verification is successful (Yes in ST114), the process proceeds to the payment process (ST110). On the other hand, if the store clerk verification is unsuccessful (No in ST114), the process proceeds to the result display (ST111).

[0117] If the store clerk verification is invalid (No in ST113), the process proceeds to PIN entry and PIN verification (ST106).

[0118] In this way, in the first mode, if the payment amount is small and no multiple matches have occurred, or if the payment amount is small and multiple matches have occurred and the clerk verification is successful, the clerk approval process (ST109) is omitted.

[0119] 6, in the second mode, if the PIN verification is successful (Yes in ST107), the payment process (ST110) is started. That is, unlike the first mode, if the PIN verification is successful (Yes in ST107), the store clerk approval determination process (ST108) and the store clerk approval process (ST109) are not executed.

[0120] In the second mode, if the current face matching result is not a multiple match (Yes in ST112), the process proceeds to the clerk approval determination process (ST108) and the clerk approval process (ST109). If the clerk matching is successful (Yes in ST114), the process proceeds to the clerk approval determination process (ST108), and if the clerk matching is unsuccessful (No in ST114), the process proceeds to the result display (ST111). At this time, the customer terminal 2 displays a payment failure screen 251 (see FIG. 4(F)).

[0121] In this way, in the second mode, if the PIN verification is successful, the store clerk approval process (ST109) is omitted.

[0122] As described above, in this embodiment, there is a first mode in which clerk approval is omitted when the payment amount is small and no multiple matching has occurred (first case), or when the payment amount is small and multiple matching has occurred and clerk verification is successful (second case), and a second mode in which clerk approval is omitted when PIN verification is successful (third case). The administrator can select either the first mode or the second mode. This mode selection is stored in the storage unit 42 of the authentication server 4 as setting information. In addition, the mode selection may be set for each facility (commercial facility such as a store or a shopping mall) or for each clerk terminal 3.

[0123] In this embodiment, a PIN verification process is performed when the payment amount is high, i.e., when the payment amount is equal to or exceeds a predetermined threshold value. However, the PIN verification process may not be performed and instead a store clerk approval process may be performed.

[0124] Next, the procedure of the process performed in each of the customer terminal 2, the clerk terminal 3, the authentication server 4, and the payment server 5 according to the first embodiment will be described. Figures 7, 8, 9, and 10 are sequence diagrams showing an example of the procedure of the process performed in each of the customer terminal 2, the clerk terminal 3, the authentication server 4, and the payment server 5. In particular, Figures 7, 8, 9, and 10 describe a case where the clerk approval process is omitted. Note that the description of the contents that overlap with the description of the flow diagrams shown in Figures 5 and 6 will be omitted as appropriate.

[0125] The example shown in Figure 7 is a case where the current payment amount is determined to be small in the payment amount determination process, i.e., the payment amount is determined to be less than a predetermined standard value, and the multi-match determination process determines that there is no multi-match. Since the omission condition is met, the store clerk approval process is omitted.

[0126] In this example, since the current payment amount is determined to be small in the payment amount determination process, the multi-match determination process is executed and it is determined in the multi-match determination process that there is no multi-match.

[0127] The examples shown in Figs. 8 and 9 are for a case where the PIN verification process is successful and the omission condition is met, so that the store clerk approval process is omitted.

[0128] In the example shown in FIG. 8, the payment amount determination process determines that the current payment amount is high, i.e., the payment amount is equal to or greater than a reference amount, so that the PIN verification process is executed and the verification is successful.

[0129] In the example shown in Figure 9, the payment amount is determined to be small in the payment amount determination process, that is, the payment amount is determined to be less than the reference value, so a multi-match determination process is executed, and because a multi-match is determined in the multi-match determination process, a store clerk matching feasibility determination process is executed, and because the store clerk matching feasibility determination process determines that store clerk matching is invalid, a PIN matching process is executed, and matching is successful in the PIN matching process.

[0130] The example shown in Figure 10 is a case where a multi-match is determined in the multi-match determination process and matching is successful in the store clerk matching process, i.e., the person to be authenticated is identified as a single registered person. Since the omission condition is met, the store clerk approval process is omitted.

[0131] In this example, the payment amount is determined to be small in the payment amount determination process, i.e., the payment amount is determined to be less than the standard value, so a multi-match determination process is executed, and because a multi-match is determined in the multi-match determination process, a store clerk matching feasibility determination process is executed, and because the store clerk matching feasibility determination process determines that store clerk matching is valid, a store clerk matching process is executed, and matching is successful in the clerk matching process, i.e., the person to be authenticated is identified as a single registered person.

[0132] In the present embodiment, face matching as the first matching and PIN matching as the second matching are performed. The first matching is performed using biometric information as personal identification information. The second matching is performed using personal identification information different from the first matching. The second matching may be performed using biometric information or may be performed using personal identification information different from the biometric information. That is, the first matching and the second matching may be so-called multimodal biometric authentication, which is performed using different biometric information such as a face and a fingerprint or a face and a voiceprint. In addition, the personal identification information other than the biometric information may be a telephone number, a password, or the like, in addition to the PIN. In addition, when a user terminal possessed by a customer is used as the customer terminal 2, information indicating that a user has logged in to the system by inputting a user ID and a password may be used as personal identification information other than the biometric information.

[0133] Furthermore, a user terminal (such as a smartphone) owned by a customer may be used as the customer terminal 2 by installing a payment application thereon. In this case, the customer may register a PIN in advance on the user terminal serving as the customer terminal 2, whereby the PIN may be stored in advance in the user terminal, thereby omitting PIN entry. Furthermore, the customer may select in advance to omit PIN entry, thereby omitting PIN entry. In this case, setting information for each customer regarding whether or not to omit PIN entry may be stored in the authentication server 4.

[0134] (First Modification of the First Embodiment) Next, a description will be given of a first modified example of the first embodiment. Fig. 11 is a flow diagram showing the procedure of processing carried out in the authentication and settlement system 1 according to the first modified example of the first embodiment.

[0135] In the first embodiment, in the first mode, if the payment amount is small and no multiple matches have occurred (first case), or if the payment amount is small and multiple matches have occurred and clerk verification is successful (second case), the clerk approval process (ST109) is omitted in the second mode if PIN verification is successful (third case). In the clerk approval determination process (ST108), it is determined whether or not to uniformly perform clerk approval based on the setting information specified by the administrator.

[0136] On the other hand, in this modified example, immediately before the payment process (ST110), a store clerk approval determination process (ST108) and a store clerk approval process (ST109) are executed. That is, when the payment amount is small and no multiple matches have occurred (first case), when the payment amount is small and multiple matches have occurred and store clerk verification has been successful (second case), or when PIN verification has been successful (third case), the process proceeds to the store clerk approval determination process (ST108), and depending on the result of the determination here, the store clerk approval process (ST109) is executed or omitted.

[0137] Here, in this modified example, the setting information includes omission conditions that allow omission of store clerk approval, and in the store clerk approval determination process (ST108), it is determined whether the execution of the payment process satisfies the omission conditions. That is, the omission conditions included in the setting information stored in advance in the storage unit 34 are read, and based on the omission conditions, it is determined whether the execution of the payment process corresponds to a case in which store clerk approval is not required, and if the execution of the payment process corresponds to a case in which store clerk approval is not required, the store clerk approval process (ST109) is omitted. On the other hand, if the execution of the payment process does not correspond to a case in which store clerk approval is not required, the store clerk approval process (ST109) is not omitted.

[0138] Specifically, the skip conditions are set to a case where the payment amount is small and no multiple matches have occurred (first case), a case where the payment amount is small and multiple matches have occurred and store clerk verification is successful (second case), and a case where PIN verification is successful (third case). Therefore, if these skip conditions are met, it is determined in the store clerk approval determination process (ST108) that the execution of the payment process does not require store clerk approval, and the store clerk approval process (ST109) is skipped.

[0139] In this modified example, the administrator may specify that clerk approval should not be performed under any circumstances. In this case, the clerk approval determination process (ST108) determines that clerk approval should not be performed under any circumstances.

[0140] (Second Modification of the First Embodiment) Next, a second modified example of the first embodiment will be described. Fig. 12 is an explanatory diagram showing a salesclerk verification screen 301 displayed on a salesclerk terminal 3 according to the second modified example of the first embodiment.

[0141] In the first embodiment, when a multiple match occurs, a store clerk matching screen 111 (see FIG. 3(B)) is displayed on the store clerk terminal 3 so that a store clerk can visually match the face image (matching image) of the person to be authenticated with the face images (registered images) of the registered persons selected as candidates for the person to be authenticated in the face matching to identify the person to be authenticated. On this store clerk matching screen 111, the face images (registered images) of the registered persons selected as candidates for the person to be authenticated are displayed one by one in turn.

[0142] Meanwhile, in this modified example, the store clerk matching screen 301 is provided with a first face image display section 112 and a second face image display section 311. As in the first embodiment (see FIG. 3(B)), the first face image display section 112 displays the face image of the person to be authenticated taken by the camera 21 of the customer terminal 2. Meanwhile, the second face image display section 311 displays a list of face images (registered images) of registered persons selected as candidates for the person to be authenticated in descending order of matching score (similarity). This enables the store clerk to quickly perform visual matching.

[0143] In addition, thumbnails of reduced-size facial images (registered images) of registered individuals selected as candidates for the person to be authenticated may be displayed in a list, and when a store clerk selects one of the thumbnails, the facial image of the registered individual (registered image) may be displayed at the same size as the facial image of the person to be authenticated (matching image).

[0144] Furthermore, on the store clerk matching screen 301, face images (registered images) of registered persons selected as candidates for persons to be authenticated may be displayed in a list in descending order of frequency of use (e.g., frequency of visits to a store). Also, a process may be performed to detect a sign of a customer's use (e.g., visit to a store) based on the customer's use history (e.g., visit history), that is, a state in which the customer is highly likely to use (e.g., visit to a store) in the near future, and face images of customers (registered persons) for which a sign of use has been detected based on the detection results may be preferentially displayed.

[0145] (Third Modification of the First Embodiment) Next, a description will be given of a third modified example of the first embodiment. Fig. 13 is a block diagram showing a schematic configuration of a customer terminal 2, a store clerk terminal 3, and an authentication server 4 according to the third modified example of the first embodiment.

[0146] In the first embodiment, the payment amount input by the clerk at the clerk terminal 3 is transmitted from the clerk terminal 3 to the customer terminal 2, but in this modification, the payment amount input by the clerk at the POS terminal 6 is transmitted from the POS terminal 6 to the customer terminal 2. This eliminates the need for the clerk to input the payment amount at the clerk terminal 3, thereby reducing the workload of the clerk.

[0147] The POS terminal 6 is disposed at the checkout counter of the store. The POS terminal 6 includes a display 61, an input device 62, a communication unit 63, a storage unit 64, and a processor 65.

[0148] The display 61 displays a screen related to sales information such as the name and price of the product purchased by the customer. The input device 62 is operated by the store clerk to input information about the purchased product. Note that a touch panel display in which a display panel as the display 61 and a touch panel as the input device 62 are integrated may be provided.

[0149] The communication unit 63 communicates with the customer terminal 2. The communication unit 63 also communicates with the POS server 7. The POS server 7 provides product information (price, etc.) to the POS terminal 6, and also collects and manages sales information from the POS terminal 6.

[0150] The storage unit 64 stores programs executed by the processor 65 and the like.

[0151] The processor 65 performs various processes by executing the programs stored in the storage unit 64. In this embodiment, the processor 65 performs a process of inputting a payment amount and the like.

[0152] In the payment amount input process, the processor 65 acquires the payment amount in response to the store clerk's input operation of the product using the input device 62. At this time, for example, when the store clerk operates a barcode reader serving as the input device 62 to read the barcode of the purchased product, the identification information of the purchased product is acquired, and the amounts corresponding to the identification information are tallied to calculate the payment amount.

[0153] As in the first embodiment, the customer terminal 2 includes a camera 21, a display 22, an input device 23, a communication unit 24, a storage unit 25, and a processor 26. As in the first embodiment, the communication unit 24 communicates with the store clerk terminal 3 and the authentication server 4, but in this modification, the communication unit 24 also communicates with the POS terminal 6. Specifically, the communication unit 24 receives the payment amount from the POS terminal 6. As in the first embodiment, the processor 26 performs a payment amount determination process, a PIN input process, and the like.

[0154] As in the first embodiment, the store clerk terminal 3 includes a display 31, an input device 32, a communication unit 33, a storage unit 34, and a processor 35. As in the first embodiment, the processor 35 performs store clerk matching feasibility determination processing, store clerk matching processing, store clerk approval feasibility determination processing, and store clerk approval processing. However, in this modification, unlike the first embodiment, the processor 35 does not perform payment amount input processing.

[0155] The authentication server 4 is the same as in the first embodiment.

[0156] The customer terminal 2 and the clerk terminal 3 may be integrated into the POS terminal 6, that is, all of the functions of the customer terminal 2 and the clerk terminal 3 may be included in the POS terminal 6. Also, some of the functions of the customer terminal 2 and the clerk terminal 3 may be included in the POS terminal 6. In this case, the POS terminal 6 may have a display 61 and an input device 62 on the clerk side and the customer side, respectively. Also, in this case, the POS terminal 6 may be configured as a multi-payment terminal (multifunctional payment terminal) and may perform face recognition payment according to this embodiment as one of various cashless payments such as electronic money, credit cards, and prepaid cards in addition to cash payments.

[0157] Second embodiment Next, a second embodiment will be described. Note that points that are not particularly mentioned here are the same as those in the above embodiment. Fig. 14 is an overall configuration diagram of an authentication and settlement system 1 according to the second embodiment.

[0158] In the first embodiment, the person to be authenticated is identified as one registered person through face matching, PIN matching, and store clerk matching, but if that registered person has frequently used the current usage location in the past, there is a high possibility that the person to be authenticated is the identified registered person. Therefore, in this embodiment, if the person to be authenticated has frequently used the current usage location, approval of the payment by the store clerk is omitted.

[0159] As shown in Fig. 14, in this embodiment, the authentication and settlement system 1 includes a management server 8. The management server 8 manages a usage history database. In the usage history database, information on authentications performed in the past, specifically, information on the usage location (e.g., a store, a facility, etc.) related to the authentication and the number of uses (e.g., the number of authentications) is registered as usage history information for each customer (user). The management server 8 obtains information on the customer and usage location related to each authentication from the authentication server 4, and registers the information in the usage history database.

[0160] When the person to be authenticated is identified, the store clerk terminal 3 acquires usage history information about the person to be authenticated from the management server 8 and determines whether the number of uses by the person to be authenticated within a specified period at the current usage location is equal to or exceeds a specified threshold value (N times) (store clerk approval determination process). Here, if the number of uses is equal to or exceeds the threshold value, the store clerk approval process is omitted. Note that if the number of uses at the current usage location is less than the threshold value, the store clerk approval process may not be omitted even if other conditions for omission are met.

[0161] The number of uses may be the number of times authentication was performed (number of authentication attempts), the number of times authentication was successful (number of authentication successes), or the number of times payments were made (number of payments).The number of uses may be the number of times a place of use related to each authentication was visited, specifically, the number of times a store related to authentication was entered (number of store entries), or the number of times a facility (e.g., a shopping mall) in which a store related to authentication is located (number of entries).

[0162] The management server 8 may be configured in the cloud or on-premise. The authentication server 4 may have the functions of the management server 8. The customer terminal 2 and the clerk terminal 3 may have the functions of the management server 8.

[0163] Third embodiment Next, a third embodiment will be described. Note that points not specifically mentioned here are the same as those in the above-mentioned embodiment. Fig. 15 is an overall configuration diagram of an authentication and settlement system 1 according to the third embodiment.

[0164] For example, at each store (sales floor) in a commercial facility such as a shopping mall, the authentication and payment system 1 is used for payment of the price of purchased goods. In this case, the people who are authenticated for payment using the customer terminal 2 at each store (sales floor) in the commercial facility are limited to those who have entered the commercial facility through an entrance and are present within the facility at the time of payment.

[0165] On the other hand, authentication may be performed on people entering a commercial facility such as a shopping mall through an entrance. In this case, if the visitors identified by a single registered person in the authentication at the time of entry include a person who is the same as the person to be authenticated identified by a single registered person in the authentication at the time of payment at a store in the commercial facility, there is a high possibility that the person to be authenticated is the identified registered person. Therefore, in this embodiment, if the visitors identified in the authentication at the time of entry include a person who is the same as the person to be authenticated identified in the authentication at the time of payment, approval of the payment by the store clerk is omitted.

[0166] As shown in Fig. 5, in this embodiment, the authentication and payment system 1 cooperates with an entrance management system 9 of a commercial facility. The entrance management system 9 includes an entrance camera 91 and a management server 92. The entrance camera 91 captures images of people entering through the entrance of the commercial facility. The management server 92 performs authentication of the entering person based on the image captured by the entrance camera 91, and identifies the entering person. Note that when authentication at the time of entry is performed based on face matching, the face matching may be performed by the authentication server 4.

[0167] The store clerk terminal 3 obtains the result of the authentication at the time of entry for people entering the commercial facility from the management server 92, and if the person to be authenticated identified in the authentication at the time of payment is among people who have been present within a predetermined time since entering the commercial facility through the entrance, the store clerk approval process is omitted. Note that the predetermined time may be set based on the average length of stay in the commercial facility, for example.

[0168] In addition, on the store clerk terminal 3, the store clerk matching screen 111 (see Figure 3 (B)) may display the result of the authentication at the time of entry for each candidate for authentication, i.e., information on whether or not the person is the person identified in the authentication at the time of entry.

[0169] When a person matching is performed between a person entering through the entrance of the commercial facility and a person leaving through the entrance, it is possible to ascertain the people who are in the commercial facility at the time of payment. In this case, the store clerk terminal 3 acquires information on the people who are in the commercial facility at the time of payment from the management server 92, and if the person to be authenticated identified in the authentication at the time of payment is among the people who are in the commercial facility at the time of payment, the store clerk approval process is omitted.

[0170] Also, person matching may be performed between a visitor who entered through the entrance of the commercial facility and a person to be authenticated who is authenticated for payment at the customer terminal 2. Specifically, the characteristics of the visitor extracted from the image captured by the entrance camera 91 may be compared with the characteristics of the person to be authenticated extracted from the image captured by the camera 21 of the customer terminal 2 to determine whether they are the same person. Here, if the person who entered through the entrance of the commercial facility and the person to be authenticated for payment at the customer terminal 2 are the same person, the store clerk approval process is omitted.

[0171] In the present embodiment, the authentication and payment system 1 is described as being targeted at commercial facilities such as shopping malls, but the facilities targeted by the authentication and payment system 1 are not limited to this.

[0172] As described above, the embodiments have been described as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to these, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made. In addition, it is also possible to combine the components described in the above embodiments to create new embodiments. [Industrial Applicability]

[0173] The authentication and payment system, employee terminal, and authentication and payment method of the present invention have the effect of reducing the workload of employees such as store clerks while increasing the security of payments, and are useful as an authentication and payment system in which one or more processors perform a process of matching the authenticated person based on at least biometric information, identifying the authenticated person based on the matching results, and instructing the execution of payment processing, an employee terminal in which a processor performs the processes necessary for authentication and payment in response to the employee's operations, and an authentication and payment method. [Explanation of symbols]

[0174] 1: Authentication payment system 2: Customer terminal (user terminal) 3: Store clerk terminal (staff terminal) 4: Authentication server 5: Payment server 6: POS terminal 7: POS server 8: Management server 9: Admission Control System 21: Camera 22: Display 23: Input device 26: Processor 31: Display 32: Input device 35: Processor 43: Processor 101: Payment amount input screen 111: Clerk verification screen 121: Clerk approval screen 201: Payment amount confirmation screen 231:PIN entry screen 301: Clerk verification screen

Claims

1. An authentication and payment system, comprising: one or more processors that execute a process of performing a match based on at least biometric information on an authenticated person, identifying the authenticated person based on a result of the match, and instructing execution of a payment process, The processor, a first matching process for selecting candidates for the person to be authenticated based on a degree of similarity between biometric information of the person to be authenticated and biometric information of each enrollee; A second matching process based on information different from that of the first matching process; a payment amount determination process for determining whether the current payment amount is equal to or greater than a predetermined threshold value; a multi-match determination process for determining whether or not a multi-match has occurred in which a plurality of candidates are selected in the first comparison process; an employee matching process for acquiring a matching result by having an employee visually match candidates for the authentication subject with registered employees when multiple matches occur; and an employee approval process for requesting an employee's approval for proceeding to the payment process and obtaining an answer to the request. An authentication and payment system characterized in that, if the first matching process is successful and a specified omission condition is satisfied, the employee approval process is omitted.

2. The processor, The authentication payment system described in claim 1, characterized in that immediately before instructing the execution of the payment processing, the omission conditions contained in the setting information stored in a predetermined memory unit are read, and if it is determined based on the omission conditions that the execution of the payment processing corresponds to a case where the approval of an employee is not required, the employee approval processing is omitted.

3. The processor, The authentication payment system described in claim 1, characterized in that the omission condition is that when the payment amount determination process determines that the current payment amount is less than a predetermined reference value and when the multi-match determination process determines that there is no multi-match, the employee approval process is omitted.

4. The processor, The authentication and settlement system according to claim 1, characterized in that, as the omission condition, if matching is successful in the second matching process, the employee approval process is omitted.

5. The processor, The authentication and payment system described in claim 1, characterized in that the omission condition is that if a multi-match is determined in the multi-match determination process and matching is successful in the employee matching process, the employee approval process is omitted.

6. The processor, 2. The authentication and settlement system according to claim 1, wherein it is determined whether or not to omit the employee approval process based on the omission conditions set for each facility or each terminal.

7. The processor, 2. The authentication and settlement system according to claim 1, wherein a determination is made as to whether or not to execute the employee verification process based on setting information set for each facility or each terminal.

8. The processor, The authentication and payment system described in claim 1, characterized in that the omission condition is that if the person to be authenticated is an individual whose number of uses within a specified period at the current location of use is greater than or equal to a specified threshold, the employee approval process is omitted.

9. The processor, The authentication and payment system described in claim 1, characterized in that the omission condition is that if there is an authenticated person identified as a single registered person in the first matching process or the employee matching process among the people who enter the facility through the entrance within a specified time period, the employee approval process is omitted.

10. A user terminal and an employee terminal are provided, The processor, The authentication and payment system described in claim 1, characterized in that when a multi-match occurs and multiple candidates are selected, a screen displaying information about the multiple candidates is output only to the employee terminal and not to the user terminal.

11. Equipped with employee terminals, The processor, 2. The authentication and settlement system according to claim 1, wherein a screen is output on the staff terminal in which the plurality of candidates selected in the first matching process are displayed in order of similarity.

12. The system includes a user terminal, an employee terminal, and an authentication server, The processor provided in the user terminal executes the payment amount determination process, The processor provided in the employee terminal executes the employee matching process and the employee approval process; The authentication and payment system according to claim 1, characterized in that the processor provided in the authentication server executes the first matching process, the second matching process, and the multi-match determination process.

13. An employee terminal having a processor that performs processing necessary for authentication and settlement in response to an operation by an employee, The processor, an employee matching process for acquiring a matching result by having an employee visually match the candidate for authentication with the registered person when a multi-match occurs in which multiple candidates are selected in a first matching process that selects candidates for authentication based on the similarity between the biometric information of the person to be authenticated and the biometric information of each registered person; and an employee approval process for requesting approval from the employee for proceeding with the payment process and obtaining an answer thereto. The employee terminal is characterized in that, when the first comparison process is successful and a predetermined omission condition is satisfied, the employee approval process is omitted.

14. 1. An authentication and payment method, comprising: performing a process of performing a match based on at least biometric information on an authenticated person, identifying the authenticated person based on a result of the match, and instructing execution of a payment process, the process being performed by one or more processors; a first matching process for selecting candidates for the person to be authenticated based on a degree of similarity between biometric information of the person to be authenticated and biometric information of each enrollee; A second matching process based on information different from that of the first matching process; a payment amount determination process for determining whether the current payment amount is equal to or greater than a predetermined threshold value; a multi-match determination process for determining whether or not a multi-match has occurred in which a plurality of candidates are selected in the first comparison process; an employee matching process for acquiring a matching result by having an employee visually match candidates for the authentication subject with registered employees when multiple matches occur; and an employee approval process for requesting an employee's approval for proceeding to the payment process and obtaining an answer to the request. An authentication and payment method characterized in that, if the first matching process is successful and a predetermined omission condition is satisfied, the employee approval process is omitted.

Images