Authenticated payment system, authenticated payment method and authenticated payment program

Abstract

To enhance user convenience while securing the security of payment.SOLUTION: A processor of an authenticated payment system can execute: face collation (ST104) for selecting candidates of a person to be authenticated based on a similarity between face information on the person to be authenticated and the face information for each registrant; PIN collation (ST107) based on a PIN input by the person to be authenticated; payment amount determination (ST105) of determining whether or not the PIN collation can be omitted depending on whether or not the present payment amount is greater than or equal to a predetermined reference value; and multi-matching determination (ST106) for determining whether or not a plurality of candidates for the person to be authenticated are selected in the face collation. When executing the face collation, executing the payment amount determination, and then, determining that a second collation process can be omitted and also when executing the multi-matching determination, so that one candidate for the person to be authenticated is selected in the face collation and the person to be authenticated is identified, the processor omits the PIN collation.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an authentication and payment system in which one or more processors perform a process of matching a person to be authenticated based on at least biometric information, identifying the person to be authenticated based on the matching results, and instructing the execution of a payment process; an authentication and payment terminal in which a processor performs the processes necessary for authentication and payment in response to user operations; and an authentication and payment method. [Background technology]

[0002] When making cashless payments, such as paying for goods purchased at a store, authentication payment systems that perform various types of identity authentication to identify the user are becoming widespread. In particular, as the accuracy of facial matching has improved in recent years, facial recognition is increasingly being adopted to improve user convenience. Furthermore, because authentication using a single factor carries a high risk of payment due to mismatch, authentication payment systems that use multi-factor authentication are becoming more common.

[0003] As an example of an authentication payment system that employs such multi-factor authentication, a technology is known in which an IC card storing a personal identification number and biometric information (fingerprint) is used, and if the payment amount is less than a set value, the personal identification number entered by the person to be authenticated is compared with the personal identification number stored on the IC card, and if the payment amount is more than the set value, the biometric information obtained from the person to be authenticated is compared with the biometric information stored on the IC card (see Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-155636 Summary of the Invention [Problem to be solved by the invention]

[0005] In conventional technology, the matching that compares the biometric information acquired from the person to be authenticated with the biometric information stored in an IC card is one-to-one authentication, whereas in contrast, the matching that registers the biometric information of each registrant in a database managed by a cloud server and compares the biometric information acquired from the person to be authenticated with the biometric information of each registrant is one-to-N authentication.

[0006] When 1:N authentication is performed using biometric authentication such as facial recognition, the biometric information obtained from the person to be authenticated is compared with the biometric information of each registered person, and people whose similarity (matching score) is above a threshold are selected as candidates. This can result in a multi-match, where multiple people are selected as candidates for the person to be authenticated. When a multi-match occurs, payment cannot be made because the person to be authenticated cannot be identified as a single person.

[0007] Furthermore, cashless payments that rely on authentication pose a risk of fraudulent activity, such as impersonating someone else or using a counterfeit IC card. In particular, authentication using a single factor, such as facial matching alone, may not be able to adequately eliminate fraudulent activity, increasing the risk of fraudulent activity.

[0008] On the other hand, if multi-factor authentication is performed by, for example, performing facial matching and matching using a PIN (Personal Identification Number), even if multiple matches occur in facial matching, the authenticated person can be identified to one person, and the likelihood of fraudulent activity being eliminated increases, reducing the risk of payment.

[0009] However, when PIN verification is performed in addition to facial verification, the person to be authenticated is required to enter a PIN after facial verification is completed, which can be very inconvenient for the user. Therefore, to improve user convenience, it is desirable to eliminate the need to enter a PIN as much as possible. However, conventional technologies do not take this into consideration at all, and are unable to improve user convenience while ensuring the security of payments.

[0010] Therefore, the main object of the present invention is to provide an authentication payment system, an authentication payment terminal, and an authentication payment method that can improve user convenience while ensuring the security of payments. [Means for solving the problem]

[0011] The authentication and payment system of the present invention is an authentication and payment system in which one or more processors execute a process of performing a match based on at least biometric information on a person to be authenticated, identifying the person to be authenticated based on the match result, and instructing the execution of a payment process, wherein the processor is capable of executing a first matching process that selects candidates for the person to be authenticated based on the similarity between the biometric information of the person to be authenticated and the biometric information of each registered person, a second matching process based on information different from the first matching process, a first determination process that determines whether the second matching process can be omitted based on predetermined determination criteria, and a second determination process that determines whether multiple candidates for the person to be authenticated have been selected in the first matching process, and is configured to omit the second matching process if the processor executes the first matching process and determines that the second matching process can be omitted, and if the processor executes the second determination process and one candidate for the person to be authenticated is selected and the person to be authenticated is identified in the first matching process, the second matching process is omitted.

[0012] In addition, the authentication and payment terminal of the present invention is an authentication and payment terminal in which a processor executes the processes necessary for authentication and payment in response to user operations, and is connected to an authentication server that is capable of executing a first matching process that selects a candidate for authentication based on the similarity between the biometric information of the person to be authenticated and the biometric information of each registered person, and a second matching process that is based on information different from the first matching process, and the processor executes a first judgment process that determines whether the second matching process can be omitted based on predetermined judgment criteria, and a second judgment process that determines whether multiple candidate for authentication has been selected in the first matching process, and is configured to omit the second matching process if it is determined that the second matching process can be omitted and if one candidate for authentication has been selected in the first matching process and the person to be authenticated has been identified.

[0013] In addition, the authentication and payment method of the present invention is an authentication and payment method in which one or more processors perform a process of performing a match based on at least biometric information on a person to be authenticated, identifying the person to be authenticated based on the match result, and instructing the execution of a payment process, and is capable of executing a first matching process of selecting a candidate person to be authenticated based on the similarity between the biometric information of the person to be authenticated and the biometric information of each registered person, a second matching process based on information different from the first matching process, a first determination process of determining whether the second matching process can be omitted based on predetermined determination criteria, and a second determination process of determining whether multiple candidate people to be authenticated have been selected in the first matching process, and is configured to omit the second matching process if the first matching process is executed and the first determination process determines that the second matching process can be omitted, and if the second determination process is executed and one candidate person to be authenticated is selected and the person to be authenticated is identified in the first matching process, the second matching process is omitted. [Effects of the Invention]

[0014] According to the present invention, if it is determined based on predetermined criteria that the second verification process can be omitted, the second verification process is omitted except in cases where multiple candidates for the person to be authenticated are selected in the first verification process (multiple matches), thereby preventing the user from feeling inconvenienced. This makes it possible to ensure the security of payments while improving user convenience. [Brief explanation of the drawings]

[0015] [Figure 1] Overall configuration diagram of the authentication and payment system according to the first embodiment [Figure 2] FIG. 1 is a block diagram showing the schematic configuration of an authentication payment terminal and an authentication server according to a first embodiment. [Figure 3] FIG. 1 is a flowchart showing the procedure of processing performed in the authentication and payment system according to the first embodiment. [Figure 4] FIG. 10 is an explanatory diagram showing a screen displayed on the authentication and payment terminal according to the first embodiment; [Figure 5] Overall configuration diagram of the authentication and payment system according to the second embodiment [Figure 6] FIG. 10 is a flowchart showing the procedure of processing performed in the authentication and payment system according to the second embodiment. [Figure 7] Overall configuration diagram of an authentication and payment system according to a second modification of the second embodiment [Figure 8] FIG. 10 is a flowchart showing the procedure of processing performed in the authentication and payment system according to the third embodiment. [Figure 9] Overall configuration diagram of an authentication and payment system according to the fourth embodiment [Figure 10] FIG. 10 is a flowchart showing the procedure of processing performed in the authentication and payment system according to the fourth embodiment. [Figure 11] Overall configuration diagram of an authentication and payment system according to the fifth embodiment [Figure 12] FIG. 13 is a flowchart showing the procedure of processing performed in the authentication and payment system according to the sixth embodiment. [Figure 13] FIG. 13 is a flowchart showing the procedure of processing performed in the authentication and payment system according to the seventh embodiment. [Figure 14] Overall configuration diagram of an authentication and payment system according to the eighth embodiment [Figure 15] FIG. 20 is an explanatory diagram showing a confirmation screen displayed on a confirmation terminal according to the eighth embodiment; DETAILED DESCRIPTION OF THE INVENTION

[0016] The first invention made to solve the above problem is an authentication and payment system in which one or more processors execute a process of performing a match based on at least biometric information on a person to be authenticated, identifying the person to be authenticated based on the match result, and instructing the execution of a payment process, wherein the processor is capable of executing a first matching process of selecting a candidate person to be authenticated based on the similarity between the biometric information of the person to be authenticated and the biometric information of each registered person, a second matching process based on information different from the first matching process, a first determination process of determining whether the second matching process can be omitted based on predetermined determination criteria, and a second determination process of determining whether multiple candidates for the person to be authenticated have been selected in the first matching process, and is configured to omit the second matching process if the processor executes the first matching process and determines that the second matching process can be omitted, and if the processor executes the second determination process and one candidate person to be authenticated is selected and the person to be authenticated is identified in the first matching process, the second matching process is omitted.

[0017] According to this, if it is determined based on predetermined criteria that the second matching process can be omitted, the second matching process is omitted except in cases where multiple candidates for the person to be authenticated were selected in the first matching process (multiple matches), which prevents the user from feeling inconvenienced. This makes it possible to ensure the security of payments while improving convenience for users.

[0018] In addition, in a second invention, the processor is configured to perform, as the first determination process, a payment amount determination that determines whether or not the second matching process can be omitted depending on whether the current payment amount is equal to or greater than a predetermined reference value.

[0019] This allows PIN verification to be appropriately omitted depending on the level of risk in the payment, thereby ensuring the security of payments while increasing convenience for users.

[0020] In addition, in a third invention, the processor is configured to set a range of normal payment behavior for each user in advance based on historical information regarding the user's payment behavior in each payment, perform a payment behavior determination to determine whether the current payment behavior is within the range of normal payment behavior, and determine whether the second matching process can be omitted based on the result of the determination.

[0021] According to this, if the user's current payment behavior does not fall within the range of normal payment behavior, i.e., if it deviates from past payment behavior trends, there is a high possibility that the current payment is fraudulent. In such cases, the second matching process is carried out to reduce the risk of payment and, in particular, to eliminate fraudulent payments due to impersonation, etc.

[0022] In addition, in a fourth invention, the processor is configured to perform, as the first determination process, a payment amount determination to determine whether or not the second matching process can be omitted depending on whether the current payment amount is equal to or greater than a predetermined reference value, and to perform, as the third determination process, the payment behavior determination.

[0023] This allows PIN verification to be appropriately omitted depending on the level of risk in the payment, thereby ensuring the security of payments while increasing convenience for users.

[0024] In a fifth aspect of the present invention, the processor performs the payment behavior determination as the first determination process.

[0025] This simplifies the procedure for determining whether or not PIN verification can be omitted depending on the level of risk involved in the payment.

[0026] In a sixth aspect of the present invention, the processor determines the payment behavior based on at least one of a payment location, a payment amount, and a payment object as the payment behavior.

[0027] This allows for appropriate judgment of payment behavior. The payment target is a product or service that is provided to a user and requires cashless payment for payment of the price or fee.

[0028] In addition, the seventh invention is configured such that when multiple candidates for the person to be authenticated are selected in the first matching process, the processor obtains information about people who are likely to be staying in the facility at the time of payment from a system that manages people who use the facility, and identifies the person to be authenticated based on the information about the people who are staying in the facility.

[0029] This means that even if multiple candidates for the person to be authenticated are selected in the first matching process (multi-match), the person to be authenticated can be identified by using information managed in an external system, thereby increasing the chances of omitting the second matching process.

[0030] In addition, an eighth invention is configured such that, as the first determination process, the processor determines whether the current payment behavior is a low-risk payment behavior based on the current payment amount and the similarity obtained in the first matching process.

[0031] This allows PIN verification to be appropriately omitted depending on the level of risk in the payment, thereby ensuring the security of payments while increasing convenience for users.

[0032] In addition, the ninth invention is configured such that, when multiple candidates for the person to be authenticated are selected in the first matching process, the processor provides candidate information regarding the selected multiple candidates to a confirmation terminal that can be operated by a facility employee, and the confirmation terminal obtains from the confirmation terminal personal identification information regarding a person identical to the person to be authenticated that the employee confirms from among the multiple candidates included in the candidate information, which information was obtained in response to the employee's operation, and identifies the person to be authenticated based on the personal identification information.

[0033] This allows staff to confirm the identity of the person to be authenticated by visually comparing the candidate information with the person to be authenticated or by verbally asking the person to be authenticated, thereby narrowing down multiple candidates selected through facial matching to one person.

[0034] Further, a tenth invention is an authentication and payment terminal in which a processor executes the processes necessary for authentication and payment in response to user operations, and an authentication server executes a process of performing a match based on at least biometric information on the person to be authenticated, identifying the person to be authenticated based on the match result, and instructing the execution of payment processing. The authentication and payment system is connected to an authentication server that is capable of executing a first matching process that selects a candidate person to be authenticated based on the similarity between the biometric information of the person to be authenticated and the biometric information of each registered user, and a second matching process that is based on information different from the first matching process. The processor executes a first determination process that determines whether the second matching process can be omitted based on predetermined determination criteria, and a second determination process that determines whether multiple candidate people to be authenticated have been selected in the first matching process. If it is determined that the second matching process can be omitted and one candidate person to be authenticated has been selected in the first matching process and the person to be authenticated has been identified, the second matching process is omitted.

[0035] This makes it possible to ensure the security of payments while improving convenience for users, similar to the first invention.

[0036] In addition, an eleventh invention is an authentication and payment method in which one or more processors perform a process of performing a match based on at least biometric information on a person to be authenticated, identifying the person to be authenticated based on the match result, and instructing the execution of a payment process, wherein the method is capable of performing a first matching process of selecting a candidate person to be authenticated based on the similarity between the biometric information of the person to be authenticated and the biometric information of each registered person, a second matching process based on information different from the first matching process, a first determination process of determining whether the second matching process can be omitted based on a predetermined determination criterion, and a second determination process of determining whether multiple candidates for the person to be authenticated have been selected in the first matching process, and is configured to omit the second matching process if the first matching process is performed and the first determination process determines that the second matching process can be omitted, and if the second determination process is performed and one candidate person to be authenticated is selected and the person to be authenticated is identified in the first matching process, the second matching process is omitted.

[0037] This makes it possible to ensure the security of payments while improving convenience for users, similar to the first invention.

[0038] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0039] (First embodiment) FIG. 1 is a diagram showing the overall configuration of an authentication and settlement system 1 according to the first embodiment.

[0040] The authentication and payment system 1 identifies a user (customer) through personal authentication when making a cashless payment such as paying for a product purchased at a store, and then makes the payment. The authentication and payment system 1 comprises multiple authentication and payment terminals 2, an authentication server 3, and a payment server 4. The authentication and payment terminals 2, the authentication server 3, and the payment server 4 are connected to a network such as the Internet.

[0041] The authentication and payment terminal 2 is installed at the location where payment is made in the store (such as the cash register). The authentication and payment terminal 2 displays a screen related to authentication and payment. When making a payment, the user can perform the operations necessary for authentication and payment on the screen displayed on the authentication and payment terminal 2.

[0042] The authentication server 3 performs face matching (first matching) based on an image of the user's face and PIN matching (second matching) based on the PIN (Personal Identification Number) entered by the user (personal identification number) on the user (person to be authenticated) performing authentication and payment operations at the authentication and payment terminal 2. If face matching and PIN matching are successful, the authentication server 3 notifies the payment server 4 that authentication of the user (person to be authenticated) has been successful, and instructs the payment server 4 to execute payment processing for the identified user. If predetermined conditions are satisfied, PIN matching is omitted. In this case, the authentication server 3 instructs the payment server 4 to execute payment processing only if face matching is successful.

[0043] If authentication is successful in the authentication server 3, the payment server 4 executes payment processing for the user (person to be authenticated) notified by the authentication server 3, based on information such as the user's credit card that has been registered in advance.

[0044] Next, a description will be given of the schematic configuration of the authentication payment terminal 2 and authentication server 3 according to the first embodiment. FIG.

[0045] The authentication and payment terminal 2 includes a camera 21 , a display 22 , a communication unit 23 , a storage unit 24 , and a processor 25 .

[0046] The camera 21 captures the face of the user (person to be authenticated).

[0047] The display 22 displays screens relating to authentication and payment.

[0048] The communication unit 23 communicates with the authentication server 3 .

[0049] The storage unit 24 stores programs executed by the processor 25 and the like.

[0050] The processor 25 performs various processes by executing the programs stored in the storage unit 24. In this embodiment, the processor 25 performs a payment amount determination process, a multi-match determination process, and the like.

[0051] In the payment amount determination process (first determination process), processor 25 determines whether or not to skip the PIN verification process (second verification process) depending on whether or not the payment amount is equal to or greater than a predetermined reference value.

[0052] In the multi-match determination process (second determination process), processor 25 determines whether or not a state has occurred in which multiple people have been selected as candidates for the person to be authenticated in the face matching process performed by authentication server 3 (multi-match).

[0053] The authentication server 3 includes a communication unit 31 , a storage unit 32 , and a processor 33 .

[0054] The communication unit 31 communicates with the authentication payment terminal 2 and the payment server 4.

[0055] The storage unit 32 stores programs executed by the processor 33. The storage unit 32 also stores registration information for a face information database. In the face information database, face information (face feature amounts extracted from face images) for each person (registrant) who has undergone a registration process in advance is registered.

[0056] The processor 33 performs various processes by executing programs stored in the storage unit 32. In this embodiment, the processor 33 performs face verification processing, PIN verification processing, and the like.

[0057] In the face matching process, processor 33 compares the facial information (facial feature amount) extracted from the face image of the person to be authenticated with the facial information (facial feature amount) of each person registered in the face information database (1:N matching) to obtain a matching score that represents the degree of similarity between the two. The matching score is compared with a predetermined threshold, and people whose matching score is equal to or greater than the threshold are selected as candidates.

[0058] In the PIN verification process, the processor 33 compares the PIN entered by the person to be authenticated at the authentication / payment terminal 2 with the PIN of the candidate selected in the face verification process, and determines whether or not the two match.

[0059] In this embodiment, the face information database is managed by the authentication server 3 (cloud server), but the authentication and payment terminal 2 may manage the face information database. In this case, for example, face information about users of the store where the authentication and payment terminal 2 is installed is registered in the face information database. Alternatively, an edge server may be installed on a facility-by-facility basis, and the edge server may manage the face information database. In this case, for example, face information about users of the facility is registered in the face information database.

[0060] In a large commercial facility such as a shopping mall, multiple stores are located in one facility, and an authentication and payment terminal 2 is installed in each of the multiple stores. In some cases, one facility consists of one store. In other cases, like a large store, an authentication and payment terminal 2 is installed in each of multiple sales areas, that is, multiple authentication and payment terminals 2 are installed in one store.

[0061] Furthermore, if the authentication and payment terminal 2 manages the face information database, the face matching process is performed in the authentication and payment terminal 2 rather than the authentication server 3. The PIN matching process may also be performed in the authentication and payment terminal 2. Conversely, processes such as the payment amount determination process and the multi-match determination process may also be performed in the authentication server 3 rather than the authentication and payment terminal 2.

[0062] Next, a description will be given of the processing carried out in the authentication and payment system 1 according to the first embodiment. Fig. 3 is a flow diagram showing the procedure of the processing carried out in the authentication and payment system 1. Fig. 4 is an explanatory diagram showing a screen displayed on the authentication and payment terminal 2.

[0063] First, the payment amount is input by a store clerk into the authentication and payment terminal 2 (ST101). At this time, the payment amount input screen shown in FIG. 4(A) is displayed on the authentication and payment terminal 2. The store clerk can input the payment amount by operating the numeric keypad on the payment amount input screen. After confirming the input payment amount, the store clerk presses the confirm button.

[0064] Next, the user confirms the payment amount at the authentication payment terminal 2 (ST102). At this time, the payment amount confirmation screen shown in FIG. 4(B) is displayed at the authentication payment terminal 2. The user can confirm the payment amount (amount to be paid) on the payment amount confirmation screen. After confirming the payment amount, the user presses the OK button. If there is an error in the payment amount, the user presses the CANCEL button, and the screen returns to the payment amount input screen shown in FIG. 4(A).

[0065] Next, the authentication and payment terminal 2 photographs the user's face with the camera 21, and the authentication server 3 performs face matching based on the user's facial image (ST103). At this time, the authentication and payment terminal 2 displays a face matching screen shown in FIG. 4(C). The face matching screen displays the user's face photographed by the camera 21. The face matching screen also displays the name of the person identified by face matching.

[0066] Next, in the authentication and payment terminal 2, the processor 25 determines whether or not face matching was successful based on the matching result sent from the authentication server 3 (ST104). If face matching fails (No in ST104), the authentication and payment terminal 2 then displays a result indicating that face matching failed (ST109). Specifically, a matching error screen as shown in Fig. 4(D) is displayed.

[0067] On the other hand, if face matching is successful (Yes in ST104), processor 25 then determines whether the payment amount is equal to or greater than a predetermined reference value (ST105).

[0068] If the payment amount is equal to or greater than the reference value (Yes in ST105), the user then inputs a PIN into the authentication payment terminal 2, and the authentication server 3 performs PIN verification based on the input PIN (ST107). At this time, the PIN input screen shown in FIG. 4(E) is displayed on the authentication payment terminal 2. The user can input the PIN by operating the numeric keypad on the PIN input screen. After inputting the PIN, the user presses the OK button.

[0069] Next, if the PIN verification is successful, the authentication server 3 notifies the payment server 4 that the authentication of the user has been successful, and instructs the payment server 4 to execute payment processing for the identified user (person to be authenticated). The payment server 4 executes payment processing for the identified user (ST108). At this time, the authentication payment terminal 2 displays the payment processing in progress screen shown in Figure 4 (F).

[0070] Next, when the payment server 4 has successfully completed the payment, it notifies the authentication server 3 that the payment has been completed, and the authentication server 3 notifies the authentication / payment terminal 2 that the payment has been completed. Next, the authentication / payment terminal 2 displays a result indicating that the payment has been completed (ST109). At this time, the authentication / payment terminal 2 displays the payment completion screen shown in Figure 4(G).

[0071] On the other hand, if the PIN verification fails, the authentication server 3 notifies the authentication / payment terminal 2 that authentication of the user has failed. Furthermore, if the payment is not completed successfully, the payment server 4 notifies the authentication server 3 that the payment cannot be made, and the authentication server 3 notifies the authentication / payment terminal 2 that the payment cannot be made. Next, the authentication / payment terminal 2 displays a message indicating that the payment cannot be made (ST109). At this time, the authentication / payment terminal 2 displays the payment error screen shown in FIG. 4(H).

[0072] If the payment amount is less than the reference value (No in ST105), the processor 25 in the authentication payment terminal 2 then determines whether the current face matching result is a multiple match (ST106). At this time, the authentication payment terminal 2 determines whether there is a multiple match based on the information on the face matching result acquired from the authentication server 3.

[0073] If the current face matching result is a multiple match (Yes in ST105), the process proceeds to PIN entry and PIN verification (ST107). On the other hand, if the current face matching result is not a multiple match (No in ST106), the process skips PIN entry and PIN verification (ST107) and proceeds to payment processing (ST108). At this time, the authentication payment terminal 2 notifies the authentication server 3 that PIN verification will be skipped, and the authentication server 3 notifies the payment server 4 that authentication of the user has been successful based on the success of only the face matching. Note that a number (master PIN code) that results in successful PIN verification for all users may be sent from the authentication payment terminal 2 to the authentication server 3, and the PIN verification performed by the authentication server 3 may essentially be omitted.

[0074] In this manner, in this embodiment, if it is determined that the payment amount is small and PIN verification can be omitted, PIN verification is omitted except in cases where multiple candidates for the person to be authenticated are selected in face verification (multiple matches), thereby avoiding inconvenience to the user. This ensures the security of the payment while improving user convenience.

[0075] In addition, in the authentication payment terminal 2, either a first flow including the PIN verification omission process (ST105, ST106) or a second flow not including the PIN verification omission process is set according to the operation of the store manager. When making a payment, either the first flow or the second flow is selected and executed based on the setting for each store. Furthermore, either the first flow or the second flow may be set for each authentication payment terminal 2 in addition to for each store.

[0076] Alternatively, a user terminal (such as a smartphone) owned by the user may be used as the authentication payment terminal 2 by installing a payment application. In this case, the user may register a PIN in advance on the user terminal serving as the authentication payment terminal 2, thereby pre-storing the PIN in the user terminal, thereby omitting the PIN entry. Alternatively, the user may pre-select omitting the PIN entry, thereby omitting the PIN entry. In this case, setting information for each user regarding whether or not to omit PIN entry may be stored in the authentication server 3.

[0077] In facial matching, a facial image of the person to be authenticated taken from the front is used. However, in addition to this frontal facial image, a facial image of the person to be authenticated taken from an oblique angle, for example, a facial image of the person facing left, may also be used. This improves the accuracy of facial matching and reduces the risk of payment. Alternatively, the person to be authenticated may be asked to perform a predetermined movement (gesture), and matching may be performed based on characteristics related to the way the person to be authenticated moves their body. This improves the accuracy of matching, and in particular improves the function of eliminating impersonation, thereby reducing the risk of payment.

[0078] In this embodiment, facial matching is performed as the first matching, and PIN matching is performed as the second matching. The first matching is performed using biometric information as personal identification information. The second matching is performed using personal identification information different from the first matching. The second matching may be performed using biometric information, or may be performed using personal identification information different from the biometric information. That is, the first matching and the second matching may be so-called multimodal biometric authentication, which is performed using different biometric information, such as a face and a fingerprint or a face and a voiceprint. Furthermore, personal identification information other than biometric information may be a telephone number, a password, or the like, in addition to a PIN. Furthermore, when a user terminal owned by a user is used as the authentication / payment terminal 2, information indicating that the user has logged in to the system by entering a user ID and password, for example, may be used as personal identification information other than biometric information.

[0079] (Second embodiment) Next, a second embodiment will be described. Note that points not particularly mentioned here are the same as those in the previous embodiment. Figure 5 is a diagram showing the overall configuration of an authentication and payment system 1 according to the second embodiment.

[0080] If the user's current payment behavior does not fall within the range of the user's normal payment behavior, i.e., if it deviates from the trends of past payment behavior, there is a high possibility that the current payment is fraudulent. Therefore, in this embodiment, a payment behavior determination (third determination process) is performed to determine whether the current payment behavior falls within the range of normal payment behavior. If the current payment behavior does not fall within the range of normal payment behavior, PIN verification is performed to reduce the risk of the payment. On the other hand, if the current payment behavior falls within the range of normal payment behavior, PIN verification is omitted because the risk of the payment is low.

[0081] In particular, in this embodiment, the payment behavior determination is based on the payment location as a payment behavior. That is, it is determined whether the current payment location is within the range of usual payment locations. Here, the payment location specifically refers to the store related to the current payment, the facility in which the store is located, or the area in which the store is located.

[0082] Specifically, if this is the first time a payment has been made at the store, the current payment location is determined to be outside the range of normal payment locations. Also, if this is the first time a payment has been made at the facility where the store is located, the current payment location is determined to be outside the range of normal payment locations. Also, if this is the first time a payment has been made in the area where the store is located, the current payment location is determined to be outside the range of normal payment locations.

[0083] Furthermore, if the authentication payment terminal 2 is installed in a store or the like, the payment location (store, facility, area) can be identified from the installation location of the authentication payment terminal 2. On the other hand, a user terminal (smartphone) carried by a user may be used as the authentication payment terminal 2 by installing a payment application on the user's device. In this case, the payment location can be identified by acquiring the user's own location information using a positioning system such as GPS provided in the authentication payment terminal 2.

[0084] As shown in FIG. 5, in this embodiment, the authentication and payment system 1 includes a management server 5. The management server 5 manages a history information database. Information about payments made in the past, specifically, information about payment locations (stores, facilities, and areas), is registered in the history information database as history information for each user. The management server 5 obtains information about the payment location for each payment from the authentication server 3 and registers that information in the history information database. The management server 5 also performs a process (payment behavior analysis) to generate information about the usual payment location (store, facility, and area) for each registrant from the information about the payment location for each payment.

[0085] The authentication server 3 obtains information about the usual payment locations (stores, facilities, areas) of the candidate person selected by face matching from the management server 5 and provides this information to the authentication payment terminal 2. Based on the information about the usual payment locations of the candidate person, the authentication payment terminal 2 determines whether or not the current payment location is within the range of usual payment locations (payment behavior determination).

[0086] In this embodiment, the history information is managed by the management server 5 (cloud server), but the history information related to the store may be managed by the authentication and payment terminal 2 installed in the store. In this case, the payment behavior determination for the store as the payment location can be performed only by the authentication and payment terminal 2.

[0087] Next, a procedure of processing carried out in the authentication and settlement system 1 according to the second embodiment will be described. FIG.

[0088] In the authentication and payment terminal 2, the processes of ST101 to ST109 are performed in the same manner as in the first embodiment (see FIG. 3), but in this embodiment, the process according to the determination result in the multi-match determination (ST106) is different.

[0089] That is, in the authentication payment terminal 2, when the processor 25 determines that the current face matching result is not a multiple match (No in ST106), the processor 25 then determines whether or not the current payment behavior is within the range of normal payment behavior (ST121). Specifically, it is determined whether or not the current payment location is within the range of normal payment locations.

[0090] If the current payment action does not fall within the range of normal payment actions (No in ST121), the process proceeds to PIN input and PIN verification (ST107). On the other hand, if the current payment action falls within the range of normal payment actions (Yes in ST121), the process skips PIN input and PIN verification (ST107) and proceeds to payment processing (ST108).

[0091] In this embodiment, if the user's current payment behavior does not fall within the range of normal payment behavior, i.e., if it deviates from past payment behavior trends, there is a high possibility that the current payment is fraudulent. In such cases, PIN verification is performed to reduce the risk of payment and, in particular, to eliminate fraudulent payments due to impersonation, etc.

[0092] (First modified example of the second embodiment) Next, a first modified example of the second embodiment will be described. Note that points not specifically mentioned here are the same as those in the above embodiment. Note that the configuration of the authentication and payment system 1 according to this modified example is the same as that of the second embodiment (see FIG. 5). In addition, the processing procedure performed by the authentication and payment system 1 according to this modified example is also the same as that of the second embodiment (see FIG. 6).

[0093] In the second embodiment, a determination is made as to whether the current payment behavior falls within the range of the candidate's usual payment behavior (payment behavior determination), and in particular, the payment behavior determination is made based on the payment location. On the other hand, in this modified example, the payment behavior determination is made based on the payment amount (see ST121 in FIG. 6). That is, a determination is made as to whether the current payment amount falls within the range of the candidate's usual payment amounts, and if the current payment amount falls within the range, PIN verification is omitted.

[0094] The management server 5 of the authentication and payment system 1 obtains information about the payment amount for each payment from the authentication server 3 and registers that information in the history information database. The management server 5 also performs a process (payment behavior analysis) to generate information about the range of normal payment amounts for each registrant from the information about the payment amount for each payment. For example, the average of past payment amounts may be calculated, and a predetermined range centered on that average may be set as the normal payment amount range.

[0095] (Second Modification of the Second Embodiment) Next, a second modified example of the second embodiment will be described. Note that points not specifically mentioned here are the same as those in the above embodiment. Figure 7 is an overall configuration diagram of an authentication and payment system 1 according to this modified example. Note that the processing procedure performed in the authentication and payment system 1 according to this modified example is the same as that in the second embodiment (see Figure 6).

[0096] In the second embodiment, a determination is made as to whether the current payment behavior falls within the range of the user's usual payment behavior (payment behavior determination), and in particular, the payment behavior determination is made based on the payment location. Furthermore, in the first modified example, the payment behavior determination is made based on the payment amount. On the other hand, in this modified example, the payment behavior determination is made based on the purchased items (see ST121 in FIG. 6). That is, a determination is made as to whether the current purchased items fall within the range of the user's usual purchased items, and if the current purchased items fall within the range of the user's usual purchased items, PIN entry is omitted. The range of purchased items refers to, for example, the product category to which the purchased items belong.

[0097] Here, the authentication server 3 can obtain information on the payment location and payment amount based on information on the authentication payment terminal 2 itself where the payment operation is performed and information input at the authentication payment terminal 2, but cannot obtain information on the purchased items, specifically, the details of the purchased items (type, unit price, quantity). Therefore, in this embodiment, the authentication payment system 1 cooperates with a POS system 6 (Point of sale system) to obtain information on the purchased items.

[0098] The POS system 6 includes a POS terminal 61 and a POS server 62. The POS terminal 61 is operated by a store clerk to input information about purchased items. The POS server 62 manages sales information about items in the store in accordance with input operations on the POS terminal 61.

[0099] The management server 5 of the authentication and payment system 1 acquires information about the purchased products in each payment from the POS server 62 and registers the information about the purchased products in the history information database. The management server 5 also performs a process (payment behavior analysis) to generate information about the range of normally purchased products for each registrant from the information about the purchased products in each payment.

[0100] The authentication server 3 obtains information about the range of normally purchased items for the candidate person selected by face matching from the management server 5 and provides the information to the authentication payment terminal 2. Based on the information about the range of normally purchased items for the candidate person, the authentication payment terminal 2 determines whether or not the purchased item this time is within the range of normally purchased items (payment behavior determination).

[0101] In this modified example, an example of a settlement related to payment for a product purchased at a store has been described, but similar processing can also be used for payments related to fees when a user uses various services.

[0102] In this modification, the authentication and payment system 1 can obtain information about purchased items, i.e., details of the purchased items (type, unit price, quantity), by linking with the POS system 6. In this case, the payment amount (total amount of purchased items) can be calculated in the authentication and payment system 1, eliminating the need for a store clerk to input the payment amount on the payment amount input screen (see FIG. 4(A)).

[0103] (Third embodiment) Next, a third embodiment will be described. It should be noted that the points not specifically mentioned here are the same as those in the previous embodiment. Fig. 8 is a flow chart showing the procedure of processing performed in the authentication and settlement system 1 according to the third embodiment.

[0104] In the first embodiment, a determination is made as to whether the payment amount is equal to or greater than a reference value (payment amount determination), and if the payment amount is equal to or greater than the reference value, i.e., if the payment risk is high, PIN verification is performed. In the second embodiment, in addition to the payment amount determination, if the current face matching result is not a multiple match, a determination is made as to whether the current payment behavior falls within the range of normal payment behavior (payment behavior determination), and if the current payment behavior does not fall within the range of normal payment behavior, i.e., if there is a possibility of fraudulent payment, PIN verification is performed.

[0105] On the other hand, in this embodiment, if the payment amount is above a reference value or if the payment behavior is not within the range of normal payment behavior, the payment is similarly considered to be a high-risk case, and therefore, instead of the payment amount determination in the first embodiment, a payment behavior determination similar to that in the second embodiment is made.

[0106] As shown in Figure 8, in the authentication payment terminal 2, processes ST101 to ST104 and ST106 to ST109 are performed as in the first embodiment (see Figure 3), but in this embodiment, a payment behavior determination (ST131) is performed instead of the payment amount determination (ST105) in the first embodiment.

[0107] That is, in the authentication payment terminal 2, if face matching is successful (Yes in ST104), the processor 25 then determines whether or not the current payment behavior falls within the range of normal payment behavior (ST131). Here, if the current payment behavior does not fall within the range of normal payment behavior (No in ST131), the process proceeds to PIN input and PIN matching (ST107).

[0108] On the other hand, if the current payment behavior falls within the range of normal payment behavior (Yes in ST131), then processor 25 determines whether the current face matching result is a multiple match (ST106).

[0109] If the current face matching result is a multiple match (Yes in ST106), the process proceeds to PIN entry and PIN verification (ST107). On the other hand, if the current face matching result is not a multiple match (No in ST106), the process skips PIN entry and PIN verification (ST107) and proceeds to payment processing (ST108).

[0110] (Fourth embodiment) Next, a fourth embodiment will be described. Note that points not particularly mentioned here are the same as those in the previous embodiments. Fig. 9 is an overall configuration diagram of an authentication and settlement system 1 according to the fourth embodiment.

[0111] For example, the authentication and payment system 1 is used to pay for purchased goods at each store (sales floor) in a facility such as a shopping mall. In this case, the person making the payment using the authentication and payment terminal 2 is limited to those who enter the facility through the entrance and are present within the facility at the time of payment. Therefore, in this embodiment, if multiple matches occur in the face matching results, the authentication and payment system 1 works in cooperation with the facility's entrance and exit management system 7 to identify the person making the payment (the person to be authenticated).

[0112] That is, the authentication and payment system 1 acquires information on people staying in the facility from the entrance and exit management system 7, and narrows down the candidates selected by face matching based on the information on the people staying in the facility. If the candidates can be narrowed down to one, PIN matching is omitted.

[0113] The entrance / exit management system 7 comprises an entrance camera 71 and a management server 72. The entrance camera 71 captures images of people entering and exiting the facility through the entrance. The management server 72 manages people currently staying within the facility (staying people) based on information about people detected from images captured by the entrance camera 71. Specifically, of the people who have entered the facility through the entrance, those who have not yet exited through the entrance are extracted as staying people.

[0114] The authentication server 3 acquires visiting person information about people staying in the facility from the management server 72 of the entrance / exit management system 7 and provides the visiting person information to the authentication / payment terminal 2. If multiple matches occur in the current face matching result, the authentication / payment terminal 2 narrows down the candidate persons to one based on the visiting person information. Specifically, person matching is performed between the person staying in the facility and the multiple candidate persons selected by face matching. If person matching is successful, that is, if any of the multiple candidate persons selected by face matching matches the person staying in the facility, that person is determined to be the person making the payment (the person to be authenticated).

[0115] In person matching, personal information about people staying in the facility, acquired by the entrance / exit management system 7, is compared with personal information about candidates selected by face matching, acquired by the authentication and payment system 1. Here, personal information includes name, address, attributes (gender, age, etc.), etc.

[0116] Next, a procedure of processing carried out in the authentication and settlement system 1 according to the fourth embodiment will be described. FIG.

[0117] In the authentication and payment terminal 2, the processes of ST101 to ST109 are performed in the same manner as in the first embodiment (see FIG. 3), but in this embodiment, the process according to the determination result in the multi-match determination (ST106) is different.

[0118] That is, in the authentication and payment terminal 2, when the processor 25 determines that the current face matching result is a multiple match (Yes in ST105), the processor 25 then determines whether or not the candidate persons can be narrowed down to one person based on the visiting person information acquired from the entrance and exit management system 7 (ST141). If the candidate persons cannot be narrowed down to one person (No in ST141), the process proceeds to PIN input and PIN verification (ST107). On the other hand, if the candidate persons can be narrowed down to one person (Yes in ST141), the process skips PIN input and PIN verification (ST107) and proceeds to payment processing (ST108).

[0119] In this embodiment, even when multiple candidates for the person to be authenticated are selected in face matching (multi-match), the person to be authenticated can be identified by using a database managed by an external system, thereby increasing the opportunities to omit PIN entry and PIN matching.

[0120] (Fifth embodiment) Next, a fifth embodiment will be described. Note that points not specifically mentioned here are the same as those in the previous embodiments. Figure 11 is an overall configuration diagram of an authentication and payment system 1 according to the fifth embodiment. Note that the processing procedure performed in the authentication and payment system 1 according to the fifth embodiment is the same as that in the fourth embodiment (see Figure 10).

[0121] Some facilities, such as facilities where various events are held (concert venues, event halls, movie theaters, etc.), require reservations in order to use the facility. In such facilities, the person making a payment using the authentication payment terminal 2 is limited to those who are staying in the facility at the time of payment, i.e., those who have made a reservation to use the facility at the time of payment. Therefore, in this embodiment, if multiple matches occur in the face matching results, the system works in cooperation with the facility's reservation management system 8 to identify the person making the payment.

[0122] That is, the authentication and payment system 1 acquires from the reservation management system 8 reservation person information (staying person information) about the person who made the reservation to use the facility at the time of payment, i.e., the person who is staying in the facility at the time of payment, and narrows down the multiple candidate persons selected by face matching based on the reservation person information. Here, if the candidate persons can be narrowed down to one, PIN matching is omitted.

[0123] The reservation management system 8 comprises a reservation terminal 81 and a management server 82. The reservation terminal 81 is used by people who wish to make reservations. The management server 82 accepts reservations from people who wish to make reservations in response to the reservation operations on the reservation terminal 81, and manages the reservation status for each person.

[0124] The authentication server 3 obtains reservation person information (staying person information) regarding the person who has made a reservation to use the facility at the time of payment from the management server 82 of the reservation management system 8, i.e., the person who is staying in the facility at the time of payment, and provides the reservation person information to the authentication payment terminal 2.

[0125] If multiple matches occur in the current facial matching result, the authentication payment terminal 2 narrows down the candidate persons to one based on the reservation person information. Specifically, person matching is performed between the person who made the reservation to use the facility at the time of payment and the multiple candidate persons selected by facial matching. Here, if person matching is successful, that is, if any of the multiple candidate persons selected by facial matching matches the person who made the reservation to use the facility at the time of payment, that person is determined to be the person making the payment (the person to be authenticated).

[0126] The processing procedure performed by the authentication and payment system 1 in this embodiment is the same as that in the fourth embodiment (see Figure 10), but in this embodiment, in the narrowing down judgment (ST141), it is determined whether or not the candidate persons can be narrowed down to one person based on the reservation person information obtained from the reservation management system 8.

[0127] (Sixth embodiment) Next, a sixth embodiment will be described. The points not specifically mentioned here are the same as those of the previous embodiments. Fig. 12 is a flow chart showing the procedure of processing performed in the authentication and settlement system 1 according to the sixth embodiment.

[0128] PIN verification (second verification) is preferably performed when the risk of the payment behavior is high, and can be omitted when the risk of the payment behavior is low. In other words, the necessity of PIN verification can be determined depending on the level of risk of the payment. Therefore, in this embodiment, a payment risk determination is performed to determine whether the current payment behavior is a low-risk payment behavior. If the current payment behavior is a low-risk payment behavior, PIN verification is omitted.

[0129] As shown in Figure 12, in the authentication and payment terminal 2, processes ST101 to ST109 are performed in the same manner as in the second embodiment (see Figure 6), but in this embodiment, the processing depending on the judgment result in the multi-match judgment (ST106) is different.

[0130] That is, in the authentication payment terminal 2, if the processor 25 determines that the current face matching result is not a multiple match (No in ST106), the processor 25 then determines whether the current payment action is a low-risk payment action (ST151). If the current payment action is a high-risk payment action (No in ST151), the process proceeds to PIN input and PIN verification (ST107). On the other hand, if the current payment action is a low-risk payment action (Yes in ST151), the process skips PIN input and PIN verification (ST107) and proceeds to payment processing (ST108).

[0131] Here, the authentication payment terminal 2 calculates a risk assessment value that indicates the level of risk of this payment action, and if the risk assessment value is less than a predetermined threshold, PIN verification is omitted. The risk assessment value is calculated based on the payment amount and the facial matching score (similarity). Specifically, for example, the risk assessment value is calculated by multiplying the payment amount by the facial matching score (reciprocal). The assessment value expresses the level of risk, and if the payment amount is high or the score is low, the risk is high and the risk assessment value is large. Conversely, if the payment amount is low or the score is high, the risk is low and the risk assessment value is small.

[0132] As a result, if the payment amount is high and the score is low, PIN verification is not omitted because the risk is high. On the other hand, if the payment amount is low and the score is high, PIN verification is omitted because the risk is low. Also, if the payment amount is low, PIN verification may be omitted even if the score is not high. Also, if the score is high, PIN verification may be omitted even if the payment amount is not low.

[0133] In this way, in this embodiment, PIN verification is appropriately omitted depending on the level of risk in the payment, thereby ensuring the security of the payment while improving convenience for the user.

[0134] (Modification of the sixth embodiment) Next, a modified example of the sixth embodiment will be described. Note that the points not particularly mentioned here are the same as those in the above-mentioned embodiment. Note that the processing procedure performed in the authentication and settlement system 1 according to this modified example is the same as that in the sixth embodiment (see FIG. 12).

[0135] In the sixth embodiment, a risk assessment value that indicates the risk level of the payment behavior is calculated based on the payment amount and the facial matching score (similarity), and whether PIN verification can be omitted is determined based on the risk assessment value. On the other hand, in this modified example, the risk of the payment behavior is set based on the content of the payment behavior, and whether PIN verification can be omitted is determined depending on whether the current payment behavior is a low-risk payment behavior.

[0136] Specifically, for example, if the payment is a prepaid payment, i.e., if the payment is within the amount deposited in advance, the payment is considered low-risk and PIN entry is omitted. On the other hand, if the payment amount exceeds the prepaid amount and automatic credit top-up is required, the payment is considered high-risk and PIN entry is required.

[0137] (Seventh embodiment) Next, a seventh embodiment will be described. Note that points not particularly mentioned here are the same as those in the previous embodiments. Fig. 13 is a flow diagram showing the procedure of processing performed in the authentication and settlement system 1 according to the seventh embodiment.

[0138] If multiple matches occur in the face matching results, a single person cannot be identified, making payment impossible, and PIN matching (second matching) is therefore required. On the other hand, if the threshold value for face matching is set high, multiple matches are less likely to occur in the face matching results, and PIN matching can be omitted. Therefore, in this embodiment, if multiple matches occur in the face matching results, the threshold value for face matching is increased by a predetermined value, and face matching is performed again. Furthermore, if the multiple matches are not resolved by the second face matching, the threshold value is changed in stages, and face matching is repeatedly performed until the multiple matches are resolved.

[0139] As shown in Figure 13, the authentication and payment terminal 2 performs processes ST101 to ST109 in the same manner as in the first embodiment (see Figure 3), but in this embodiment, the processes depending on the judgment result in the multi-match judgment (ST101) are different.

[0140] That is, in the authentication and payment terminal 2, when the processor 25 determines that the current face matching result is a multiple match (Yes in ST106), the processor 25 then changes the threshold value for face matching (ST161) and returns to face matching (ST103). That is, in the authentication server 3, face matching is performed again based on the changed threshold value.

[0141] In this way, in this embodiment, if multiple matches occur in the face matching results, the threshold value is changed in stages and face matching is performed repeatedly until the multiple matches are resolved, thereby identifying the person to be authenticated and eliminating the need to enter a PIN, thereby improving convenience for the user.

[0142] (Eighth embodiment) Next, an eighth embodiment will be described. Note that points not specifically mentioned here are the same as those of the previous embodiments. Figure 14 is an overall configuration diagram of an authentication and payment system 1 according to the eighth embodiment. The processing procedure performed in the authentication and payment system 1 according to the eighth embodiment is the same as that of the fourth embodiment (see Figure 10).

[0143] In the fourth and fifth embodiments, when a multi-match occurs in which multiple candidates for the person to be authenticated are selected, the multiple candidates selected by face matching are narrowed down to one based on the visiting person information about people staying in the facility. On the other hand, in this embodiment, when a multi-match occurs, a store clerk (a facility employee) who faces the person to be authenticated visually confirms the identity of the person to be authenticated, thereby narrowing down the multiple candidates selected by face matching to one. Note that, although the following description uses an example in which the store clerk and the person to be authenticated face to face, the store clerk does not necessarily need to face the person to be authenticated, as long as the store clerk is in a situation in which the identity of the person to be authenticated can be confirmed by visual confirmation or other means.

[0144] In this embodiment, the authentication and payment system 1 includes a confirmation terminal 9. The confirmation terminal 9 can be operated by a store clerk. When a multiple match occurs in face matching, the authentication server 3 transmits candidate information about multiple registered individuals selected as candidates for the person to be authenticated to the confirmation terminal 9. The confirmation terminal 9 displays the candidate information received from the authentication server 3 on its screen. The store clerk verifies the identity of the person to be authenticated by visually comparing the candidate information displayed on the confirmation terminal 9 with the person to be authenticated in person, or by verbally asking the person questions. The confirmation terminal 9 transmits the identity verification information acquired in response to the store clerk's operation to the authentication server 3.

[0145] Specifically, if a person identical to the person to be authenticated is found among the candidates for the person to be authenticated, personal identification information including information on a registrant who matches the person to be authenticated is sent to the authentication server 3. On the other hand, if a person identical to the person to be authenticated is not found among the candidates for the person to be authenticated, personal identification information including information to the effect that there is no registrant who matches the person to be authenticated is sent to the authentication server 3.

[0146] When the authentication server 3 receives the personal identification information from the confirmation terminal 9, it transmits the personal identification information to the authentication and payment terminal 2.

[0147] In the narrowing-down determination (ST141 in FIG. 10), the authentication and payment terminal 2 determines, based on the personal verification information acquired from the authentication server 3, whether or not the candidates can be narrowed down to one person.

[0148] Next, a confirmation screen 101 displayed on the confirmation terminal 9 according to the eighth embodiment will be described. FIG.

[0149] A facial image 102 of the person to be authenticated, captured by the camera 21 of the authentication payment terminal 2, is displayed on the confirmation screen 101. A facial image 103 of a registrant who has been selected as a candidate for the person to be authenticated is also displayed on the confirmation screen 101. The facial image 103 of the registrant is included in the candidate person information provided by the authentication server. The store clerk visually compares the face of the person to be authenticated, the facial image 102 of the person to be authenticated, and the facial image 103 of the registrant to determine whether they are the same person.

[0150] The confirmation screen 101 is also provided with a forward button 104 and a back button 105. When the store clerk operates the forward button 104, the facial image 103 of the next registrant is displayed. When the store clerk operates the back button 105, the facial image 103 of the previous registrant is displayed. This allows the store clerk to sequentially check the facial images 103 of all registrants selected as candidates for the person to be authenticated.

[0151] Furthermore, the confirmation screen 101 displays characters 106 indicating the names of the registrants selected as candidates to be authenticated. In addition, the confirmation screen 101 displays the matching score, the serial numbers and total number of the selected candidates to be authenticated, etc. The names of the registrants and the matching score are included in the candidate information provided by the authentication server.

[0152] The store clerk can confirm whether the person to be authenticated is a registrant by verbally asking the person to be authenticated their name and depending on whether the name matches the name of the registrant displayed on confirmation screen 101. Note that identity verification may also be performed based on information such as address in addition to the name.

[0153] Furthermore, confirmation screen 101 is provided with a confirm button 107 and a cancel button 108. If the store clerk finds a person identical to the person to be authenticated among the candidates for the person to be authenticated, he or she operates confirm button 107. As a result, personal identification information including information on a registrant who matches the person to be authenticated is sent to authentication server 3. On the other hand, if the store clerk cannot find a person identical to the person to be authenticated among the candidates for the person to be authenticated, he or she operates cancel button 108. As a result, personal identification information including information that there is no registrant who matches the person to be authenticated is sent to authentication server 3.

[0154] In this way, in this embodiment, the identity of the person to be authenticated is confirmed by the store clerk who faces the person to be authenticated visually comparing the candidate information provided by the authentication server with the person to be authenticated or by verbally asking the person to be authenticated. This makes it possible to narrow down the multiple candidates selected by face matching to one person.

[0155] As described above, the embodiments have been described as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to these, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made. Furthermore, it is also possible to combine the components described in the above embodiments to create new embodiments. [Industrial Applicability]

[0156] The authentication payment system, authentication payment terminal, and authentication payment method of the present invention have the effect of increasing convenience for users while ensuring the security of payments, and are useful as an authentication payment system in which one or more processors perform a process of matching the person to be authenticated based on at least biometric information, identifying the person to be authenticated based on the matching results, and instructing the execution of payment processing, as well as an authentication payment terminal and authentication payment method in which a processor performs the processes necessary for authentication and payment in accordance with user operations. [Explanation of symbols]

[0157] 1: Authentication payment system 2: Authentication payment terminal 3: Authentication server 4: Payment server 5: Management server 6: POS system 7: Entrance / Exit Management System 8: Reservation management system 9: Confirmation terminal 21: Camera 22: Display 23: Communications Department 24: Storage part 25: Processor 31: Communications Department 32: Storage part 33: Processor 61: POS terminal 62: POS server 71: Entrance camera 72: Management server 81: Reservation terminal 82: Management server

Claims

1. An authentication and payment system, in which one or more processors execute a process of performing a match based on at least biometric information on a person to be authenticated, identifying the person to be authenticated based on a result of the match, and instructing execution of a payment process, The processor: a first matching process for selecting candidates for the person to be authenticated based on the degree of similarity between the biometric information of the person to be authenticated and the biometric information of each registered person; a second determination process for determining whether or not a plurality of candidates for the person to be authenticated have been selected in the first verification process, execute the first verification process, execute the second determination process, and if a plurality of candidates for the person to be authenticated are selected in the first verification process, display candidate information relating to the selected plurality of candidates on a confirmation terminal that can be operated by an employee; An authentication and settlement system characterized in that one candidate determined in response to an operation by the employee from among the plurality of candidates in the candidate information is identified as the person to be authenticated at the confirmation terminal.

2. The candidate information displayed on the confirmation terminal includes registered image information of the candidate. The authentication and payment system of claim 1 .

3. The candidate information displayed on the confirmation terminal includes name information of the candidate. The authentication and payment system of claim 1 .

4. The processor: selecting, as candidates, individuals whose similarity between the biometric information acquired from the person to be authenticated and the biometric information of each registered person is equal to or greater than a threshold value; the candidate information displayed on the confirmation terminal includes the similarity; The authentication and payment system of claim 1 .

5. The processor: a second verification process based on the input personal identification number; a first determination process for determining whether the second verification process can be omitted based on a predetermined determination criterion; It is further possible to executes the first verification process, executes the first determination process, determines that the second verification process can be omitted, and if the person to be authenticated is identified by the employee, omits the second verification process. The authentication and payment system of claim 1 .

6. The processor: a second verification process based on the input personal identification number; a first determination process for determining whether the second verification process can be omitted based on a predetermined determination criterion; It is further possible to execute the first verification process, execute the first determination process, and if it is determined that the second verification process can be omitted and the person to be authenticated is not identified by the employee, proceed to the second verification process. The authentication and payment system of claim 1 .

7. The processor: a second verification process based on the input personal identification number; a first determination process for determining whether the second verification process can be omitted based on a predetermined determination criterion; It is further possible to Executing the first collation process and the first determination process; As the first determination process, a payment amount determination is performed to determine whether or not the second verification process can be omitted depending on whether or not the current payment amount is equal to or greater than a predetermined reference value. The authentication and payment system of claim 1 .

8. The processor: a second verification process based on the input personal identification number; a first determination process for determining whether the second verification process can be omitted based on a predetermined determination criterion; It is further possible to Executing the first collation process and the first determination process; A range of normal payment behavior for each user is set in advance based on historical information regarding at least one of the user's payment location, payment amount, and payment object in past payments, and If it is determined in the first determination process that the second matching process can be omitted, and if a plurality of candidates for the person to be authenticated are not selected in the second determination process, performing a payment behavior determination to determine whether or not the current payment behavior is within the range of the normal payment behavior, and determining whether or not the second verification process can be omitted based on the result of the payment behavior determination; The authentication and payment system of claim 1 .

9. The processor: As the first determination process, a payment amount determination is performed to determine whether or not the second verification process can be omitted depending on whether or not the current payment amount is equal to or greater than a predetermined reference value; As a third determination process, the payment behavior determination is performed. The authentication and payment system of claim 8.

10. the processor performs the payment behavior determination as the first determination process; The authentication and payment system of claim 8.

11. The processor: a second verification process based on the input personal identification number; a first determination process for determining whether the second verification process can be omitted based on a predetermined determination criterion; It is further possible to Executing the first collation process and the first determination process; After it is determined in the first determination process that the second verification process can be omitted, When a plurality of candidates for the person to be authenticated are selected in the first matching process, acquiring, from a system that manages people using the facility, information about people who are likely to be staying in the facility at the time of payment, and identifying the person to be authenticated based on the information about the people who are staying in the facility; The authentication and payment system of claim 1 .

12. the predetermined determination criterion is a criterion using the amount of the current payment and the similarity obtained in the first matching process; The authentication and payment system according to any one of claims 5 to 8.

13. An authentication and payment method, comprising: performing a verification of a person to be authenticated based on at least biometric information; identifying the person to be authenticated based on a result of the verification; and instructing execution of a payment process, the method comprising: a first matching process for selecting candidates for the person to be authenticated based on the degree of similarity between the biometric information of the person to be authenticated and the biometric information of each registered person; a second determination process for determining whether or not a plurality of candidates for the person to be authenticated have been selected in the first verification process; is executable, The first verification process is executed, and the second determination process is executed. If a plurality of candidates for the person to be authenticated are selected in the first verification process, Displaying candidate information for the selected candidates on a confirmation terminal that can be operated by an employee, identifying one candidate determined in response to an operation by the employee from among the plurality of candidates in the candidate information on the confirmation terminal as a person to be authenticated; Authentication payment method.

14. An authentication and payment program for causing a computer to execute a process of performing a match based on at least biometric information on a person to be authenticated, identifying the person to be authenticated based on a result of the match, and instructing execution of a payment process, The computer, by the authentication and payment program, a first matching process for selecting candidates for the person to be authenticated based on the degree of similarity between the biometric information of the person to be authenticated and the biometric information of each registered person; a second determination process for determining whether or not a plurality of candidates for the person to be authenticated have been selected in the first verification process; is executable, The first verification process is executed, and the second determination process is executed. If a plurality of candidates for the person to be authenticated are selected in the first verification process, Displaying candidate information for the selected candidates on a confirmation terminal that can be operated by an employee, identifying one candidate determined in response to an operation by the employee from among the plurality of candidates in the candidate information on the confirmation terminal as a person to be authenticated; Certified Payment Program.

Images