Processing execution device, authentication system, processing execution method, and program

Abstract

This processing execution device (1) comprises: an acquisition unit (11) for acquiring, from a user terminal (2) after a user has moved to within a first range, certification information that indicates successful completion of a first biometric authentication which was conducted on the basis of a first captured image in which the user was imaged by the user terminal (2) owned by the user in the outside of the first range at the installed location of the device; an authentication control unit (12) for initiating control of a second biometric authentication on the user when certification information has been acquired; and an execution unit (13) for executing a prescribed process when the second biometric authentication is successfully completed.

Description

[Technical Field]

[0001] The present invention relates to a process execution device, a user terminal, an authentication system, a process execution method, an authentication method, and a program, and in particular to a process execution device, a user terminal, an authentication system, a process execution method, an authentication method, and a program that executes a process using biometric authentication. [Background technology]

[0002] In recent years, payment processing using facial recognition has become widespread. Patent Document 1 discloses technology related to a sales management system that performs facial recognition at the time of payment. The system described in Patent Document 1 includes a store visit detection store terminal installed at the entrance of the store, a sales management server, a purchase support store terminal that performs payment, and a storage medium that stores a proximity ID. The store visit detection store terminal acquires the proximity ID from the storage medium carried by a visitor (user) to the store and registers the proximity ID in the sales management server. When the user purchases a product, the purchase support store terminal and the sales management server perform facial recognition of the user using the user ID associated with the proximity ID and then perform payment processing.

[0003] Although the accuracy of biometric authentication such as facial recognition has improved, there is still a risk of misidentification. Therefore, two-factor authentication using different authentication methods is sometimes used to perform certain processes. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-157294 Summary of the Invention [Problem to be solved by the invention]

[0005] However, performing two-factor authentication immediately before payment processing to reduce false authentications requires the installation of devices for acquiring authentication information for multiple authentication methods near the payment terminal, which increases installation costs.In addition, in the case of Patent Document 1, a terminal for detecting proximity IDs must be installed at the entrance of the store, which also increases installation costs.

[0006] In view of the above-mentioned problems, the object of the present disclosure is to provide a processing execution device, a user terminal, an authentication system, a processing execution method, an authentication method, and a program for reducing false authentications while suppressing costs in processing based on successful biometric authentication. [Means for solving the problem]

[0007] A process execution device according to a first aspect of the present disclosure includes: an acquisition means for acquiring, from a user terminal carried by the user outside a first range of an installation location of the device, certification information indicating the success of a first biometric authentication performed based on a first captured image of the user taken by the user terminal after the user moves within the first range; an authentication control means for starting control of a second biometric authentication for the user when the authentication information is acquired; an execution means for executing a predetermined process when the second biometric authentication is successful; Equipped with.

[0008] A user terminal according to a second aspect of the present disclosure includes: an acquisition means for acquiring a first captured image of a user outside a first range of a location where the processing execution device is installed; an authentication control means for controlling the first biometric authentication by transmitting biometric information based on the first captured image to an authentication server; a storage means for storing, when the first biometric authentication is successful, certification information indicating the success, which is acquired from the authentication server; an output means for outputting the certification information so that the process execution device can control second biometric authentication for the user and perform a predetermined process after the user moves within the first range; Equipped with.

[0009] An authentication system according to a third aspect of the present disclosure includes: A user terminal owned by a user; an authentication server that performs biometric authentication; a process execution device that is installed at a first location and that executes a predetermined process; Equipped with The user terminal acquiring a first photographed image of the user outside a first range of the first location; transmitting biometric information based on the first captured image to the authentication server, thereby controlling the first biometric authentication; The authentication server If the first biometric authentication is successful, transmitting certification information indicating the success to the user terminal; The user terminal storing the certification information obtained from the authentication server; outputting the credential after the user moves within a first range; The processing execution device When the authentication information is acquired from the user terminal, control of second biometric authentication for the user is initiated; If the second biometric authentication is successful, the predetermined process is executed.

[0010] A processing execution method according to a fourth aspect of the present disclosure includes: A computer installed at the first location acquiring, from a user terminal carried by the user outside a first range of the first location, certification information indicating success of a first biometric authentication performed based on a first captured image of the user taken by the user terminal after the user moves within the first range; If the authentication information is acquired, start a second biometric authentication control for the user; If the second biometric authentication is successful, a predetermined process is executed.

[0011] A non-transitory computer-readable medium storing a program according to a fifth aspect of the present disclosure includes: A computer installed at the first location an acquisition process for acquiring, from a user terminal carried by the user outside a first range of the first location, certification information indicating success of a first biometric authentication performed based on a first captured image of the user taken by the user terminal after the user moves within the first range; an authentication control process that starts control of second biometric authentication for the user when the authentication information is acquired; an execution process for executing a predetermined process if the second biometric authentication is successful; Execute the following.

[0012] An authentication method according to a sixth aspect of the present disclosure includes: The computer acquiring a first captured image of the user outside a first range of an installation location of the processing execution device; transmitting biometric information based on the first captured image to an authentication server, thereby controlling the first biometric authentication; If the first biometric authentication is successful, certification information indicating the success, which is obtained from the authentication server, is stored in a storage device; After the user moves into the first range, the certification information is output to cause the process execution device to control second biometric authentication for the user and perform a predetermined process.

[0013] A non-transitory computer-readable medium storing a program according to a seventh aspect of the present disclosure includes: On the computer, an acquisition process of acquiring a first captured image of the user outside a first range of the installation location of the process execution device; an authentication control process for controlling first biometric authentication by transmitting biometric information based on the first captured image to an authentication server; a storage process for storing, in a storage device, proof information indicating success obtained from the authentication server when the first biometric authentication is successful; an output process of outputting the certification information so that the process execution device controls second biometric authentication for the user and performs a predetermined process after the user moves within a first range; Execute the following. [Effects of the Invention]

[0014] The present disclosure makes it possible to provide a processing execution device, a user terminal, an authentication system, a processing execution method, an authentication method, and a program for reducing erroneous authentication while suppressing costs in processing in response to successful biometric authentication. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a block diagram showing a configuration of a processing execution device according to a first embodiment. [Figure 2] 1 is a flowchart showing the flow of a processing execution method according to the first embodiment. [Figure 3] FIG. 10 is a block diagram showing the configuration of a user terminal according to the second embodiment. [Figure 4] 10 is a flowchart showing the flow of an authentication method according to the second embodiment. [Figure 5] FIG. 10 is a block diagram showing the overall configuration of an authentication system according to a third embodiment. [Figure 6] FIG. 10 is a block diagram showing the configuration of a store management device according to a third embodiment. [Figure 7] FIG. 10 is a block diagram showing the configuration of an authentication device according to a third embodiment. [Figure 8] 11 is a flowchart showing the flow of a face information registration process performed by the authentication device according to the third embodiment. [Figure 9] FIG. 11 is a block diagram showing the configuration of a user terminal according to the third embodiment. [Figure 10] FIG. 11 is a diagram showing an example of display of certification information according to the third embodiment. [Figure 11] FIG. 10 is a block diagram showing the configuration of a payment terminal according to the third embodiment. [Figure 12] FIG. 11 is a sequence diagram showing the flow of pre-authentication processing according to the third embodiment. [Figure 13] 11 is a flowchart showing the flow of face authentication processing by the authentication device according to the third embodiment. [Figure 14] FIG. 11 is a sequence diagram showing the flow of payment processing according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0016] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals, and for clarity of explanation, duplicate explanations will be omitted as necessary.

[0017] <Embodiment 1> FIG. 1 is a block diagram showing the configuration of a process execution device 1 according to the first embodiment. The process execution device 1 is an information processing device installed at a first location (installation location). The user terminal is an information terminal that is carried by a user and capable of wireless communication. The user terminal initially captures an image of the user using a photographing function outside a first range of the installation location of the process execution device 1. The user terminal then performs first biometric authentication based on the first captured image of the user captured outside the first range. At this time, the user terminal performs first biometric authentication for the first captured image using an external authentication server. Here, it is assumed that the authentication server has registered the user's biometric information in advance. Therefore, the authentication server performs the first biometric authentication by comparing the biometric information extracted from the first captured image captured by the user terminal with the registered biometric information. If the first biometric authentication is successful, the authentication server transmits certification information indicating the success of the first biometric authentication to the user terminal. The user terminal stores the certification information.

[0018] Here, the process execution device 1 includes an acquisition unit 11, an authentication control unit 12, and an execution unit 13. The acquisition unit 11 acquires the above-mentioned certification information from the user terminal after the user moves within a first range of the installation location of the process execution device 1. When the certification information is acquired, the authentication control unit 12 starts controlling a second biometric authentication for the user. For example, the authentication control unit 12 performs second biometric authentication on a second captured image of the user taken within the first range using the authentication server. When the second biometric authentication is successful, the execution unit 13 executes a predetermined process. Here, the predetermined process is, for example, but is not limited to, a payment process.

[0019] 2 is a flowchart showing the flow of the process execution method according to the first embodiment. First, the acquisition unit 11 acquires certification information from the user terminal after the user carrying the user terminal moves within a first range of a first location where the process execution device 1 is installed (S11). As described above, the certification information is information indicating the success of the first biometric authentication performed based on a first captured image of the user taken by the user terminal outside the first range of the first location where the process execution device 1 is installed.

[0020] Next, when the authentication information is acquired, the authentication control unit 12 starts controlling the second biometric authentication for the user (S12). Then, the process execution device 1 determines whether the second biometric authentication is successful (S13). If the second biometric authentication is successful, the execution unit 13 executes a predetermined process (S14). On the other hand, if the second biometric authentication is not successful, the execution unit 13 does not execute the predetermined process.

[0021] As described above, in the first embodiment, it is assumed that the first biometric authentication has been successful for a user's image captured in advance by a user terminal carried by the user at a location (outside the first range) that is at least a predetermined distance from the process execution device 1. At this time, the user terminal holds certification information indicating that the first biometric authentication has been successful. Then, when the user enters the first range of the process execution device 1, the process execution device 1 acquires the certification information from the user terminal carried by the user. The process execution device 1 executes a predetermined process on the condition that the certification information indicates that the first biometric authentication has been successful and that the user currently within the first range has succeeded in the second biometric authentication. Here, the first biometric authentication, which is a preliminary authentication, is performed using the imaging function of the user terminal carried by the user, and therefore no separate imaging device needs to be installed. This reduces installation costs. Furthermore, by performing two biometric authentications to execute a predetermined process, authentication accuracy can be improved. Therefore, in processing based on successful biometric authentication, it is possible to reduce costs and reduce erroneous authentications.

[0022] Note that biometric authentication involves extracting a person's biometric information from a captured image, matching the extracted biometric information with pre-registered biometric information, and determining that authentication is successful if the degree of match is above a threshold. Here, the biometric information may be data (features) calculated from physical characteristics unique to an individual, such as facial feature information, fingerprints, voiceprints, veins, retinas, irises, and palm patterns.

[0023] The process execution device 1 includes a processor, a memory, and a storage device (not shown). The storage device stores a computer program that implements the process of the process execution method according to this embodiment. The processor then loads the computer program from the storage device into the memory and executes the computer program. This allows the processor to implement the functions of an acquisition unit 11, an authentication control unit 12, and an execution unit 13.

[0024] Alternatively, each component of the process execution device 1 may be realized by dedicated hardware. Furthermore, some or all of the components of each device may be realized by general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and a program. Furthermore, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array), quantum processor (quantum computer control chip), etc., may be used as the processor.

[0025] Furthermore, when some or all of the components of the processing execution device 1 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally located or distributed. For example, the information processing devices, circuits, etc. may be realized as a client-server system, cloud computing system, etc., in which each is connected via a communication network. Furthermore, the functions of the processing execution device 1 may be provided in a SaaS (Software as a Service) format.

[0026] <Embodiment 2> 3 is a block diagram showing the configuration of a user terminal 2 according to the second embodiment. The user terminal 2 corresponds to the user terminal in the first embodiment described above. The user terminal 2 is an information terminal that can be carried by a user and is capable of wireless communication. The processing execution device is the same as that in the first embodiment described above. The user terminal 2 includes an acquisition unit 21, an authentication control unit 22, a storage unit 23, and an output unit 24.

[0027] The acquisition unit 21 acquires a first captured image of the user outside the first range of the installation location of the processing execution device. The authentication control unit 22 controls the first biometric authentication by transmitting biometric information based on the first captured image to the authentication server. The storage unit 23 stores certification information 231 indicating the success of the first biometric authentication, which is acquired from the authentication server when the first biometric authentication is successful. The storage unit 23 may be a storage device itself built into the user terminal 2, or may perform processing to store the certification information in the storage device. After the user moves within the first range, the output unit 24 outputs the certification information 231 to cause the processing execution device to control the second biometric authentication of the user and perform predetermined processing.

[0028] 4 is a flowchart showing the flow of the authentication method according to the second embodiment. First, the acquisition unit 21 acquires a first captured image of the user taken outside a first range of the installation location of the process execution device (S21). Next, the authentication control unit 22 controls the first biometric authentication by transmitting biometric information based on the first captured image to the authentication server (S22).

[0029] Then, the storage unit 23 stores, in the storage device, proof information indicating the success, acquired from the authentication server if the first biometric authentication is successful (S23). After that, after the user moves within the first range of the installation location of the processing execution device, the proof information is output to the processing execution device to control the second biometric authentication for the user and to perform a predetermined process (S24).

[0030] In this way, in the second embodiment as well, similar to the first embodiment described above, it is possible to reduce costs and reduce erroneous authentication in the processing in response to successful biometric authentication.

[0031] The user terminal 2 includes a processor, a memory, and a storage device (not shown). The storage device stores a computer program that implements the processing of the authentication method according to this embodiment. The processor then loads the computer program from the storage device into the memory and executes the computer program. This allows the processor to implement the functions of an acquisition unit 21, an authentication control unit 22, and an output unit 24.

[0032] Alternatively, each component of the user terminal 2 may be realized by dedicated hardware. Furthermore, some or all of the components of each device may be realized by general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and programs. Furthermore, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array), quantum processor (quantum computer control chip), etc., may be used as the processor.

[0033] <Embodiment 3> The present embodiment 3 is a specific example of the above-mentioned embodiments 1 and 2. In the present embodiment 3, an example will be described in which the predetermined process performed by the process execution device in response to biometric authentication is a payment process in response to face authentication in a store. Note that the predetermined process in response to biometric authentication is not limited to this.

[0034] FIG. 5 is a block diagram showing the overall configuration of an authentication system 1000 according to the third embodiment. The authentication system 1000 is an information system that performs payment processing when a customer (user) of the store 300 is successfully authenticated both in a location (second range 320) a predetermined distance away from the cash register installation location 311 and in the vicinity of the cash register installation location 311 (first range 310). Facial authentication (first biometric authentication) in the second range 320 is performed using the image capturing function of the user terminal 200-1 possessed by the user U1. On the other hand, facial authentication (second biometric authentication) in the first range 310 is performed using the image capturing function of the payment terminal 100, provided that the first biometric authentication is successful. If the second biometric authentication is successful and the user identified by each biometric authentication matches, the payment terminal 100 performs payment processing. This allows the user to make contactless payments without having to enter a personal identification number or the like. Furthermore, two-step authentication can improve authentication accuracy.

[0035] Authentication system 1000 includes user terminals 200-1 and 200-2, a payment terminal 100, a store management device 500, and an authentication device 600. Store management device 500 and authentication device 600 may be collectively referred to as authentication server 400. User terminals 200-1 and 200-2, payment terminal 100, store management device 500, and authentication device 600 are communicatively connected via network N. Here, network N is a wired or wireless communication line or network, such as an in-store LAN (Local Area Network), the Internet, a wireless communication network, or a mobile phone network. Network N can use any type of communication protocol.

[0036] It is assumed that users U1 and U2 have already registered their own facial images or facial feature information in a face information DB (DataBase) 610 of the authentication device 600. It is also assumed that users U1 and U2 have already registered their own payment information (credit card information, debit bank account information, etc.) in a member DB 512.

[0037] The store management device 500 is an information processing device for performing various management tasks for the store 300. The store management device 500 may be configured redundantly with multiple servers, and each functional block may be implemented by multiple computers.

[0038] 6 is a block diagram showing the configuration of a store management device 500 according to the third embodiment. The store management device 500 includes a storage unit 510, a memory 520, a communication unit 530, and a control unit 540. The storage unit 510 is an example of a storage device such as a hard disk or flash memory. The storage unit 510 stores a program 511 and a member DB 512. The program 511 is a computer program that implements part of the facial information and member information registration process, pre-authentication process, payment process, and other processes according to the third embodiment.

[0039] The member DB 512 is a database that manages information on people who visit the store 300 and are registered as members. The member DB 512 manages user IDs 5121, personal information 5122, and payment information 5123 in association with each other. The user ID 5121 is identification information for a user who is a member of the store 300. The user ID 5121 is information that corresponds to the user ID 611 in the face information DB 610, which will be described later. The personal information 5122 is information including the user's name, nickname, address, telephone number, notification destination, etc. The notification destination is identification information (terminal ID) of the user terminal owned by the user, the user's login ID, email address, SNS (Social Networking Service) account, etc. The payment information 5123 is credit card information, debit bank account information, etc., used when the payment terminal 100 performs payment processing in response to successful biometric authentication.

[0040] The memory 520 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily holding information during operation of the control unit 540. The communication unit 530 is a communication interface with the network N.

[0041] The control unit 540 is a processor, or control device, that controls each component of the store management device 500. The control unit 540 loads the program 511 from the storage unit 510 into the memory 520 and executes the program 511. In this way, the control unit 540 realizes the functions of a registration unit 541, an authentication control unit 542, a certification information issuance unit 543, and a payment processing unit 544.

[0042] The registration unit 541 receives a member registration request including a facial image, personal information, and payment information from any user terminal 200, and performs a process to register the facial information and member information. Specifically, the registration unit 541 acquires a facial image from the member registration request, and transmits a facial information registration request including the acquired facial image to the authentication device 600. The registration unit 541 then receives from the authentication device 600 a user ID that was issued when the facial information was registered by the authentication device 600. The registration unit 541 then acquires the personal information and payment information from the member registration request, and associates the received user ID 5121 with the acquired personal information 5122 and payment information 5123, and registers them in the member DB 512.

[0043] When the authentication control unit 542 receives a pre-authentication request including a facial image of the user from the user terminal 200, it transmits a facial authentication request (a request for first biometric authentication) including the facial image to the authentication device 600. Then, the authentication control unit 542 receives the facial authentication result in the authentication device 600. Moreover, when the authentication control unit 542 receives a facial authentication request (a request for second biometric authentication) including a facial image of the user from the payment terminal 100, it transmits a facial authentication request including the facial image to the authentication device 600. Then, the authentication control unit 542 receives the facial authentication result in the authentication device 600.

[0044] The certification information issuing unit 543 issues certification information when the face authentication result in the first biometric authentication indicates success. Specifically, the certification information issuing unit 543 identifies a user ID included in the face authentication result and reads out personal information 5122 associated with the identified user ID 5121 from the member DB 512. Then, the certification information issuing unit 543 generates certification information indicating that the pre-authentication is successful. At this time, the certification information issuing unit 543 may include in the certification information the identified user ID 5121, the read out personal information 5122, time information corresponding to the success of the first biometric authentication, etc. Here, the time information corresponding to the success of the first biometric authentication is, for example, the time when the face image was captured, the time of authentication, or date and time (hour, minute, second, as necessary) information indicating the expiration date and time of the certification information. Furthermore, the certification information issuing unit 543 may include a nickname from the personal information 5122. Furthermore, the certification information issuing unit 543 may include in the certification information location information of the user terminal 200 that is the requestor of the pre-authentication request. Here, the location information of the user terminal 200 may be included in the pre-authentication request, or may be location information of the wireless base station that has established a wireless communication connection with the user terminal 200, or the like.

[0045] Then, the certification information issuing unit 543 transmits the generated certification information to the user terminal 200 that has requested the pre-authentication request. As will be described later, if the first biometric authentication is successful between the user terminal 200 and the authentication device 600, the certification information issuing unit 543 may receive a request for issuing certification information including the user ID from the user terminal 200. In this case as well, the certification information issuing unit 543 issues certification information as described above.

[0046] The certification information issuing unit 543 may issue code information including a notification that the pre-authentication was successful, the user ID, the time information, and the location information. In this case, the certification information issuing unit 543 includes the code information in the certification information and transmits it to the user terminal 200.

[0047] The payment processing unit 544 performs payment processing when it receives a payment request from the payment terminal 100. Specifically, the payment processing unit 544 acquires the user ID and payment amount from the payment request, and reads out payment information 5123 associated with the acquired user ID 5121 from the member DB 512. The payment processing unit 544 then performs payment processing for the payment amount using the payment information 5123. The payment processing unit 544 then transmits the payment result to the payment terminal 100.

[0048] Returning to FIG. 5, the explanation will be continued. The authentication device 600 is an information processing device that manages facial feature information of users and performs facial authentication. In response to a facial authentication request received from the outside, the authentication device 600 compares the facial image or facial feature information included in the request with the facial feature information of each user and returns the comparison result (authentication result) to the request source.

[0049] FIG. 7 is a block diagram showing the configuration of an authentication device 600 according to the third embodiment. The authentication device 600 includes a face information DB 610, a face detection unit 620, a feature point extraction unit 630, a registration unit 640, and an authentication unit 650. The face information DB 610 stores a user ID 611 and facial feature information 612 for the user ID in association with each other. The facial feature information 612 is a collection of feature points extracted from a facial image. The authentication device 600 may delete the facial feature information 612 from the facial feature DB 610 in response to a request from a user or the like corresponding to the facial feature information 612. Alternatively, the authentication device 600 may delete the facial feature information 612 after a certain period of time has elapsed since registration.

[0050] The face detection unit 620 detects a face area included in a registration image for registering face information and outputs the detected face area to the feature point extraction unit 630. The feature point extraction unit 630 extracts feature points from the face area detected by the face detection unit 620 and outputs face feature information to the registration unit 640. The feature point extraction unit 630 also extracts feature points included in a face image received from the store management device 500 or the like and outputs the face feature information to the authentication unit 650.

[0051] The registration unit 640 issues a new user ID 611 when registering facial feature information. The registration unit 640 associates the issued user ID 611 with facial feature information 612 extracted from the registered image and registers the associated user ID 611 in the facial information DB 610. The authentication unit 650 performs facial authentication using the facial feature information 612. Specifically, the authentication unit 650 compares the facial feature information extracted from the facial image with the facial feature information 612 in the facial information DB 610. If the comparison is successful, the authentication unit 650 identifies the user ID 611 associated with the compared facial feature information 612. The authentication unit 650 returns a match of the facial feature information to the request source as a facial authentication result. The match of the facial feature information corresponds to the success or failure of authentication. Note that the facial feature information matches (matches) when the degree of match is equal to or greater than a threshold. If the facial authentication is successful, the facial authentication result includes the identified user ID.

[0052] FIG. 8 is a flowchart showing the flow of face information registration processing by the authentication device 600 according to the third embodiment. First, the authentication device 600 receives a face information registration request (S201). For example, the authentication device 600 receives the face information registration request from the store management device 500 via the network N. Next, the face detection unit 620 detects a face area from the face image included in the face information registration request (S202). Then, the feature point extraction unit 630 extracts feature points (facial feature information) from the face area detected in step S202 (S203). Then, the registration unit 640 issues a user ID 611 (S204). Then, the registration unit 640 associates the extracted facial feature information 612 with the issued user ID 611 and registers them in the face information DB 610 (S205). Thereafter, the registration unit 640 returns the issued user ID 611 to the request source (for example, the store management device 500) (S206). The authentication device 600 may perform face information registration processing in response to a face information registration request received from an arbitrary information registration terminal. For example, the information registration terminal may be an information processing device such as a personal computer, a smartphone, or a tablet terminal. The information registration terminal may also be the user terminal 200.

[0053] Returning to FIG. 5, the explanation will be continued. The user terminal 200-1 is an information terminal that is portable and capable of wireless communication, carried by the user U1. Here, it is assumed that the user U1 and the user terminal 200-1 are present in a second range 320 near the entrance of the store 300. Here, it is assumed that the second range 320 is outside the first range 310 and is a range that is a predetermined distance away from the first range 310. Therefore, the second range 320 is not limited to near the entrance of the store 300, but may be outside the store 300. The user U1 photographs his or her face using his or her user terminal 200-1 in a location (second range 320) different from in front of the payment terminal 100. The user terminal 200-1 transmits the facial image to the authentication server 400, where facial authentication is performed. If the facial authentication is successful, the user terminal 200-1 receives and internally stores certification information 222-1.

[0054] The user terminal 200-2 is an information terminal that is carried by the user U2 and is capable of wireless communication. Here, it is assumed that the user U2 and the user terminal 200-2 are present in a first range 310 near a cash register installation location 311 of the store 300. It is assumed that the user terminal 200-2 has previously received certification information 222-2 in the second range 320 and stored it internally. The user terminal 200-2 then outputs the certification information 222-2. Here, the certification information 222-1 and 222-2 are certification information indicating that face authentication was successful in the second range 320 in advance. Alternatively, the user terminal 200-2 may output the certification information 222-2 via short-range wireless communication and transmit the certification information 222-2 to the payment terminal 100. Alternatively, the user terminal 200-2 may display the certification information 222-2 and have the payment terminal 100 read the certification information 222-2.

[0055] It is assumed that the user terminals 200-1 and 200-2 have the same configuration. Hereinafter, when there is no need to distinguish between the user terminals 200-1 and 200-2, they will be collectively referred to simply as the "user terminal 200." The user terminal 200 is an example of the user terminal 2 described above. The user terminal 200 is, for example, an information terminal such as a mobile phone terminal, a smartphone, or a tablet terminal. The user terminal 200 communicates with the store management device 500 and the authentication device 600 included in the authentication server 400 via the network N. Furthermore, the users U1 and U2 may be the same person. That is, the user U1 carrying the user terminal 200-1 may move from the second range 320 to the first range 310 and be represented as the user U2 carrying the user terminal 200-2.

[0056] FIG. 9 is a block diagram showing the configuration of a user terminal 200 according to the third embodiment. The user terminal 200 includes a camera 210, a storage unit 220, a memory 230, a communication unit 240, an input / output unit 250, and a control unit 260. The camera 210 is a photographing device that photographs images under the control of the control unit 260. The storage unit 220 is a storage device such as a flash memory and may be an example of the storage unit 23 described above. The storage unit 220 stores a program 221 and certification information 222. The program 221 is a computer program that implements processes according to the present embodiment, including registration of face information and member information, pre-authentication, and output of certification information. The certification information 222 is an example of information indicating the success of the first biometric authentication issued by the store management device 500 when pre-authentication is successful. The certification information 222 is information that associates a user ID 2221, location information 2222, and time information 2223. The user ID 2221 is identification information of the user who owns the user terminal 200. The user ID 2221 is information corresponding to the user ID 5121 registered in the member DB 512. As described above, the location information 2222 is information indicating the location of the user terminal 200 when the pre-authentication was successful. As described above, the time information 2223 is time information corresponding to the success of the first biometric authentication. Note that the certification information 222 may include the code information described above. Furthermore, the certification information 222 may include personal information corresponding to the user ID 2221, such as the member's name.

[0057] The memory 230 is a volatile storage device such as RAM, and is a storage area for temporarily storing information when the control unit 260 is operating. The communication unit 240 is a communication interface with the network N. In particular, the communication unit 240 performs wireless communication. For example, the communication unit 240 establishes a connection with a wireless base station inside or outside the store 300 and performs communication. The communication unit 240 may also establish a short-range wireless communication connection with the payment terminal 100 and perform communication. Here, various standards such as Bluetooth (registered trademark), BLE (Bluetooth Low Energy), and UWB (Ultra Wide Band) can be applied to the short-range wireless communication. The communication unit 240 may also communicate with a GPS (Global Positioning System) satellite to acquire location information. The input / output unit 250 includes a display device (display unit) such as a screen and an input device. The input / output unit 250 is, for example, a touch panel. The control unit 260 is a processor that controls the hardware of the user terminal 200. The control unit 260 loads the program 221 from the storage unit 220 into the memory 230 and executes it. As a result, the control unit 260 realizes the functions of an acquisition unit 261, a registration unit 262, an authentication control unit 263, and an output unit 264.

[0058] The acquisition unit 261 is an example of the acquisition unit 21 described above. The acquisition unit 261 acquires a captured image including the user's face captured by the camera 210 in response to a user's operation. The acquisition unit 261 also acquires membership information including personal information and payment information input by the user. The acquisition unit 261 also acquires a first captured image of the user U1 captured within the second range 320. That is, the acquisition unit 261 acquires a first captured image of the user U1 captured outside the first range 310 of the payment terminal 100. If the first biometric authentication is successful, the acquisition unit 261 also acquires certification information 222 including the user ID 2221 of the user U1 from the authentication server 400 (store management device 500). If the first biometric authentication is successful, the acquisition unit 261 also acquires certification information 222 including location information 2222 of the user terminal 200 from the authentication server 400. Furthermore, when the first biometric authentication is successful, the acquisition unit 261 acquires, from the authentication server 400, certification information 222 including time information 2223 corresponding to the success of the first biometric authentication. Then, the acquisition unit 261 stores the acquired certification information 222 in the storage unit 220.

[0059] The registration unit 262 performs a process for registering the user's facial information and membership information. Specifically, the registration unit 262 sends a membership registration request including the user's facial image, personal information, and payment information to the store management device 500. As a result, as described above, the facial feature information of the user is registered in the facial information DB 610 of the authentication device 600, and the membership information is registered in the membership DB 512 of the store management device 500.

[0060] The authentication control unit 263 is an example of the authentication control unit 22 described above. The authentication control unit 263 extracts a facial area of ​​a person detected from an image captured by the camera 210 as a facial image, and transmits a pre-authentication request including the facial image to the store management device 500. The authentication control unit 263 may include current time information and location information of the user terminal 200 in the pre-authentication request. The authentication control unit 263 may transmit a facial authentication request including the facial image directly to the authentication device 600 and receive a facial authentication result from the authentication device 600. If the facial authentication result indicates success, the authentication control unit 263 may extract a user ID included in the facial authentication result and transmit a request for issuing certification information including the user ID to the store management device 500.

[0061] The output unit 264 is an example of the output unit 24 described above. The output unit 264 outputs the certification information 222 acquired by the acquisition unit 261 by displaying it. That is, the output unit 264 outputs the certification information 222 to the input / output unit 250 and displays the certification information 222 on the screen. For example, the output unit 264 displays the content of the certification information 222 to allow the user to confirm it. Furthermore, if the certification information 222 includes code information, the output unit 264 displays the certification information 222 including the code information on the screen. By displaying the code information, it is also possible to have the payment terminal 100 read the code information and acquire the certification information 222.

[0062] Alternatively, output unit 264 may output certification information 222 by transmitting it to payment terminal 100 via the above-mentioned short-range wireless communication. This allows payment terminal 100 to acquire certification information 222.

[0063] 10 is a diagram showing an example of the display of certification information according to the third embodiment. Here, a case is shown in which the user terminal 200-1 pre-authenticates the user U1 in the second range 320, and the acquired certification information is displayed as a result of the successful pre-authentication. A pre-authentication certification information display screen 71 is an example of a screen displayed on the input / output unit 250 of the user terminal 200-1. The pre-authentication certification information display screen 71 includes a message display field 711, a nickname display field 712, an expiration date display field 713, and code information 714.

[0064] The message display field 711 shows an example in which a message such as "XX Store pre-authentication was successful." Note that the message displayed in the message display field 711 is not limited to this. Various methods can be used to identify "XX Store," i.e., the store name. For example, the user terminal 200 may identify the store name based on location information of the user terminal 200 when the pre-authentication application provided by the store 300 is launched within the second range 320. Alternatively, the store management device 500 may identify the store name based on location information of the user terminal 200 included in the pre-authentication request from the user terminal 200. In this case, the store management device 500 returns the issued authentication information to the user terminal 200, including the store name and store information. Alternatively, while outside the store 300, the user terminal 200 may perform pre-authentication of user U1 as a company member using an application for an integrated service provided by the company that operates the store 300. In this case, pre-authentication is completed when user U1 and the user terminal 200 enter the store 300.

[0065] The nickname display field 712 is, for example, a display field for the (registered member) nickname among the personal information included in the certification information 222. This allows user U1 to visually confirm whether or not the face authentication has accurately authenticated the user U1. Therefore, if the nickname displayed in the nickname display field 712 is a nickname other than that of user U1, user U1 can take a picture of his or her face with the camera 210 again to perform pre-authentication. At this time, user U1 can also move to a location with different lighting conditions and take a picture. Furthermore, by displaying the nickname, in the event of an erroneous authentication, another person's nickname will be displayed. Therefore, user U1 can identify that the nickname is not his or her own, but will not see the personal information such as the member ID or name of the erroneously authenticated person. This prevents personal information leakage. As another display example of the pre-authentication certification information display screen 71, a member ID display field or a member name display field may be provided instead of or in addition to the nickname display field 712. The member ID display field is a field for displaying the user ID 2221 or a member ID corresponding thereto. The member name display field is a field for displaying the name included in the personal information corresponding to the user ID 2221.

[0066] The expiration date display field 713 is a field that displays the year, month, day, hour, minute, and second of the expiration date of the certification information, as an example of the time information 2223 included in the certification information 222. The expiration date may be, for example, 30 minutes after the pre-authentication is successful. Note that the time of successful pre-authentication may be displayed instead of the expiration date display field 713. Furthermore, when the time information 2223 is the time of successful pre-authentication, the output unit 264 may display the time after a predetermined time (for example, 30 minutes) has elapsed from the time information as the expiration date.

[0067] As described above, the code information 714 is information including information indicating that the pre-authentication was successful, the user ID, the time information, and the location information. Here, the code information 714 is an example of a two-dimensional code, a QR (Quick Response) code (registered trademark), but it may be other code information such as a two-dimensional code of another standard, a one-dimensional code, or a number.

[0068] Returning to FIG. 5, the explanation will be continued. The payment terminal 100 is an example of the above-mentioned process execution device 1. The payment terminal 100 is installed at the cash register installation location 311 and is an information processing device that performs payment processing in response to successful facial authentication. The payment terminal 100 may be either an attended or unattended cash register terminal. The payment terminal 100 also controls facial authentication using an authentication server 400. In particular, the payment terminal 100 directly performs facial authentication (second biometric authentication) on a user who has successfully passed pre-authentication (first biometric authentication), on the condition that the user presents the above-mentioned proof information, and performs payment processing if the users who have successfully passed the first and second biometric authentications match.

[0069] FIG. 11 is a block diagram showing the configuration of a payment terminal 100 according to the third embodiment. The payment terminal 100 includes a camera 110, a storage unit 120, a memory 130, a communication unit 140, an input / output unit 150, and a control unit 160. The payment terminal 100 may be connected to a code reader (not shown) that reads code information. The camera 110 is an imaging device that takes an image under the control of the control unit 160. For example, the camera 110 takes an image of the face of a user U2 who is present within a first range 310. The storage unit 120 is an example of a storage device such as a hard disk or flash memory. The storage unit 120 stores a program 121. The program 121 is a computer program that implements processes including the payment process according to the third embodiment.

[0070] The memory 130 is a volatile storage device such as RAM, and is a storage area for temporarily storing information when the control unit 160 is operating. The communication unit 140 is a communication interface with the network N. The communication unit 140 may establish a short-range wireless communication connection with the user terminal 200 and perform communication. The input / output unit 150 includes a display device (display unit) such as a screen and an input device. The input / output unit 150 is, for example, a touch panel. The control unit 160 is a processor that controls the hardware of the payment terminal 100. The control unit 160 loads the program 121 from the storage unit 120 into the memory 130 and executes it. As a result, the control unit 160 realizes the functions of an acquisition unit 161, a determination unit 162, an authentication control unit 163, and a payment unit 164.

[0071] The acquiring unit 161 is an example of the aforementioned acquiring unit 11. The acquiring unit 161 acquires the certification information from the user terminal 200-2 present within the first range 310. For example, the acquiring unit 161 acquires the certification information from the user terminal 200-2 within the first range 310 via short-range wireless communication. Alternatively, the acquiring unit 161 may acquire the certification information by reading the certification information (code information) displayed on the user terminal 200-2.

[0072] The determination unit 162 determines whether the certification information acquired by the acquisition unit 161 indicates that pre-authentication (first biometric authentication) has been successful. The determination unit 162 may also determine whether the time information included in the certification information indicates that it is within the expiration date. The determination unit 162 may also determine whether the location information included in the certification information is included in a second range 320 that is a predetermined distance away from the first range 310. If the determination unit 162 indicates that pre-authentication has been successful, it identifies the user ID included in the certification information.

[0073] Furthermore, the determination unit 162 determines whether the second biometric authentication is successful. Specifically, the determination unit 162 determines whether the face authentication is successful based on the face authentication result received by the authentication control unit 163, which will be described later. If the face authentication is successful, the determination unit 162 determines whether the user ID included in the certification information matches the user ID included in the face authentication result.

[0074] The authentication control unit 163 is an example of the authentication control unit 12 described above. When the determination unit 162 determines that the pre-authentication is successful, the authentication control unit 163 starts controlling face authentication. Specifically, the authentication control unit 163 controls the camera 110 to capture an image of an area including the face of user U2, the person to be settled, who is present within the first range 310. Then, the authentication control unit 163 extracts a facial area of ​​a person detected from the image captured by the camera 110 as a facial image, and transmits a face authentication request including the facial image to the authentication server 400 (the store management device 500 or the authentication device 600). The authentication control unit 163 may include the facial image itself or facial features extracted from the facial image as biometric information in the face authentication request. Then, the authentication control unit 163 receives a face authentication result from the authentication server 400. When the time information included in the certification information indicates that the validity period is within the validity period, the authentication control unit 163 may start controlling face authentication (second biometric authentication). Furthermore, the authentication control unit 163 may start controlling face authentication (second biometric authentication) when the location information included in the certification information is included in a second range 320 that is a predetermined distance away from the first range 310.

[0075] The settlement unit 164 is an example of the execution unit 13. The settlement unit 164 executes a settlement process when the determination unit 162 determines that the user ID indicated by the authentication information matches the user ID of a user who has successfully passed face authentication (second biometric authentication). Specifically, as will be described later, the settlement unit 164 uses the store management device 500 to execute a settlement process for a user who has successfully passed face authentication.

[0076] 12 is a sequence diagram showing the flow of pre-authentication processing according to the present embodiment 3. Here, it is assumed that a user U1 carrying a user terminal 200-1 visits the store 300 as a customer. Then, it is assumed that the user U1 performs pre-authentication within a second range 320 near the entrance of the store 300 and obtains certification information.

[0077] First, the user terminal 200-1 launches a pre-authentication application (pre-authentication app) (S301). For example, assume that there is a sign at the entrance of the store 300 stating, "To use facial payment, pre-authentication using the pre-authentication app at the store entrance is required." In this case, the user U1 performs an operation to launch the pre-authentication app installed in the user terminal 200-1. Alternatively, if code information for launching the pre-authentication app is displayed at the entrance of the store 300, the user U1 photographs the code information with the camera 210 of the user terminal 200-1. In response, the user terminal 200-1 analyzes the photographed code information and launches the pre-authentication app. Alternatively, if a short-range wireless communication terminal is installed within the second range 320 of the store 300, the short-range wireless communication terminal may transmit a store entry notification (pre-authentication app launch notification) by broadcast communication or the like. In this case, the user terminal 200-1 may display the received store entry notification on a screen or notify the user U1 and automatically or manually launch the pre-authentication app.

[0078] Next, the user terminal 200-1, in response to an operation by the user U1, photographs the face of the user U1 using the camera 210 via the function of the pre-authentication application (S302).Then, the user terminal 200-1 transmits a pre-authentication request including the photographed face image to the store management device 500 via the network N (S303).

[0079] The store management device 500 receives a pre-authentication request from the user terminal 200-1 via the network N, acquires a facial image from the pre-authentication request, and transmits a facial authentication request including the acquired facial image to the authentication device 600 via the network N (S304). In response, the authentication device 600 receives the facial authentication request from the store management device 500 via the network N and performs facial authentication processing (S305).

[0080] FIG. 13 is a flowchart showing the flow of face authentication processing by the authentication device according to the third embodiment. First, the authentication device 600 receives a face authentication request from the store management device 500 via the network N (S211). The authentication device 600 may also receive a face authentication request from the user terminal 200, the payment terminal 100, or the like. Next, the authentication device 600 extracts facial feature information from the face image included in the face authentication request, similar to steps S202 and S203 described above. Then, the authentication unit 650 of the authentication device 600 compares the facial feature information extracted from the face image included in the face authentication request with the facial feature information 612 in the face information DB 610 (S212) and calculates the degree of match. Then, the authentication unit 650 determines whether the degree of match is equal to or greater than a threshold (S213). If the facial feature information matches, that is, if the degree of match between the facial feature information is equal to or greater than the threshold, the authentication unit 650 identifies the user ID 611 associated with the facial feature information 612 (S214). The authentication unit 650 then returns the facial authentication result, including the fact that facial authentication was successful and the identified user ID 611, to the store management device 500 via the network N (S215). If the degree of match is less than the threshold in step S213, the authentication unit 650 returns the facial authentication result, including the fact that facial authentication was unsuccessful, to the store management device 500 via the network N (S216).

[0081] Returning to FIG. 12, the explanation will be continued. The store management device 500 then receives the face authentication result from the authentication device 600 via network N (S306). The store management device 500 then determines whether face authentication was successful based on the face authentication result. If the face authentication result indicates that face authentication was unsuccessful, the store management device 500 returns a message indicating that authentication was unsuccessful to the user terminal 200-1 via network N.

[0082] In this example, the facial authentication result includes a message indicating successful facial authentication and the user ID of user U1. Therefore, the store management device 500 determines that user U1 has successfully passed facial authentication. The store management device 500 then performs a certification information issuing process (S307). Specifically, as described above, the certification information issuing unit 543 of the store management device 500 identifies the user ID of user U1 included in the facial authentication result and reads personal information 5122 associated with user U1's user ID 5121 from the member DB 512. The personal information may include, for example, the member's name for display purposes. The personal information may also include a member ID. Alternatively, the member ID may be the user ID. The certification information issuing unit 543 also identifies time information corresponding to the success of facial authentication, as described above. The certification information issuing unit 543 also identifies the location information of user terminal 200-1, as described above. Furthermore, as described above, the certification information issuing unit 543 may generate code information for specifying information including a notification that face authentication was successful, the member ID (and member name), time information, and location information. Then, the certification information issuing unit 543 generates certification information including a notification that face authentication was successful, the member ID, the member name, time information, location information, and code information.

[0083] The store management device 500 then transmits the generated certification information to the user terminal 200-1 via network N (S308). In response, the user terminal 200-1 receives the certification information from the store management device 500 via network N and stores it in the storage unit 220 as certification information 222 (S309). The user terminal 200-1 then displays the received certification information 222 on its screen (S310). For example, it may be displayed as shown in FIG. 10 above. As described above, user U1 checks the member name etc. in the certification information displayed on the user terminal 200-1, and if it differs from his / her own name, facial authentication is not performed. False authentication If it determines that the person has been identified, the person can move to a different location, have their face photographed again, and perform pre-authentication.

[0084] 12, the user terminal may send a facial authentication request directly to the authentication device without going through the store management device. If the facial authentication result received from the authentication device indicates success, the user terminal sends a credential issuance request to the store management device, including the user ID included in the facial authentication result. In response to the credential issuance request, the store management device executes step S307 and subsequent steps.

[0085] FIG. 14 is a sequence diagram showing the flow of payment processing according to the third embodiment. Here, it is assumed that the above-mentioned pre-authenticated user U1 has made a purchase in the store 300 and moved to the first range 310 to make a payment. In the following explanation, the user U1 and user terminal 200-1 after the move will be referred to as user U2 and user terminal 200-2. In other words, it is assumed that the certification information 222-2 has already been saved in the user terminal 200-2. It is also assumed that user U2 and user terminal 200-2 are present within the first range 310 of the payment terminal 100, that is, in front of or near the payment terminal 100.

[0086] First, user terminal 200-2 outputs certification information 222-2 to payment terminal 100 (S321). For example, as described above, user terminal 200-2 may output certification information 222-2 via short-range wireless communication and have payment terminal 100 receive certification information 222-2. Alternatively, as described above, user terminal 200-2 may display code information of certification information 222-2, and payment terminal 100 may acquire the certification information by reading the code information with camera 110 or a code reader and analyzing the code information.

[0087] Next, the payment terminal 100 performs a determination process on the acquired certification information (S322). Specifically, the payment terminal 100 determines whether the certification information indicates that pre-authentication was successful. Here, because the certification information indicates that pre-authentication was successful, the payment terminal 100 determines that pre-authentication was successful. Furthermore, the payment terminal 100 may determine whether the time information included in the certification information indicates that the validity period is within the validity period, and whether the location information included in the certification information is within the second range 320. Then, if the certification information includes time information, the payment terminal 100 determines that the certification information is valid if it is within the validity period. For example, the payment terminal 100 can perform payment processing using facial authentication, with one of the conditions being that user U2 has performed pre-authentication within 30 minutes. Furthermore, if the certification information includes location information, the payment terminal 100 determines that the certification information is valid if the location information is within the second range 320. For example, the payment terminal 100 can perform payment processing using facial authentication, with one of the conditions being that the user U2 has performed pre-authentication within 100 meters of the store 300.

[0088] If the pre-authentication is successful and the authentication information is determined to be valid in step S322, the payment terminal 100 identifies the user ID included in the authentication information (S323). Then, the payment terminal 100 starts controlling facial authentication. Specifically, the payment terminal 100 captures a facial image of user U2 using the camera 110 (S324). Then, the payment terminal 100 transmits a facial authentication request including the captured facial image to the store management device 500 via the network N (S325).

[0089] The store management device 500 receives a facial authentication request from the payment terminal 100 via the network N, and transmits the facial authentication request including a facial image to the authentication device 600 via the network N (S326). In response, the authentication device 600 receives the facial authentication request from the store management device 500 via the network N, and performs facial authentication processing in the same manner as in FIG. 13 described above (S327).

[0090] The store management device 500 then receives the face authentication result from the authentication device 600 via network N (S328). The store management device 500 then transmits the received face authentication result to the payment terminal 100 via network N (S329). In response, the payment terminal 100 receives the face authentication result from the store management device 500 via network N.

[0091] The payment terminal 100 may send a face authentication request directly to the authentication device 600 without going through the store management device 500, and may receive a face authentication result directly from the authentication device 600.

[0092] The payment terminal 100 then determines whether or not face authentication was successful based on the face authentication result. If the face authentication result indicates that face authentication failed, the payment terminal 100 displays on the screen a message to the effect that authentication failed, i.e., that payment using face authentication is not possible. The payment terminal 100 may also notify the user terminal 200-2 that payment using face authentication is not possible via short-range wireless communication.

[0093] Here, the facial authentication result includes a message indicating that facial authentication was successful and the user ID of user U2. Therefore, the payment terminal 100 determines that user U2 has succeeded in facial authentication. Next, the payment terminal 100 determines whether the user IDs from the pre-authentication and the facial authentication immediately before the payment match (S330). That is, the payment terminal 100 determines whether the user ID identified in step S323 matches the user ID included in the facial authentication result received in step S329.

[0094] If it is determined in step S330 that the user IDs match, the payment terminal 100 transmits a payment request, including the user ID and the payment amount for the products and other items that user U2 wishes to purchase, to the store management device 500 via network N (S331). In response, the store management device 500 receives the payment request from the payment terminal 100 via network N and performs payment processing (S332). Specifically, the payment processing unit 544 of the store management device 500 acquires the user ID and the payment amount from the received payment request and reads out payment information 5123 associated with the acquired user ID 5121 from the member DB 512. The payment processing unit 544 then performs payment processing for the payment amount using the payment information 5123. The payment processing unit 544 then transmits a payment result to the payment terminal 100 via network N (S333). In response, the payment terminal 100 receives the payment result from the store management device 500 via network N and displays the payment result on the screen (S334). Furthermore, payment terminal 100 may notify user terminal 200-2 of the payment result via short-range wireless communication.

[0095] On the other hand, if it is determined in step S330 that the user IDs do not match, the payment terminal 100 displays on the screen a message that payment by facial authentication is not possible. The payment terminal 100 may also notify the user terminal 200-2 by short-range wireless communication that payment by facial authentication is not possible. This prevents, for example, payment processing from being performed even when the pre-authentication results in erroneous authentication of a person other than user U2 (U1). At the very least, payment processing can be prevented when either the pre-authentication or the facial authentication at the time of payment results in erroneous authentication.

[0096] In this way, in this embodiment, pre-authentication is performed using the camera function of the terminal carried by the customer at a location different from the cash register installation location 311 (for example, at the store entrance or around the store), and if the success of the pre-authentication can be proven at the time of payment, payment by facial authentication is permitted. In other words, by combining biometric authentication results from different locations, two-step authentication is achieved, improving authentication accuracy and the reliability of predetermined processing according to biometric authentication.

[0097] Furthermore, when two-step authentication is performed at the time of payment, the entire payment process takes a long time. Therefore, in this embodiment, by dispersing the authentication timing, the authentication process time at the time of payment can be shortened and the reliability of two-step authentication can be improved (maintained).

[0098] As described above, the biometric authentication used in the two-step authentication can be a combination of various methods such as face authentication, iris authentication, and fingerprint authentication. In particular, by using face authentication or iris authentication for the biometric authentication in the payment terminal 100, the user can perform payment processing without contact. For example, it is preferable that at least one of the first biometric authentication and the second biometric authentication is face authentication.

[0099] Note that when using other highly accurate biometric authentication technologies (such as iris authentication) other than facial authentication, it is difficult to perform the authentication using a camera mounted on a user terminal such as a general smartphone. Therefore, it is necessary to install a highly accurate and expensive camera near the entrance of the store 300 or in the payment terminal 100, which can increase costs. In contrast, in this embodiment, rather than using other highly accurate biometric authentication technologies, authentication accuracy can be improved and costs can be reduced by performing two stages by combining relatively inexpensive facial authentication for pre-authentication and authentication before payment.

[0100] Furthermore, even with facial recognition, two-step authentication can be performed in different locations under different backgrounds and lighting conditions, reducing the possibility of incorrect authentication.

[0101] 14, payment terminal 100 activates camera 110 after steps S321 to S323, that is, after the authentication information is acquired and confirmed, but this is not limiting. For example, payment terminal 100 may activate camera 110 to capture an image of user U2's face before step S321, and control facial authentication after step S323. At this time, payment terminal 100 may start control of facial authentication by starting a process of extracting features from the facial image.

[0102] Furthermore, the user terminal 200 transmits a facial image during facial information registration processing or pre-authentication processing, but it may extract facial features from the facial image and include the facial features in place of the facial image in the member registration request or pre-authentication request. Furthermore, the store management device 500 transmits a facial image together with a facial information registration request or a facial authentication request, but it may extract facial features from the facial image and include the facial features in place of the facial image in the facial information registration request or facial authentication request.

[0103] 14, the payment terminal 100 may also transmit a facial authentication request including the user ID identified in step S323. In this case, the store management device 500 transmits a facial authentication request including the user ID and a facial image to the authentication device 600. This allows the authentication device 600 to perform one-to-one authentication between the facial feature information corresponding to the (specified) user ID included in the received facial authentication request and the facial image (facial feature information) included in the received facial authentication request. In other words, the authentication process can be performed by narrowing down the matching targets in the facial information DB 610. This reduces the load of the authentication process and improves the processing speed.

[0104] <Other embodiments> The above-mentioned certification information may be registered on a predetermined server, and the user terminal may output a URL (Uniform Resource Locator) including the address of the server instead of the certification information. The server is connected to the user terminal, payment terminal, store management device, and authentication device via a network N. The URL may specify a folder or directory on the server where the information is to be registered, or the name of an application running on the server that registers and acquires the certification information. In these cases, the payment terminal may acquire a URL from a user terminal within the first range and download the certification information from the URL.

[0105] For example, in the certification information issuance process of the pre-authentication process, the store management device transmits the certification information and the URL of the server where the certification information is to be registered to the user terminal. The user terminal then uploads the certification information to the received URL and registers the certification information in the server where the certification information is to be registered. The user terminal then outputs the received URL to the payment terminal. For example, the user terminal outputs the URL information via short-range wireless communication, and the payment terminal acquires the URL information.

[0106] Alternatively, the store management device issues code information for the URL of the server where the certification information is to be registered, and transmits the code information, the URL of the server where the certification information is to be registered, and the code information to the user terminal. The user terminal then uploads the certification information to the received URL and registers the certification information in the server where the certification information is to be registered. The user terminal then displays the received code information, and the payment terminal reads the code information using a camera or the like and analyzes the code information to obtain the URL.

[0107] Alternatively, the store management device may upload the issued certification information to the registration server and register the certification information in the registration server. The store management device may then issue code information for the URL of the registration server and transmit the code information to the user terminal. Alternatively, the store management device may transmit the URL to the user terminal. The user terminal may then output the received URL information via short-range wireless communication, and the payment terminal may acquire the URL information. Alternatively, the user terminal may display the received code information, and the payment terminal may read the code information using a camera or the like and analyze the code information to acquire the URL.

[0108] After this, the payment terminal can download the authentication information from the acquired URL, and the above-mentioned processing from S323 onwards in Fig. 14 is carried out.

[0109] Alternatively, in the payment process, the user terminal may not output the information including the URL received from the store management device to the payment terminal. Furthermore, in the payment process, the user terminal may not display an information code including the URL and have the payment terminal read it. For example, the user terminal may upload authentication information for the URL received from the store management device and register the authentication information with the registration server. Alternatively, a display board displaying an information code including the URL of the server to which the authentication information is to be registered may be installed near the payment terminal. The information code may include a payment terminal ID and a store ID along with the URL. The URL included in the information code may be different for each payment terminal. Then, in the payment process, the user terminal photographs the information code displayed on the display board and extracts the URL. The user terminal then uploads authentication information for the extracted URL and registers the authentication information with the registration server. After this, the registration server may send a registration completion notification including the URL to the payment terminal or to the payment terminal via the store management device. The payment terminal may download authentication information from the URL included in the registration completion notification received from the registration server. Then, the above-described processing from S323 onward in FIG. 14 is carried out.

[0110] Furthermore, the payment terminal may read the code information 714 in FIG. 10 using a camera or the like, or may acquire authentication information via short-range wireless communication, and then display the captured facial image of the user on a screen on the store staff's side. Alternatively, the payment terminal may acquire a facial image of a user who has been successfully pre-authenticated from the authentication device 600 and display it on the screen. That is, the payment terminal may display on its screen either a facial image captured at the time of payment, a pre-authenticated facial image, or a pre-registered facial image. The screen displaying the facial image may be the payment terminal's screen, particularly a staff screen in a position not visible to the user, or a display device installed in a staff room. This makes it easy for store staff to verify the identity of the user with the naked eye.

[0111] Furthermore, the store management device may register a facial image of a user who has successfully completed pre-authentication in the registration server. Alternatively, the user terminal may register the user's facial image in the registration server when pre-authentication is successful. The payment terminal may then download the facial image from the above-mentioned URL and display it on the screen. Alternatively, the user terminal may register the facial image together with the authentication information in the registration server. In this case, the payment terminal may download the facial image together with the authentication information from the above-mentioned URL and display it on the screen. This makes it easier for store staff to verify the identity of the user with the naked eye. The facial image downloaded together with the authentication information may be a pre-registered image or an image captured when pre-authentication is successful.

[0112] In the third embodiment, the store management device 500 and the authentication device 600 are described as separate information processing devices, but they may be the same device. For example, the store management device 500 may register facial feature information in association with the user ID 5121 in the member database 512. In this case, the control unit 540 may further include the functions of the face detection unit 620, feature point extraction unit 630, registration unit 640, and authentication unit 650 shown in FIG. 7.

[0113] In the above examples, the program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray® disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may also be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

[0114] The present disclosure is not limited to the above-described embodiments, and may be modified as appropriate without departing from the spirit and scope of the present disclosure. In addition, the present disclosure may be implemented by appropriately combining the respective embodiments.

[0115] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. (Appendix A1) an acquisition means for acquiring, from a user terminal carried by the user outside a first range of an installation location of the device, certification information indicating the success of a first biometric authentication performed based on a first captured image of the user, the first captured image being captured by the user outside the first range of an installation location of the device, after the user moves within the first range; an authentication control means for starting control of a second biometric authentication for the user when the authentication information is acquired; an execution means for executing a predetermined process when the second biometric authentication is successful; A processing execution device comprising: (Appendix A2) the authentication information includes identification information of a user who has successfully passed the first biometric authentication; The execution means executes the predetermined process when the identification information of the user indicated by the certification information matches the identification information of the user who has succeeded in the second biometric authentication. 10. The process execution device according to claim 1. (Appendix A3) the certification information includes time information corresponding to success of the first biometric authentication; The authentication control means starts control of the second biometric authentication when the time information included in the certification information indicates that the time is within the expiration date. 10. The process execution device according to claim 1, wherein the processing execution device is a processing execution device according to claim 1. (Appendix A4) the certification information includes location information of the user terminal when the first biometric authentication is successful, The authentication control means starts control of the second biometric authentication when the location information included in the certification information is within a second range that is a predetermined distance away from the first range. A processing execution device according to any one of appendices A1 to A3. (Appendix A5) When the certification information is acquired, the authentication control means controls the second biometric authentication by transmitting biometric information based on a second captured image of the user present within the first range to the authentication server that performed the first biometric authentication. A processing execution device according to any one of appendices A1 to A4. (Appendix A6) The acquiring means acquires the certification information from the user terminal within the first range via short-range wireless communication. A processing execution device according to any one of appendices A1 to A5. (Appendix A7) The acquiring means acquires the certification information by reading the certification information displayed on the user terminal. A processing execution device according to any one of appendices A1 to A5. (Appendix A8) At least one of the first biometric authentication and the second biometric authentication is face authentication. A process execution device according to any one of appendices A1 to A7. (Appendix B1) an acquisition means for acquiring a first captured image of a user outside a first range of a location where the processing execution device is installed; an authentication control means for controlling the first biometric authentication by transmitting biometric information based on the first captured image to an authentication server; a storage means for storing, when the first biometric authentication is successful, certification information indicating the success, which is acquired from the authentication server; an output means for outputting the certification information so that the process execution device can control second biometric authentication for the user and perform a predetermined process after the user moves within the first range; A user terminal comprising: (Appendix B2) the acquiring means acquires the certification information including the user's identification information from the authentication server when the first biometric authentication is successful; The output means outputs the certification information by displaying it. 2. A user terminal as described in Appendix B1. (Appendix B3) the acquiring means acquires, when the first biometric authentication is successful, the certification information including time information corresponding to the success of the first biometric authentication from the authentication server; The output means outputs the certification information by displaying it. A user terminal as described in Appendix B1 or B2. (Appendix B4) The output means outputs the certification information by transmitting the certification information to the process execution device via short-range wireless communication. A user terminal according to any one of appendices B1 to B3. (Appendix B5) The output means outputs the certification information by displaying it so that it can be read by the processing execution device. A user terminal according to any one of appendices B1 to B3. (Appendix C1) A user terminal owned by a user; an authentication server that performs biometric authentication; a process execution device that is installed at a first location and that executes a predetermined process; Equipped with The user terminal acquiring a first photographed image of the user outside a first range of the first location; transmitting biometric information based on the first captured image to the authentication server, thereby controlling the first biometric authentication; The authentication server If the first biometric authentication is successful, transmitting certification information indicating the success to the user terminal; The user terminal storing the certification information obtained from the authentication server; outputting the credential after the user moves within a first range; The processing execution device When the authentication information is acquired from the user terminal, control of second biometric authentication for the user is initiated; If the second biometric authentication is successful, the predetermined process is executed. Authentication system. (Appendix C2) the authentication information includes identification information of a user who has successfully passed the first biometric authentication; The process execution device executes the predetermined process when the identification information of the user indicated by the certification information matches the identification information of the user who has succeeded in the second biometric authentication. The authentication system described in Appendix C1. (Appendix D1) A computer installed at the first location acquiring, from a user terminal carried by the user outside a first range of the first location, certification information indicating success of a first biometric authentication performed based on a first captured image of the user taken by the user terminal after the user moves within the first range; If the authentication information is acquired, start a second biometric authentication control for the user; If the second biometric authentication is successful, a predetermined process is executed. How to perform the process. (Appendix E1) A computer installed at the first location an acquisition process for acquiring, from a user terminal carried by the user outside a first range of the first location, certification information indicating success of a first biometric authentication performed based on a first captured image of the user taken by the user terminal after the user moves within the first range; an authentication control process that starts control of second biometric authentication for the user when the authentication information is acquired; an execution process for executing a predetermined process if the second biometric authentication is successful; A non-transitory computer-readable medium storing a program for executing the program. (Appendix F1) The computer acquiring a first captured image of the user outside a first range of an installation location of the processing execution device; transmitting biometric information based on the first captured image to an authentication server, thereby controlling the first biometric authentication; If the first biometric authentication is successful, certification information indicating the success, which is obtained from the authentication server, is stored in a storage device; outputting the certification information to cause the process execution device to control second biometric authentication for the user and perform a predetermined process after the user moves within the first range; Authentication method. (Appendix G1) On the computer, an acquisition process of acquiring a first captured image of the user outside a first range of the installation location of the process execution device; an authentication control process for controlling first biometric authentication by transmitting biometric information based on the first captured image to an authentication server; a storage process for storing, in a storage device, proof information indicating success obtained from the authentication server when the first biometric authentication is successful; an output process of outputting the certification information so that the process execution device controls second biometric authentication for the user and performs a predetermined process after the user moves within a first range; A non-transitory computer-readable medium storing a program for executing the program.

[0116] Although the present invention has been described above with reference to the embodiments (and examples), the present invention is not limited to the above-described embodiments (and examples). Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. [Explanation of symbols]

[0117] 1 Processing execution device 11 Acquisition Department 12 Authentication control section 13 Executive Department 2. User terminal 21 Acquisition Department 22 Authentication control section 23 Memory section 231 Certification Information 24 Output section 1000 Authentication System U1 User U2 users N Network 100 payment terminals 110 Camera 120 Storage section 121 Programs 130 memory 140 Communications Department 150 Input / output section 160 control section 161 Acquisition Department 162 Judgment section 163 Authentication control section 164 Payment Department 200 user terminals 200-1 User terminal 200-2 User terminal 210 Camera 220 Storage section 221 Program 222 Certification Information 222-1 Certification Information 222-2 Certification Information 2221 User ID 2222 Location information 2223 Time information 230 memory 240 Communications Department 250 Input / output section 260 Control Unit 261 Acquisition Department 262 Registration Department 263 Authentication control section 264 output section 300 stores 310 First Range 311 Cash register installation location 320 Second Range 400 Authentication Server 500 Store management device 510 Storage section 511 Program 512 Member DB 5121 User ID 5122 Personal Information 5123 Payment Information 520 memory 530 Communications Department 540 Control Unit 541 Registration Department 542 Authentication control unit 543 Certification Information Issuance Department 544 Payment Processing Unit 600 Authentication Device 610 Face Information DB 611 User ID 612 Facial Feature Information 620 Face detection unit 630 Feature Point Extraction Unit 640 Registration Department 650 Authentication Department 71 Pre-authentication certificate information display screen 711 Message display field 712 Nickname display field 713 Expiration date display column 714 Code Information

Claims

1. an acquisition means for acquiring, from a user terminal carried by the user outside a first range of an installation location of the device, certification information indicating the success of a first biometric authentication performed based on a first captured image of the user taken by the user terminal after the user moves within the first range; an authentication control means for starting control of a second biometric authentication for the user when the authentication information is acquired; an execution means for executing a predetermined process when the second biometric authentication is successful; A processing execution device comprising:

2. the authentication information includes identification information of a user who has successfully passed the first biometric authentication; The execution means executes the predetermined process when the identification information of the user indicated by the certification information matches the identification information of the user who has succeeded in the second biometric authentication. The processing execution device according to claim 1 .

3. the certification information includes time information corresponding to success of the first biometric authentication; The authentication control means starts control of the second biometric authentication when the time information included in the certification information indicates that the time is within the expiration date.

3. The processing execution device according to claim 1.

4. the certification information includes location information of the user terminal when the first biometric authentication is successful, The authentication control means starts control of the second biometric authentication when the location information included in the certification information is within a second range that is a predetermined distance away from the first range. The processing execution device according to any one of claims 1 to 3.

5. When the certification information is acquired, the authentication control means controls the second biometric authentication by transmitting biometric information based on a second captured image of the user present within the first range to the authentication server that performed the first biometric authentication. The processing execution device according to any one of claims 1 to 4.

6. The acquiring means acquires the certification information from the user terminal within the first range via short-range wireless communication. The processing execution device according to any one of claims 1 to 5.

7. The acquiring means acquires the certification information by reading the certification information displayed on the user terminal. The processing execution device according to any one of claims 1 to 5.

8. At least one of the first biometric authentication and the second biometric authentication is face authentication. The processing execution device according to any one of claims 1 to 7.

9. A user terminal owned by a user; an authentication server that performs biometric authentication; a process execution device that is installed at a first location and that executes a predetermined process; Equipped with The user terminal acquiring a first captured image of the user outside a first range of the first location; transmitting biometric information based on the first captured image to the authentication server, thereby controlling the first biometric authentication; The authentication server If the first biometric authentication is successful, transmitting certification information indicating the success to the user terminal; The user terminal storing the certification information obtained from the authentication server; outputting the credential after the user moves within a first range; The processing execution device When the authentication information is acquired from the user terminal, control of second biometric authentication for the user is initiated; If the second biometric authentication is successful, the predetermined process is executed. Authentication system.

10. the authentication information includes identification information of a user who has successfully passed the first biometric authentication; The process execution device executes the predetermined process when the identification information of the user indicated by the certification information matches the identification information of the user who has succeeded in the second biometric authentication. The authentication system of claim 9.

11. a computer located at a first location; acquiring, from a user terminal carried by the user outside a first range of the first location, certification information indicating success of a first biometric authentication performed based on a first captured image of the user captured by the user terminal after the user moves within the first range; When the authentication information is acquired, control of second biometric authentication for the user is started, and when the second biometric authentication is successful, a predetermined process is executed. How to perform the process.

12. A computer installed at a first location an acquisition process for acquiring, from a user terminal carried by the user outside a first range of the first location, certification information indicating success of a first biometric authentication performed based on a first captured image of the user captured by the user terminal after the user moves within the first range; an authentication control process that starts control of second biometric authentication for the user when the authentication information is acquired; an execution process for executing a predetermined process if the second biometric authentication is successful; A program to execute.

Images