Processing execution device, authentication system, processing execution method, and program

Abstract

This user terminal (1) comprises: an imaging unit (11) that captures an information code including predetermined activation information (for example, activation information for an authentication assistance function program); an activation unit (12) that activates the authentication assistance function program using the activation information included in the captured information code; an acquisition unit (13) that acquires an image, including the face of a user, captured by the imaging unit (11) in response to the activation of the authentication assistance function program; and an output unit (14) that outputs the user's biometric information, based on the image, for biometric authentication.

Description

[Technical Field]

[0001] The present invention relates to a user terminal, a processing execution device, an authentication system, an authentication assistance method, a processing execution method, and a program, and in particular to a user terminal, a processing execution device, an authentication system, an authentication assistance method, a processing execution method, and a program that executes processing using biometric authentication. [Background technology]

[0002] In recent years, payment processing and membership authentication using facial recognition in stores have become increasingly common. Patent Document 1 discloses a technology for performing authentication using facial image data. The transaction processing device disclosed in Patent Document 1 reads facial image data from a card, extracts feature points from the facial image data as feature point data, and transmits the feature point data to a host computer. The host computer then performs authentication based on the feature point data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2003-256746 Summary of the Invention [Problem to be solved by the invention]

[0004] From the viewpoint of reliability of identity verification, it is desirable to photograph a face on the spot and extract facial feature data from the photographed image for biometric authentication such as face recognition. However, installing cameras for reading biometric information at various locations in facilities such as stores when performing biometric authentication has the problem of high implementation costs. Note that the technology disclosed in Patent Document 1 uses facial image data stored in advance on a card, and therefore cannot eliminate the risk of impersonation using another person's card.

[0005] In view of the above-mentioned problems, the object of the present disclosure is to provide a user terminal, a processing execution device, an authentication system, an authentication assistance method, a processing execution method, and a program that reduce the cost of introducing biometric authentication while ensuring the reliability of personal authentication. [Means for solving the problem]

[0006] A user terminal according to a first aspect of the present disclosure includes: an imaging means for imaging an information code including predetermined startup information; a start-up means for starting an authentication assistant function using the start-up information included in the photographed information code; an acquisition means for acquiring an image including the user's face photographed by the photographing means in response to activation of the authentication assistance function; an output means for outputting biometric information of the user based on the image for biometric authentication; Equipped with.

[0007] A process execution device according to a second aspect of the present disclosure includes: an acquisition means for acquiring, from a user terminal held by the user, biometric information based on an image including the face of the user captured by the user terminal in response to an authentication assisting function of the user terminal that is activated based on predetermined activation information included in an information code captured by the user terminal; an authentication control means for controlling biometric authentication of the user when the biometric information is acquired; an execution means for executing a predetermined process when the biometric authentication is successful; Equipped with.

[0008] An authentication system according to a third aspect of the present disclosure includes: A user terminal owned by a user; a process execution device that executes a predetermined process; Equipped with The user terminal an imaging means for imaging an information code including predetermined startup information; a start-up means for starting an authentication assistant function using the start-up information included in the photographed information code; an acquisition means for acquiring an image including the user's face photographed by the photographing means in response to activation of the authentication assistance function; an output means for outputting biometric information of the user based on the image for biometric authentication; Equipped with The processing execution device an acquisition means for acquiring the biometric information from the user terminal; an authentication control means for controlling biometric authentication of the user when the biometric information is acquired; an execution means for executing a predetermined process when the biometric authentication is successful; Equipped with.

[0009] An authentication assistance method according to a fourth aspect of the present disclosure includes: a computer having an imaging device, taking an image of an information code including predetermined startup information with the image capturing device; activating an authentication assistance function using the activation information included in the photographed information code; acquiring an image including the user's face photographed by the photographing device in response to activation of the authentication assistance function; Biometric information of the user based on the image is output for biometric authentication.

[0010] A non-transitory computer-readable medium storing a program according to a fifth aspect of the present disclosure includes: A computer equipped with an imaging device, a photographing process of photographing an information code including predetermined startup information by the photographing device; a start-up process for starting an authentication assistant function using the start-up information included in the photographed information code; an acquisition process for acquiring an image including a face of the user captured by the image capturing device in response to activation of the authentication assistance function; an output process of outputting biometric information of the user based on the image for biometric authentication; Execute the following.

[0011] A processing execution method according to a sixth aspect of the present disclosure includes: The computer Acquires biometric information from a user terminal based on an image including the user's face, the image being captured by the user terminal in response to an authentication assistance function of the user terminal that is activated based on predetermined activation information included in an information code captured by the user terminal; When the biometric information is acquired, control biometric authentication for the user; If the biometric authentication is successful, a predetermined process is executed.

[0012] A non-transitory computer-readable medium storing a program according to a seventh aspect of the present disclosure includes: an acquisition process for acquiring, from a user terminal held by the user, biometric information based on an image including the face of the user captured by the user terminal in accordance with an authentication assistance function of the user terminal that is activated based on predetermined activation information included in an information code captured by the user terminal; an authentication control process for controlling biometric authentication of the user when the biometric information is acquired; an execution process for executing a predetermined process if the biometric authentication is successful; to be executed by the computer. [Effects of the Invention]

[0013] The present disclosure makes it possible to provide a user terminal, a process execution device, an authentication system, an authentication assistance method, a process execution method, and a program for reducing the introduction cost of biometric authentication while ensuring the reliability of personal authentication. [Brief explanation of the drawings]

[0014] [Figure 1] FIG. 2 is a block diagram showing the configuration of a user terminal according to the first embodiment. [Figure 2] 1 is a flowchart showing the flow of an authentication assistance method according to the first embodiment. [Figure 3] FIG. 10 is a block diagram showing the configuration of a process execution device according to a second embodiment. [Figure 4]10 is a flowchart showing the flow of a processing execution method according to the second embodiment. [Figure 5] FIG. 10 is a block diagram showing the overall configuration of an authentication system according to a third embodiment. [Figure 6] FIG. 10 is a block diagram showing the configuration of a store management device according to a third embodiment. [Figure 7] FIG. 10 is a block diagram showing the configuration of an authentication device according to a third embodiment. [Figure 8] 11 is a flowchart showing the flow of a face information registration process performed by the authentication device according to the third embodiment. [Figure 9] FIG. 11 is a block diagram showing the configuration of a user terminal according to the third embodiment. [Figure 10] FIG. 11 is a block diagram showing the configuration of a payment terminal according to the third embodiment. [Figure 11] FIG. 11 is a sequence diagram showing the flow of payment processing according to the third embodiment. [Figure 12] 11 is a flowchart showing the flow of face authentication processing by the authentication device according to the third embodiment. [Figure 13] FIG. 10 is a block diagram showing the overall configuration of an authentication system according to a fourth embodiment. [Figure 14] FIG. 11 is a sequence diagram showing the flow of payment processing according to the fourth embodiment. [Figure 15] FIG. 10 is a block diagram showing the overall configuration of an authentication system according to a fifth embodiment. [Figure 16] FIG. 13 is a sequence diagram showing the flow of payment processing according to the fifth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0015] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals, and for clarity of explanation, duplicate explanations will be omitted as necessary.

[0016] <Embodiment 1> FIG. 1 is a block diagram showing the configuration of a user terminal 1 according to the first embodiment. The user terminal 1 is an information terminal that can be carried by a user and is capable of wireless communication. The user terminal 1 also includes a photographing device. The user terminal 1 includes a photographing unit 11, a startup unit 12, an acquisition unit 13, and an output unit 14. The photographing unit 11 photographs an information code including predetermined startup information. Here, the information code is display information obtained by converting the predetermined information into a code of a number, a graphic, or a combination thereof. The information code may be printed on a display board or paper, or may be displayed on a display device, etc. The startup information is information used to start an authentication assistance function (not shown) included in the user terminal 1. The authentication assistance function is a functional block that acquires and outputs biometric information based on a captured image of a user in order to have an external authentication control device (not shown) perform biometric authentication of the user. The authentication assistance function may also be called an authentication assistance unit for assisting biometric authentication. The authentication assistance function is, for example, a computer program (application program) in which the relevant processing is implemented. For example, an application program related to the authentication assistance function is pre-installed in the user terminal 1. Therefore, the startup information only needs to include information that can identify at least the authentication assistance function to be started. Furthermore, the startup information may include a command string that executes the authentication assistance program related to the authentication assistance function. The photographing unit 11 may be a photographing device itself, such as a built-in camera of the user terminal 1, or a processing unit that controls the photographing device.

[0017] The activation unit 12 activates the authentication assistance function using activation information included in the captured information code. The acquisition unit 13 acquires an image including the user's face captured by the photographing unit 11 in response to activation of the authentication assistance function. The output unit 14 outputs the user's biometric information based on the image for biometric authentication. The user's biometric information based on the image is an image of the user's face area in the image captured by the photographing unit 11, or facial feature information extracted from the image of the face area. The output unit 14 outputs the biometric information according to a predetermined communication method. For example, the output unit 14 may output the biometric information via short-range wireless communication. Alternatively, the output unit 14 may transmit the biometric information to a predetermined destination via a communication network. The authentication assistance function unit described above may include the acquisition unit 13 and the output unit 14.

[0018] 2 is a flowchart showing the flow of the authentication assistance method according to the first embodiment. First, the photographing unit 11 photographs an information code including predetermined activation information with a photographing device provided in the user terminal 1 (S11). Next, the activation unit 12 activates the authentication assistance function using the activation information included in the photographed information code (S12). Here, when the authentication assistance function is activated, it controls the photographing unit 11 to photograph an area including the user's face.

[0019] The acquisition unit 13 then acquires an image including the user's face captured by the image capture device in response to activation of the authentication assistance function (S13), and the output unit 14 outputs the user's biometric information based on the image for biometric authentication (S14).

[0020] As described above, in the first embodiment, the user terminal 1 uses a built-in camera to capture an image of an information code displayed on a display board or the like. The user terminal 1 analyzes the captured information code to extract startup information contained in the information code. The user terminal 1 then activates an authentication assistance function using the extracted startup information. When activated, the authentication assistance function controls the built-in camera to capture an image of the face of the user who is the owner of the user terminal 1. Alternatively, the authentication assistance function may prompt the user to press a capture button. In response to this, the user terminal 1 acquires an image of the user's face and outputs biometric information based on the face image so that biometric authentication can be performed by an external authentication control device.

[0021] In recent years, it is common for user terminals (mobile terminals) to be equipped with a built-in camera. Therefore, in the first embodiment, biometric authentication in the authentication control device is assisted by having the user terminal read an information code including startup information, which serves as a trigger. Therefore, there is no need to install a camera for acquiring biometric information on the authentication control device side. As a result, it is possible to reduce the introduction cost of biometric authentication while ensuring the reliability of personal authentication.

[0022] Note that biometric authentication involves extracting a person's biometric information from a captured image, matching the extracted biometric information with pre-registered biometric information, and determining that authentication is successful if the degree of match is above a threshold. Here, the biometric information may be data (features) calculated from physical characteristics unique to an individual, such as facial feature information, fingerprints, voiceprints, veins, retinas, irises, and palm patterns.

[0023] The user terminal 1 includes a processor, a memory, and a storage device (not shown). The storage device stores a computer program (and an authentication assistance program) that implements the processing of the authentication assistance method according to this embodiment. The processor then loads the computer program from the storage device into the memory and executes the computer program. This allows the processor to realize the functions of the image capture unit 11, the startup unit 12, the acquisition unit 13, and the output unit 14.

[0024] Alternatively, each component of the user terminal 1 may be realized by dedicated hardware. Furthermore, some or all of the components of each device may be realized by general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and programs. Furthermore, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array), quantum processor (quantum computer control chip), etc., may be used as the processor.

[0025] <Embodiment 2> 3 is a block diagram showing the configuration of a process execution device 2 according to the second embodiment. The process execution device 2 is either the authentication control device described above, or an information processing device that controls biometric authentication using the authentication control device and executes a predetermined process in response to success of the biometric authentication. The process execution device 2 includes an acquisition unit 21, an authentication control unit 22, and an execution unit 23.

[0026] The acquiring unit 21 acquires, from a user terminal, biometric information based on a facial image of a user who is the owner of the user terminal. Here, the user terminal corresponds to the user terminal 1 according to the above-described first embodiment. Therefore, it can be said that the acquiring unit 21 acquires biometric information based on an image including the face of the user that is captured by the user terminal in response to an authentication assistance function of the user terminal that is activated based on predetermined activation information included in an information code captured by the user terminal.

[0027] When biometric information is acquired, the authentication control unit 22 controls biometric authentication for the user. For example, if biometric information for registration of the user has been registered in advance, the authentication control unit 22 performs biometric authentication by comparing the acquired biometric information with the registration biometric information. Alternatively, if biometric information for registration of the user has been registered in advance in an external authentication control device, the authentication control unit 22 may transmit the acquired biometric information to the authentication control device, cause it to perform biometric authentication processing, and receive the biometric authentication result.

[0028] If the biometric authentication is successful, the execution unit 23 executes a predetermined process, such as, but not limited to, a payment process.

[0029] 4 is a flowchart showing the flow of a processing execution method according to the second embodiment. First, the acquisition unit 21 acquires biometric information based on an image including the user's face from a user terminal (S21). Here, the image including the user's face is captured by the user terminal in response to an authentication assistance function in the user terminal that is activated based on predetermined activation information included in an information code captured by the user terminal carried by the user.

[0030] Next, when the biometric information is acquired, the authentication control unit 22 controls biometric authentication for the user (S22). Then, the authentication control unit 22 determines whether or not the biometric authentication is successful (S23). If the biometric authentication is successful, the execution unit 23 executes a predetermined process (S24). On the other hand, if the biometric authentication is unsuccessful, the process ends.

[0031] As described above, in the second embodiment, it is assumed that a user terminal carried by a user uses a built-in camera to capture an image of an information code displayed on a display board installed near the process execution device 2. In response to this, it is assumed that the authentication assistance function of the user terminal is activated, the built-in camera of the user terminal captures an image of the user's face in advance, and biometric information based on the face image is output for biometric authentication. Therefore, the process execution device 2 can control biometric authentication using the acquired biometric information and perform a predetermined process if the biometric authentication is successful. Therefore, it is not necessary to install a camera for acquiring biometric information near the process execution device 2. From the above, the second embodiment also ensures the reliability of personal authentication while reducing the introduction cost of biometric authentication.

[0032] The process execution device 2 includes a processor, a memory, and a storage device (not shown). The storage device stores a computer program that implements the process of the process execution method according to this embodiment. The processor then loads the computer program from the storage device into the memory and executes the computer program. This allows the processor to implement the functions of an acquisition unit 21, an authentication control unit 22, and an execution unit 23.

[0033] Alternatively, each component of the processing execution device 2 may be realized by dedicated hardware. Furthermore, some or all of the components of each device may be realized by general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and a program. Furthermore, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array), quantum processor (quantum computer control chip), etc., may be used as the processor.

[0034] Furthermore, when some or all of the components of the processing execution device 2 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or decentralized. For example, the information processing devices, circuits, etc. may be realized as a client-server system, cloud computing system, etc., in which each is connected via a communication network. Furthermore, the functions of the processing execution device 2 may be provided in a SaaS (Software as a Service) format.

[0035] <Embodiment 3> The present embodiment 3 is a specific example of the above-mentioned embodiments 1 and 2. In the present embodiment 3, an example will be described in which the predetermined process performed by the process execution device in response to biometric authentication is a payment process in response to face authentication in a store. Note that the predetermined process in response to biometric authentication is not limited to this.

[0036] FIG. 5 is a block diagram showing the overall configuration of an authentication system 1000 according to the third embodiment. The authentication system 1000 is an information system that enables a customer (user U1) of a store 3 to use his / her user terminal 100 to perform payment processing based on facial authentication in cooperation with a payment terminal 200. For example, when making a payment, the user U1 uses the camera of the user terminal 100 to capture an image of an information code 310 on a display board 300 installed near the payment terminal 200. The information code 310 includes activation information 311 and a communication method 312. The activation information 311 includes information for activating an authentication assistance program installed in the user terminal 100. The communication method 312 includes a designation of a communication method between the user terminal 100 and the payment terminal 200. In response to this, the user terminal 100 activates the authentication assistance program and captures an image of the face of the user U1. The user terminal 100 then transmits facial feature information based on the captured facial image to the payment terminal 200 via short-range wireless communication. The payment terminal 200 transmits the facial feature information received via short-range wireless communication to the authentication control device 400, and receives the facial authentication result. If the facial authentication is successful, the payment terminal 200 works in conjunction with the store management device 500 to process the payment for user U1.

[0037] The authentication system 1000 includes a user terminal 100, a payment terminal 200, a store management device 500, and an authentication device 600. The store management device 500 and authentication device 600 may be collectively referred to as an authentication control device 400. The user terminal 100, payment terminal 200, store management device 500, and authentication device 600 are communicatively connected via a network N. Here, the network N is a wired or wireless communication line or network, such as an in-store LAN (Local Area Network), the Internet, a wireless communication network, or a mobile phone network. The network N can use any type of communication protocol.

[0038] It is assumed that user U1 has already registered his / her own face image or facial feature information in the face information DB (DataBase) 610 of the authentication device 600. It is also assumed that user U1 has already registered his / her own payment information (credit card information, debit bank account information, etc.) in the member DB 512.

[0039] The store management device 500 is an information processing device for performing various management tasks for the store 3. The store management device 500 may be configured redundantly with multiple servers, and each functional block may be implemented by multiple computers.

[0040] 6 is a block diagram showing the configuration of a store management device 500 according to the third embodiment. The store management device 500 includes a storage unit 510, a memory 520, a communication unit 530, and a control unit 540. The storage unit 510 is an example of a storage device such as a hard disk or flash memory. The storage unit 510 stores a program 511 and a member DB 512. The program 511 is a computer program that implements part of the facial information and member information registration process, facial authentication process, payment process, and other processes according to the third embodiment.

[0041] The member DB 512 is a database that manages information on people who visit the store 3 and are registered as members. The member DB 512 manages user IDs 5121, personal information 5122, and payment information 5123 in association with each other. The user ID 5121 is identification information for a user who is a member of the store 3. The user ID 5121 is information that corresponds to the user ID 611 in the face information DB 610, which will be described later. The personal information 5122 is information including the user's name, address, telephone number, notification destination, etc. The notification destination is identification information (terminal ID) of the user terminal owned by the user, the user's login ID, email address, SNS (Social Networking Service) account, etc. The payment information 5123 is credit card information, debit bank account information, etc., used when the payment terminal 200 performs payment processing in response to successful biometric authentication.

[0042] The memory 520 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily holding information during operation of the control unit 540. The communication unit 530 is a communication interface with the network N.

[0043] The control unit 540 is a processor, or control device, that controls each component of the store management device 500. The control unit 540 loads the program 511 from the storage unit 510 into the memory 520 and executes the program 511. In this way, the control unit 540 realizes the functions of a registration unit 541, an authentication control unit 542, and a payment processing unit 543.

[0044] The registration unit 541 receives a member registration request including a facial image, personal information, and payment information from any user terminal 100, and performs a process to register the facial information and member information. Specifically, the registration unit 541 acquires a facial image from the member registration request, and transmits a facial information registration request including the acquired facial image to the authentication device 600. The registration unit 541 then receives from the authentication device 600 a user ID that was issued when the facial information was registered by the authentication device 600. The registration unit 541 then acquires the personal information and payment information from the member registration request, and associates the received user ID 5121 with the acquired personal information 5122 and payment information 5123, and registers them in the member DB 512.

[0045] When the authentication control unit 542 receives a pre-authentication request including a face image of the user from the user terminal 100, it transmits a face authentication request (a request for first biometric authentication) including the face image to the authentication device 600. Then, the authentication control unit 542 receives the face authentication result from the authentication device 600.

[0046] The payment processing unit 543 performs payment processing when it receives a payment request from the payment terminal 200. Specifically, the payment processing unit 543 acquires the user ID and payment amount from the payment request, and reads out payment information 5123 associated with the acquired user ID 5121 from the member DB 512. The payment processing unit 543 then performs payment processing for the payment amount using the payment information 5123. The payment processing unit 543 then transmits the payment result to the payment terminal 200.

[0047] Returning to FIG. 5, the explanation will be continued. The authentication device 600 is an information processing device that manages facial feature information of users and performs facial authentication. In response to a facial authentication request received from the outside, the authentication device 600 compares the facial image or facial feature information included in the request with the facial feature information of each user and returns the comparison result (authentication result) to the request source.

[0048] FIG. 7 is a block diagram showing the configuration of an authentication device 600 according to the third embodiment. The authentication device 600 includes a face information DB 610, a face detection unit 620, a feature point extraction unit 630, a registration unit 640, and an authentication unit 650. The face information DB 610 stores a user ID 611 and facial feature information 612 for the user ID in association with each other. The facial feature information 612 is a collection of feature points extracted from a facial image. The authentication device 600 may delete the facial feature information 612 from the facial feature DB 610 in response to a request from a user or the like corresponding to the facial feature information 612. Alternatively, the authentication device 600 may delete the facial feature information 612 after a certain period of time has elapsed since registration.

[0049] The face detection unit 620 detects a face area included in a registration image for registering face information and outputs the detected face area to the feature point extraction unit 630. The feature point extraction unit 630 extracts feature points from the face area detected by the face detection unit 620 and outputs face feature information to the registration unit 640. The feature point extraction unit 630 also extracts feature points included in a face image received from the store management device 500 or the like and outputs the face feature information to the authentication unit 650.

[0050] The registration unit 640 issues a new user ID 611 when registering facial feature information. The registration unit 640 associates the issued user ID 611 with facial feature information 612 extracted from the registered image and registers the associated user ID 611 in the facial information DB 610. The authentication unit 650 performs facial authentication using the facial feature information 612. Specifically, the authentication unit 650 compares the facial feature information extracted from the facial image with the facial feature information 612 in the facial information DB 610. If the comparison is successful, the authentication unit 650 identifies the user ID 611 associated with the compared facial feature information 612. The authentication unit 650 returns a match of the facial feature information to the request source as a facial authentication result. The match of the facial feature information corresponds to the success or failure of authentication. Note that the facial feature information matches (matches) when the degree of match is equal to or greater than a threshold. If the facial authentication is successful, the facial authentication result includes the identified user ID.

[0051] FIG. 8 is a flowchart showing the flow of face information registration processing by the authentication device 600 according to the third embodiment. First, the authentication device 600 receives a face information registration request (S201). For example, the authentication device 600 receives the face information registration request from the store management device 500 via the network N. Next, the face detection unit 620 detects a face area from the face image included in the face information registration request (S202). Then, the feature point extraction unit 630 extracts feature points (facial feature information) from the face area detected in step S202 (S203). Then, the registration unit 640 issues a user ID 611 (S204). Then, the registration unit 640 associates the extracted facial feature information 612 with the issued user ID 611 and registers them in the face information DB 610 (S205). Thereafter, the registration unit 640 returns the issued user ID 611 to the request source (for example, the store management device 500) (S206). The authentication device 600 may perform face information registration processing in response to a face information registration request received from an arbitrary information registration terminal. For example, the information registration terminal may be an information processing device such as a personal computer, a smartphone, or a tablet terminal. The information registration terminal may also be the user terminal 100.

[0052] Returning to FIG. 5, the explanation will be continued. The user terminal 100 is an example of the above-mentioned user terminal 1. The user terminal 100 is an information terminal that is portable and capable of wireless communication, and is carried by the user U1. Here, it is assumed that the user U1 and the user terminal 100 are located near the payment terminal 200 in the store 3. In other words, it is assumed that the user terminal 100 is located in a position where it can photograph the information code 310 displayed on the display board 300, and is located within a distance where it can communicate with the payment terminal 200 by short-range wireless communication.

[0053] FIG. 9 is a block diagram showing the configuration of a user terminal 100 according to the third embodiment. The user terminal 100 includes a camera 110, a storage unit 120, a memory 130, a communication unit 140, an input / output unit 150, and a control unit 160. The camera 110 is a photographing device that photographs images under the control of the control unit 160. The storage unit 120 is a storage device such as a flash memory. The storage unit 120 stores a control program 121 and an authentication assistance program 122. The control program 121 is a computer program that implements processes such as registration of facial information and member information, analysis of information codes, and activation of the authentication assistance program 122. The control program 121 may also implement processes such as facial photography, extraction of facial feature information, and output of a facial image or facial feature information in response to activation of the authentication assistance program 122. The authentication assistance program 122 is a computer program that implements the processing of the above-described authentication assistance function. The authentication assistance program 122 controls the camera 110 in response to activation. Furthermore, the authentication assistant program 122 may be implemented with a face photographing process, a face feature information extraction process, and a face image or face feature information output process.

[0054] The memory 130 is a volatile storage device such as RAM, and is a storage area for temporarily storing information when the control unit 160 is operating. The communication unit 140 is a communication interface with the network N. In particular, the communication unit 140 performs wireless communication. For example, the communication unit 140 establishes a connection with a wireless base station inside or outside the store 3 and performs communication. The communication unit 140 may also establish a short-range wireless communication connection with the payment terminal 200 and perform communication. Here, various standards such as Bluetooth (registered trademark), BLE (Bluetooth Low Energy), and UWB (Ultra Wide Band) can be applied to the short-range wireless communication. The communication unit 140 may also communicate with a GPS (Global Positioning System) satellite to acquire location information. The input / output unit 150 includes a display device (display unit) such as a screen and an input device. The input / output unit 150 is, for example, a touch panel. The control unit 160 is a processor that controls the hardware of the user terminal 100. The control unit 160 loads the control program 121 and the authentication assistance program 122 from the storage unit 120 into the memory 130 and executes them. As a result, the control unit 160 realizes the functions of an imaging control unit 161, an acquisition unit 162, a registration unit 163, an extraction unit 164, a startup unit 165, and an output unit 166.

[0055] The photographing control unit 161 is an example of the photographing unit 11 described above. Alternatively, the photographing unit 11 may be realized by combining the photographing control unit 161 and the camera 110. The photographing control unit 161 controls the camera 110 to take a photograph in response to an operation by the user U1 or an instruction from the authentication assistance program 122. For example, the photographing control unit 161 controls the camera 110 to take a photograph. Display board 300 The photographing control unit 161 causes the camera 110 to photograph the face of the user U1.

[0056] The acquisition unit 162 is an example of the above-mentioned acquisition unit 13. The acquisition unit 162 acquires an image captured by the camera 110. Specifically, the acquisition unit 162 acquires an image of the information code 310 and a facial image of the user U1. For example, the acquisition unit 162 acquires an image including the face of the user U1 captured by the photography control unit 161 in response to the activation of the authentication assistant program 122.

[0057] The registration unit 163 performs a process for registering the user's facial information and membership information. Specifically, the registration unit 163 sends a membership registration request including the user's facial image, personal information, and payment information to the store management device 500. As a result, as described above, the facial feature information of the user is registered in the facial information DB 610 of the authentication device 600, and the membership information is registered in the membership DB 512 of the store management device 500.

[0058] The extraction unit 164 analyzes the image of the information code 310 acquired by the acquisition unit 162, and extracts startup information 311 and a communication method 312. The startup information 311 includes a command string for starting the authentication assistance program 122. Alternatively, the startup information 311 may include the program file name of the authentication assistance program 122. The communication method 312 includes a designation of a communication method for the facial image or facial feature information. It is assumed that one of the above-mentioned short-range wireless communication methods, for example, BLE, is designated as the communication method 312 according to the third embodiment. Furthermore, the extraction unit 164 may extract facial feature information from the facial image acquired by the acquisition unit 162.

[0059] The launch unit 165 is an example of the above-mentioned launch unit 12. The launch unit 165 launches the authentication assistant program 122 using the launch information 311.

[0060] The output unit 166 is an example of the output unit 14 described above. The output unit 166 outputs a facial image or facial feature information for facial authentication via the payment terminal 200 by the communication method 312 specified in the information code 310. Specifically, the output unit 166 outputs the facial image or facial feature information by short-range wireless communication. The output unit 166 may output the facial image, etc. by BLE broadcast communication, for example. Alternatively, the output unit 166 may establish wireless communication with the payment terminal 200 by BLE and output the facial image, etc. to the payment terminal 200.

[0061] Returning to FIG. 5, the explanation will be continued. The payment terminal 200 is an example of the process execution device 2 described above. The payment terminal 200 is installed at a payment location within the store 3 and is an information processing device that performs payment processing in response to successful facial authentication. The payment terminal 200 may be an attended or unattended cash register terminal. The payment terminal 200 controls facial authentication using an authentication control device 400. A display board 300 is posted near the payment terminal 200. In particular, the payment terminal 200 performs facial authentication when it reads the information code 310 on the display board 300 and acquires a facial image, etc. from the user terminal 100 that captured the facial image, and if the facial authentication is successful, it performs payment processing.

[0062] FIG. 10 is a block diagram showing the configuration of a payment terminal 200 according to the third embodiment. The payment terminal 200 includes a storage unit 220, a memory 230, a communication unit 240, an input / output unit 250, and a control unit 260. The storage unit 220 is an example of a storage device such as a hard disk or flash memory. The storage unit 220 stores a program 221, a store ID 222, and a payment terminal ID 223. The program 221 is a computer program that implements processing including the payment processing according to the third embodiment. The store ID 222 is identification information for the store 3. The payment terminal ID 223 is identification information for the payment terminal 200 within the store 3. Note that instead of the store ID 222 and the payment terminal ID 223, identification information that uniquely identifies the store 3 and the payment terminal 200 may be used.

[0063] The memory 230 is a volatile storage device such as RAM, and is a storage area for temporarily storing information when the control unit 260 is operating. The communication unit 240 is a communication interface with the network N. The communication unit 240 may establish a short-range wireless communication connection with the user terminal 100 and perform communication. The input / output unit 250 includes a display device (display unit) such as a screen and an input device. The input / output unit 250 is, for example, a touch panel. The control unit 260 is a processor that controls the hardware of the payment terminal 200. The control unit 260 loads the program 221 from the storage unit 220 into the memory 230 and executes it. As a result, the control unit 260 realizes the functions of the acquisition unit 261, the authentication control unit 262, and the payment unit 263.

[0064] The acquisition unit 261 is an example of the above-mentioned acquisition unit 21. The acquisition unit 261 acquires a face image or face feature information from the user terminal 100 via short-range wireless communication.

[0065] The authentication control unit 262 is an example of the above-mentioned authentication control unit 22. When a facial image or the like is acquired by the acquisition unit 261, the authentication control unit 262 controls facial authentication. Specifically, the authentication control unit 262 transmits a facial authentication request including the facial image or the like to the authentication control device 400 (store management device 500 or authentication device 600). Note that the authentication control unit 262 may include the facial image itself or facial features extracted from the facial image as biometric information in the facial authentication request. Then, the authentication control unit 262 receives a facial authentication result from the authentication control device 400.

[0066] The settlement unit 263 is an example of the execution unit 23. When the facial authentication result indicates success, the settlement unit 263 executes a settlement process. Specifically, as will be described later, the settlement unit 263 uses the store management device 500 to execute a settlement process for a user whose facial authentication has been successful.

[0067] FIG. 11 is a sequence diagram showing the flow of payment processing according to the third embodiment. First, the user terminal 100 photographs the information code 310 displayed on the display board 300 with the camera 110 (S301). Next, the user terminal 100 analyzes the photographed information code 310 and extracts the startup information 311 and the communication method 312 (S302). Then, the user terminal 100 starts the authentication assistance program 122 using the startup information 311 (S303). For example, the startup unit 165 executes a command for starting the authentication assistance program 122. As a result, the user terminal 100 may start an application for the authentication assistance function. The photography control unit 161 of the user terminal 100 controls the camera 110 to photograph the face of the user U1 in accordance with an instruction from the authentication assistance program 122 (S304). At this time, the photography control unit 161 may receive a photography instruction from the user U1. Then, the user terminal 100 outputs the facial image according to the communication method 312 (S305). Here, it is assumed that the user terminal 100 and the payment terminal 200 are located within a distance where short-range wireless communication is possible. The user terminal 100 may output the facial image in response to an instruction from the authentication assistance program 122.

[0068] Next, the payment terminal 200 acquires the facial image output from the user terminal 100 via short-range wireless communication. Then, the payment terminal 200 transmits a facial authentication request including the acquired facial image and the store ID 222 to the store management device 500 via the network N (S306). Note that the facial authentication request does not necessarily have to include the store ID 222.

[0069] The store management device 500 receives a facial authentication request from the payment terminal 200 via the network N, and transmits the facial authentication request including the facial image to the authentication device 600 via the network N (S307). In response, the authentication device 600 receives the facial authentication request from the store management device 500 via the network N, and performs facial authentication processing (S308).

[0070] FIG. 12 is a flowchart showing the flow of face authentication processing by the authentication device 600 according to the third embodiment. First, the authentication device 600 receives a face authentication request from the store management device 500 via the network N (S211). The authentication device 600 may also receive a face authentication request from the user terminal 100, the payment terminal 200, or the like. Next, the authentication device 600 extracts facial feature information from the face image included in the face authentication request, similar to steps S202 and S203 described above. Then, the authentication unit 650 of the authentication device 600 compares the facial feature information extracted from the face image included in the face authentication request with the facial feature information 612 in the face information DB 610 (S212) and calculates the degree of match. Then, the authentication unit 650 determines whether the degree of match is equal to or greater than a threshold (S213). If the facial feature information matches, that is, if the degree of match is equal to or greater than the threshold, the authentication unit 650 identifies the user ID 611 associated with the facial feature information 612 (S214). The authentication unit 650 then returns the facial authentication result, including the fact that facial authentication was successful and the identified user ID 611, to the store management device 500 via the network N (S215). If the degree of match is less than the threshold in step S213, the authentication unit 650 returns the facial authentication result, including the fact that facial authentication was unsuccessful, to the store management device 500 via the network N (S216).

[0071] Returning to FIG. 11, the explanation will be continued. The store management device 500 then receives the facial authentication result from the authentication device 600 via network N (S309). The store management device 500 then transmits the received facial authentication result to the payment terminal 200 via network N (S310). In response, the payment terminal 200 receives the facial authentication result from the store management device 500 via network N.

[0072] The payment terminal 200 may send a face authentication request directly to the authentication device 600 without going through the store management device 500, and may receive the face authentication result directly from the authentication device 600.

[0073] Then, the payment terminal 200 determines whether or not the face authentication was successful based on the face authentication result. If the face authentication result indicates that the face authentication failed, the payment terminal 200 displays on the screen a message to the effect that the authentication failed, that is, that payment based on face authentication is not possible. The payment terminal 200 may also notify the user terminal 100 that payment based on face authentication is not possible via short-range wireless communication.

[0074] In this example, the facial authentication result includes a message indicating successful facial authentication and the user ID of user U1. Therefore, the payment terminal 200 determines that user U1 has successfully passed facial authentication. The payment terminal 200 transmits a payment request, including the user ID and the payment amount for the products and other items that user U1 wishes to purchase, to the store management device 500 via the network N (S311). In response, the store management device 500 receives the payment request from the payment terminal 200 via the network N and performs payment processing (S312). Specifically, the payment processing unit 543 of the store management device 500 acquires the user ID and the payment amount from the received payment request and reads out payment information 5123 associated with the acquired user ID 5121 from the member DB 512. The payment processing unit 543 then performs payment processing for the payment amount using the payment information 5123. The payment processing unit 543 then transmits a payment result to the payment terminal 200 via the network N (S313). In response, the payment terminal 200 receives the payment result from the store management device 500 via the network N and displays the payment result on the screen (S314). Furthermore, the payment terminal 200 may notify the user terminal 100 of the payment result via short-range wireless communication.

[0075] In this way, in this embodiment, the store does not need to install a camera for facial authentication, and payment processing using facial authentication can be introduced while suppressing costs. Furthermore, the user takes a photo of their face as if they were taking a "selfie," rather than having their photo taken by the store. This lowers the psychological hurdle of facial authentication, and promotes the use of payment processing using facial authentication.

[0076] The information code 310 according to this embodiment does not necessarily include the communication method 312. In that case, for example, the method of short-range wireless communication between the user terminal 100 and the payment terminal 200 may be determined in advance.

[0077] <Embodiment 4> The fourth embodiment is a modification of the third embodiment. The information code according to the fourth embodiment includes a payment terminal ID. The user terminal designates one of the payment terminals in the store with the payment terminal ID included in the information code as the payment terminal to be used by the user, and outputs a facial image, etc.

[0078] 13 is a block diagram showing the overall configuration of an authentication system 1000a according to the fourth embodiment. Compared to the above-described authentication system 1000, the authentication system 1000a is equipped with a plurality of sets of payment terminals and display boards within the store 3a. The following description will focus on the differences from the above-described third embodiment, and redundant explanations and illustrations will be omitted as appropriate.

[0079] Specifically, a display board 300a is installed near payment terminal 200a. Display board 300a displays information code 310a, which includes payment terminal ID 313a in addition to startup information 311 and communication method 312. Payment terminal ID 313a is identification information for payment terminal 200a. Display board 300b is installed near payment terminal 200b. Display board 300b displays information code 310b, which includes payment terminal ID 313b in addition to startup information 311 and communication method 312. Payment terminal ID 313b is identification information for payment terminal 200b. Therefore, it can be said that information codes 310a and 310b include terminal information that is the output destination of biometric information. Note that information codes 310a and 310b do not necessarily have to include communication method 312. In that case, for example, a user terminal 100a The method of short-distance wireless communication between the payment terminals 200a and 200b may be determined in advance.

[0080] Furthermore, it is assumed that payment terminals 200a and 200b and user terminal 100a are located within a distance where they can communicate via a predetermined short-range wireless communication. In other words, when a face image or the like is output from user terminal 100a via short-range wireless communication, it may be possible for both payment terminals 200a and 200b to receive it.

[0081] The user terminal 100a differs from the above-described user terminal 100 in the functions of extracting an information code and outputting a facial image, etc. Specifically, the user terminal 100a analyzes the image of the acquired information code and extracts the payment terminal ID in addition to the startup information and communication method. The user terminal 100a also outputs the facial image, etc. via short-range wireless communication, with the extracted payment terminal ID as the output destination.

[0082] When payment terminals 200a and 200b receive a facial image or the like via short-range wireless communication, they determine whether the payment terminal ID specified as the output destination matches their own payment terminal ID 223. If the payment terminal IDs do not match, payment terminal 200a etc. will not perform subsequent facial authentication processing etc.

[0083] Fig. 14 is a sequence diagram showing the flow of payment processing according to the fourth embodiment. Here, the differences from Fig. 11 described above will be mainly explained. As a premise, it is assumed that the user terminal 100a is located in front of the display board 300a and the payment terminal 200a. It is also assumed that the user terminal 100a is located within a distance where it can communicate with both the payment terminals 200a and 200b via short-range wireless communication.

[0084] First, the user terminal 100a captures an image of the information code 310a displayed on the display board 300a with the camera 110 (S301). Next, the user terminal 100a analyzes the captured information code 310a and extracts the startup information 311, the communication method 312, and the payment terminal ID 313a (S302a). After steps S303 and S304, the user terminal 100a outputs a facial image or the like via short-range wireless communication with the payment terminal ID 313a as the output destination (S305a). For example, the user terminal 100a may perform broadcast communication by specifying the payment terminal ID 313a as the destination of the short-range wireless communication.

[0085] Next, the payment terminal 200a 100a The payment terminal 200a acquires the facial image output from the payment terminal 200a by short-range wireless communication. Then, the payment terminal 200a determines whether the payment terminal ID specified as the destination of the acquired signal matches its own payment terminal ID 223 (S305b). Here, it is determined that they match, and thereafter, the payment terminal 200a performs step S306 and subsequent steps in the same manner as in FIG. 11 above.

[0086] On the other hand, the payment terminal 200b is a user terminal 100a The facial image output from the payment terminal 200b is acquired by short-range wireless communication, and it is determined whether the payment terminal ID specified as the destination of the acquired signal matches its own payment terminal ID 223. In this case, since they do not match, payment terminal 200b does not perform any further processing.

[0087] The user terminal 100a may output a signal requesting establishment of a connection via short-range wireless communication, specifying the payment terminal ID 313a. In this case, the payment terminal 200a receives the signal requesting establishment of a connection. Since the payment terminal ID 313a is specified in the connection establishment request, the payment terminal 200a responds to the user terminal 100a in response to the connection establishment request. In other words, the payment terminal 200a establishes a connection via short-range wireless communication with the user terminal 100a. After establishing a connection via short-range wireless communication with the payment terminal 200a, the user terminal 100a transmits a facial image or the like via short-range wireless communication, specifying the payment terminal ID 313a as the destination. On the other hand, when the payment terminal 200b receives a signal requesting establishment of a connection from the user terminal 100a, the payment terminal 200b determines that the connection establishment request is not addressed to itself, since the payment terminal ID 313a is specified in the connection establishment request. Therefore, the payment terminal 200b does not respond to the received connection establishment request.

[0088] In this way, in this embodiment, by including the payment terminal ID in the information code, even if there are multiple payment terminals within the range of short-range wireless communication of the payment terminal 200a, the biometric information can be output to the appropriate payment terminal, thereby enabling appropriate payment processing according to the biometric authentication.

[0089] <Embodiment 5> The fifth embodiment is a modification of the third or fourth embodiment described above. The information code according to the fifth embodiment specifies (long-distance) communication via a network N as the communication method, and further includes a store ID. In other words, the information code includes destination information of an authentication control device that controls biometric authentication. Furthermore, the information code may further include identification information of a processing terminal (payment terminal) that performs processing according to the biometric authentication.

[0090] 15 is a block diagram showing the overall configuration of an authentication system 1000b according to the fifth embodiment. The authentication system 1000b differs from the above-described authentication system 1000a in the information contained in the information code of the display board installed near each payment terminal in the store 3b. The following description will focus on the differences from the above-described fourth embodiment, and redundant explanations and illustrations will be omitted as appropriate.

[0091] Specifically, display board 300c is installed near payment terminal 200a. Display board 300c displays information code 310c, which includes startup information 311, communication method 312c, payment terminal ID 313a, and store ID 314. Display board 300d is installed near payment terminal 200b. Display board 300d displays information code 310d, which includes startup information 311, communication method 312d, payment terminal ID 313b, and store ID 314.

[0092] The communication methods 312c and 312d include a specification for communication via the network N and destination information such as the address of the authentication control device 400 (store management device 500b or authentication device 600). The store ID 314 is identification information for the store 3b.

[0093] The user terminal 100b differs from the above-described user terminals 100 and 100a in the functions of the information code extraction process and the facial image output process. Specifically, the user terminal 100b analyzes the acquired information code image and extracts startup information, a communication method, a payment terminal ID, and a store ID. The user terminal 100b then outputs the facial image and other data by transmitting it to either the store management device 500b or the authentication device 600 (the authentication control device 400) via the network N in accordance with the extracted communication method. The user terminal 100b then transmits the extracted payment terminal ID and store ID together with the facial image and other data.

[0094] Fig. 16 is a sequence diagram showing the flow of payment processing according to the fifth embodiment. Here, the explanation will focus on the differences from Fig. 14 described above. It is assumed that the user terminal 100b is located in front of the display board 300a and the payment terminal 200a.

[0095] First, the user terminal 100b captures an image of the information code 310c displayed on the display board 300c with the camera 110 (S301). Next, the user terminal 100b analyzes the captured information code 310c and extracts the startup information 311, the communication method 312c, the payment terminal ID 313a, and the store ID 314 (S302b). After steps S303 and S304, the user terminal 100b transmits the facial image, etc., the payment terminal ID 313a, and the store ID 314 to the store management device 500b via the network N (S305c). For example, the user terminal 100b specifies the address of the store management device 500b as the transmission destination.

[0096] In response, the store management device 500b receives the facial image, payment terminal ID 313a, and store ID 314 from the user terminal 100b via network N. Because the received store ID 314 indicates store 3b, the store management device 500b performs step S307 as described above. The authentication device 600 then performs step S308 as described above and returns the facial authentication result.

[0097] The store management device 500b then determines whether or not face authentication was successful based on the received face authentication result. If the face authentication result indicates that face authentication failed, the store management device 500b transmits a message to the user terminal 100b via the network N indicating that authentication failed, i.e., that payment using face authentication is not possible.

[0098] In this example, the facial authentication result includes a message indicating successful facial authentication and the user ID of user U1. Therefore, the store management device 500b determines that user U1 has successfully passed facial authentication. The store management device 500b then transmits payment authorization, including user U1's user ID and the received payment terminal ID 313a (identification information of the payment terminal 200a), to the payment terminal 200a via network N (S310b).

[0099] The payment terminal 200a receives the payment permission from the store management device 500b via the network N. Thereafter, the payment terminal 200a performs the processes from step S311 onwards, as described above.

[0100] In this embodiment, by specifying communication via a network as the communication method and including the store ID and payment terminal ID in the information code, payment processing using face authentication can be performed on a user terminal without a short-range wireless communication function. Furthermore, the store ID and payment terminal ID enable the store management device 500b to notify the appropriate payment terminal of payment permission.

[0101] <Other embodiments> In other embodiments, the information code may include a URL (Uniform Resource Locator) as destination information. In this case, the URL includes the address of a server to which the biometric information is to be registered. The server is connected to the user terminal, the payment terminal, the store management device, and the authentication device via a network N. The URL may specify a folder or directory on the server to which the biometric information is to be registered, or the name of an application running on the server that registers and outputs the biometric information. In these cases, the user terminal analyzes the image of the acquired information code to extract startup information, a communication method, and a URL indicating the server to which the biometric information is to be registered. As described above, the information code may include a payment terminal ID and a store ID. The user terminal then uses the startup information to start an authentication assistance program, captures a picture of the user's face, uploads the facial image to the extracted URL, and registers the facial image in the registration server.

[0102] Thereafter, for example, the user terminal outputs information including the extracted URL to the payment terminal via short-range wireless communication. In response, the payment terminal can download the facial image from the acquired URL. Then, the processing from S306 onwards in FIG. 11 described above is performed. Alternatively, the user terminal may not output information including the extracted URL to the payment terminal. For example, after the user terminal registers the facial image in the registration server, the registration server may send a registration completion notice including the URL to the payment terminal, or to the payment terminal via the store management device. The payment terminal may download the facial image from the URL included in the registration completion notice received from the registration server. Then, the processing from S306 onwards in FIG. 11 described above may be performed. In this case, the information code may include a payment terminal ID or a store ID along with the URL. Alternatively, the URL included in the information code may be different for each payment terminal.

[0103] Alternatively, if the information code includes a payment terminal ID and a store ID along with the URL, the user uploads a facial image to the extracted URL and registers the facial image in the registration server. The user terminal may then transmit information including the payment terminal ID and the store ID along with the extracted URL to the store management device via network N. In response, the store management device can download the facial image, payment terminal ID, and store ID from the acquired URL. Then, the processing from S307 onwards in FIG. 16 described above is performed. The user terminal may also transmit information including the payment terminal ID and the store ID along with the extracted URL to the authentication device via network N. In response, the authentication device can download the facial image, payment terminal ID, and store ID from the acquired URL. The authentication device then performs facial authentication processing and transmits the facial authentication result, the payment terminal ID, and the store ID to the store management device. Then, the processing from S310b onwards in FIG. 16 described above is performed.

[0104] Alternatively, the user terminal may upload a payment terminal ID and a store ID along with a facial image to the extracted URL, and register the facial image in association with the payment terminal ID and the store ID in the registration server. In this case, the registration server sends a face authentication request including the facial image to the authentication device and receives the face authentication result. If face authentication is successful, the registration server may notify the payment terminal of the face authentication result, addressed to the payment terminal ID associated with the face image for which face authentication was successful. Then, the processing from S311 onwards in FIG. 11 described above is performed. Alternatively, if face authentication is successful, the registration server may notify the store management device of the face authentication result and the payment terminal ID, addressed to the store ID associated with the face image for which face authentication was successful. Then, the processing from S310 onwards in FIG. 11 described above is performed.

[0105] In this way, even when the information code includes a URL for registering biometric information, the user terminal can be said to output the user's biometric information for biometric authentication by registering the user's biometric information in the URL.

[0106] Furthermore, in the case of the above-described fourth or fifth embodiment, the information code may contain a different URL for each payment terminal. For example, assume that information code 310a corresponding to payment terminal 200a contains URL (X), and information code 310b corresponding to payment terminal 200b contains URL (Y). In this case, assume that URL (X) is preset for payment terminal 200a to access during payment, and URL (Y) is preset for payment terminal 200b to access during payment. Then, for example, when the user terminal photographs and analyzes information code 310a, it extracts URL (X) and uploads a facial image to URL (X). Payment terminal 200a can download a facial image from URL (X) at the time of payment, even if the user terminal does not notify it of URL (X). Then, the processing from S306 onward in FIG. 11 described above is performed.

[0107] In the above-described embodiment, the user terminal 100 activates a camera upon reading the information code as a trigger to capture a facial image and output the facial image, thereby assisting facial authentication. Furthermore, in the above-described embodiment, the terminal information of the user terminal 100 and user information (e.g., user ID) may be associated and registered in advance in the authentication control device 400. In this case, the user terminal 100 transmits its own terminal information along with the facial image to the authentication control device 400 via the payment terminal 200, or directly to the authentication control device 400. The authentication control device 400 then performs settlement processing if the user ID corresponding to the received terminal information matches the user ID identified by facial authentication. This provides two-factor authentication, consisting of user authentication based on the terminal information from which the facial image was output and biometric authentication based on biometric information (e.g., facial image), thereby improving authentication accuracy. Instead of the authentication control device 400, the terminal information of the user terminal 100 and user information (e.g., user ID) may be associated and registered in a cloud-based customer management system connected to the authentication control device 400.

[0108] In the above third and fourth embodiments, the store management device 500 and the authentication device 600 are described as separate information processing devices, but they may also be the same. For example, the store management device 500 may register facial feature information in association with the user ID 5121 in the member database 512. In this case, the control unit 540 may further include the functions of the face detection unit 620, feature point extraction unit 630, registration unit 640, and authentication unit 650 shown in FIG. 7. Similarly, the store management device 500b according to the above fifth embodiment may also be the same information processing device.

[0109] In the above examples, the program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray® disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may also be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

[0110] The present disclosure is not limited to the above-described embodiments, and may be modified as appropriate without departing from the spirit and scope of the present disclosure. In addition, the present disclosure may be implemented by appropriately combining the respective embodiments.

[0111] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. (Appendix A1) an imaging means for imaging an information code including predetermined startup information; a start-up means for starting an authentication assistant function using the start-up information included in the photographed information code; an acquisition means for acquiring an image including the user's face photographed by the photographing means in response to activation of the authentication assistance function; an output means for outputting biometric information of the user based on the image for biometric authentication; A user terminal comprising: (Appendix A2) the information code includes a designation of a communication method for the biometric information, The output means outputs the biometric information by the communication method specified in the information code. 1. A user terminal as described in Appendix A1. (Appendix A3) The communication method is short-range wireless communication. A user terminal as described in Appendix A2. (Appendix A4) the information code includes information about a terminal to which the biometric information is output, The output means outputs the biometric information to the terminal information included in the information code as an output destination. A user terminal according to any one of appendices A1 to A3. (Appendix A5) the information code includes destination information of an authentication control device that controls the biometric authentication, The output means outputs the biometric information by transmitting it to the destination information included in the information code. A user terminal as described in Appendix A1 or A2. (Appendix A6) the information code further includes identification information of a processing terminal that performs processing according to the biometric authentication, The output means outputs the biometric information and the identification information of the processing terminal included in the information code by transmitting them to the destination information. A user terminal as described in Appendix A5. (Appendix A7) the biometric authentication is face authentication, The biometric information is facial feature information. A user terminal according to any one of appendices A1 to A6. (Appendix B1) an acquisition means for acquiring, from a user terminal held by the user, biometric information based on an image including the face of the user captured by the user terminal in response to an authentication assisting function of the user terminal that is activated based on predetermined activation information included in an information code captured by the user terminal; an authentication control means for controlling biometric authentication of the user when the biometric information is acquired; an execution means for executing a predetermined process when the biometric authentication is successful; A processing execution device comprising: (Appendix B2) The acquiring means acquires the biometric information from the user terminal by short-range wireless communication. 10. The process execution device according to claim 8, wherein the processing execution device is a processing execution device. (Appendix B3) the biometric authentication is face authentication, The biometric information is facial feature information. A processing execution device according to appendix B1 or B2. (Appendix C1) A user terminal owned by a user; a process execution device that executes a predetermined process; Equipped with The user terminal an imaging means for imaging an information code including predetermined startup information; a start-up means for starting an authentication assistant function using the start-up information included in the photographed information code; an acquisition means for acquiring an image including the user's face photographed by the photographing means in response to activation of the authentication assistance function; an output means for outputting biometric information of the user based on the image for biometric authentication; Equipped with The processing execution device an acquisition means for acquiring the biometric information from the user terminal; an authentication control means for controlling biometric authentication of the user when the biometric information is acquired; an execution means for executing a predetermined process when the biometric authentication is successful; An authentication system comprising: (Appendix C2) the information code includes a designation of a communication method for the biometric information, The output means outputs the biometric information by the communication method specified in the information code. The authentication system described in Appendix C1. (Appendix D1) a computer having an imaging device, taking an image of an information code including predetermined startup information with the image capturing device; activating an authentication assistance function using the activation information included in the photographed information code; acquiring an image including the user's face photographed by the photographing device in response to activation of the authentication assistance function; outputting biometric information of the user based on the image for biometric authentication; Authentication assistance methods. (Appendix E1) A computer equipped with an imaging device, a photographing process of photographing an information code including predetermined startup information by the photographing device; a start-up process for starting an authentication assistant function using the start-up information included in the photographed information code; an acquisition process for acquiring an image including a face of the user captured by the image capturing device in response to activation of the authentication assistance function; an output process of outputting biometric information of the user based on the image for biometric authentication; A non-transitory computer-readable medium storing a program for executing the program. (Appendix F1) The computer Acquires biometric information from a user terminal based on an image including the user's face, the image being captured by the user terminal in response to an authentication assistance function of the user terminal that is activated based on predetermined activation information included in an information code captured by the user terminal; When the biometric information is acquired, control biometric authentication for the user; If the biometric authentication is successful, a predetermined process is executed. How to perform the process. (Appendix G1) an acquisition process for acquiring, from a user terminal held by the user, biometric information based on an image including the face of the user captured by the user terminal in accordance with an authentication assistance function of the user terminal that is activated based on predetermined activation information included in an information code captured by the user terminal; an authentication control process for controlling biometric authentication of the user when the biometric information is acquired; an execution process for executing a predetermined process if the biometric authentication is successful; A non-transitory computer-readable medium storing a program that causes a computer to execute the program.

[0112] Although the present invention has been described above with reference to the embodiments (and examples), the present invention is not limited to the above-described embodiments (and examples). Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. [Explanation of symbols]

[0113] 1. User terminal 11 Filming Department 12 Starting part 13 Acquisition Department 14 Output section 2 Processing execution device 21 Acquisition Department 22 Authentication control section 23 Executive Department 1000 Authentication System U1 User N Network 100 user terminals 100a User terminal 100b User terminal 110 Camera 120 Storage section 121 Control Program 122 Certification Assistance Program 130 memory 140 Communications Department 150 Input / output section 160 control section 161 Imaging control unit 162 Acquisition Department 163 Registration Department 164 Extraction part 165 Starting part 166 Output section 200 payment terminals 220 Storage section 221 Program 222 Store ID 223 Payment terminal ID 230 memory 240 Communications Department 250 Input / output section 260 Control Unit 261 Acquisition Department 262 Authentication control section 263 Payment Department 3 stores 300 display board 310 Information Code 311 Startup Information 312 Communication Methods 1000a Authentication System 200a Payment terminal 200b payment terminal 3a store 300a display board 310a information code 313a Payment terminal ID 300b display board 310b information code 313b Payment terminal ID 1000b authentication system 3b store 300c display board 310c information code 312c communication method 314 Store ID 300d display board 310d information code 312d Communication method 400 Authentication control device 500 Store management device 500b Store management device 510 Storage section 511 Program 512 Member DB 5121 User ID 5122 Personal Information 5123 Payment Information 520 memory 530 Communications Department 540 Control Unit 541 Registration Department 542 Authentication control unit 543 Payment Processing Unit 600 Authentication Device 610 Face Information DB 611 User ID 612 Facial Feature Information 620 Face detection unit 630 Feature Point Extraction Unit 640 Registration Department 650 Authentication Department

Claims

1. A processing execution device, an acquisition means for acquiring, from a user terminal held by the user, biometric information based on an image including the face of the user captured by the user terminal in response to an authentication assisting function of the user terminal that is activated based on predetermined activation information included in an information code captured by the user terminal; an authentication control means for transmitting the acquired biometric information to an authentication control system that performs biometric authentication and predetermined processing for the user; an execution means for requesting the authentication control system to execute the predetermined process using the information identified by the biometric authentication; Equipped with the information code includes destination information of the processing execution device, the acquiring means acquires the biometric information from the user terminal based on the destination information. Processing execution device.

2. The acquiring means acquires the biometric information from the user terminal by short-range wireless communication. The processing execution device according to claim 1 .

3. the biometric authentication is face authentication, The biometric information is facial feature information.

3. The processing execution device according to claim 1.

4. The authentication control means transmits the acquired biometric information to the authentication control system that performs the biometric authentication and the payment processing as the predetermined processing, the execution means requests the authentication control system to execute the payment process using the payment information identified by the biometric authentication. The processing execution device according to any one of claims 1 to 3.

5. A user terminal owned by a user; a process execution device that executes a request for a predetermined process; an authentication control system that performs biometric authentication on the user and the predetermined processing; Equipped with The user terminal an imaging means for imaging an information code including predetermined startup information; a start-up means for starting an authentication assistant function using the start-up information included in the photographed information code; an acquisition means for acquiring an image including the user's face photographed by the photographing means in response to activation of the authentication assistance function; an output means for outputting biometric information of the user based on the image for biometric authentication; Equipped with The processing execution device an acquisition means for acquiring the biometric information from the user terminal; an authentication control means for transmitting the acquired biometric information to the authentication control system; an execution means for requesting the authentication control system to execute the predetermined process using the information identified by the biometric authentication; Equipped with the information code includes destination information of the processing execution device, the output means of the user terminal outputs the biometric information by transmitting it to the acquisition means of the process execution device based on the destination information included in the information code. Authentication system.

6. the information code includes a designation of a communication method for the biometric information, The output means outputs the biometric information by the communication method specified in the information code. The authentication system according to claim 5 .

7. The computer Acquires biometric information from a user terminal based on an image including the user's face, the image being captured by the user terminal in response to an authentication assistance function of the user terminal that is activated based on predetermined activation information included in an information code captured by the user terminal; transmitting the acquired biometric information to an authentication control system that performs biometric authentication and predetermined processing for the user; requesting the authentication control system to execute the predetermined process using the information identified by the biometric authentication; the information code includes destination information of the computer; In the acquisition, the biometric information is acquired from the user terminal based on the destination information. How to perform the process.

8. an acquisition process for acquiring, from a user terminal held by the user, biometric information based on an image including the face of the user captured by the user terminal in accordance with an authentication assistance function of the user terminal that is activated based on predetermined activation information included in an information code captured by the user terminal; an authentication control process for transmitting the acquired biometric information to an authentication control system that performs biometric authentication and predetermined processing for the user; an execution process of requesting the authentication control system to execute the predetermined process using the information identified by the biometric authentication; on the computer, the information code includes destination information of the computer; In the acquisition process, the biometric information is acquired from the user terminal based on the destination information. program.

Images