Authentification system and information processing method

Abstract

To provide an authentication system and an information processing method capable of improving convenience by using data of a registered face image by an authentication engine for performing authentication other than face authentication.SOLUTION: An authentication system 10 for performing the user authentication using information received from a user terminal 20 includes: information acquisition means 17 for receiving the user face image data from the user terminal 20 at the time of user registration, extracting the feature quantity of a user face image based on the received user face image data and storing the information on the feature quantity of the extracted user face image as the user identification information in a memory 16; and linking means 19 which links the user identification information used in an authentication engine of a service organization performing authentication other than face authentication with the user identification information on the feature quantity of the user face image stored in the memory 16.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an authentication system and an information processing method. [Background technology]

[0002] 2. Description of the Related Art Conventionally, as an authentication system that performs authentication based on face data, there is known an authentication system that performs identity authentication by matching input face data with pre-registered face data (see, for example, Patent Documents 1 and 2).

[0003] In the authentication system described in Patent Document 1, a target person is authenticated using an image of a face part in an image captured by a camera. In addition, in the authentication system described in Patent Document 2, for example, when four face images are registered, two are face patterns for accuracy assurance, one is a face pattern for absorbing disturbance components, and one is a face pattern to be updated. When a new face pattern is registered, the face pattern to be updated that has the second lowest similarity to the newly registered face pattern among the four face patterns registered in advance is deleted. In other words, by leaving the face pattern for absorbing disturbance components that has the lowest similarity to the newly registered face pattern, face authentication is performed while adapting to environmental variations. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-197426 A [Patent Document 2] JP 2006-72540 A Summary of the Invention [Problem to be solved by the invention]

[0005] The authentication systems disclosed in Patent Documents 1 and 2 have a problem in that the registered face image data cannot be used in an authentication engine that performs authentication other than face authentication, which is inconvenient.

[0006] The present invention has been made in consideration of the above points, and aims to provide an authentication system and an information processing method that can improve convenience by using registered face image data in an authentication engine that performs authentication other than face authentication. [Means for solving the problem]

[0007] The authentication system of the present invention is an authentication system that authenticates a user using information received from a user terminal, and is characterized in comprising: an information acquisition means for receiving the user's facial image data from the user terminal at the time of user registration, extracting features of the user's facial image based on the received user's facial image data, and storing information related to the extracted features of the user's facial image in memory; an authentication means for authenticating the user by comparing the features of the user's facial image extracted from the user's facial image data received from the service facility's imaging unit or the features of the user's facial image received from the service facility's imaging unit with the features of the user's facial image stored in the memory at the time of user authentication; and a linking means for linking user identification information used in an authentication engine of the service facility that performs authentication other than facial authentication with user identification information related to the features of the user's facial image stored in the memory.

[0008] The authentication system of the present invention is an authentication system that authenticates a user using information received from a user terminal, and is characterized in comprising: an information acquisition means for receiving the user's facial image data from the user terminal at the time of user registration, extracting features of the user's facial image based on the received user's facial image data, and storing information relating to the extracted features of the user's facial image in a memory; a transmission means for transmitting information relating to the features of the user's facial image stored in the memory to the imaging unit of each service facility so that authentication based on the user's facial image can be performed in the imaging unit of each service facility; and a linking means for linking user identification information used in an authentication engine of a service facility that performs authentication other than facial recognition with user identification information relating to the features of the user's facial image stored in the memory.

[0009] The authentication system of the present invention is an authentication system that authenticates a user using information received from a user terminal, and includes an information acquisition means for receiving the user's facial image data from the user terminal at the time of user registration, extracting features of the user's facial image based on the received user's facial image data, and storing information related to the extracted features of the user's facial image in memory, and an authentication means for authenticating the user by comparing the features of the user's facial image extracted from the user's facial image data received from the imaging unit of the service facility or the features of the user's facial image received from the imaging unit of the service facility with the features of the user's facial image stored in the memory, and is characterized in that when authenticating the user by the authentication means, two-factor authentication is performed by using the features of the user's facial image and elements other than the features of the user's facial image.

[0010] The authentication system of the present invention is an authentication system that authenticates a user using information received from a user terminal, and is characterized in comprising: an information acquisition means for receiving the user's facial image data from the user terminal at the time of user registration and storing the received user's facial image data in memory; an authentication means for authenticating the user by comparing the user's facial image data received from the service institution's imaging unit with the user's facial image data stored in the memory at the time of user authentication; and a linking means for linking user identification information used in an authentication engine of the service institution that performs authentication other than facial authentication with user identification information related to the user's facial image data stored in the memory.

[0011] The authentication system of the present invention is an authentication system that authenticates a user using information received from a user terminal, and is characterized in comprising: an information acquisition means for receiving a user's facial image data from the user terminal at the time of user registration and storing the received user's facial image data in a memory; a transmission means for transmitting the user's facial image data stored in the memory to the imaging unit of each service facility so that authentication based on the user's facial image can be performed in the imaging unit of each service facility; and a linking means for linking user identification information used in an authentication engine of a service facility that performs authentication other than facial authentication with user identification information related to the user's facial image data stored in the memory.

[0012] The information processing method of the present invention is an information processing method by an authentication system that authenticates a user using information received from a user terminal, and is characterized by comprising the steps of: receiving, at the time of user registration, facial image data of the user from the user terminal, extracting features of the user's facial image based on the received facial image data of the user, and storing information relating to the extracted features of the user's facial image in a memory; authenticating the user by comparing, at the time of user authentication, the features of the user's facial image extracted from the user's facial image data received from the imaging unit of the service facility or the features of the user's facial image received from the imaging unit of the service facility with the features of the user's facial image stored in the memory; and linking user identification information used in an authentication engine of the service facility that performs authentication other than facial authentication with user identification information relating to the features of the user's facial image stored in the memory.

[0013] The information processing method of the present invention is an information processing method by an authentication system that authenticates a user using information received from a user terminal, and is characterized in that it includes the steps of: receiving, at the time of user registration, facial image data of the user from the user terminal, extracting features of the user's facial image based on the received user's facial image data, and storing information relating to the extracted features of the user's facial image in a memory; transmitting information relating to the features of the user's facial image stored in the memory to the imaging unit of each service facility so that authentication based on the user's facial image can be performed in the imaging unit of each service facility; and linking user identification information used in an authentication engine of a service facility that performs authentication other than facial recognition with user identification information relating to the features of the user's facial image stored in the memory.

[0014] The information processing method of the present invention is an information processing method by an authentication system that authenticates a user using information received from a user terminal, and includes the steps of: receiving the user's facial image data from the user terminal at the time of user registration, extracting features of the user's facial image based on the received user's facial image data, and storing information related to the extracted features of the user's facial image in memory; and authenticating the user by comparing the features of the user's facial image extracted from the user's facial image data received from the imaging unit of the service facility or the features of the user's facial image received from the imaging unit of the service facility with the features of the user's facial image stored in the memory, and is characterized in that when authenticating the user by the authentication means, two-factor authentication is performed by using the features of the user's facial image and elements other than the features of the user's facial image.

[0015] The information processing method of the present invention is an information processing method by an authentication system that authenticates a user using information received from a user terminal, and is characterized by comprising the steps of: receiving a user's facial image data from the user terminal and storing the received user's facial image data in a memory when registering a user; authenticating a user by comparing the user's facial image data received from the service facility's imaging unit with the user's facial image data stored in the memory when authenticating a user; and linking user identification information used in an authentication engine of the service facility that performs authentication other than facial authentication with user identification information related to the user's facial image data stored in the memory.

[0016] The information processing method of the present invention is an information processing method by an authentication system that authenticates a user using information received from a user terminal, and is characterized in that it includes the steps of: receiving the user's facial image data from the user terminal at the time of user registration, and storing the received user's facial image data in a memory; transmitting the user's facial image data stored in the memory to the imaging unit of each service institution so that the imaging unit of each service institution performs authentication based on the user's facial image; and linking user identification information used in an authentication engine of a service institution that performs authentication other than facial authentication with user identification information related to the user's facial image data stored in the memory. Effect of the Invention

[0017] According to the authentication system and information processing method of the present invention, the registered face image data can be used in an authentication engine that performs authentication other than face authentication, thereby improving convenience. [Brief description of the drawings]

[0018] [Figure 1] 1 is a diagram illustrating an example of an authentication system according to an embodiment of the present invention and an imaging unit disposed in each service facility. [Diagram 2] 4 is a flowchart showing the process executed when a face image of a user is registered by the authentication system shown in FIG. [Diagram 3] 4 is a flowchart showing an example of processing contents executed when authenticating a user by the authentication system and the imaging unit shown in FIG. [Figure 4] FIG. 13 is a diagram illustrating another example of an authentication system and an imaging unit disposed in each service facility according to an embodiment of the present invention. [Diagram 5] 5 is a flowchart showing the process executed when a face image of a user is registered by the authentication system shown in FIG. [Figure 6]5 is a flowchart showing an example of processing contents executed when authenticating a user by the authentication system and the imaging unit shown in FIG. [Figure 7] 13 is a diagram illustrating still another example of an authentication system and an imaging unit disposed in each service facility according to an embodiment of the present invention. FIG. [Figure 8] 8 is a flowchart showing the process executed when a face image of a user is registered by the authentication system shown in FIG. 7. [Figure 9] 8 is a flowchart showing an example of processing contents executed when authenticating a user by the authentication system and the imaging unit shown in FIG. 7. [Figure 10] FIG. 13 is a diagram showing an initial screen displayed on a user terminal. [Figure 11] FIG. 13 is a diagram showing a registration screen displayed on a user terminal. [Figure 12] FIG. 13 is a diagram showing a registration screen displayed on a user terminal. [Figure 13] FIG. 13 is a diagram showing a service addition screen displayed on a user terminal. [Figure 14] FIG. 13 is a diagram showing an authentication history screen displayed on a user terminal. [Figure 15] FIG. 13 is a diagram showing a detailed screen of an authentication history displayed on a user terminal. [Figure 16] FIG. 13 is a diagram illustrating still another example of an authentication system and an imaging unit disposed in each company according to an embodiment of the present invention. [Figure 17] FIG. 13 is a diagram illustrating still another example of an authentication system and an imaging unit disposed in each company according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Figures 1 to 15 are diagrams showing an authentication system according to the present embodiment and imaging units arranged in each service facility.

[0020] As shown in FIG. 1, imaging units 30A, 30B, and 30C that authenticate users are arranged in each service facility such as a restaurant, a hotel, a transportation facility, an office building, an apartment building, and a convenience store. Although three imaging units 30A, 30B, and 30C are illustrated in FIG. 1, two or four or more imaging units may be used. An authentication system 10 installed in a company other than each service facility is connected to each imaging unit 30A, 30B, and 30C so as to be able to communicate with each other via a network such as an Internet line. A user terminal 20 such as a smartphone carried by a user is connected to the authentication system 10 and each imaging unit 30A, 30B, and 30C so as to be able to communicate with each other via a network such as an Internet line. The authentication system 10 and each imaging unit 30A, 30B, and 30C will be described in detail below.

[0021] The authentication system 10 is composed of, for example, a computer, and includes a processor 12 such as a CPU, a memory 16, and a communication unit 18. The processor 12 includes a feature extraction means 14 for extracting the feature of the user's face image corresponding to each of the imaging units 30A, 30B, and 30C as a hash value based on the face image data received from the user terminal 20, and a registration means 13 for registering the extracted feature of the user's face image. The processor 12 executes a program stored in the memory 16, so that the feature extraction means 14 extracts the feature of the user's face image corresponding to each of the imaging units 30A, 30B, and 30C as a hash value. Specifically, the feature extraction means 14 extracts the hash value calculated from the received face image data of the user by a predetermined hash function as the feature of the user's face image. Note that even if the face image data of the user is the same, the feature of the user's face image may differ depending on the type of the imaging units 30A, 30B, and 30C. This is because the specifications of the imaging units 30A, 30B, and 30C used by different service facilities such as business companies are also different. For this reason, the feature extraction means 14 extracts the feature of the user's face image for each of the imaging units 30A, 30B, and 30C. That is, feature of the face images of a plurality of users corresponding to each of the imaging units 30A, 30B, and 30C is extracted from one face image data. In addition, the processor 12 executes a program stored in the memory 16, so that the feature of the user's face image for each of the imaging units 30A, 30B, and 30C extracted by the feature extraction means 14 (specifically, hash value) is associated with the user's identification information and the identification information of the imaging units 30A, 30B, and 30C by the registration means 13 and stored in the memory 16. Note that the program executed by the processor 12 is not limited to the one stored in the memory 16. Processing may be performed in each of the feature extraction means 14 and the registration means 13 by the processor 12 executing a program transmitted to the authentication system 10 from an external device or a program stored in a recording medium that is removably attached to the authentication system 10.In this embodiment, the feature extraction means 14 and the registration means 13 constitute information acquisition means 17. When a user is registered, the information acquisition means 17 receives face image data of the user, extracts feature amounts of the face image of the user based on the received face image data of the user, and stores information related to the extracted feature amounts of the face image of the user in memory 16 as user identification information.

[0022] As described above, the memory 16 stores the feature amount (specifically, hash value) of the user's face image extracted by the feature amount extraction means 14 in association with the user's identification information and the identification information of the imaging units 30A, 30B, and 30C. As described above, the feature amount of the user's face image extracted by the feature amount extraction means 14 may differ depending on the type of the imaging units 30A, 30B, and 30C. For this reason, the feature amount extraction means 14 extracts the feature amount of the user's face image for each of the imaging units 30A, 30B, and 30C. As a result, the feature amount of the user's face image extracted by the feature amount extraction means 14 must also be stored in the memory 16 in association with each of the imaging units 30A, 30B, and 30C. In addition, the memory 16 stores the user's identification information in association with the service facility selected by the user. In addition, as described above, the memory 16 stores programs for causing the processor 12 to perform various processes. The processor 12 also transmits and receives signals to and from the imaging units 30A, 30B, and 30C or the user terminal 20 located at each service facility via a network such as the Internet line through a communication unit 18.

[0023] Each of the imaging units 30A, 30B, 30C arranged in each service facility is composed of a computer or the like, and each imaging unit 30A, 30B, 30C has a processor 32A, 32B, 32C such as a CPU, a memory 36A, 36B, 36C, an imaging unit 38A, 38B, 38C, a processing unit 40A, 40B, 40C, and a communication unit 42A, 42B, 42C. The processor 32A, 32B, 32C has a feature extraction means 34A, 34B, 34C that extracts a feature of a user's face image as a hash value based on the user's face image data captured by the imaging unit 38A, 38B, 38C, and an authentication means 35A, 35B, 35C. The processors 32A, 32B, and 32C execute the programs stored in the memories 36A, 36B, and 36C to extract the features of the user's face image as hash values ​​in the feature extraction means 34A, 34B, and 34C. Specifically, the feature extraction means 34A, 34B, and 34C extract hash values ​​calculated from the received face image data of the user by a predetermined hash function as the features of the user's face image. The processors 32A, 32B, and 32C also execute the programs stored in the memories 36A, 36B, and 36C to authenticate the user in the authentication means 35A, 35B, and 35C. Details of such processing will be described later. The programs executed by the processors 32A, 32B, and 32C are not limited to those stored in the memories 36A, 36B, and 36C. Various processes may be performed in each of the feature extraction means 34A, 34B, 34C and the authentication means 35A, 35B, 35C by the processors 32A, 32B, 32C executing a program transmitted from an external device to the imaging units 30A, 30B, 30C or a program stored in a recording medium detachably attached to the imaging units 30A, 30B, 30C. Also, each of the imaging units 30A, 30B, 30C is not limited to being associated with one service facility. For example, the imaging unit 30A may be associated with multiple service facilities.

[0024] The memories 36A, 36B, and 36C are configured to store the identification information of a user registered in advance in association with the feature amount of the facial image of the user. As described above, the memories 36A, 36B, and 36C are configured to store programs for causing the processors 32A, 32B, and 32C to perform various processes. The imaging units 38A, 38B, and 38C each have a camera, for example, and are configured to capture an image of the user to obtain facial image data of the user.

[0025] The processing units 40A, 40B, and 40C are adapted to perform various processes for the authenticated user. For example, when the imaging units 30A, 30B, and 30C are installed in an office building or an apartment complex, the processing units 40A, 40B, and 40C unlock the doors installed at the entrances and exits of the office building or apartment complex when the user is authenticated. When the imaging units 30A, 30B, and 30C are installed in restaurants, hotels, transportation facilities, convenience stores, and the like, the imaging units 30A, 30B, and 30C enable cashless payment when paying fees at these service facilities. In this case, the imaging units 30A, 30B, and 30C transmit payment information to the server of a financial institution or credit card company, so that the payment amount is automatically debited from the user's bank account or added to the credit card statement. The processors 32A, 32B, and 32C transmit and receive signals to and from the authentication system 10 or the user terminal 20 via a network such as the Internet line by the communication units 42A, 42B, and 42C.

[0026] In addition, in each of the imaging units 30A, 30B, and 30C, the feature amount of the user's face image can be registered in each of the imaging units 30A, 30B, and 30C by capturing the user's face image with the imaging units 38A, 38B, and 38C. Specifically, when the feature amount of the user's face image is registered in each of the imaging units 30A, 30B, and 30C, when the user's face image is captured by the imaging units 38A, 38B, and 38C, the processors 32A, 32B, and 32C extract the feature amount of the user's face image as a hash value with the feature amount extraction means 34A, 34B, and 34C based on the user's face image data captured by the imaging units 38A, 38B, and 38C. Then, the extracted feature amount of the user's face image (specifically, the hash value) is stored in the memory 36A, 36B, and 36C. In this manner, the feature amount of the user's face image is registered in each of the imaging units 30A, 30B, and 30C.

[0027] A face authentication application can be installed on the user terminal 20 from an online store or the like. When such a face authentication application is installed, the user can register face image data and register a service provider to use the service, etc., through the user terminal 20. The processing content of such a face authentication application will be described later. Note that such a face authentication application may be provided by the authentication system 10, or may be provided by a system other than the authentication system 10.

[0028] In this embodiment, the authentication system 10 and the imaging units 30A, 30B, and 30C arranged in each service facility are API-linked (Application Programming Interface), which makes it easier to configure the systems of the imaging units 30A, 30B, and 30C than if each system of the imaging units 30A, 30B, and 30C were configured independently.

[0029] Next, the processing contents when authenticating a user by the authentication system 10 and the imaging units 30A, 30B, and 30C will be described with reference to FIGS. 2, 3, and 10 to 12. FIG.

[0030] First, a process in which a user registers face image data in the authentication system 10 using the user terminal 20 will be described. First, the user installs a face authentication application in the user terminal 20. The screen shown in FIG. 10 is displayed as an initial screen of such a face authentication application. The user first performs user registration using such a face authentication application in the user terminal 20. Specifically, when the account button is pressed on the screen shown in FIG. 10, a user registration screen as shown in FIG. 11 appears. When registration information such as a name, date of birth, telephone number, email address, and password are input on such a user registration screen, and a check is placed in the box indicating that the user agrees to the terms of use, and then the user presses the registration button, a face image capture screen as shown in FIG. 12 appears. When the user captures a face image using the user terminal 20 on such an image capture screen, various information input on the user registration screen and the user's face image data are transmitted from the user terminal 20 to the authentication system 10. In this manner, the processor 12 of the authentication system 10 receives face image data from the user terminal 20 (STEP 1). The processor 12 of the authentication system 10 also receives from the user terminal 20 the identification information of the user terminal 20, and the registration information such as the user's name, date of birth, telephone number, email address, and password entered into the user terminal 20. The processor 12 also issues a user ID as the user's identification information, and stores the issued user ID in the memory 16.

[0031] Next, the processor 12 of the authentication system 10 extracts the feature amount of the facial image corresponding to each of the imaging units 30A, 30B, and 30C as a hash value by the feature amount extraction means 14 based on the facial image data received from the user terminal 20 (STEP 2). At this time, the feature amount of the user's facial image extracted by the feature amount extraction means 14 may differ depending on the type of the imaging units 30A, 30B, and 30C. For this reason, the feature amount extraction means 14 extracts the feature amount of the user's facial image for each of the imaging units 30A, 30B, and 30C. In addition, the feature amount extraction means 14 extracts only the feature amount of the user's facial image corresponding to the imaging units 30A, 30B, and 30C of the service facility selected in advance by the user. For example, if the user is permitted to use facial image data for the service facility where the imaging unit 30A is installed, but is not permitted to use facial image data for the service facility where the imaging unit 30B is installed, the feature amount extraction means 14 extracts only the feature amount of the user's facial image corresponding to the imaging unit 30A. As described above, the memory 16 stores the user's identification information and the service facility selected by the user in association with each other. The processor 12 then stores the features of the facial images corresponding to the imaging units 30A, 30B, and 30C extracted by the feature extraction means 14 in the memory 16 of the authentication system 10 by the registration means 13 in association with the user ID (user's identification information) and the identification information of the imaging units 30A, 30B, and 30C (STEP 3). In this manner, the registration of the user's facial image captured by the user terminal 20 is completed. The information related to the features of the user's facial image stored in the memory 16 is transmitted from the authentication system 10 to the imaging units 30A, 30B, and 30C of the service facility selected by the user (STEP 4). At this time, the features of the user's facial images corresponding to the imaging units 30A, 30B, and 30C are transmitted to the imaging units 30A, 30B, and 30C. The imaging units 30A, 30B, and 30C store information relating to the feature amounts of the user's face image transmitted from the authentication system 10 in the memories 36A, 36B, and 36C in association with the user's identification information.

[0032] Next, a process of authenticating a user in each of the imaging units 30A, 30B, and 30C will be described. When authentication of a user is required at a service facility where each of the imaging units 30A, 30B, and 30C is installed, first, the imaging units 38A, 38B, and 38C of the imaging units 30A, 30B, and 30C capture images of the user to obtain face image data of the user (STEP 11). In addition, in the imaging units 30A, 30B, and 30C, the processors 32A, 32B, and 32C extract features of the user's face image as hash values ​​using feature extraction means 34A, 34B, and 34C based on the captured face image data (STEP 12). Then, the processors 32A, 32B, and 32C authenticate the user by comparing the feature amount (specifically, hash value) of the user's face image extracted by the feature amount extraction means 34A, 34B, and 34C with the feature amount (specifically, hash value) of the user's face image stored in the memories 36A, 36B, and 36C (STEP 13). More specifically, if the coincidence rate between the feature amount of the user's face image extracted by the feature amount extraction means 34A, 34B, and 34C and the feature amount of the user's face image stored in the memories 36A, 36B, and 36C exceeds a predetermined threshold value (e.g., 80%), the authentication means 35A, 35B, and 35C authenticate the user. As described above, the memories 36A, 36B, and 36C store the user's identification information registered in advance in association with the feature amount of the user's face image.

[0033] Then, when the authentication means 35A, 35B, and 35C authenticate the user ("YES" in STEP 14), the processors 32A, 32B, and 32C enable the respective processing units 40A, 40B, and 40C to implement the services corresponding to the imaging units 30A, 30B, and 30C (STEP 15). Specifically, as described above, when the imaging units 30A, 30B, and 30C are installed in an office building or an apartment complex, the processing units 40A, 40B, and 40C unlock the doors installed at the entrances and exits of the office building or apartment complex when the authentication of the user is performed. Also, when the imaging units 30A, 30B, and 30C are installed in restaurants, hotels, transportation facilities, convenience stores, and the like, they enable cashless payment when paying fees at these service facilities. When cashless payment is performed, two-factor authentication may be performed. Thereafter, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C transmit information related to the usage status of the service to the authentication system 10 (STEP 17). As a result, information related to the usage status of the service at each service facility is stored in the memory 16 for each user in the authentication system 10.

[0034] On the other hand, if the feature amount of the user's face image extracted by the feature amount extraction means 34A, 34B, 34C does not substantially match the feature amount of the user's face image stored in the memory 36A, 36B, 36C and the authentication means 35A, 35B, 35C cannot authenticate the user ("NO" in STEP 14), the processors 32A, 32B, 32C disable the service corresponding to the imaging unit 30A, 30B, 30C by the processing units 40A, 40B, 40C (STEP 16). In this case, the processors 32A, 32B, 32C of the imaging units 30A, 30B, 30C also transmit information related to the service usage status (specifically, information that the user attempted to perform authentication with the imaging units 30A, 30B, 30C but was not authenticated and was unable to use the service) to the authentication system 10 (STEP 17).

[0035] According to such an authentication method, even if the feature of the user's face image is registered in the imaging engine (e.g., imaging unit 30A) of one service facility but not in the imaging engine (e.g., imaging unit 30B) of another service facility, the feature of the user's face image is stored in the memory 16 of the authentication system 10 and in the memories 36A, 36B, and 36C of each imaging unit 30A, 30B, and 30C in association with the identification information of the imaging units 30A, 30B, and 30C, so that even a service facility where the feature of the user's face image is not registered can authenticate the user by capturing the user's face image with an imaging unit. In this case, the user does not need to register face image data in all of the multiple imaging units, which can save the user's trouble.

[0036] The authentication system 10 and the authentication method according to this embodiment are not limited to those shown in Figures 1 to 3. Other examples of the authentication system 10 and the authentication method according to this embodiment will be described with reference to Figures 4 to 6. In the authentication system 10 and the imaging units 30A, 30B, and 30C shown in Figure 4, the same components as those in the authentication system 10 and the imaging units 30A, 30B, and 30C shown in Figure 1 are given the same reference numerals and their description will be omitted.

[0037] 4, the processor 12 of the authentication system 10 includes a feature extraction means 14 for extracting a feature of a user's face image corresponding to each of the imaging units 30A, 30B, and 30C as a hash value based on face image data received from the user terminal 20, a registration means 13 for registering the extracted feature of the user's face image, and an authentication means 15 for authenticating the user based on the feature (specifically, the hash value) of the user's face image captured by the imaging sections 38A to 38C of each of the imaging units 30A, 30B, and 30C. The processor 12 executes a program stored in the memory 16 to store in the memory 16 the feature (specifically, the hash value) of the user's face image extracted by the feature extraction means 14 in the registration means 13 in association with the user's identification information and the identification information of the imaging units 30A, 30B, and 30C. Moreover, the processor 12 executes a program stored in the memory 16, and thereby performs authentication of the user in the authentication means 15 by comparing the feature amount (specifically, hash value) of the user's face image captured by the imaging sections 38A to 38C of each of the imaging units 30A, 30B, and 30C with the feature amount (specifically, hash value) of the user's face image corresponding to each of the imaging units 30A, 30B, and 30C stored in the memory 16. The program executed by the processor 12 is not limited to the one stored in the memory 16. The processor 12 may execute a program transmitted to the authentication system 10 from an external device or a program stored in a recording medium detachably attached to the authentication system 10, thereby performing processing in each of the feature amount extraction means 14, the registration means 13, and the authentication means 15. Also in this embodiment, the feature amount extraction means 14 and the registration means 13 constitute the information acquisition means 17. When a user is registered, the information acquisition means 17 accepts the user's facial image data, extracts features of the user's facial image based on the accepted user's facial image data, and stores information relating to the extracted features of the user's facial image in the memory 16 as user identification information.

[0038] Each of the imaging units 30A, 30B, 30C arranged in each service facility is composed of, for example, a computer, and each imaging unit 30A, 30B, 30C has a processor 32A, 32B, 32C such as a CPU, a memory 36A, 36B, 36C, an imaging unit 38A, 38B, 38C, a processing unit 40A, 40B, 40C, and a communication unit 42A, 42B, 42C. The processors 32A, 32B, 32C have feature extraction means 34A, 34B, 34C that extract features of a user's face image as a hash value based on the user's face image data captured by the imaging units 38A, 38B, 38C. In the example shown in FIG. 4, the processors 32A, 32B, 32C do not have authentication means 35A, 35B, 35C as shown in FIG. 1. The processors 32A, 32B, and 32C execute the programs stored in the memories 36A, 36B, and 36C to extract the features of the user's face image as hash values ​​in the feature extraction means 34A, 34B, and 34C. Specifically, the feature extraction means 34A, 34B, and 34C extract a hash value obtained from the received face image data of the user by a predetermined hash function as the feature of the user's face image. Note that the programs executed by the processors 32A, 32B, and 32C are not limited to those stored in the memories 36A, 36B, and 36C. Various processes may be performed in the feature extraction means 34A, 34B, and 34C by the processors 32A, 32B, and 32C executing a program transmitted to the imaging units 30A, 30B, and 30C from an external device or a program stored in a recording medium detachably attached to the imaging units 30A, 30B, and 30C. In the example shown in FIG. 4, the memories 36A, 36B, and 36C are not configured to store the feature amounts of the user's face image.

[0039] 4, the authentication system 10 and the imaging units 30A, 30B, and 30C arranged in each service facility are linked through an API (Application Programming Interface). This makes it easier to configure the systems for each of the imaging units 30A, 30B, and 30C than if each of the imaging units 30A, 30B, and 30C were configured independently.

[0040] Next, the processing contents when authenticating a user by the authentication system 10 and the imaging units 30A, 30B, and 30C as shown in FIG. 4 will be described with reference to FIG. 5 and FIG.

[0041] First, a process in which a user registers face image data in the authentication system 10 using the user terminal 20 will be described. A specific method for the user to capture a face image using the user terminal 20 has already been described, and will not be described here. When a user first performs user registration using such a face authentication app in the user terminal 20, various information input on the user registration screen and the user's face image data are transmitted from the user terminal 20 to the authentication system 10. In this manner, the processor 12 of the authentication system 10 receives the face image data from the user terminal 20 (STEP 21). The processor 12 of the authentication system 10 also receives from the user terminal 20 the identification information of the user terminal 20 and the registration information, such as the user's name, date of birth, telephone number, email address, and password, input to the user terminal 20. The processor 12 also issues a user ID as the user's identification information, and stores the issued user ID in the memory 16.

[0042] Next, the processor 12 of the authentication system 10 extracts the features of the facial images corresponding to each of the imaging units 30A, 30B, and 30C as hash values ​​using the feature extraction means 14 based on the facial image data received from the user terminal 20 (STEP 22). At this time, the features of the user's facial image extracted by the feature extraction means 14 may differ depending on the type of the imaging units 30A, 30B, and 30C, and the feature extraction means 14 extracts the features of the user's facial image for each of the imaging units 30A, 30B, and 30C. In addition, the feature extraction means 14 extracts only the features of the user's facial image corresponding to the imaging units 30A, 30B, and 30C of the service facility selected in advance by the user. Then, the processor 12 causes the registration means 13 to store the features of the facial images corresponding to the imaging units 30A, 30B, and 30C extracted by the feature extraction means 14 in the memory 16 of the authentication system 10 in association with the user ID (user identification information) and the identification information of the imaging units 30A, 30B, and 30C (STEP 23). In this manner, registration of the user's facial image captured by the user terminal 20 is completed. Note that, in the example shown in Fig. 4, information related to the features of the user's facial image stored in the memory 16 is not transmitted from the authentication system 10 to the imaging units 30A, 30B, and 30C of the service facility selected by the user.

[0043] Next, a process of authenticating a user in each of the imaging units 30A, 30B, and 30C will be described. When authentication of a user is required at a service facility where each of the imaging units 30A, 30B, and 30C is installed, first, the imaging units 38A, 38B, and 38C of the imaging units 30A, 30B, and 30C capture images of the user to obtain face image data of the user (STEP 31). In addition, in the imaging units 30A, 30B, and 30C, the processors 32A, 32B, and 32C extract features of the user's face image as hash values ​​using the feature extraction means 34A, 34B, and 34C based on the captured face image data (STEP 32). Then, the processors 32A, 32B, and 32C transmit the features (specifically, hash values) of the user's face image extracted by the feature extraction means 34A, 34B, and 34C to the processor 12 of the authentication system 10 via the communication units 42A, 42B, and 42C (STEP 33). When the processor 12 of the authentication system 10 receives information related to the feature amount of the user's face image from the imaging units 30A, 30B, and 30C, the processor 12 receives information related to the feature amount of the user's face image transmitted only from the imaging units 30A, 30B, and 30C of the service facility selected by the user, which is stored in the memory 16. Then, in the authentication system 10, the processor 12 performs authentication of the user by comparing the feature amount (specifically, hash value) of the user's face image received from the imaging units 30A, 30B, and 30C with the feature amount (specifically, hash value) of the user's face image stored in the memory 16 by the authentication means 15 (STEP 34). More specifically, when the matching rate between the feature amount of the user's face image received from the imaging units 30A, 30B, and 30C and the feature amount of the user's face image stored in the memory 16 exceeds a predetermined threshold value (e.g., 80%), the authentication means 15 performs authentication of the user. As described above, the memory 16 stores the identification information of the pre-registered user and the identification information of the imaging units 30A, 30B, and 30C in association with the feature amounts of the user's face image.

[0044] Then, when the authentication means 15 authenticates the user ("YES" in STEP 35), information related to the authentication result is transmitted from the processor 12 of the authentication system 10 to the imaging units 30A, 30B, and 30C via the communication unit 18 (STEP 36). Then, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C that have received the information related to the authentication result enable the respective processing units 40A, 40B, and 40C to implement the services corresponding to the imaging units 30A, 30B, and 30C (STEP 37). After that, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C transmit information related to the service usage status to the authentication system 10. As a result, information related to the service usage status at each service facility in the authentication system 10 is stored in the memory 16 for each user.

[0045] On the other hand, if the feature amount of the user's face image received from the imaging units 30A, 30B, 30C does not substantially match the feature amount of the user's face image stored in the memory 16 and the authentication means 15 is unable to authenticate the user ("NO" in STEP 35), information on the authentication result is also transmitted from the processor 12 of the authentication system 10 to the imaging units 30A, 30B, 30C via the communication unit 18 (STEP 38). Then, the processors 32A, 32B, 32C of the imaging units 30A, 30B, 30C that have received the information on the authentication result disable the implementation of the service corresponding to the imaging units 30A, 30B, 30C via the respective processing units 40A, 40B, 40C (STEP 39). In this case, too, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C transmit information regarding the usage status of the service (specifically, information that the user attempted to perform authentication using the imaging units 30A, 30B, and 30C but was not authenticated and was therefore unable to use the service) to the authentication system 10.

[0046] According to such an authentication method, even if the feature amount of a user's facial image is registered in an imaging engine (e.g., imaging unit 30A) of a certain service facility but not registered in an imaging engine (e.g., imaging unit 30B) of another service facility, by storing the feature amount of the user's facial image in association with the identification information of the imaging units 30A, 30B, and 30C in the memory 16 of the authentication system 10, the user can be authenticated by capturing the user's facial image with an imaging unit even at a service facility where the feature amount of the user's facial image is not registered. In this case, the user does not need to register facial image data in all of the multiple imaging units, which saves the user's effort.

[0047] Further, still another example of the authentication system 10 and authentication method according to the present embodiment will be described with reference to Fig. 7 to Fig. 9. Note that, in the authentication system 10 and the imaging units 30A, 30B, and 30C shown in Fig. 7, the same components as those in the authentication system 10 and the imaging units 30A, 30B, and 30C shown in Fig. 1 and Fig. 4 are designated by the same reference numerals, and description thereof will be omitted.

[0048] 7, the processor 12 of the authentication system 10 includes a feature extraction means 14 for extracting a feature of a user's face image corresponding to each of the imaging units 30A, 30B, and 30C as a hash value based on face image data received from the user terminal 20, a registration means 13 for registering the extracted feature of the user's face image, and an authentication means 15 for authenticating the user based on the feature (specifically, the hash value) of the user's face image captured by the imaging sections 38A to 38C of each of the imaging units 30A, 30B, and 30C. The processor 12 executes a program stored in the memory 16 to store in the memory 16 the feature (specifically, the hash value) of the user's face image extracted by the feature extraction means 14 in the registration means 13 in association with the user's identification information and the identification information of the imaging units 30A, 30B, and 30C. Moreover, the processor 12 executes a program stored in the memory 16, and thereby performs authentication of the user in the authentication means 15 by comparing the feature amount (specifically, hash value) of the user's face image captured by the imaging sections 38A to 38C of each of the imaging units 30A, 30B, and 30C with the feature amount (specifically, hash value) of the user's face image corresponding to each of the imaging units 30A, 30B, and 30C stored in the memory 16. The program executed by the processor 12 is not limited to the one stored in the memory 16. The processor 12 may execute a program transmitted to the authentication system 10 from an external device or a program stored in a recording medium detachably attached to the authentication system 10, thereby performing processing in each of the feature amount extraction means 14, the registration means 13, and the authentication means 15. Also in this embodiment, the feature amount extraction means 14 and the registration means 13 constitute the information acquisition means 17. When a user is registered, the information acquisition means 17 accepts the user's facial image data, extracts features of the user's facial image based on the accepted user's facial image data, and stores information relating to the extracted features of the user's facial image in the memory 16 as user identification information.

[0049] Each of the imaging units 30A, 30B, 30C arranged in each service facility is composed of, for example, a computer, and each imaging unit 30A, 30B, 30C has a processor 32A, 32B, 32C such as a CPU, a memory 36A, 36B, 36C, an imaging unit 38A, 38B, 38C, a processing unit 40A, 40B, 40C, and a communication unit 42A, 42B, 42C. In the example shown in FIG. 7, the processors 32A, 32B, 32C do not have the feature extraction means 34A, 34B, 34C and the authentication means 35A, 35B, 35C as shown in FIG. 1. In the example shown in FIG. 7, the memories 36A, 36B, 36C are not configured to store the feature of the user's face image.

[0050] 7, the authentication system 10 and the imaging units 30A, 30B, and 30C arranged in each service facility are linked through an API (Application Programming Interface). This makes it easier to configure the systems for each of the imaging units 30A, 30B, and 30C than if each of the imaging units 30A, 30B, and 30C were configured independently.

[0051] Next, the processing contents when authenticating a user by the authentication system 10 and the imaging units 30A, 30B, and 30C as shown in FIG. 7 will be described with reference to FIG. 8 and FIG.

[0052] First, a process in which a user registers face image data in the authentication system 10 using the user terminal 20 will be described. A specific method for the user to capture a face image using the user terminal 20 has already been described, and will not be described here. When a user first performs user registration using such a face authentication app in the user terminal 20, various information input on the user registration screen and the user's face image data are transmitted from the user terminal 20 to the authentication system 10. In this manner, the processor 12 of the authentication system 10 receives the face image data from the user terminal 20 (STEP 41). The processor 12 of the authentication system 10 also receives from the user terminal 20 the identification information of the user terminal 20 and the registration information, such as the user's name, date of birth, telephone number, email address, and password, input to the user terminal 20. The processor 12 also issues a user ID as the user's identification information, and stores the issued user ID in the memory 16.

[0053] Next, the processor 12 of the authentication system 10 extracts the features of the facial images corresponding to each of the imaging units 30A, 30B, and 30C as hash values ​​using the feature extraction means 14 based on the facial image data received from the user terminal 20 (STEP 42). At this time, the features of the user's facial image extracted by the feature extraction means 14 may differ depending on the type of the imaging units 30A, 30B, and 30C, and the feature extraction means 14 extracts the features of the user's facial image for each of the imaging units 30A, 30B, and 30C. In addition, the feature extraction means 14 extracts only the features of the user's facial image corresponding to the imaging units 30A, 30B, and 30C of the service facility selected in advance by the user. Then, the processor 12 causes the registration means 13 to store the features of the facial images corresponding to the imaging units 30A, 30B, and 30C extracted by the feature extraction means 14 in the memory 16 of the authentication system 10 in association with the user ID (identification information of the user) and the identification information of the imaging units 30A, 30B, and 30C (STEP 43). In this manner, the registration of the facial image of the user captured by the user terminal 20 is completed. Note that, in the example shown in Fig. 7, the information related to the features of the facial image of the user stored in the memory 16 is not transmitted from the authentication system 10 to the imaging units 30A, 30B, and 30C of the service facility selected by the user.

[0054] Next, a process of authenticating a user in each of the imaging units 30A, 30B, and 30C will be described. When authentication of a user is required at a service facility where each of the imaging units 30A, 30B, and 30C is installed, first, the imaging units 38A, 38B, and 38C of the imaging units 30A, 30B, and 30C capture images of the user to obtain face image data of the user (STEP 51). The processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C transmit the face image data of the user captured by the imaging units 38A, 38B, and 38C to the processor 12 of the authentication system 10 via the communication units 42A, 42B, and 42C (STEP 52). When the processor 12 of the authentication system 10 accepts the user's facial image data from the imaging units 30A, 30B, and 30C, the processor 12 accepts the user's facial image data transmitted only from the imaging units 30A, 30B, and 30C of the service facility selected by the user, which is stored in the memory 16. In the authentication system 10, the processor 12 extracts the features of the user's facial image as a hash value by the feature extraction means 14 based on the facial image data accepted from the imaging units 30A, 30B, and 30C (STEP 53). The processor 12 then compares the features of the user's facial image extracted by the feature extraction means 14 (specifically, the hash value) with the features of the user's facial image stored in the memory 16 (specifically, the hash value) by the authentication means 15, thereby authenticating the user (STEP 54). More specifically, when the coincidence rate between the features of the user's facial image extracted by the feature extraction means 14 and the features of the user's facial image stored in the memory 16 exceeds a predetermined threshold (e.g., 80%), the authentication means 15 authenticates the user. As described above, the memory 16 stores pre-registered user identification information and identification information of the imaging units 30A, 30B, and 30C in association with the features of the user's facial image.

[0055] Then, when the authentication means 15 authenticates the user ("YES" in STEP 55), information related to the authentication result is transmitted from the processor 12 of the authentication system 10 to the imaging units 30A, 30B, and 30C via the communication unit 18 (STEP 56). Then, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C that have received the information related to the authentication result enable the respective processing units 40A, 40B, and 40C to implement the services corresponding to the imaging units 30A, 30B, and 30C (STEP 57). After that, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C transmit information related to the service usage status to the authentication system 10. As a result, information related to the service usage status at each service facility in the authentication system 10 is stored in the memory 16 for each user.

[0056] On the other hand, if the feature amount of the user's face image received from the imaging units 30A, 30B, 30C does not substantially match the feature amount of the user's face image stored in the memory 16 and the authentication means 15 cannot authenticate the user ("NO" in STEP 55), information on the authentication result is also transmitted from the processor 12 of the authentication system 10 to the imaging units 30A, 30B, 30C via the communication unit 18 (STEP 58). Then, the processors 32A, 32B, 32C of the imaging units 30A, 30B, 30C that have received the information on the authentication result disable the implementation of the service corresponding to the imaging units 30A, 30B, 30C via the respective processing units 40A, 40B, 40C (STEP 59). In this case, too, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C transmit information regarding the usage status of the service (specifically, information that the user attempted to perform authentication using the imaging units 30A, 30B, and 30C but was not authenticated and was therefore unable to use the service) to the authentication system 10.

[0057] According to such an authentication method, even if the feature amount of a user's facial image is registered in an imaging engine (e.g., imaging unit 30A) of a certain service facility but not registered in an imaging engine (e.g., imaging unit 30B) of another service facility, by storing the feature amount of the user's facial image in association with the identification information of the imaging units 30A, 30B, and 30C in the memory 16 of the authentication system 10, the user can be authenticated by capturing the user's facial image with an imaging unit even at a service facility where the feature amount of the user's facial image is not registered. In this case, the user does not need to register facial image data in all of the multiple imaging units, which saves the user's effort.

[0058] Next, a process will be described for a case where a user wants to increase the number of service providers to which the face authentication service described above is applied in the authentication system 10 as shown in FIG. 1 to FIG. 9. After the user performs the user registration as described above, when the user presses the "Add Service" button with his / her finger on the initial screen of the user terminal 20 as shown in FIG. 10, a list of service providers as shown in FIG. 13 is displayed. Note that such a list of service providers is registered in the authentication system 10 in advance. On the screen as shown in FIG. 13, the icons of unregistered services and registered services are displayed in different colors, or the icons of unregistered services are displayed dimmed, so that the icons of unregistered services are displayed in a distinguished manner. Then, when the user presses the icon of the unregistered service with his / her finger, the terms of the service to be added are displayed. When the user inputs an instruction to agree to the terms of the service, the unregistered service becomes a registered service. At this time, in the authentication system 10, the service provider related to this registered service is associated with the user ID (user identification information) and stored in the memory 16. After that, the user terminal 20 displays a face image capture screen as shown in FIG. 12. When the user captures a face image on such an imaging screen using the user terminal 20, the user's face image data is transmitted from the user terminal 20 to the authentication system 10. In this manner, the processor 12 of the authentication system 10 receives the face image data from the user terminal 20. Then, the processor 12 of the authentication system 10 extracts, as a hash value, the feature amount of the face image corresponding to the imaging unit of the new service facility using the feature amount extraction means 14 based on the face image data received from the user terminal 20. The processor 12 causes the registration means 13 to store the feature amount of the face image corresponding to the new imaging unit extracted by the feature amount extraction means 14 in the memory 16 of the authentication system 10 in association with the user ID (identification information of the user) and the identification information of the imaging unit of the new service facility. In this manner, the registration of the new service facility is completed.In addition, as described later, when the user's facial image data is stored in the memory 16, when the user registers a new service facility with the user terminal 20, the feature extraction means 14 may extract the feature of the facial image corresponding to the imaging unit of the new service facility as a hash value based on the user's facial image data stored in the memory 16, even if the user terminal 20 does not capture the user's facial image. Also, the user may be able to delete a registered service on a screen such as that shown in FIG. 13. In this case, the registered service becomes an unregistered service. Also, information related to the feature of the user's facial image corresponding to the imaging unit of the service facility related to the deleted registered service, which is stored in the memory 16, is deleted.

[0059] After the user performs the above-mentioned user registration, when the user presses the "authentication history" button on the initial screen of the user terminal 20 as shown in FIG. 10 with his / her finger, a list of past authentication history information (in other words, a list of information related to the user's usage of the service facility) as shown in FIG. 14 is displayed on the user terminal 20. More specifically, the memory 16 of the authentication system 10 stores the user's past authentication history information in association with the user's identification information. When the user presses the "authentication history" button on the initial screen of the user terminal 20 as shown in FIG. 10 with his / her finger, a signal requesting the user's past authentication history information is transmitted from the user terminal 20 by the processor 12 of the authentication system 10. When the processor 12 of the authentication system 10 receives a signal requesting the user's past authentication history information from the user terminal 20, the processor 12 of the authentication system 10 transmits the past authentication history information corresponding to the user's identification information stored in the memory 16 to the user terminal 20 by the communication unit 18. As a result, the user terminal 20 displays a list of the user's past authentication history information. Furthermore, when the user presses a certain authentication history display with his / her finger in the list of past authentication history information as shown in FIG. 14, details of this authentication history are displayed on the user terminal 20 as shown in FIG.

[0060] In addition, in this embodiment, instead of the user using the user terminal 20 to register the features of the user's face authentication in the authentication system 10, the user may use certain imaging units 30A, 30B, and 30C to register the features of the user's face authentication in the authentication system 10. Specifically, when the user inputs registration information in certain imaging units 30A, 30B, and 30C and captures the user's face image with the imaging units 38A, 38B, and 38C, the input registration information and the user's face image data are transmitted from the imaging units 30A, 30B, and 30C to the authentication system 10. In this manner, the processor 12 of the authentication system 10 receives the face image data from the imaging units 30A, 30B, and 30C. The processor 12 also issues a user ID as the user's identification information based on the registration information received from the imaging units 30A, 30B, and 30C, and stores the issued user ID in the memory 16.

[0061] Next, the processor 12 of the authentication system 10 extracts the feature amount of the facial image corresponding to each of the imaging units 30A, 30B, and 30C as a hash value by the feature amount extraction means 14 based on the facial image data received from the imaging units 30A, 30B, and 30C. At this time, the feature amount extraction means 14 extracts the feature amount of the user's facial image for each of the imaging units 30A, 30B, and 30C. In addition, the feature amount extraction means 14 extracts only the feature amount of the user's facial image corresponding to the imaging units 30A, 30B, and 30C of the service facility selected in advance by the user. For example, if the user is permitted to use facial image data for the service facility where the imaging unit 30A is installed, but is not permitted to use facial image data for the service facility where the imaging unit 30B is installed, the feature amount extraction means 14 extracts only the feature amount of the user's facial image corresponding to the imaging unit 30A. As described above, the memory 16 stores the user's identification information and the service facility selected by the user in association with each other. Then, the processor 12 causes the registration means 13 to store the features of the facial images corresponding to the imaging units 30A, 30B, and 30C extracted by the feature extraction means 14 in the memory 16 of the authentication system 10 in association with the user ID (user identification information) and the identification information of the imaging units 30A, 30B, and 30C. In this manner, registration of the user's facial images captured by the imaging sections 38A, 38B, and 38C of the imaging units 30A, 30B, and 30C is completed. In this manner, the user can register the features of the user's facial authentication in the authentication system 10 without using the user terminal 20.

[0062] According to the authentication method performed by the authentication system 10 according to the present embodiment and configured as described above, a user's face image data and user identification information are received, and based on the received user's face image data, features of the user's face image are extracted for each of the multiple imaging units 30A, 30B, and 30C. Then, information related to the features of the user's face image for each of the multiple imaging units 30A, 30B, and 30C that have been extracted is stored in the memory 16 in association with the received user's identification information. According to this authentication method, face authentication can be easily performed using the multiple imaging units 30A, 30B, and 30C.

[0063] Specifically, although it has been common to provide an authentication engine using face authentication in the past, in the authentication system of the prior art, face authentication could not be performed with an authentication engine in which face data is not registered. Therefore, in order to perform authentication with each of the multiple authentication engines, the user needs to register face data with each of the multiple authentication engines, which is time-consuming and stressful. In contrast, in the present embodiment, even if the feature amount of a user's face image is registered with an authentication engine (e.g., the imaging unit 30A) of a certain service facility but is not registered with an authentication engine (e.g., the imaging unit 30B) of another service facility, the feature amount of the user's face image is stored in the memory 16 of the authentication system 10 for each of the imaging units 30A, 30B, and 30C, so that the user can be authenticated by capturing the user's face image with the imaging units 38A, 38B, and 38C even with the imaging units 30A, 30B, and 30C of the service facility in which the feature amount of the user's face image is not registered. In this case, the user does not need to register face image data with all of the multiple imaging units 30A, 30B, and 30C, which can reduce the user's effort. This makes it possible to encourage users who have not used various services using imaging units in which face image data has not been registered, because registering face image data is troublesome, to use the various services with ease.

[0064] In addition, when the feature amount of the user's face image, such as a hash value, is extracted and stored in the memory 16, the amount of data stored in the memory 16 can be significantly reduced compared to when the user's face image data itself is stored in the memory 16. This is because the amount of data of the feature amount of the user's face image is smaller than the amount of data of the user's face image data itself. In addition, in this case, since the user's face image data itself is not stored in the memory 16, the privacy of the user can be protected more reliably. In addition, when information related to the feature amount of the user's face image is sent between the authentication system 10 and each of the imaging units 30A, 30B, and 30C, the amount of data communication can be significantly reduced compared to when the user's face image data is sent between the authentication system 10 and each of the imaging units 30A, 30B, and 30C.

[0065] In addition, in the authentication method of the present embodiment, as described above, when extracting the feature amount of the user's face image based on the received face image data of the user, the feature amount of the user's face image is extracted for each of the multiple imaging units 30A, 30B, and 30C, and the extracted feature amount of the user's face image for each of the multiple imaging units 30A, 30B, and 30C is associated with the user's identification information and stored in the memory by the registration means 13. At this time, it is possible to deal with the case where the feature amount of the user's face image extracted by the feature amount extraction means 14 differs depending on the type of the imaging units 30A, 30B, and 30C. Note that, if the same program is used for the multiple imaging units 30A, 30B, and 30C and the feature amount of the user's face image extracted by the feature amount extraction means 14 is common to the imaging units 30A, 30B, and 30C, it is not necessary to extract the feature amount of the user's face image for each of the multiple imaging units 30A, 30B, and 30C.

[0066] In the authentication method of the present embodiment, as described above, the memory 16 stores information related to the service facility selected by the user in association with the user's identification information, and in the step of extracting the feature amount of the user's face image for each of the multiple imaging units 30A, 30B, and 30C based on the received user's face image data, the feature amount of the user's face image corresponding only to the imaging units of the service facility selected by the user stored in the memory 16 is extracted by the feature amount extraction means 14. In this case, the feature amount of the user's face image corresponding to the imaging units 30A, 30B, and 30C of the service facility not selected by the user is not stored in the memory 16, so that security can be improved and the user can feel at ease. In addition, companies and the like that participate in the group of authentication engines managed collectively by the authentication system 10 can appeal to customers the improved customer convenience that allows authentication by multiple authentication engines just by registering face image data on the user terminal 20 or the like.

[0067] Also, in the authentication method of this embodiment, as described above, the feature extraction means 14 extracts a hash value calculated from the received facial image data of the user by a predetermined hash function as a feature of the facial image of the user for each of the multiple imaging units 30A, 30B, and 30C. In this case, since the hash value is stored in the memory 16 as a feature of the facial image of the user, the amount of data stored in the memory 16 can be reduced compared to the case where the facial image data itself is stored in the memory 16. Also, since it is difficult to restore or infer the facial image data from the hash value, the authentication system 10 stores only the hash value, which can improve the privacy and security of the user.

[0068] In this embodiment, the feature extraction means 14 is not limited to extracting the feature of the user's face image as a hash value for each of the multiple imaging units 30A, 30B, and 30C based on the received user's face image data. The feature extraction means 14 may extract the feature of the user's face image as a value of a type other than the hash value for each of the multiple imaging units 30A, 30B, and 30C based on the received user's face image data. For example, the relative position, size, shape, etc. of each part of the face (eyes, nose, ears, etc.) may be extracted as the feature of the user's face image. Even in this case, if the data amount of the value of a type other than the hash value is less than the data amount of the face image itself, the data amount stored in the memory 16 can be reduced.

[0069] In the authentication method of the present embodiment, as described above, in the step of extracting feature amounts of a user's facial image for each of the imaging units 30A, 30B, and 30C by the feature amount extraction means 14 based on the received facial image data of the user, the feature amount of the user's facial image is extracted for each of the imaging units 30A, 30B, and 30C by the feature amount extraction means 14 based on the user's facial image data transmitted from the user terminal 20 carried by the user. Alternatively, in the step of extracting feature amounts of a user's facial image for each of the imaging units 30A, 30B, and 30C by the feature amount extraction means 14 based on the received facial image data of the user, the feature amount of the user's facial image may be extracted for each of the imaging units 30A, 30B, and 30C by the feature amount extraction means 14 based on the user's facial image data transmitted from one of the imaging units 30A, 30B, and 30C.

[0070] In the present embodiment, a program for performing an authentication method by the authentication system 10, which is executed by the processor 12, and a recording medium on which the program is recorded are used. Here, the processor 12 executes the program to receive face image data of a user and identification information of the user, and extracts features of the face image of the user for each of the imaging units 30A, 30B, and 30C based on the received face image data of the user. Then, information related to the features of the face image of the user for each of the extracted imaging units 30A, 30B, and 30C is stored in the memory 16 in association with the received identification information of the user. According to such a program and recording medium, face authentication can be easily performed by the multiple imaging units 30A, 30B, and 30C.

[0071] In this embodiment, an authentication system 10 including a processor 12 is used. In this authentication system 10, the processor 12 executes a program to receive face image data and user identification information of a user, and extracts features of the face image of the user for each of the imaging units 30A, 30B, and 30C based on the received face image data of the user. Then, information related to the features of the face image of the user for each of the imaging units 30A, 30B, and 30C thus extracted is stored in the memory 16 in association with the received user identification information. According to this authentication system 10, face authentication can be easily performed using the imaging units 30A, 30B, and 30C.

[0072] The authentication method and authentication system according to the present invention are not limited to the above-mentioned aspects, and various modifications can be made.

[0073] For example, an authentication system as shown in FIG. 16 may be used. The authentication system 50 shown in FIG. 16 includes a processor 52, a first server 56, a second server 58, and a third server 60. Here, the servers 56, 58, and 60 correspond to the imaging units 30A, 30B, and 30C. Specifically, the first server 56 corresponds to the imaging unit 30A, the second server 58 corresponds to the imaging unit 30B, and the third server 60 corresponds to the imaging unit 30C. Although three imaging units 30A, 30B, and 30C are shown in FIG. 16, when two or four or more imaging units are used, a server is provided in the authentication system 10 corresponding to each imaging unit. The processor 52 includes a server management means 52a, a feature extraction means 54, a registration means 53, and an authentication means 55. The feature extraction means 54, registration means 53 and authentication means 55 of the processor 52 have substantially the same functions as the feature extraction means 14, registration means 13 and authentication means 15 of the processor 12 of the authentication system 10 shown in Figures 1, 4 and 7. The server management means 52a manages the servers 56, 58 and 60.

[0074] Each server 56, 58, 60 stores the feature amount of the data of the user's face image corresponding to each imaging unit 30A, 30B, 30C in association with the user's identification information. Each server 56, 58, 60 is communicably connected to each corresponding imaging unit 30A, 30B, 30C via a network such as the Internet line. Each server 56, 58, 60 is configured to be collectively managed by the server management means 52a using an API (Application Programming Interface). This makes it easier to configure the systems of each server 56, 58, 60 than when the systems (programs) of each server 56, 58, 60 are configured independently. Also, the server management means 52a and the service facilities where each imaging unit 30A, 30B, 30C is installed are API-linked. For example, the platform of the server management means 52a is opened to each service facility, and the same platform as the server management means 52a is used at each service facility, making it easy to configure a system for providing services at each service facility.

[0075] The authentication system 50 having such a processor 52 and each of the servers 56, 58, 60 can also perform the same processing as the authentication system 10 having the processor 12. That is, according to the authentication method performed by the authentication system 50 shown in Fig. 16, the processor 52 extracts features of the user's facial image for each of the imaging units 30A, 30B, 30C based on the received facial image data of the user using feature extraction means 54, and stores the extracted features of the user's facial image in each of the servers 56, 58, 60 in association with the user's identification information and the imaging units 30A, 30B, 30C using registration means 53.

[0076] Moreover, information related to the feature amount of the user's face image stored in each server 56, 58, 60 is transmitted from each server 56, 58, 60 to the corresponding imaging unit 30A, 30B, 30C. As a result, when authenticating a user in each imaging unit 30A, 30B, 30C, the imaging unit 38A, 38B, 38C captures an image of the user to obtain face image data of the user, and the feature amount of the user's face image is extracted by the feature amount extraction means 34A, 34B, 34C based on the obtained face image data, so that each imaging unit 30A, 30B, 30C can authenticate the user. After that, the processors 32A, 32B, 32C of the imaging units 30A, 30B, 30C transmit information related to the service usage status to the authentication system 10. As a result, information related to the service usage status at each service facility in the authentication system 50 is stored in each server 56, 58, 60 for each user.

[0077] As another method for authenticating a user, when authenticating a user in each of the imaging units 30A, 30B, and 30C, the imaging units 38A, 38B, and 38C capture an image of the user to obtain face image data of the user, and feature extraction means 34A, 34B, and 34C extract features of the user's face image based on the captured face image data. Then, information related to the features of the user's face image is transmitted from each of the imaging units 30A, 30B, and 30C to the authentication system 50. This allows the authentication means 55 to authenticate the user. After that, the authentication system 50 transmits the authentication result of the user to the original imaging units 30A, 30B, and 30C.

[0078] As another method for authenticating a user, when authenticating a user in each of the imaging units 30A, 30B, and 30C, the imaging unit 38A, 38B, and 38C captures an image of the user to obtain face image data of the user. Then, the imaging units 30A, 30B, and 30C transmit the face image data of the user to the authentication system 50. Then, the processor 52 extracts the feature amount of the face image of the user based on the face image data of the user transmitted to each of the servers 56, 58, and 60 by the feature amount extraction means 54, and compares the extracted feature amount of the face image of the user with the feature amount of the face image of the user stored in each of the servers 56, 58, and 60 by the authentication means 55. This makes it possible to authenticate the user by the authentication means 55. After that, the authentication result of the user is transmitted from the authentication system 50 to the original imaging units 30A, 30B, and 30C.

[0079] According to these authentication methods, face authentication can be easily performed using the multiple imaging units 30A, 30B, and 30C.

[0080] In the authentication system 10 as shown in FIGS. 1, 4, 7, etc., the processor 12 may store in the memory 16 the user's face image data itself transmitted from the user terminal 20 and each of the imaging units 30A, 30B, 30C.

[0081] In the above example, the authentication systems 10 and 50 are installed separately from the imaging units 30A, 30B, and 30C installed at each service facility, but one of the imaging units 30A, 30B, and 30C installed at each service facility may also function as the authentication system 10 and 50. That is, the processor of one of the imaging units 30A, 30B, and 30C installed at each service facility may have a feature extraction means, a registration means, and an authentication means having functions equivalent to the feature extraction means 14, the registration means 13, and the authentication means 15 in the processor 12 of the authentication system 10 shown in Figures 1, 4, 7, etc.

[0082] As yet another example, the authentication system 10 may perform two-stage authentication of a user by using a feature amount of the user's facial image extracted from the user's facial image data (specifically, for example, a hash value) and an element other than the feature amount of the user's facial image (specifically, for example, a password entered into the user terminal 20 at the time of user registration or identification information of the user terminal 20) (two-factor authentication). In this case, the elements required for authentication may be combined depending on the security level required for the imaging units 30A, 30B, and 30C of the service facility.

[0083] In the above description, when a user uses the user terminal 20 to register face image data in the authentication system 10, the user inputs registration information such as name, date of birth, telephone number, email address, and password on the user registration screen, checks a box indicating that the user agrees to the terms of use, and then presses the registration button. When the user captures a face image on the imaging screen using the user terminal 20, various information input on the user registration screen and the face image data of the user are transmitted from the user terminal 20 to the authentication system 10. Thereafter, the processor 12 issues a user ID as identification information of the user, and stores the issued user ID in the memory 16. However, the present embodiment is not limited to such an embodiment. As another embodiment, the feature amount (specifically, for example, a hash value) of the user's face image extracted from the user's face image data by the feature amount extraction means 14 for each of the imaging units 30A, 30B, and 30C may be used as the user ID. In this case, the user ID (i.e., hash value) is different for each of the imaging units 30A, 30B, and 30C, but the processor 12 of the authentication system 10 links the different user IDs for the imaging units 30A, 30B, and 30C of the same user to each other.

[0084] Furthermore, the processor 12 of the authentication system 10 may link a user ID issued as user identification information after receiving various information input on the user registration screen and the user's face image data, with a user ID (user identification information) used in the authentication engine 30D of various service providers that perform authentication other than face authentication. That is, the authentication system 10 may further include a linking means 19 that links a user ID (user identification information) used in the authentication engine 30D of the service provider that performs authentication other than face authentication with a user ID (user identification information) related to the feature amount of the user's face image stored in the memory 16. Specifically, the user ID used in the authentication engine 30D of various service providers that perform authentication other than face authentication may be identification information of a user terminal 20 such as a smartphone possessed by a user, user identification information (e.g., hash value) obtained from biometric information such as fingerprint information or vein information of a user, a code of several digits (specifically, for example, a combination of numbers and Roman letters) or a password input by a user to a user terminal 20 such as a smartphone. In this case, when a user is authenticated by various service provider authentication engines 30D that perform authentication other than face authentication, a user ID based on the user's face image data obtained by capturing a face image on the user terminal (specifically, a hash value extracted from the face image data) can be used instead, thereby improving convenience for the user. In addition, even after the linking by the linking means 19 is performed, the user ID used by the service provider authentication engine 30D may remain. In this case, the user can be appropriately authenticated even when the service provider authentication engine 30D performs user authentication in a stand-alone manner without using the cloud authentication system 10.

[0085] Also, different strengths of authentication may be set depending on the type of service facility. Specifically, for example, when a locking system of an office building or a home where a user works is used as an authentication engine of the service facility, a so-called smart lock is used in which the lock of the door is unlocked by the identification information of a user terminal 20 such as a smartphone. Specifically, by simply bringing the user terminal 20 close to the door of the locking system of the office building or the home where the user works or a receiving device installed in the vicinity thereof, the identification information of the user terminal 20 is read by the function of Bluetooth (registered trademark), or when a command to unlock the door is input by the user using a smart lock app installed in the user terminal 20, the user is authenticated based on the identification information of the user terminal 20. Then, when it is authenticated that the user is a registered user, the door of the office building or the home where the user works is unlocked. On the other hand, when a transfer system or a payment system to an account of a financial institution is used as an authentication engine of the service facility, face authentication is required when logging in to the financial institution service or payment service on the user terminal 20, and further, when transferring money to an account or making a payment, authentication by delivery of SMS (Short Message Service) or password input is required in addition to face authentication. In this way, by varying the strength of user ID authentication depending on the application, it is possible to improve user convenience by lowering the authentication strength for authentication engines of frequently used service providers, and to improve security by increasing the authentication strength for authentication engines of service providers that handle money, etc.

[0086] Furthermore, the user may be able to add or delete service providers that perform authentication other than face authentication, in addition to the service providers related to face authentication, on the user terminal 20 on a screen as shown in FIG. 13. That is, in addition to the list of service providers related to face authentication, a list of service providers that perform authentication other than face authentication is also registered in advance in the authentication system 10. Then, when the user registers an unregistered service on the screen of the user terminal 20 as shown in FIG. 13, a user ID used in the authentication engine of the newly registered service provider is stored in the memory 16. At this time, the user IDs of other service providers already stored in the memory 16 are linked by the linking means 19 to the user ID used in the authentication engine of the newly registered service provider (for example, identification information of the user terminal 20, a code of several digits or a password entered by the user when registering a new service provider, etc.). In this case, when a service provider that performs authentication other than facial authentication is newly registered, when the user performs authentication using the authentication engine of this service provider, a user ID based on the user's facial image data obtained by capturing a facial image with the user terminal (specifically, a hash value extracted from the facial image data) can be used instead, thereby improving user convenience. Also, on the screen as shown in FIG. 13, when a service provider that performs authentication other than facial authentication has been registered, this registered service can be deleted. In this case, the registered service becomes an unregistered service. Also, the user ID corresponding to the authentication engine of the service provider related to the deleted registered service, which is stored in the memory 16, is deleted.

[0087] According to the authentication system 10 of the above aspect, the authentication system 10 shown in FIGS. 4 to 6 and the authentication system 10 shown in FIGS. 7 to 9 include an information acquisition means 17 that receives facial image data of a user from a user terminal at the time of user registration, extracts features of the user's facial image based on the received facial image data of the user, and stores information related to the extracted features of the user's facial image in the memory 16 as user identification information; an authentication means 15 that performs user authentication by comparing the features of the user's facial image extracted from the user's facial image data received from the imaging units 30A, 30B, and 30C of the service facility or the features of the user's facial image received from the imaging units 30A, 30B, and 30C with the features of the user's facial image stored in the memory 16 at the time of user authentication; and a linking means 19 that links the user's identification information used in the authentication engine 30D of the service facility that performs authentication other than facial authentication with the user's identification information related to the features of the user's facial image stored in the memory 16. According to such an authentication system 10, convenience can be improved by using the registered face image data (specifically, the feature amount of the user's face image) in the authentication engine 30D that performs authentication other than face authentication.

[0088] 1 to 3, the authentication system 10 includes an information acquisition means 17 that receives face image data of a user from a user terminal at the time of user registration, extracts features of the user's face image based on the received face image data of the user, and stores information related to the extracted features of the user's face image in the memory 16 as user identification information, a communication unit 18 as a transmission means that transmits information related to the features of the user's face image stored in the memory 16 to the imaging units 30A, 30B, and 30C of each service facility to allow the imaging units 30A, 30B, and 30C of each service facility to perform authentication based on the user's face image, and a linking means 19 that links the user's identification information used in the authentication engine 30D of the service facility that performs authentication other than face authentication with the user's identification information related to the features of the user's face image stored in the memory 16. Even in such an authentication system 10, convenience can be improved by using the registered face image data (specifically, the features of the user's face image) in the authentication engine 30D that performs authentication other than face authentication.

[0089] Furthermore, in the authentication system 10 of this embodiment, the user identification information used in the authentication engine 30D of the service provider that performs authentication other than facial authentication includes at least one of the group consisting of identification information of the user terminal possessed by the user, information obtained from biometric information other than the user's face, and a code or password entered by the user into the user terminal.

[0090] In addition, in the authentication system 10 of this embodiment, when an instruction to add an authentication engine of a service institution is received from a user terminal, the linking means 19 links the user identification information used for authentication of the added service institution's authentication engine with the user identification information related to the features of the user's facial image stored in the memory 16.

[0091] Furthermore, in the authentication system 10 of this embodiment, even after the linking of the user's identification information by the linking means 19, the user's identification information used in the authentication engine of each service facility remains as is.

[0092] In addition, the information processing method by the authentication system 10 shown in FIGS. 4 to 6 and the authentication system 10 shown in FIGS. 7 to 9 includes the steps of: receiving, at the time of user registration, facial image data of the user from the user terminal 20, extracting features of the user's facial image based on the received facial image data of the user, and storing information related to the extracted features of the user's facial image in the memory 16 as user identification information; authenticating the user by comparing, at the time of user authentication, the features of the user's facial image extracted from the user's facial image data received from the imaging units 30A, 30B, 30C of the service facility or the features of the user's facial image received from the imaging units 30A, 30B, 30C of the service facility with the features of the user's facial image stored in the memory 16; and linking the user's identification information used in the authentication engine 30D of the service facility that performs authentication other than facial authentication with the user's identification information related to the features of the user's facial image stored in the memory 16. According to such an information processing method, the registered face image data (specifically, the feature amount of the user's face image) can be used in the authentication engine 30D that performs authentication other than face authentication, thereby improving convenience.

[0093] 1 to 3, the information processing method by the authentication system 10 includes the steps of: receiving face image data of a user from the user terminal 20 at the time of user registration; extracting features of the user's face image based on the received face image data of the user; and storing information related to the extracted features of the user's face image in the memory 16 as user identification information; transmitting information related to the features of the user's face image stored in the memory 16 to the imaging units 30A, 30B, and 30C of each service facility in order to have the imaging units 30A, 30B, and 30C of each service facility perform authentication based on the user's face image; and linking the user's identification information used in the authentication engine 30D of the service facility that performs authentication other than face authentication with the user's identification information related to the features of the user's face image stored in the memory 16. Even in such an information processing method, convenience can be improved by using the registered face image data (specifically, the features of the user's face image) in the authentication engine 30D that performs authentication other than face authentication.

[0094] As yet another example, an authentication system 10 shown in Fig. 17 may be used. In the authentication system 10 and the imaging units 30A, 30B, and 30C shown in Fig. 17, the same components as those in the authentication system 10 and the imaging units 30A, 30B, and 30C shown in Figs. 1, 4, and 7 are designated by the same reference numerals, and description thereof will be omitted.

[0095] As shown in FIG. 17, the processor 12 of the authentication system 10 has a registration means 13 for registering face image data received from the user terminal 20, and an authentication means 15 for authenticating a user based on the face image data of the user captured by the imaging sections 38A-38C of each of the imaging units 30A, 30B, and 30C. The processor 12 executes a program stored in the memory 16 to store the face image data of the user registered in the registration means 13 in the memory 16 in association with the identification information of the user and the identification information of the imaging units 30A, 30B, and 30C. The processor 12 also executes a program stored in the memory 16 to perform authentication of the user in the authentication means 15 by comparing the face image data of the user captured by the imaging sections 38A-38C of each of the imaging units 30A, 30B, and 30C with the face image data of the user stored in the memory 16. The program executed by the processor 12 is not limited to the one stored in the memory 16. The registration means 13 and the authentication means 15 may each perform processing by having the processor 12 execute a program transmitted to the authentication system 10 from an external device or a program stored in a recording medium detachably attached to the authentication system 10. In this embodiment, the registration means 13 constitutes the information acquisition means 17. The information acquisition means 17 accepts facial image data of a user at the time of user registration, and stores the accepted facial image data of the user in the memory 16 as the user's identification information.

[0096] Each of the imaging units 30A, 30B, 30C arranged in each service facility is composed of, for example, a computer, and each imaging unit 30A, 30B, 30C has a processor 32A, 32B, 32C such as a CPU, a memory 36A, 36B, 36C, an imaging unit 38A, 38B, 38C, a processing unit 40A, 40B, 40C, and a communication unit 42A, 42B, 42C.

[0097] 17, the authentication system 10 and the imaging units 30A, 30B, and 30C arranged in each service facility are linked through an API (Application Programming Interface). This makes it easier to configure the systems for each of the imaging units 30A, 30B, and 30C than if each of the imaging units 30A, 30B, and 30C were configured independently.

[0098] Next, a brief description will be given of the processing contents when authenticating a user using the authentication system 10 and the imaging units 30A, 30B, and 30C as shown in FIG.

[0099] First, a process in which a user registers face image data in the authentication system 10 using the user terminal 20 will be described. A specific method for the user to capture a face image using the user terminal 20 has already been described, and will not be described here. When a user first performs user registration using such a face authentication app in the user terminal 20, various information input on the user registration screen and the user's face image data are transmitted from the user terminal 20 to the authentication system 10. In this manner, the processor 12 of the authentication system 10 receives the face image data from the user terminal 20. The processor 12 of the authentication system 10 also receives from the user terminal 20 the identification information of the user terminal 20 and the registration information, such as the user's name, date of birth, telephone number, email address, and password, input to the user terminal 20. The processor 12 also issues a user ID as the user's identification information, and stores the issued user ID in the memory 16.

[0100] Next, the processor 12 of the authentication system 10 causes the registration means 13 to store the facial image data received from the user terminal 20 in the memory 16 of the authentication system 10 in association with the user ID (user identification information) and the identification information of the imaging units 30A, 30B, and 30C. In this manner, registration of the user's facial image captured by the user terminal 20 is completed. Note that in the example shown in Fig. 17, the user's facial image data stored in the memory 16 is not transmitted from the authentication system 10 to the imaging units 30A, 30B, and 30C of the service facility selected by the user.

[0101] Next, a process of authenticating a user in each of the imaging units 30A, 30B, and 30C will be described. When authentication of a user is required at a service facility where each of the imaging units 30A, 30B, and 30C is installed, first, the imaging units 38A, 38B, and 38C of the imaging units 30A, 30B, and 30C capture images of the user to obtain face image data of the user. The processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C transmit the face image data of the user captured by the imaging units 38A, 38B, and 38C to the processor 12 of the authentication system 10 via the communication units 42A, 42B, and 42C. When the processor 12 of the authentication system 10 receives the face image data of the user from the imaging units 30A, 30B, and 30C, it receives the face image data of the user transmitted only from the imaging units 30A, 30B, and 30C of the service facility selected by the user, which is stored in the memory 16. In the authentication system 10, the processor 12 performs authentication of the user by comparing the facial image data received from the imaging units 30A, 30B, and 30C with the facial image data of the user stored in the memory 16 by the authentication means 15. More specifically, if the coincidence rate between the facial image data of the user received from the imaging units 30A, 30B, and 30C and the facial image data of the user stored in the memory 16 exceeds a predetermined threshold (e.g., 80%), the authentication means 15 performs authentication of the user. As described above, the memory 16 stores the identification information of the user and the identification information of the imaging units 30A, 30B, and 30C registered in advance in association with the facial image data of the user.

[0102] When the authentication means 15 authenticates the user, information related to the authentication result is transmitted from the processor 12 of the authentication system 10 to the imaging units 30A, 30B, and 30C via the communication unit 18. The processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C that have received the information related to the authentication result enable the respective processing units 40A, 40B, and 40C to implement the services corresponding to the imaging units 30A, 30B, and 30C. The processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C then transmit information related to the usage status of the services to the authentication system 10. As a result, information related to the usage status of the services at each service facility is stored in the memory 16 for each user in the authentication system 10.

[0103] On the other hand, when the user's face image data received from the imaging units 30A, 30B, and 30C does not substantially match the user's face image data stored in the memory 16 and the authentication means 15 cannot authenticate the user, information related to the authentication result is also transmitted from the processor 12 of the authentication system 10 to the imaging units 30A, 30B, and 30C via the communication unit 18 (STEP 58). Then, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C that received the information related to the authentication result disable the service corresponding to the imaging units 30A, 30B, and 30C via the respective processing units 40A, 40B, and 40C. In this case, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C also transmit information related to the service usage status (specifically, information that the user attempted to perform authentication with the imaging units 30A, 30B, and 30C but was not authenticated and was unable to use the service) to the authentication system 10.

[0104] According to such an authentication method, even if the user's facial image data is registered in an authentication engine (e.g., imaging unit 30A) of one service facility but not registered in an authentication engine (e.g., imaging unit 30B) of another service facility, by storing the user's facial image data in memory 16 of authentication system 10, the user can be authenticated by a service facility where the user's facial image data is not registered by capturing the user's facial image with an imaging unit. In this case, the user does not need to register facial image data in all of the multiple authentication engines, which saves the user's trouble.

[0105] 17 also includes a linking means 19. The linking means 19 links user identification information used in an authentication engine 30D of a service provider that performs authentication other than facial authentication with user identification information related to the user's facial image data stored in the memory 16. According to this authentication system 10, the registered facial image data (specifically, the user's facial image data) can be used in the authentication engine 30D that performs authentication other than facial authentication, thereby improving convenience.

[0106] In a further modified example, in the authentication system 10 as shown in FIGS. 1 to 3, the authentication means 35A, 35B, and 35C of each imaging unit 30A, 30B, and 30C may authenticate the user using the facial image data of the user instead of the feature amount of the facial image of the user. In this case, the facial image data of the user registered in the authentication system 10 is transmitted to each imaging unit 30A, 30B, and 30C. In this case, the linking means 19 of the authentication system 10 as shown in FIGS. 1 to 3 links the user's identification information used in the authentication engine 30D of the service provider that performs authentication other than facial authentication with the user's identification information related to the facial image data of the user stored in the memory 16. In such an authentication system 10, the convenience can be improved by using the registered facial image data (specifically, the feature amount of the facial image of the user) in the authentication engine 30D that performs authentication other than facial authentication. [Explanation of symbols]

[0107] 10 Authentication System 12 processors 13 Registration methods 14 Feature extraction method 15 Authentication Methods 16 Memory 17 Information acquisition means 18 Communications Department 19 Linking Methods 20 User terminal 30A, 30B, 30C Imaging unit 30D Authentication Engine 32A, 32B, 32C Processors 34A, 34B, 34C Feature extraction means 35A, 35B, 35C Authentication Methods 36A, 36B, 36C Memory 38A, 38B, 38C Imaging section 40A, 40B, 40C Processing section 42A, 42B, 42C Communication Department 50 Authentication System 52 processors 52a Server Management Methods 53 Registration Method 54 Feature Extraction Method 55 Authentication Methods 56 First Server 58 Second Server 60 Third Server

Claims

1. An authentication system that authenticates a user using information received from a user terminal, an information acquisition means for receiving facial image data of a user from a user terminal at the time of user registration, extracting features of the facial image of the user based on the received facial image data of the user, and storing information relating to the extracted features of the facial image of the user in a memory; an authentication means for authenticating a user by comparing, at the time of user authentication, a feature amount of a user's face image extracted from the user's face image data received from an imaging unit of the service facility or a feature amount of the user's face image received from the imaging unit of the service facility with a feature amount of the user's face image stored in the memory; A linking means for linking user identification information used in an authentication engine of a service provider that performs authentication other than face authentication with user identification information related to features of the user's face image stored in the memory; An authentication system that includes:

2. 2. The authentication system according to claim 1, wherein when the authentication means authenticates the user, two-factor authentication is performed by using a feature amount of a facial image of the user and an element other than the feature amount of the facial image of the user.

3. An authentication system that authenticates a user using information received from a user terminal, an information acquisition means for receiving facial image data of a user from a user terminal at the time of user registration, extracting features of the facial image of the user based on the received facial image data of the user, and storing information relating to the extracted features of the facial image of the user in a memory; a transmitting means for transmitting information relating to features of the user's facial image stored in the memory to the imaging unit of each service facility so that the imaging unit of each service facility performs authentication based on the user's facial image; A linking means for linking user identification information used in an authentication engine of a service provider that performs authentication other than face authentication with user identification information related to features of the user's face image stored in the memory; An authentication system that includes:

4. 4. The authentication system according to claim 1, wherein the user identification information used in an authentication engine of a service provider that performs authentication other than facial recognition includes at least one of a group consisting of identification information of a user terminal held by the user, information obtained from biometric information other than the user's face, and a code or password entered by the user into the user terminal.

5. 5. The authentication system according to claim 1, wherein, when an instruction to add an authentication engine of a service provider is received from a user terminal, the linking means links user identification information used in authentication of the added authentication engine of the service provider with user identification information related to features of a facial image of the user stored in the memory.

6. 6. The authentication system according to claim 1, wherein the user identification information used in the authentication engine of each service provider remains unchanged even after the linking of the user identification information by the linking means.

7. The authentication system according to any one of claims 1 to 6, wherein the information acquisition means, when extracting features of the user's facial image based on the received facial image data of the user, extracts a hash value calculated from the received facial image data of the user using a hash function as the feature of the user's facial image.

8. An authentication system that authenticates a user using information received from a user terminal, an information acquisition means for receiving facial image data of a user from a user terminal at the time of user registration, extracting features of the facial image of the user based on the received facial image data of the user, and storing information relating to the extracted features of the facial image of the user in a memory; an authentication means for authenticating a user by comparing, at the time of user authentication, a feature amount of a user's face image extracted from the user's face image data received from an imaging unit of the service facility or a feature amount of the user's face image received from the imaging unit of the service facility with a feature amount of the user's face image stored in the memory; Equipped with An authentication system in which, when authenticating a user by the authentication means, two-factor authentication is performed by using features of a facial image of the user and an element other than the features of the facial image of the user.

9. An authentication system that authenticates a user using information received from a user terminal, an information acquisition means for receiving face image data of a user from a user terminal at the time of user registration and storing the received face image data of the user in a memory; an authentication means for authenticating a user by comparing face image data of the user received from an imaging unit of a service facility with face image data of the user stored in the memory at the time of user authentication; A linking means for linking user identification information used in an authentication engine of a service provider that performs authentication other than face authentication with user identification information related to the user's face image data stored in the memory; An authentication system that includes:

10. An authentication system that authenticates a user using information received from a user terminal, an information acquisition means for receiving face image data of a user from a user terminal at the time of user registration and storing the received face image data of the user in a memory; a transmitting means for transmitting the facial image data of the user stored in the memory to an imaging unit of each service facility so that the imaging unit of each service facility performs authentication based on the facial image of the user; A linking means for linking user identification information used in an authentication engine of a service provider that performs authentication other than face authentication with user identification information related to the user's face image data stored in the memory; An authentication system that includes:

11. 1. An information processing method for an authentication system that authenticates a user using information received from a user terminal, comprising: a step of accepting facial image data of a user from a user terminal at the time of user registration, extracting features of the facial image of the user based on the accepted facial image data of the user, and storing information relating to the extracted features of the facial image of the user in a memory; a step of authenticating a user by comparing, at the time of user authentication, a feature amount of a user's facial image extracted from the user's facial image data received from an imaging unit of the service facility or a feature amount of the user's facial image received from the imaging unit of the service facility with a feature amount of the user's facial image stored in the memory; A step of linking user identification information used in an authentication engine of a service provider that performs authentication other than facial authentication with user identification information related to features of the user's facial image stored in the memory; An information processing method comprising:

12. 1. An information processing method for an authentication system that authenticates a user using information received from a user terminal, comprising: a step of accepting facial image data of a user from a user terminal at the time of user registration, extracting features of the facial image of the user based on the accepted facial image data of the user, and storing information relating to the extracted features of the facial image of the user in a memory; transmitting information related to features of the user's facial image stored in the memory to an imaging unit of each service facility so that the imaging unit of each service facility performs authentication based on the user's facial image; A step of linking user identification information used in an authentication engine of a service provider that performs authentication other than facial authentication with user identification information related to features of the user's facial image stored in the memory; An information processing method comprising:

13. 1. An information processing method for an authentication system that authenticates a user using information received from a user terminal, comprising: a step of accepting facial image data of a user from a user terminal at the time of user registration, extracting features of the facial image of the user based on the accepted facial image data of the user, and storing information relating to the extracted features of the facial image of the user in a memory; a step of authenticating a user by comparing, at the time of user authentication, a feature amount of a user's facial image extracted from the user's facial image data received from an imaging unit of the service facility or a feature amount of the user's facial image received from the imaging unit of the service facility with a feature amount of the user's facial image stored in the memory; Equipped with The information processing method, wherein when the authentication means authenticates the user, two-factor authentication is performed by using a feature amount of a facial image of the user and an element other than the feature amount of the facial image of the user.

14. 1. An information processing method for an authentication system that authenticates a user using information received from a user terminal, comprising: receiving face image data of the user from the user terminal at the time of user registration, and storing the received face image data of the user in a memory; a step of authenticating a user by comparing face image data of the user received from an imaging unit of a service facility with face image data of the user stored in the memory at the time of user authentication; A step of linking user identification information used in an authentication engine of a service provider that performs authentication other than facial authentication with user identification information related to the user's facial image data stored in the memory; An information processing method comprising:

15. 1. An information processing method for an authentication system that authenticates a user using information received from a user terminal, comprising: receiving face image data of the user from the user terminal at the time of user registration, and storing the received face image data of the user in a memory; transmitting the facial image data of the user stored in the memory to an imaging unit of each service facility so that the imaging unit of each service facility performs authentication based on the facial image of the user; A step of linking user identification information used in an authentication engine of a service provider that performs authentication other than facial authentication with user identification information related to the user's facial image data stored in the memory; An information processing method comprising:

Images