Authentication system and information processing method

The authentication system enables the use of facial image data across various authentication methods by extracting and linking feature amounts, addressing the inconvenience of conventional systems and enhancing security and privacy.

JP7591790B2Active Publication Date: 2024-11-29ミガロホールディングス株式会社 +1
View PDF 13 Cites 0 Cited by

Patent Information

Application Number
JP2022035061
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-02-18
Filing Date
2022-03-08
Publication Date
2024-11-29
Estimated Expiration
2040-06-12

AI Technical Summary

Technical Problem

Conventional authentication systems that perform face recognition are inconvenient because registered facial image data cannot be utilized by authentication engines that perform authentication methods other than face authentication.

Method used

An authentication system and method that allows facial image data to be received from a user terminal, extracts feature amounts, and stores them in a memory for linking with user identification information, enabling authentication using these features in various authentication engines, including those that do not rely solely on face recognition.

Benefits of technology

Improves convenience by allowing registered facial image data to be used across multiple authentication methods, reducing the need for repeated data registration and enhancing security and privacy through reduced data storage and communication.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007591790000001
    Figure 0007591790000001
  • Figure 0007591790000002
    Figure 0007591790000002
  • Figure 0007591790000003
    Figure 0007591790000003
Patent Text Reader

Abstract

An authentication system and an information processing method are provided that can improve convenience by using registered face image data in an authentication engine that performs authentication other than face authentication. [Solution] An authentication system 10 that authenticates a user using information received from a user terminal 20 is equipped with an information acquisition means 17 that receives user facial image data from the user terminal 20 at the time of user registration, extracts features of the user's facial image based on the received user facial image data, and stores information related to the extracted features of the user's facial image in memory 16 as user identification information, and a linking means 19 that links the user identification information used in an authentication engine of a service provider that performs authentication other than facial recognition with the user identification information related to the features of the user's facial image stored in memory 16.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an authentication system and an information processing method. [Background technology]

[0002] BACKGROUND ART Conventionally, as an authentication system that performs authentication based on face data, an authentication system that performs identity authentication by comparing input face data with pre-registered face data is known (see, for example, Patent Documents 1 and 2).

[0003] In the authentication system described in Patent Document 1, a target person is authenticated using an image of the face portion in an image captured by a camera. In the authentication system described in Patent Document 2, for example, when four face images are registered, two are face patterns for ensuring accuracy, one is a face pattern for absorbing disturbance components, and one is a face pattern to be updated. When a new face pattern is registered, the face pattern to be updated that has the second lowest similarity to the newly registered face pattern is deleted from the four previously registered face patterns. In other words, by leaving the face pattern for absorbing disturbance components that has the lowest similarity to the newly registered face pattern, face authentication is performed while adapting to environmental variations. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2019-197426 [Patent Document 2] Japanese Patent Application Laid-Open No. 2006-72540 Summary of the Invention [Problem to be solved by the invention]

[0005] The authentication systems disclosed in Patent Documents 1 and 2 have the problem of inconvenience because the registered face image data cannot be used in an authentication engine that performs authentication other than face authentication.

[0006] The present invention has been made in consideration of these points, and aims to provide an authentication system and information processing method that can improve convenience by using registered facial image data in an authentication engine that performs authentication other than facial authentication. [Means for solving the problem]

[0007] The authentication system of the present invention is an authentication system that authenticates a user using information received from a user terminal, and is characterized by comprising: an information acquisition means that, at the time of user registration, receives facial image data of the user from the user terminal, extracts features of the user's facial image based on the received facial image data of the user, and stores information related to the extracted features of the user's facial image in memory; an authentication means that, at the time of user authentication, authenticates the user by comparing the features of the user's facial image extracted from the user's facial image data received from the imaging unit of the service facility or the features of the user's facial image received from the imaging unit of the service facility with the features of the user's facial image stored in the memory; and a linking means that links user identification information used in an authentication engine of the service facility that performs authentication other than facial authentication with user identification information related to the features of the user's facial image stored in the memory.

[0008] The authentication system of the present invention is an authentication system that authenticates a user using information received from a user terminal, and is characterized by comprising: an information acquisition means that receives user facial image data from the user terminal at the time of user registration, extracts features of the user's facial image based on the received user facial image data, and stores information related to the extracted features of the user's facial image in memory; a transmission means that transmits information related to the features of the user's facial image stored in the memory to the imaging unit of each service facility so that the imaging unit of each service facility can perform authentication based on the user's facial image; and a linking means that links user identification information used in an authentication engine of a service facility that performs authentication other than facial recognition with user identification information related to the features of the user's facial image stored in the memory.

[0009] The authentication system of the present invention is an authentication system that authenticates a user using information received from a user terminal, and includes: an information acquisition means that, at the time of user registration, receives facial image data of the user from the user terminal, extracts features of the user's facial image based on the received facial image data of the user, and stores information related to the extracted features of the user's facial image in memory; and an authentication means that, at the time of user authentication, authenticates the user by comparing the features of the user's facial image extracted from the user's facial image data received from an imaging unit of a service facility or the features of the user's facial image received from the imaging unit of the service facility with the features of the user's facial image stored in the memory, and is characterized in that, when authenticating a user using the authentication means, two-factor authentication is performed by using the features of the user's facial image and elements other than the features of the user's facial image.

[0010] The authentication system of the present invention is an authentication system that authenticates a user using information received from a user terminal, and is characterized by comprising: an information acquisition means that receives user facial image data from the user terminal at the time of user registration and stores the received user facial image data in memory; an authentication means that authenticates a user by comparing the user facial image data received from the service facility's imaging unit with the user facial image data stored in the memory at the time of user authentication; and a linking means that links user identification information used in the service facility's authentication engine that performs authentication other than facial authentication with user identification information related to the user facial image data stored in the memory.

[0011] The authentication system of the present invention is an authentication system that authenticates a user using information received from a user terminal, and is characterized by comprising: an information acquisition means that receives user facial image data from the user terminal at the time of user registration and stores the received user facial image data in memory; a transmission means that transmits the user facial image data stored in the memory to the imaging unit of each service facility so that the imaging unit of each service facility can perform authentication based on the user's facial image; and a linking means that links user identification information used in the authentication engine of the service facility that performs authentication other than facial authentication with user identification information related to the user facial image data stored in the memory.

[0012] The information processing method of the present invention is an information processing method by an authentication system that authenticates a user using information received from a user terminal, and is characterized by comprising the steps of: receiving, at the time of user registration, facial image data of the user from the user terminal, extracting features of the user's facial image based on the received facial image data of the user, and storing information related to the extracted features of the user's facial image in memory; and, at the time of user authentication, authenticating the user by comparing the features of the user's facial image extracted from the user's facial image data received from an imaging unit of the service facility or the features of the user's facial image received from the imaging unit of the service facility with the features of the user's facial image stored in the memory; and linking user identification information used in an authentication engine of the service facility that performs authentication other than facial authentication with user identification information related to the features of the user's facial image stored in the memory.

[0013] The information processing method of the present invention is an information processing method by an authentication system that authenticates a user using information received from a user terminal, and is characterized by comprising the steps of: receiving facial image data of the user from the user terminal at the time of user registration; extracting features of the user's facial image based on the received facial image data of the user; and storing information related to the extracted features of the user's facial image in memory; transmitting information related to the features of the user's facial image stored in the memory to the imaging unit of each service facility so that the imaging unit of each service facility can perform authentication based on the user's facial image; and linking user identification information used in an authentication engine of a service facility that performs authentication other than facial recognition with user identification information related to the features of the user's facial image stored in the memory.

[0014] The information processing method of the present invention is an information processing method by an authentication system that authenticates a user using information received from a user terminal, and includes the steps of: receiving facial image data of the user from the user terminal at the time of user registration, extracting features of the user's facial image based on the received facial image data of the user, and storing information related to the extracted features of the user's facial image in memory; and authenticating the user by comparing the features of the user's facial image extracted from the user's facial image data received from the imaging unit of the service facility or the features of the user's facial image received from the imaging unit of the service facility with the features of the user's facial image stored in the memory, and is characterized in that when authenticating the user by the authentication means, two-factor authentication is performed by using the features of the user's facial image and elements other than the features of the user's facial image.

[0015] The information processing method of the present invention is an information processing method by an authentication system that authenticates a user using information received from a user terminal, and is characterized by comprising the steps of: receiving user facial image data from the user terminal and storing the received user facial image data in memory when registering a user; authenticating the user by comparing the user facial image data received from the service facility's imaging unit with the user facial image data stored in the memory when authenticating the user; and linking user identification information used in the service facility's authentication engine that performs authentication other than facial authentication with user identification information related to the user facial image data stored in the memory.

[0016] The information processing method of the present invention is an information processing method by an authentication system that authenticates a user using information received from a user terminal, and is characterized by comprising the steps of: receiving the user's facial image data from the user terminal at the time of user registration, and storing the received user's facial image data in memory; transmitting the user's facial image data stored in the memory to the imaging unit of each service facility so that the imaging unit of each service facility can perform authentication based on the user's facial image; and linking the user's identification information used in the authentication engine of the service facility that performs authentication other than facial recognition with the user's identification information related to the user's facial image data stored in the memory. [Effects of the Invention]

[0017] According to the authentication system and information processing method of the present invention, the registered face image data can be used in an authentication engine that performs authentication other than face authentication, thereby improving convenience. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a diagram illustrating an example of an authentication system according to an embodiment of the present invention and an imaging unit disposed at each service facility. [Figure 2] 4 is a flowchart showing the processing executed when a face image of a user is registered by the authentication system shown in FIG. [Figure 3] 4 is a flowchart showing an example of processing content executed when authenticating a user using the authentication system and imaging unit shown in FIG. [Figure 4] FIG. 10 is a diagram schematically illustrating another example of an authentication system and imaging units arranged at each service facility according to an embodiment of the present invention. [Figure 5] 5 is a flowchart showing the processing content executed when a face image of a user is registered by the authentication system shown in FIG. [Figure 6]5 is a flowchart showing an example of processing content executed when authenticating a user using the authentication system and imaging unit shown in FIG. 4. [Figure 7] FIG. 10 is a diagram schematically illustrating still another example of an authentication system and imaging units arranged at each service facility according to an embodiment of the present invention. [Figure 8] 8 is a flowchart showing the processing content executed when a face image of a user is registered by the authentication system shown in FIG. 7. [Figure 9] 8 is a flowchart showing an example of processing content executed when authenticating a user using the authentication system and imaging unit shown in FIG. 7. [Figure 10] FIG. 10 is a diagram showing an initial screen displayed on a user terminal. [Figure 11] FIG. 10 is a diagram showing a registration screen displayed on a user terminal. [Figure 12] FIG. 10 is a diagram showing a registration screen displayed on a user terminal. [Figure 13] FIG. 10 is a diagram showing a service addition screen displayed on a user terminal. [Figure 14] FIG. 10 is a diagram showing an authentication history screen displayed on a user terminal. [Figure 15] FIG. 10 is a diagram showing a detailed screen of an authentication history displayed on a user terminal. [Figure 16] FIG. 10 is a diagram schematically illustrating yet another example of an authentication system according to an embodiment of the present invention and imaging units disposed in each company. [Figure 17] FIG. 10 is a diagram schematically illustrating yet another example of an authentication system according to an embodiment of the present invention and imaging units disposed in each company. DETAILED DESCRIPTION OF THE INVENTION

[0019] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will now be described with reference to the accompanying drawings, in which: Figures 1 to 15 show an authentication system according to the present embodiment and imaging units arranged at each service facility.

[0020] As shown in FIG. 1, imaging units 30A, 30B, and 30C that authenticate users are installed in each service facility, such as a restaurant, hotel, transportation facility, office building, apartment complex, or convenience store. While FIG. 1 illustrates three imaging units 30A, 30B, and 30C, two or more imaging units may be used. An authentication system 10 installed in a company separate from each service facility is communicatively connected to each imaging unit 30A, 30B, and 30C via a network such as the Internet. A user terminal 20, such as a smartphone carried by a user, is communicatively connected to the authentication system 10 and each imaging unit 30A, 30B, and 30C via a network such as the Internet. Details of the authentication system 10 and each imaging unit 30A, 30B, and 30C are described below.

[0021] The authentication system 10 is configured, for example, by a computer, and includes a processor 12 such as a CPU, a memory 16, and a communication unit 18. The processor 12 includes a feature extraction means 14 that extracts feature quantities of the user's facial image corresponding to each of the imaging units 30A, 30B, and 30C as hash values ​​based on facial image data received from the user terminal 20, and a registration means 13 that registers the extracted feature quantities of the user's facial image. The processor 12 executes a program stored in the memory 16, causing the feature extraction means 14 to extract feature quantities of the user's facial image corresponding to each of the imaging units 30A, 30B, and 30C as hash values. Specifically, the feature extraction means 14 extracts hash values ​​calculated from the received user's facial image data using a predetermined hash function as the feature quantities of the user's facial image. Note that even if the user's facial image data is the same, the feature quantities of the user's facial image may differ depending on the type of imaging unit 30A, 30B, and 30C. This is because the specifications of the imaging units 30A, 30B, and 30C used by different service providers, such as business companies, also differ. Therefore, the feature extraction means 14 extracts features of the user's facial image for each of the imaging units 30A, 30B, and 30C. That is, from one facial image data set, feature values ​​of multiple users' facial images corresponding to each of the imaging units 30A, 30B, and 30C are extracted. Furthermore, by executing a program stored in the memory 16, the processor 12 causes the registration means 13 to associate the feature values ​​(specifically, hash values) of the user's facial image for each of the imaging units 30A, 30B, and 30C extracted by the feature extraction means 14 with the user's identification information and the identification information of the imaging units 30A, 30B, and 30C and store them in the memory 16. The programs executed by the processor 12 are not limited to those stored in the memory 16. Processing may be performed in each of the feature extraction means 14 and the registration means 13 by the processor 12 executing a program transmitted to the authentication system 10 from an external device or a program stored on a recording medium that is detachably attached to the authentication system 10.In this embodiment, the feature extraction means 14 and the registration means 13 constitute information acquisition means 17. When a user is registered, the information acquisition means 17 receives face image data of the user, extracts feature amounts of the face image of the user based on the received face image data of the user, and stores information related to the extracted feature amounts of the face image of the user in memory 16 as user identification information.

[0022] As described above, the memory 16 stores the feature amounts (specifically, hash values) of the user's facial image extracted by the feature amount extraction means 14 in association with the user's identification information and the identification information of the imaging units 30A, 30B, and 30C. As described above, the feature amounts of the user's facial image extracted by the feature amount extraction means 14 may differ depending on the type of imaging unit 30A, 30B, and 30C. For this reason, the feature amount extraction means 14 extracts the feature amounts of the user's facial image for each imaging unit 30A, 30B, and 30C. As a result, the feature amounts of the user's facial image extracted by the feature amount extraction means 14 must also be stored in the memory 16 in association with each imaging unit 30A, 30B, and 30C. The memory 16 also stores the user's identification information in association with the service provider selected by the user. As described above, the memory 16 also stores programs for causing the processor 12 to perform various processes. The processor 12 also transmits and receives signals to and from the imaging units 30A, 30B, 30C or the user terminal 20 located at each service facility via a network such as the Internet line using a communication unit 18.

[0023] Each of the imaging units 30A, 30B, and 30C disposed at each service facility is composed of, for example, a computer, and each imaging unit 30A, 30B, and 30C has a processor 32A, 32B, and 32C such as a CPU, a memory 36A, 36B, and 36C, an imaging unit 38A, 38B, and 38C, a processing unit 40A, 40B, and 40C, and a communication unit 42A, 42B, and 42C. The processor 32A, 32B, and 32C has feature extraction means 34A, 34B, and 34C that extracts features of a user's facial image as a hash value based on the user's facial image data captured by the imaging unit 38A, 38B, and 38C, and authentication means 35A, 35B, and 35C. The processors 32A, 32B, and 32C execute programs stored in memories 36A, 36B, and 36C to cause feature extraction means 34A, 34B, and 34C to extract features of the user's facial image as hash values. Specifically, the feature extraction means 34A, 34B, and 34C extract hash values ​​calculated from the received user's facial image data using a predetermined hash function as features of the user's facial image. The processors 32A, 32B, and 32C also execute programs stored in memories 36A, 36B, and 36C to perform user authentication in authentication means 35A, 35B, and 35C. Details of this processing will be described later. Note that the programs executed by the processors 32A, 32B, and 32C are not limited to those stored in memories 36A, 36B, and 36C. Various processes may be performed in the feature extraction means 34A, 34B, 34C and the authentication means 35A, 35B, 35C by the processors 32A, 32B, 32C executing a program transmitted to the imaging units 30A, 30B, 30C from an external device or a program stored on a recording medium detachably attached to the imaging units 30A, 30B, 30C. Furthermore, each of the imaging units 30A, 30B, 30C is not limited to corresponding to a single service facility. For example, the imaging unit 30A may correspond to multiple service facilities.

[0024] The memories 36A, 36B, and 36C are configured to store pre-registered user identification information and facial image features of the users in association with each other. As described above, the memories 36A, 36B, and 36C are configured to store programs for causing the processors 32A, 32B, and 32C to perform various processes. The imaging units 38A, 38B, and 38C each have a camera, for example, and are configured to capture an image of the user to acquire facial image data of the user.

[0025] The processing units 40A, 40B, and 40C are also configured to perform various processes for authenticated users. For example, if the imaging units 30A, 30B, and 30C are installed in an office building or an apartment complex, the processing units 40A, 40B, and 40C unlock doors at entrances and exits of the building or apartment complex when a user is authenticated. Furthermore, if the imaging units 30A, 30B, and 30C are installed in restaurants, hotels, transportation facilities, convenience stores, and other facilities, they enable cashless payment when paying fees at these service facilities. In this case, the imaging units 30A, 30B, and 30C transmit payment information to a server of a financial institution or credit card company, so that the payment amount is automatically debited from the user's bank account or added to the credit card statement. The processors 32A, 32B, and 32C also transmit and receive signals to and from the authentication system 10 or the user terminal 20 via a network such as the Internet via the communication units 42A, 42B, and 42C.

[0026] Furthermore, in each of the imaging units 30A, 30B, and 30C, a user's facial image is captured by the imaging units 38A, 38B, and 38C, and the feature values ​​of the user's facial image can be registered in each of the imaging units 30A, 30B, and 30C. Specifically, when the feature values ​​of the user's facial image are registered in each of the imaging units 30A, 30B, and 30C, when the user's facial image is captured by the imaging units 38A, 38B, and 38C, the processors 32A, 32B, and 32C extract the feature values ​​of the user's facial image as hash values ​​using feature extraction means 34A, 34B, and 34C based on the user's facial image data captured by the imaging units 38A, 38B, and 38C. The extracted feature values ​​of the user's facial image (specifically, hash values) are then stored in memories 36A, 36B, and 36C. In this manner, the feature values ​​of the user's facial image are registered in each of the imaging units 30A, 30B, and 30C.

[0027] A facial recognition app can be installed on the user terminal 20 from an online store or the like. Once such a facial recognition app is installed, the user can register facial image data and register the service provider from which the service is to be used, using the user terminal 20. The processing details of such a facial recognition app will be described later. Note that such a facial recognition app may be provided by the authentication system 10, or may be provided by a system separate from the authentication system 10.

[0028] In this embodiment, the authentication system 10 and the imaging units 30A, 30B, and 30C located at each service facility are API-linked (Application Programming Interface), which makes it easier to configure the systems for each of the imaging units 30A, 30B, and 30C than if each system were configured independently.

[0029] Next, the processing contents when authenticating a user using the authentication system 10 and the imaging units 30A, 30B, and 30C will be described with reference to FIGS. 2, 3, and 10 to 12. FIG.

[0030] First, a process in which a user registers facial image data in the authentication system 10 using the user terminal 20 will be described. First, the user installs a facial authentication app in the user terminal 20. The initial screen of such a facial authentication app is displayed as shown in FIG. 10. The user first registers using such a facial authentication app on the user terminal 20. Specifically, when the user presses the account button on the screen shown in FIG. 10, a user registration screen such as that shown in FIG. 11 appears. When the user enters registration information such as name, date of birth, phone number, email address, and password on such a user registration screen, checks the box indicating agreement to the terms of use, and then presses the registration button, a facial image capture screen such as that shown in FIG. 12 appears. When the user captures a facial image using the user terminal 20 on such a capture screen, the various information entered on the user registration screen and the user's facial image data are transmitted from the user terminal 20 to the authentication system 10. In this manner, the processor 12 of the authentication system 10 receives the facial image data from the user terminal 20 (STEP 1). Processor 12 of authentication system 10 also receives from user terminal 20 the identification information of user terminal 20 and registration information such as the user's name, date of birth, telephone number, email address, and password entered into user terminal 20. Processor 12 also issues a user ID as the user's identification information and stores this issued user ID in memory 16.

[0031] Next, the processor 12 of the authentication system 10 extracts facial image features corresponding to each of the imaging units 30A, 30B, and 30C as hash values ​​using the feature extraction means 14 based on the facial image data received from the user terminal 20 (STEP 2). The feature extraction means 14 may extract different facial image features for each of the imaging units 30A, 30B, and 30C. Therefore, the feature extraction means 14 extracts the facial image features for the user for each of the imaging units 30A, 30B, and 30C. The feature extraction means 14 also extracts only the facial image features of the user corresponding to the imaging units 30A, 30B, and 30C of the service facility preselected by the user. For example, if the user is permitted to use facial image data at the service facility where the imaging unit 30A is installed but is not permitted to use facial image data at the service facility where the imaging unit 30B is installed, the feature extraction means 14 extracts only the facial image features of the user corresponding to the imaging unit 30A. As described above, the memory 16 stores the user's identification information and the service provider selected by the user in association with each other. The processor 12 then causes the registration means 13 to store the facial image features extracted by the feature extraction means 14 and corresponding to each of the imaging units 30A, 30B, and 30C in the memory 16 of the authentication system 10 in association with the user ID (user identification information) and the identification information of the imaging units 30A, 30B, and 30C (STEP 3). In this manner, registration of the user's facial image captured by the user terminal 20 is completed. Furthermore, information related to the facial image features stored in the memory 16 is transmitted from the authentication system 10 to the imaging units 30A, 30B, and 30C of the service provider selected by the user (STEP 4). At this time, the facial image features of the user corresponding to the imaging units 30A, 30B, and 30C are transmitted to the imaging units 30A, 30B, and 30C. The imaging units 30A, 30B, and 30C store information relating to the feature amounts of the facial image of the user transmitted from the authentication system 10 in the memories 36A, 36B, and 36C in association with the user's identification information.

[0032] Next, a process for authenticating a user in each of the imaging units 30A, 30B, and 30C will be described. When user authentication becomes necessary at a service facility where each of the imaging units 30A, 30B, and 30C is installed, first, the imaging units 38A, 38B, and 38C of the imaging units 30A, 30B, and 30C capture an image of the user to obtain facial image data of the user (STEP 11). Then, in the imaging units 30A, 30B, and 30C, the processors 32A, 32B, and 32C extract features of the user's facial image as hash values ​​using feature extraction means 34A, 34B, and 34C based on the acquired facial image data (STEP 12). The processors 32A, 32B, and 32C then compare the features (specifically, hash values) of the user's facial image extracted by the feature extraction means 34A, 34B, and 34C with the features (specifically, hash values) of the user's facial image stored in the memories 36A, 36B, and 36C to authenticate the user (STEP 13). More specifically, if the match rate between the features of the user's facial image extracted by the feature extraction means 34A, 34B, and 34C and the features of the user's facial image stored in the memories 36A, 36B, and 36C exceeds a predetermined threshold (e.g., 80%), the authentication means 35A, 35B, and 35C authenticates the user. As described above, the memories 36A, 36B, and 36C store pre-registered user identification information and the features of the user's facial image in association with each other.

[0033] Then, when the authentication means 35A, 35B, and 35C authenticate the user ("YES" in STEP 14), the processors 32A, 32B, and 32C enable the respective processing units 40A, 40B, and 40C to implement the services corresponding to the imaging units 30A, 30B, and 30C (STEP 15). Specifically, as described above, if the imaging units 30A, 30B, and 30C are installed in an office building or an apartment complex, the processing units 40A, 40B, and 40C unlock doors installed at entrances and exits of the office building or apartment complex when the user is authenticated. Furthermore, if the imaging units 30A, 30B, and 30C are installed in restaurants, hotels, transportation facilities, convenience stores, and the like, they enable cashless payment when paying fees at these service facilities. Note that two-factor authentication may be performed when cashless payment is performed. Thereafter, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C transmit information relating to the usage status of the service to the authentication system 10 (STEP 17). As a result, information relating to the usage status of the service at each service facility is stored in the memory 16 for each user in the authentication system 10.

[0034] On the other hand, if the feature amounts of the user's facial image extracted by the feature amount extraction means 34A, 34B, 34C do not substantially match the feature amounts of the user's facial image stored in the memories 36A, 36B, 36C and the authentication means 35A, 35B, 35C are unable to authenticate the user ("NO" in STEP 14), the processors 32A, 32B, 32C disable the respective processing units 40A, 40B, 40C from providing the service corresponding to the imaging unit 30A, 30B, 30C (STEP 16). In this case as well, the processors 32A, 32B, 32C of the imaging units 30A, 30B, 30C transmit information relating to the service usage status (specifically, information that the user attempted to perform authentication using the imaging unit 30A, 30B, 30C but was not authenticated and was therefore unable to use the service) to the authentication system 17.

[0035] According to this authentication method, even if the features of a user's facial image are registered in the imaging engine (e.g., imaging unit 30A) of one service facility but not in the imaging engine (e.g., imaging unit 30B) of another service facility, by storing the features of the user's facial image in association with the identification information of the imaging units 30A, 30B, and 30C in memory 16 of authentication system 10 and memories 36A, 36B, and 36C of each imaging unit 30A, 30B, and 30C, the user can be authenticated by capturing the user's facial image with an imaging unit even at a service facility where the features of the user's facial image are not registered. In this case, the user does not need to register facial image data in all of the multiple imaging units, thereby saving the user effort.

[0036] It should be noted that the authentication system 10 and authentication method according to this embodiment are not limited to those shown in Figures 1 to 3. Other examples of the authentication system 10 and authentication method according to this embodiment will be described with reference to Figures 4 to 6. It should be noted that, in the authentication system 10 and each of the imaging units 30A, 30B, and 30C shown in Figure 4, the same components as those in the authentication system 10 and each of the imaging units 30A, 30B, and 30C shown in Figure 1 will be given the same reference numerals, and their description will be omitted.

[0037] 4, the processor 12 of the authentication system 10 includes a feature extraction means 14 that extracts features of the user's facial image corresponding to each of the imaging units 30A, 30B, and 30C as hash values ​​based on facial image data received from the user terminal 20, a registration means 13 that registers the extracted features of the user's facial image, and an authentication means 15 that authenticates the user based on the features (specifically, hash values) of the user's facial image captured by the imaging sections 38A to 38C of each of the imaging units 30A, 30B, and 30C. The processor 12 executes a program stored in the memory 16 to store in the memory 16 the features (specifically, hash values) of the user's facial image extracted by the feature extraction means 14 in the registration means 13 in association with the user's identification information and the identification information of the imaging units 30A, 30B, and 30C. Moreover, the processor 12 executes a program stored in the memory 16, thereby causing the authentication means 15 to compare the feature amounts (specifically, hash values) of the user's facial image captured by the imaging sections 38A to 38C of each of the imaging units 30A, 30B, and 30C with the feature amounts (specifically, hash values) of the user's facial image corresponding to each of the imaging units 30A, 30B, and 30C stored in the memory 16, thereby authenticating the user. Note that the programs executed by the processor 12 are not limited to those stored in the memory 16. The processor 12 may execute a program transmitted to the authentication system 10 from an external device or a program stored in a recording medium detachably attached to the authentication system 10, thereby performing processing in each of the feature amount extraction means 14, the registration means 13, and the authentication means 15. Also in this embodiment, the feature amount extraction means 14 and the registration means 13 constitute the information acquisition means 17. When a user is registered, the information acquisition means 17 accepts the user's facial image data, extracts the features of the user's facial image based on the accepted facial image data of the user, and stores information relating to the extracted features of the user's facial image in the memory 16 as the user's identification information.

[0038] Each of the imaging units 30A, 30B, and 30C installed at each service facility is composed of, for example, a computer, and each imaging unit 30A, 30B, and 30C includes a processor 32A, 32B, or 32C such as a CPU, a memory 36A, 36B, or 36C, an imaging unit 38A, 38B, or 38C, a processing unit 40A, 40B, or 40C, and a communication unit 42A, 42B, or 42C. The processors 32A, 32B, and 32C include feature extraction means 34A, 34B, or 34C that extracts features of a user's facial image as a hash value based on the user's facial image data captured by the imaging unit 38A, 38B, or 38C. Note that in the example shown in FIG. 4, the processors 32A, 32B, and 32C do not include authentication means 35A, 35B, or 35C as shown in FIG. 1. The processors 32A, 32B, and 32C execute programs stored in the memories 36A, 36B, and 36C to cause the feature extraction means 34A, 34B, and 34C to extract features of the user's facial image as hash values. Specifically, the feature extraction means 34A, 34B, and 34C extract hash values ​​calculated from the received user's facial image data using a predetermined hash function as features of the user's facial image. Note that the programs executed by the processors 32A, 32B, and 32C are not limited to those stored in the memories 36A, 36B, and 36C. The processors 32A, 32B, and 32C may execute programs transmitted to the imaging units 30A, 30B, and 30C from an external device or programs stored on a recording medium detachably attached to the imaging units 30A, 30B, and 30C, thereby causing the feature extraction means 34A, 34B, and 34C to perform various processes. In the example shown in FIG. 4, the memories 36A, 36B, and 36C are not configured to store the feature amounts of the user's facial image.

[0039] 4, the authentication system 10 and the imaging units 30A, 30B, and 30C located at each service facility are linked via an API (Application Programming Interface), which makes it easier to configure the systems for each of the imaging units 30A, 30B, and 30C than if each system were configured independently.

[0040] Next, the processing contents when authenticating a user using the authentication system 10 and the imaging units 30A, 30B, and 30C as shown in FIG. 4 will be described with reference to FIGS.

[0041] First, a process in which a user registers facial image data in the authentication system 10 using the user terminal 20 will be described. A specific method for capturing a facial image using the user terminal 20 has already been described, and will not be described here. When a user first registers using such a facial authentication app on the user terminal 20, various information entered on the user registration screen and the user's facial image data are transmitted from the user terminal 20 to the authentication system 10. In this manner, the processor 12 of the authentication system 10 receives the facial image data from the user terminal 20 (STEP 21). The processor 12 of the authentication system 10 also receives, from the user terminal 20, identification information for the user terminal 20 and registration information such as the user's name, date of birth, telephone number, email address, and password entered into the user terminal 20. The processor 12 also issues a user ID as the user's identification information and stores the issued user ID in memory 16.

[0042] Next, the processor 12 of the authentication system 10 causes the feature extraction means 14 to extract, as a hash value, the feature amounts of the facial images corresponding to each of the imaging units 30A, 30B, and 30C based on the facial image data received from the user terminal 20 (STEP 22). At this time, the feature amounts of the user's facial image extracted by the feature extraction means 14 may differ depending on the type of imaging unit 30A, 30B, and 30C, and the feature extraction means 14 extracts the feature amounts of the user's facial image for each of the imaging units 30A, 30B, and 30C. In addition, the feature extraction means 14 extracts only the feature amounts of the user's facial image corresponding to the imaging units 30A, 30B, and 30C of the service facility selected in advance by the user. Then, the processor 12 causes the registration means 13 to store the features of the facial images corresponding to each of the imaging units 30A, 30B, and 30C extracted by the feature extraction means 14 in the memory 16 of the authentication system 10 in association with the user ID (user identification information) and the identification information of the imaging units 30A, 30B, and 30C (STEP 23). In this manner, the registration of the user's facial image captured by the user terminal 20 is completed. Note that in the example shown in Fig. 4, the information related to the features of the user's facial image stored in the memory 16 is not transmitted from the authentication system 10 to the imaging units 30A, 30B, and 30C of the service facility selected by the user.

[0043] Next, a process for authenticating a user in each of the imaging units 30A, 30B, and 30C will be described. When user authentication is required at a service facility where each of the imaging units 30A, 30B, and 30C is installed, the imaging units 38A, 38B, and 38C of the imaging units 30A, 30B, and 30C first capture an image of the user to acquire facial image data of the user (STEP 31). Furthermore, in the imaging units 30A, 30B, and 30C, the processors 32A, 32B, and 32C extract features of the user's facial image as hash values ​​using the feature extraction means 34A, 34B, and 34C based on the acquired facial image data (STEP 32). The processors 32A, 32B, and 32C then transmit the features (specifically, hash values) of the user's facial image extracted by the feature extraction means 34A, 34B, and 34C to the processor 12 of the authentication system 10 via the communication units 42A, 42B, and 42C (STEP 33). When the processor 12 of the authentication system 10 receives information related to the features of the user's facial image from the imaging units 30A, 30B, and 30C, the processor 12 receives information related to the features of the user's facial image transmitted only from the imaging units 30A, 30B, and 30C of the service facility selected by the user, which is stored in the memory 16. Then, in the authentication system 10, the processor 12 authenticates the user by comparing the features (specifically, hash values) of the user's facial image received from the imaging units 30A, 30B, and 30C with the features (specifically, hash values) of the user's facial image stored in the memory 16 using the authentication means 15 (STEP 34). More specifically, if the match rate between the features of the user's facial image received from the imaging units 30A, 30B, and 30C and the features of the user's facial image stored in the memory 16 exceeds a predetermined threshold (e.g., 80%), the authentication means 15 authenticates the user. As described above, the memory 16 stores pre-registered user identification information and identification information of the imaging units 30A, 30B, and 30C in association with feature amounts of the user's facial image.

[0044] Then, when the authentication means 15 authenticates the user ("YES" in STEP 35), information related to the authentication result is transmitted from the processor 12 of the authentication system 10 to the imaging units 30A, 30B, and 30C via the communication unit 18 (STEP 36). Then, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C that have received the information related to the authentication result enable the respective processing units 40A, 40B, and 40C to implement the services corresponding to these imaging units 30A, 30B, and 30C (STEP 37). Thereafter, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C transmit information related to the usage status of the services to the authentication system 10. As a result, information related to the usage status of services at each service provider is stored in the memory 16 for each user in the authentication system 10.

[0045] On the other hand, if the feature amounts of the user's facial image received from the imaging units 30A, 30B, 30C do not substantially match the feature amounts of the user's facial image stored in the memory 16 and the authentication means 15 is unable to authenticate the user ("NO" in STEP 35), information relating to the authentication result is sent from the processor 12 of the authentication system 10 to the imaging units 30A, 30B, 30C via the communication unit 18 (STEP 38). Then, the processors 32A, 32B, 32C of the imaging units 30A, 30B, 30C that have received the information relating to the authentication result disable the implementation of the service corresponding to the imaging units 30A, 30B, 30C using the respective processing units 40A, 40B, 40C (STEP 39). In this case, too, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C transmit information regarding the usage status of the service (specifically, information that the user attempted to perform authentication using the imaging units 30A, 30B, and 30C but was not authenticated and was unable to use the service) to the authentication system 10.

[0046] According to this authentication method, even if the features of a user's facial image are registered in an imaging engine (e.g., imaging unit 30A) of one service facility but not in an imaging engine (e.g., imaging unit 30B) of another service facility, by storing the features of the user's facial image in association with the identification information of imaging units 30A, 30B, and 30C in memory 16 of authentication system 10, the user can be authenticated by capturing the user's facial image with an imaging unit even at a service facility where the features of the user's facial image are not registered. In this case, the user does not need to register facial image data for all of the multiple imaging units, thereby saving the user effort.

[0047] Further, still other examples of the authentication system 10 and authentication method according to this embodiment will be described with reference to Figures 7 to 9. Note that, in the authentication system 10 and the imaging units 30A, 30B, and 30C shown in Figure 7, the same components as those in the authentication system 10 and the imaging units 30A, 30B, and 30C shown in Figures 1 and 4 will be designated by the same reference numerals, and their description will be omitted.

[0048] 7, the processor 12 of the authentication system 10 includes a feature extraction means 14 that extracts features of the user's facial image corresponding to each of the imaging units 30A, 30B, and 30C as hash values ​​based on facial image data received from the user terminal 20, a registration means 13 that registers the extracted features of the user's facial image, and an authentication means 15 that authenticates the user based on the features (specifically, hash values) of the user's facial image captured by the imaging sections 38A to 38C of each of the imaging units 30A, 30B, and 30C. The processor 12 executes a program stored in the memory 16 to store in the memory 16 the features (specifically, hash values) of the user's facial image extracted by the feature extraction means 14 in the registration means 13 in association with the user's identification information and the identification information of the imaging units 30A, 30B, and 30C. Moreover, the processor 12 executes a program stored in the memory 16, thereby causing the authentication means 15 to compare the feature amounts (specifically, hash values) of the user's facial image captured by the imaging sections 38A to 38C of each of the imaging units 30A, 30B, and 30C with the feature amounts (specifically, hash values) of the user's facial image corresponding to each of the imaging units 30A, 30B, and 30C stored in the memory 16, thereby authenticating the user. Note that the programs executed by the processor 12 are not limited to those stored in the memory 16. The processor 12 may execute a program transmitted to the authentication system 10 from an external device or a program stored in a recording medium detachably attached to the authentication system 10, thereby performing processing in each of the feature amount extraction means 14, the registration means 13, and the authentication means 15. Also in this embodiment, the feature amount extraction means 14 and the registration means 13 constitute the information acquisition means 17. When a user is registered, the information acquisition means 17 accepts the user's facial image data, extracts the features of the user's facial image based on the accepted user's facial image data, and stores information relating to the extracted features of the user's facial image in the memory 16 as the user's identification information.

[0049] Each of the imaging units 30A, 30B, and 30C installed at each service facility is configured, for example, with a computer or the like, and each imaging unit 30A, 30B, and 30C includes a processor 32A, 32B, or 32C such as a CPU, a memory 36A, 36B, or 36C, an imaging unit 38A, 38B, or 38C, a processing unit 40A, 40B, or 40C, and a communication unit 42A, 42B, or 42C. In the example shown in FIG. 7, the processors 32A, 32B, and 32C do not include the feature extraction means 34A, 34B, or 34C and the authentication means 35A, 35B, or 35C shown in FIG. 1. In the example shown in FIG. 7, the memories 36A, 36B, and 36C are not configured to store features of the user's facial image.

[0050] 7, the authentication system 10 and the imaging units 30A, 30B, and 30C located at each service facility are linked via an API (Application Programming Interface), which makes it easier to configure the systems for each of the imaging units 30A, 30B, and 30C than if each system were configured independently.

[0051] Next, the processing contents when authenticating a user using the authentication system 10 and the imaging units 30A, 30B, and 30C as shown in FIG. 7 will be described with reference to FIGS.

[0052] First, a process in which a user registers facial image data in the authentication system 10 using the user terminal 20 will be described. A specific method for capturing a facial image using the user terminal 20 has already been described, and will not be described here. When a user first registers using such a facial authentication app on the user terminal 20, various information entered on the user registration screen and the user's facial image data are transmitted from the user terminal 20 to the authentication system 10. In this manner, the processor 12 of the authentication system 10 receives the facial image data from the user terminal 20 (STEP 41). The processor 12 of the authentication system 10 also receives, from the user terminal 20, identification information for the user terminal 20 and registration information such as the user's name, date of birth, telephone number, email address, and password entered into the user terminal 20. The processor 12 also issues a user ID as identification information for the user and stores the issued user ID in memory 16.

[0053] Next, the processor 12 of the authentication system 10 causes the feature extraction means 14 to extract, as a hash value, the feature amounts of the facial images corresponding to each of the imaging units 30A, 30B, and 30C based on the facial image data received from the user terminal 20 (STEP 42). At this time, the feature amounts of the user's facial image extracted by the feature extraction means 14 may differ depending on the type of imaging unit 30A, 30B, and 30C, and the feature extraction means 14 extracts the feature amounts of the user's facial image for each of the imaging units 30A, 30B, and 30C. In addition, the feature extraction means 14 extracts only the feature amounts of the user's facial image corresponding to the imaging units 30A, 30B, and 30C of the service facility selected in advance by the user. Then, the processor 12 causes the registration means 13 to store the features of the facial images corresponding to each of the imaging units 30A, 30B, and 30C extracted by the feature extraction means 14 in the memory 16 of the authentication system 10 in association with the user ID (user identification information) and the identification information of the imaging units 30A, 30B, and 30C (STEP 43). In this manner, the registration of the user's facial image captured by the user terminal 20 is completed. Note that in the example shown in Fig. 7, the information related to the features of the user's facial image stored in the memory 16 is not transmitted from the authentication system 10 to the imaging units 30A, 30B, and 30C of the service facility selected by the user.

[0054] Next, a process for authenticating a user in each of the imaging units 30A, 30B, and 30C will be described. When user authentication becomes necessary at a service facility where each of the imaging units 30A, 30B, and 30C is installed, first, the imaging units 38A, 38B, and 38C of the imaging units 30A, 30B, and 30C capture an image of the user to obtain facial image data of the user (STEP 51). The processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C transmit the facial image data of the user captured by the imaging units 38A, 38B, and 38C to the processor 12 of the authentication system 10 via the communication units 42A, 42B, and 42C (STEP 52). When processor 12 of authentication system 10 receives the user's facial image data from imaging units 30A, 30B, and 30C, it receives only the user's facial image data transmitted from imaging units 30A, 30B, and 30C of the service facility selected by the user, which is stored in memory 16. In authentication system 10, processor 12 extracts features of the user's facial image as hash values ​​using feature extraction means 14 based on the facial image data received from imaging units 30A, 30B, and 30C (STEP 53). Processor 12 then compares the features (specifically, hash values) of the user's facial image extracted by feature extraction means 14 with the features (specifically, hash values) of the user's facial image stored in memory 16 using authentication means 15, thereby authenticating the user (STEP 54). More specifically, if the matching rate between the feature amounts of the user's facial image extracted by the feature amount extraction means 14 and the feature amounts of the user's facial image stored in the memory 16 exceeds a predetermined threshold (e.g., 80%), the authentication means 15 authenticates the user. As described above, the memory 16 stores pre-registered user identification information and identification information of the imaging units 30A, 30B, and 30C in association with the feature amounts of the user's facial image.

[0055] Then, when the authentication means 15 authenticates the user ("YES" in STEP 55), information related to the authentication result is transmitted from the processor 12 of the authentication system 10 to the imaging units 30A, 30B, and 30C via the communication unit 18 (STEP 56). Then, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C that have received the information related to the authentication result enable the respective processing units 40A, 40B, and 40C to implement the services corresponding to these imaging units 30A, 30B, and 30C (STEP 57). Thereafter, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C transmit information related to the usage status of the services to the authentication system 10. As a result, information related to the usage status of services at each service provider is stored in the memory 16 for each user in the authentication system 10.

[0056] On the other hand, if the feature amounts of the user's facial image received from the imaging units 30A, 30B, 30C do not substantially match the feature amounts of the user's facial image stored in the memory 16 and the authentication means 15 is unable to authenticate the user ("NO" in STEP 55), information relating to the authentication result is also transmitted from the processor 12 of the authentication system 10 to the imaging units 30A, 30B, 30C via the communication unit 18 (STEP 58). Then, the processors 32A, 32B, 32C of the imaging units 30A, 30B, 30C that have received the information relating to the authentication result disable the implementation of the service corresponding to the imaging units 30A, 30B, 30C using the respective processing units 40A, 40B, 40C (STEP 59). In this case, too, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C transmit information regarding the usage status of the service (specifically, information that the user attempted to perform authentication using the imaging units 30A, 30B, and 30C but was not authenticated and was unable to use the service) to the authentication system 10.

[0057] According to this authentication method, even if the features of a user's facial image are registered in an imaging engine (e.g., imaging unit 30A) of one service facility but not in an imaging engine (e.g., imaging unit 30B) of another service facility, by storing the features of the user's facial image in association with the identification information of imaging units 30A, 30B, and 30C in memory 16 of authentication system 10, the user can be authenticated by capturing the user's facial image with an imaging unit even at a service facility where the features of the user's facial image are not registered. In this case, the user does not need to register facial image data for all of the multiple imaging units, thereby saving the user effort.

[0058] Next, a process will be described for the case where a user wishes to increase the number of service providers to which the above-described facial authentication service is applied in the authentication system 10 as shown in FIGS. 1 to 9 . After the user has performed the user registration as described above, when the user presses the “Add Service” button with his / her finger on the initial screen of the user terminal 20 as shown in FIG. 10 , a list of service providers as shown in FIG. 13 is displayed. Note that this list of service providers is pre-registered in the authentication system 10. On the screen as shown in FIG. 13 , the icons of unregistered services and registered services are displayed in different colors, or the icons of unregistered services are displayed in a dimmed color, so that they can be distinguished from each other. When the user presses the icon of an unregistered service with his / her finger, the terms of the service to be added are displayed. When the user inputs an instruction to agree to the terms of the service, the unregistered service becomes a registered service. At this time, in the authentication system 10, the service provider related to this registered service is associated with the user ID (user identification information) and stored in the memory 16. Thereafter, a facial image capture screen as shown in FIG. 12 is displayed on the user terminal 20. When the user captures a facial image on such an imaging screen using the user terminal 20, the user's facial image data is transmitted from the user terminal 20 to the authentication system 10. In this way, the processor 12 of the authentication system 10 receives the facial image data from the user terminal 20. Then, based on the facial image data received from the user terminal 20, the processor 12 of the authentication system 10 extracts, using the feature extraction means 14, the feature of the facial image corresponding to the imaging unit of the new service facility as a hash value. The processor 12 causes the registration means 13 to store, in the memory 16 of the authentication system 10, the feature of the facial image corresponding to the new imaging unit extracted by the feature extraction means 14 in association with the user ID (identification information of the user) and the identification information of the imaging unit of the new service facility. In this way, the registration of the new service facility is completed.As will be described later, if the user's facial image data is stored in memory 16, when the user registers a new service provider using the user terminal 20, the feature extraction means 14 may extract, as a hash value, the feature of the facial image corresponding to the imaging unit of the new service provider based on the user's facial image data stored in memory 16, without capturing the user's facial image using the user terminal 20. Also, the user may be able to delete a registered service on a screen such as that shown in FIG. 13. In this case, the registered service becomes an unregistered service. Furthermore, information stored in memory 16 relating to the feature of the user's facial image corresponding to the imaging unit of the service provider related to the deleted registered service is deleted.

[0059] Furthermore, after the user has performed the user registration described above, when the user presses the "Authentication History" button with his / her finger on the initial screen of the user terminal 20 as shown in FIG. 10, a list of past authentication history information (in other words, a list of information related to the user's usage of the service provider) as shown in FIG. 14 is displayed on the user terminal 20. More specifically, the memory 16 of the authentication system 10 stores the user's past authentication history information in association with the user's identification information. When the user presses the "Authentication History" button with his / her finger on the initial screen of the user terminal 20 as shown in FIG. 10, a signal requesting the user's past authentication history information is transmitted from the user terminal 20 to the processor 12 of the authentication system 10. When the processor 12 of the authentication system 10 receives the signal requesting the user's past authentication history information from the user terminal 20, the processor 12 transmits the past authentication history information corresponding to the user's identification information stored in the memory 16 to the user terminal 20 via the communication unit 18. As a result, the user terminal 20 displays a list of the user's past authentication history information. Furthermore, when the user presses a certain authentication history display with his / her finger in the list of past authentication history information as shown in FIG. 14, details of this authentication history are displayed on the user terminal 20 as shown in FIG.

[0060] Furthermore, in the present embodiment, instead of a user using the user terminal 20 to register the user's facial authentication features in the authentication system 10, the user may use one of the imaging units 30A, 30B, and 30C to register the user's facial authentication features in the authentication system 10. Specifically, when a user inputs registration information into one of the imaging units 30A, 30B, and 30C and captures the user's facial image using the imaging units 38A, 38B, and 38C, the input registration information and the user's facial image data are transmitted from the imaging units 30A, 30B, and 30C to the authentication system 10. In this manner, the processor 12 of the authentication system 10 receives the facial image data from the imaging units 30A, 30B, and 30C. The processor 12 also issues a user ID as the user's identification information based on the registration information received from the imaging units 30A, 30B, and 30C, and stores the issued user ID in the memory 16.

[0061] Next, the processor 12 of the authentication system 10 extracts facial image features corresponding to each of the imaging units 30A, 30B, and 30C as hash values ​​using the feature extraction means 14 based on the facial image data received from the imaging units 30A, 30B, and 30C. At this time, the feature extraction means 14 extracts the facial image features of the user for each of the imaging units 30A, 30B, and 30C. The feature extraction means 14 also extracts only the facial image features of the user corresponding to the imaging units 30A, 30B, and 30C of the service facility pre-selected by the user. For example, if the user is permitted to use facial image data at the service facility where the imaging unit 30A is installed but is not permitted to use facial image data at the service facility where the imaging unit 30B is installed, the feature extraction means 14 extracts only the facial image features of the user corresponding to the imaging unit 30A. As described above, the memory 16 stores the user's identification information and the service facility selected by the user in association with each other. Then, the processor 12 causes the registration means 13 to store the features of the facial images corresponding to each of the imaging units 30A, 30B, and 30C extracted by the feature extraction means 14 in the memory 16 of the authentication system 10 in association with the user ID (user identification information) and the identification information of the imaging units 30A, 30B, and 30C. In this manner, the registration of the user's facial images captured by the imaging sections 38A, 38B, and 38C of the imaging units 30A, 30B, and 30C is completed. In this manner, the user can register the features for facial authentication in the authentication system 10 without using the user terminal 20.

[0062] According to the authentication method performed by authentication system 10 of this embodiment configured as described above, a user's facial image data and user identification information are received, and feature amounts of the user's facial image are extracted for each of the multiple imaging units 30A, 30B, and 30C based on the received user's facial image data. Then, information related to the feature amounts of the extracted user's facial image for each of the multiple imaging units 30A, 30B, and 30C is stored in memory 16 in association with the received user's identification information. According to this authentication method, facial authentication can be easily performed using the multiple imaging units 30A, 30B, and 30C.

[0063] Specifically, while the use of an authentication engine using facial recognition has been widespread in the past, conventional authentication systems have been unable to perform facial authentication using an authentication engine in which facial data is not registered. Therefore, in order to perform authentication using multiple authentication engines, the user must register facial data for each of the multiple authentication engines, which is time-consuming and stressful. In contrast, in the present embodiment, even if a user's facial image features are registered in an authentication engine (e.g., imaging unit 30A) of one service facility but not in an authentication engine (e.g., imaging unit 30B) of another service facility, the user's facial image features are stored in memory 16 of authentication system 10 for each imaging unit 30A, 30B, and 30C. By capturing the user's facial image using imaging units 38A, 38B, and 38C in the imaging units 30A, 30B, and 30C of the service facility in which the user's facial image features are not registered, the user can be authenticated. In this case, the user does not need to register facial image data for all of the multiple imaging units 30A, 30B, and 30C, thereby reducing the user's effort. This allows users who have not used various services using imaging units in which face image data has not been registered because registering face image data is troublesome to be encouraged to use various services with ease.

[0064] Furthermore, when feature quantities of a user's facial image, such as a hash value, are extracted and stored in memory 16, the amount of data stored in memory 16 can be significantly reduced compared to when the user's facial image data itself is stored in memory 16. This is because the amount of data of the feature quantities of the user's facial image is smaller than the amount of data of the user's facial image data itself. In this case, the user's privacy can be more reliably protected because the user's facial image data itself is not stored in memory 16. Furthermore, when information related to the feature quantities of a user's facial image is sent between the authentication system 10 and each of the imaging units 30A, 30B, and 30C, the amount of data communication can be significantly reduced compared to when the user's facial image data is sent between the authentication system 10 and each of the imaging units 30A, 30B, and 30C.

[0065] Furthermore, in the authentication method of the present embodiment, as described above, when extracting features of a user's facial image based on the received facial image data of the user, the features of the user's facial image are extracted for each of the multiple imaging units 30A, 30B, and 30C, and the extracted features of the user's facial image for each of the multiple imaging units 30A, 30B, and 30C are stored in memory by the registration means 13 in association with the user's identification information. This can also handle cases where the features of the user's facial image extracted by the feature extraction means 14 differ depending on the type of imaging unit 30A, 30B, and 30C. Note that if the same program is used for the multiple imaging units 30A, 30B, and 30C and the features of the user's facial image extracted by the feature extraction means 14 are common to the imaging units 30A, 30B, and 30C, it is not necessary to extract the features of the user's facial image for each of the multiple imaging units 30A, 30B, and 30C.

[0066] Furthermore, in the authentication method of the present embodiment, as described above, information related to the service facility selected by the user is stored in memory 16 in association with the user's identification information, and in the step of extracting features of the user's facial image for each of the multiple imaging units 30A, 30B, and 30C based on the received user's facial image data by feature extraction means 14, feature extraction means 14 extracts features of the user's facial image corresponding only to the imaging units of the service facility selected by the user that are stored in memory 16. In this case, feature information of the user's facial image corresponding to the imaging units 30A, 30B, and 30C of service facilities not selected by the user is not stored in memory 16, thereby improving security and providing peace of mind to the user. Furthermore, companies and the like that participate in the group of authentication engines managed comprehensively by authentication system 10 can appeal to customers by promoting the improved customer convenience of being able to be authenticated by multiple authentication engines simply by registering facial image data on user terminal 20 or the like.

[0067] Furthermore, in the authentication method of this embodiment, as described above, the feature extraction means 14 extracts a hash value calculated from the received user's facial image data using a predetermined hash function as a feature of the user's facial image for each of the multiple imaging units 30A, 30B, and 30C. In this case, the hash value is stored in memory 16 as a feature of the user's facial image, so the amount of data stored in memory 16 can be reduced compared to when the facial image data itself is stored in memory 16. Furthermore, since it is difficult to restore or infer facial image data from the hash value, authentication system 10 stores only the hash value, which can improve user privacy and security.

[0068] In this embodiment, the feature extraction means 14 is not limited to extracting the feature of the user's facial image as a hash value for each of the plurality of imaging units 30A, 30B, and 30C based on the received facial image data of the user. The feature extraction means 14 may also extract the feature of the user's facial image as a value of a type other than a hash value for each of the plurality of imaging units 30A, 30B, and 30C based on the received facial image data of the user. For example, the relative position, size, shape, etc. of each facial feature (eyes, nose, ears, etc.) may be extracted as the feature of the user's facial image. Even in this case, if the amount of data of the value of a type other than a hash value is smaller than the amount of data of the facial image itself, the amount of data stored in memory 16 can be reduced.

[0069] Furthermore, in the authentication method of the present embodiment, as described above, in the step of extracting feature amounts of a user's facial image for each of the plurality of imaging units 30A, 30B, and 30C based on received facial image data of the user by the feature extraction means 14, the feature amounts of the user's facial image for each of the plurality of imaging units 30A, 30B, and 30C are extracted by the feature extraction means 14 based on the user's facial image data transmitted from the user terminal 20 carried by the user. Alternatively, in the step of extracting feature amounts of a user's facial image for each of the plurality of imaging units 30A, 30B, and 30C based on received facial image data of the user by the feature extraction means 14, the feature amounts of the user's facial image for each of the plurality of imaging units 30A, 30B, and 30C may be extracted by the feature extraction means 14 based on the user's facial image data transmitted from one of the plurality of imaging units 30A, 30B, and 30C.

[0070] Furthermore, in this embodiment, a program executed by the processor 12 for performing an authentication method using the authentication system 10 and a recording medium on which this program is recorded are used. Here, by executing the program, the processor 12 receives facial image data of a user and the user's identification information, and extracts feature amounts of the user's facial image for each of the multiple imaging units 30A, 30B, and 30C based on the received facial image data of the user. Then, information related to the extracted feature amounts of the user's facial image for each of the multiple imaging units 30A, 30B, and 30C is stored in memory 16 in association with the received user's identification information. Using such a program and recording medium, facial authentication can be easily performed using the multiple imaging units 30A, 30B, and 30C.

[0071] Furthermore, this embodiment uses an authentication system 10 including a processor 12. In this authentication system 10, the processor 12 executes a program to receive facial image data of a user and the user's identification information, and extracts features of the user's facial image for each of the multiple imaging units 30A, 30B, and 30C based on the received facial image data of the user. Then, information related to the extracted features of the user's facial image for each of the multiple imaging units 30A, 30B, and 30C is stored in memory 16 in association with the received user's identification information. According to this authentication system 10, facial authentication can be easily performed using the multiple imaging units 30A, 30B, and 30C.

[0072] The authentication method and authentication system according to the present invention are not limited to the above-described aspects, and various modifications can be made.

[0073] For example, an authentication system as shown in FIG. 16 may be used. The authentication system 50 shown in FIG. 16 includes a processor 52, a first server 56, a second server 58, and a third server 60. Here, the servers 56, 58, and 60 correspond to the imaging units 30A, 30B, and 30C, respectively. Specifically, the first server 56 corresponds to the imaging unit 30A, the second server 58 corresponds to the imaging unit 30B, and the third server 60 corresponds to the imaging unit 30C. Although FIG. 16 illustrates three imaging units 30A, 30B, and 30C, when two or four or more imaging units are used, a server is provided in the authentication system 10 corresponding to each imaging unit. The processor 52 also includes a server management means 52a, a feature extraction means 54, a registration means 53, and an authentication means 55. The feature extraction means 54, registration means 53, and authentication means 55 of the processor 52 have substantially the same functions as the feature extraction means 14, registration means 13, and authentication means 15 of the processor 12 of the authentication system 10 shown in Figures 1, 4, and 7. The server management means 52a manages the servers 56, 58, and 60.

[0074] Each server 56, 58, 60 stores feature quantities of facial image data of users corresponding to each imaging unit 30A, 30B, 30C, associated with the user's identification information. Each server 56, 58, 60 is communicatively connected to the corresponding imaging unit 30A, 30B, 30C via a network such as the Internet. Each server 56, 58, 60 is configured to be collectively managed by a server management unit 52a using an API (Application Programming Interface). This makes it easier to configure the systems of each server 56, 58, 60 than if the systems (programs) of each server 56, 58, 60 were configured independently. Furthermore, the server management unit 52a and the service providers where each imaging unit 30A, 30B, 30C is installed are API-linked. For example, the platform of the server management unit 52a may be opened to each service provider, and each service provider may use the same platform as the server management unit 52a, thereby easily building a system for providing services at each service provider.

[0075] The authentication system 50 having such a processor 52 and each of the servers 56, 58, and 60 can also perform processing similar to that of the authentication system 10 having the processor 12. That is, according to the authentication method performed by the authentication system 50 shown in Fig. 16, the processor 52 extracts features of the user's facial image for each of the imaging units 30A, 30B, and 30C based on the received user's facial image data using feature extraction means 54, and stores the extracted features of the user's facial image in each of the servers 56, 58, and 60 in association with the user's identification information and imaging units 30A, 30B, and 30C using registration means 53.

[0076] Furthermore, information related to the features of the user's facial image stored in each server 56, 58, 60 is transmitted from each server 56, 58, 60 to the corresponding imaging unit 30A, 30B, 30C. As a result, when authenticating a user in each imaging unit 30A, 30B, 30C, the imaging units 38A, 38B, 38C capture an image of the user to obtain facial image data of the user, and feature extraction means 34A, 34B, 34C extract features of the user's facial image based on the obtained facial image data, thereby enabling each imaging unit 30A, 30B, 30C to authenticate the user. Thereafter, the processors 32A, 32B, 32C of the imaging units 30A, 30B, 30C transmit information related to the service usage status to the authentication system 10. As a result, information related to the service usage status at each service provider in the authentication system 50 is stored in each server 56, 58, 60 for each user.

[0077] Another method for authenticating a user involves capturing an image of the user using the imaging units 38A, 38B, and 38C to acquire facial image data of the user, and then extracting features of the user's facial image using feature extraction means 34A, 34B, and 34C based on the acquired facial image data. Information related to the features of the user's facial image is then transmitted from each imaging unit 30A, 30B, and 30C to authentication system 50. This allows user authentication to be performed by authentication means 55. The authentication system 50 then transmits the user authentication result to the original imaging units 30A, 30B, and 30C.

[0078] As another method for authenticating a user, when authenticating a user in each of the imaging units 30A, 30B, and 30C, the imaging units 38A, 38B, and 38C capture an image of the user to obtain facial image data of the user. The facial image data of the user is then transmitted from each of the imaging units 30A, 30B, and 30C to the authentication system 50. The processor 52 then extracts features of the user's facial image based on the user's facial image data transmitted to each of the servers 56, 58, and 60 using feature extraction means 54, and compares the extracted features of the user's facial image with the features of the user's facial image stored in each of the servers 56, 58, and 60 using authentication means 55. This allows the authentication means 55 to authenticate the user. The authentication system 50 then transmits the user authentication result to the original imaging units 30A, 30B, and 30C.

[0079] According to these authentication methods, face authentication can be easily performed using a plurality of imaging units 30A, 30B, and 30C.

[0080] In addition, in the authentication system 10 shown in Figures 1, 4, 7, etc., the processor 12 may store in the memory 16 the user's facial image data itself transmitted from the user terminal 20 and each imaging unit 30A, 30B, 30C.

[0081] Furthermore, in the above example, the authentication systems 10 and 50 are installed separately from the imaging units 30A, 30B, and 30C installed at each service facility, but one of the imaging units 30A, 30B, and 30C installed at each service facility may also have the functions of the authentication systems 10 and 50. In other words, the processor of one of the imaging units 30A, 30B, and 30C installed at each service facility may have feature extraction means, registration means, and authentication means that have functions equivalent to the feature extraction means 14, registration means 13, and authentication means 15 in the processor 12 of the authentication system 10 shown in Figures 1, 4, 7, etc.

[0082] As yet another example, the authentication system 10 may perform two-stage user authentication (two-factor authentication) by using features of the user's facial image extracted from the user's facial image data (specifically, for example, a hash value) and elements other than the features of the user's facial image (specifically, for example, a password entered into the user terminal 20 during user registration or identification information of the user terminal 20). In this case, the elements required for authentication may be combined depending on the security level required for the service facility's imaging units 30A, 30B, and 30C.

[0083] In the above description, when a user uses the user terminal 20 to register facial image data in the authentication system 10, the user enters registration information such as name, date of birth, telephone number, email address, and password on a user registration screen, checks a box indicating agreement to the terms of use, and then presses a registration button. When the user captures a facial image using the user terminal 20 on the imaging screen, the various information entered on the user registration screen and the user's facial image data are transmitted from the user terminal 20 to the authentication system 10. The processor 12 then issues a user ID as user identification information and stores the issued user ID in the memory 16. However, this embodiment is not limited to this configuration. In another configuration, the feature amount (specifically, for example, a hash value) of the user's facial image extracted from the user's facial image data by the feature amount extraction means 14 for each of the imaging units 30A, 30B, and 30C may be used as the user ID. In this case, the user ID (i.e., hash value) is different for each of the imaging units 30A, 30B, and 30C, but the processor 12 of the authentication system 10 links the different user IDs for the same user's imaging units 30A, 30B, and 30C to each other.

[0084] Furthermore, the processor 12 of the authentication system 10 may link a user ID issued as user identification information after receiving various information entered on the user registration screen and the user's facial image data with a user ID (user identification information) used in the authentication engine 30D of various service providers that perform authentication other than facial authentication. That is, the authentication system 10 may further include linking means 19 that links a user ID (user identification information) used in the authentication engine 30D of the service providers that perform authentication other than facial authentication with a user ID (user identification information) related to features of the user's facial image stored in the memory 16. Specifically, the user ID used in the authentication engine 30D of various service providers that perform authentication other than facial authentication may be identification information of a user terminal 20 such as a smartphone owned by the user, user identification information (e.g., a hash value) obtained from biometric information such as the user's fingerprint information or vein information, a several-digit code (specifically, for example, a combination of numbers and Roman letters) or a password entered by the user into the user terminal 20 such as a smartphone. In this case, when a user is authenticated by the authentication engine 30D of various service providers that perform authentication other than facial authentication, a user ID based on the user's facial image data obtained by capturing a facial image with the user terminal (specifically, a hash value extracted from the facial image data) can be used instead, thereby improving convenience for the user. Furthermore, even after linking by the linking means 19, the user ID used by the authentication engine 30D of the service provider may remain. In this case, the user can be appropriately authenticated even when the authentication engine 30D of the service provider performs user authentication on a stand-alone basis without using the authentication system 10, which is a cloud.

[0085] Furthermore, different levels of authentication strength may be set depending on the type of service facility. Specifically, for example, when a locking system in an office building or home where a user works is used as the authentication engine of a service facility, a so-called smart lock is used, in which the door is unlocked based on the identification information of a user terminal 20 such as a smartphone. Specifically, by simply bringing the user terminal 20 close to the door of the locking system in the office building or home where the user works or a receiving device installed nearby, the identification information of the user terminal 20 is read using Bluetooth (registered trademark) functionality, or when the user inputs a command to unlock the door using a smart lock app installed on the user terminal 20, the user is authenticated based on the identification information of the user terminal 20. Once the user is authenticated as a pre-registered user, the door to the office building or home where the user works is unlocked. On the other hand, when a transfer system or a payment system for a financial institution's account is used as the authentication engine of a service facility, facial authentication is required when logging in to the financial institution service or payment service on the user terminal 20. Furthermore, when transferring money to an account or making a payment, authentication via SMS (Short Message Service) or password entry is required in addition to facial authentication. In this way, by varying the strength of user ID authentication depending on the application, it is possible to improve user convenience by lowering the authentication strength for authentication engines of frequently used service providers, and to improve security by increasing the authentication strength for authentication engines of service providers that handle money, etc.

[0086] Furthermore, the user may be able to add or delete service providers that perform authentication other than facial authentication, in addition to service providers related to facial authentication, on a screen such as that shown in Fig. 13 using the user terminal 20. That is, in addition to a list of service providers related to facial authentication, a list of service providers that perform authentication other than facial authentication is also registered in advance in the authentication system 10. Then, when the user registers an unregistered service on the screen of the user terminal 20 as shown in Fig. 13, a user ID to be used in the authentication engine of the newly registered service provider is stored in the memory 16. At this time, the user IDs of other service providers already stored in the memory 16 are linked by the linking means 19 to the user ID to be used in the authentication engine of the newly registered service provider (for example, identification information of the user terminal 20, a several-digit code or password entered by the user when registering a new service provider, etc.). In this case, when a service provider that performs authentication other than facial authentication is newly registered, when the user authenticates using the authentication engine of this service provider, a user ID based on the user's facial image data obtained by capturing a facial image with the user terminal (specifically, a hash value extracted from the facial image data) can be used instead, thereby improving convenience for the user. Also, on the screen shown in FIG. 13, if a service provider that performs authentication other than facial authentication has been registered, this registered service can be deleted. In this case, the registered service becomes an unregistered service. Also, the user ID stored in memory 16 and corresponding to the authentication engine of the service provider related to the deleted registered service is deleted.

[0087] According to the authentication system 10 of the above aspect, the authentication system 10 shown in FIGS. 4 to 6 and the authentication system 10 shown in FIGS. 7 to 9 include: information acquisition means 17 that, at the time of user registration, receives facial image data of a user from a user terminal, extracts features of the user's facial image based on the received facial image data of the user, and stores information related to the extracted features of the user's facial image in memory 16 as user identification information; authentication means 15 that, at the time of user authentication, authenticates a user by comparing the features of the user's facial image extracted from the user's facial image data received from imaging units 30A, 30B, and 30C of the service facility or the features of the user's facial image received from imaging units 30A, 30B, and 30C with the features of the user's facial image stored in memory 16; and linking means 19 that links the user's identification information used in authentication engine 30D of the service facility that performs authentication other than facial authentication with the user's identification information related to the features of the user's facial image stored in memory 16. According to such an authentication system 10, convenience can be improved by using the registered facial image data (specifically, the feature amounts of the user's facial image) in the authentication engine 30D that performs authentication other than facial authentication.

[0088] 1 to 3, the authentication system 10 includes an information acquisition means 17 that receives facial image data of a user from a user terminal at the time of user registration, extracts features of the user's facial image based on the received facial image data of the user, and stores information related to the extracted features of the user's facial image in memory 16 as user identification information, a communication unit 18 that serves as a transmission means for transmitting information related to the features of the user's facial image stored in memory 16 to the imaging units 30A, 30B, and 30C of each service facility so that the imaging units 30A, 30B, and 30C of each service facility perform authentication based on the user's facial image, and a linking means 19 that links the user's identification information used in an authentication engine 30D of a service facility that performs authentication other than facial authentication with the user's identification information related to the features of the user's facial image stored in memory 16. Even in this authentication system 10, convenience can be improved by using the registered facial image data (specifically, the features of the user's facial image) in the authentication engine 30D that performs authentication other than facial authentication.

[0089] Furthermore, in the authentication system 10 of this embodiment, the user identification information used in the authentication engine 30D of the service provider that performs authentication other than facial authentication includes at least one of the group consisting of identification information of the user terminal held by the user, information obtained from biometric information other than the user's face, and a code or password entered by the user into the user terminal.

[0090] Furthermore, in the authentication system 10 of this embodiment, when an instruction to add a service institution's authentication engine is received from a user terminal, the linking means 19 links the user's identification information used for authentication by the added service institution's authentication engine with the user's identification information related to the features of the user's facial image stored in the memory 16.

[0091] Furthermore, in the authentication system 10 of this embodiment, even after the linking of the user's identification information by the linking means 19, the user's identification information used in the authentication engine of each service facility remains as is.

[0092] 4 to 6 and the information processing method by the authentication system 10 shown in FIGS. 7 to 9 include the steps of: receiving, at the time of user registration, facial image data of the user from the user terminal 20; extracting features of the user's facial image based on the received facial image data of the user; and storing information relating to the extracted features of the user's facial image in memory 16 as user identification information; and, at the time of user authentication, authenticating the user by comparing the features of the user's facial image extracted from the user's facial image data received from the imaging units 30A, 30B, and 30C of the service facility or the features of the user's facial image received from the imaging units 30A, 30B, and 30C of the service facility with the features of the user's facial image stored in memory 16; and linking the user identification information used in the authentication engine 30D of the service facility that performs authentication other than facial authentication with the user identification information relating to the features of the user's facial image stored in memory 16. According to such an information processing method, the registered face image data (specifically, the feature amount of the user's face image) can be used in the authentication engine 30D that performs authentication other than face authentication, thereby improving convenience.

[0093] 1 to 3 includes the steps of: receiving, at the time of user registration, facial image data of a user from a user terminal 20, extracting features of the user's facial image based on the received facial image data of the user, and storing information relating to the extracted features of the user's facial image in memory 16 as user identification information; transmitting the information relating to the features of the user's facial image stored in memory 16 to the imaging units 30A, 30B, and 30C of each service facility so that the imaging units 30A, 30B, and 30C of each service facility perform authentication based on the user's facial image; and linking the user identification information used in an authentication engine 30D of a service facility that performs authentication other than facial authentication with the user identification information relating to the features of the user's facial image stored in memory 16. Even in this information processing method, convenience can be improved by using the registered facial image data (specifically, the features of the user's facial image) in the authentication engine 30D that performs authentication other than facial authentication.

[0094] As yet another example, an authentication system 10 shown in Fig. 17 may be used. In the authentication system 10 and the imaging units 30A, 30B, and 30C shown in Fig. 17, the same components as those in the authentication system 10 and the imaging units 30A, 30B, and 30C shown in Figs. 1, 4, and 7 are designated by the same reference numerals, and their description will be omitted.

[0095] As shown in FIG. 17, the processor 12 of the authentication system 10 includes a registration unit 13 that registers facial image data received from the user terminal 20 and an authentication unit 15 that authenticates the user based on the facial image data of the user captured by the imaging units 38A-38C of each of the imaging units 30A, 30B, and 30C. The processor 12 executes a program stored in the memory 16 to store the facial image data of the user registered in the registration unit 13 in the memory 16 in association with the user's identification information and the identification information of the imaging units 30A, 30B, and 30C. The processor 12 also executes the program stored in the memory 16 to cause the authentication unit 15 to compare the facial image data of the user captured by the imaging units 38A-38C of each of the imaging units 30A, 30B, and 30C with the facial image data of the user stored in the memory 16, thereby authenticating the user. Note that the programs executed by the processor 12 are not limited to those stored in the memory 16. The processor 12 may execute a program transmitted to the authentication system 10 from an external device or a program stored in a recording medium detachably attached to the authentication system 10, thereby performing processing in each of the registration means 13 and the authentication means 15. In this embodiment, the registration means 13 constitutes the information acquisition means 17. When registering a user, the information acquisition means 17 receives facial image data of the user and stores the received facial image data of the user in the memory 16 as the user's identification information.

[0096] Each of the imaging units 30A, 30B, 30C placed in each service facility is composed of, for example, a computer, and each imaging unit 30A, 30B, 30C has a processor 32A, 32B, 32C such as a CPU, a memory 36A, 36B, 36C, an imaging unit 38A, 38B, 38C, a processing unit 40A, 40B, 40C, and a communication unit 42A, 42B, 42C.

[0097] 17, the authentication system 10 and the imaging units 30A, 30B, and 30C located at each service facility are linked via an API (Application Programming Interface), which makes it easier to configure the systems for each of the imaging units 30A, 30B, and 30C than if each system were configured independently.

[0098] Next, a brief description will be given of the processing performed when authenticating a user using the authentication system 10 and the imaging units 30A, 30B, and 30C as shown in FIG.

[0099] First, a process in which a user registers facial image data in the authentication system 10 using the user terminal 20 will be described. Note that a specific method for the user to capture a facial image using the user terminal 20 has already been described, and will therefore not be described here. When a user first registers using such a facial authentication app on the user terminal 20, various information entered on the user registration screen and the user's facial image data are transmitted from the user terminal 20 to the authentication system 10. In this manner, the processor 12 of the authentication system 10 receives the facial image data from the user terminal 20. The processor 12 of the authentication system 10 also receives, from the user terminal 20, identification information for the user terminal 20 and registration information such as the user's name, date of birth, telephone number, email address, and password entered into the user terminal 20. The processor 12 also issues a user ID as identification information for the user and stores the issued user ID in the memory 16.

[0100] Next, the processor 12 of the authentication system 10 causes the registration means 13 to store the facial image data received from the user terminal 20 in the memory 16 of the authentication system 10 in association with the user ID (user identification information) and the identification information of the imaging units 30A, 30B, and 30C. In this manner, the registration of the user's facial image captured by the user terminal 20 is completed. Note that in the example shown in Fig. 17, the user's facial image data stored in the memory 16 is not transmitted from the authentication system 10 to the imaging units 30A, 30B, and 30C of the service facility selected by the user.

[0101] Next, a process for authenticating a user in each of the imaging units 30A, 30B, and 30C will be described. When user authentication is required at a service facility where each of the imaging units 30A, 30B, and 30C is installed, the imaging units 38A, 38B, and 38C of the imaging units 30A, 30B, and 30C first capture images of the user to obtain facial image data of the user. The processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C then transmit the facial image data of the user captured by the imaging units 38A, 38B, and 38C to the processor 12 of the authentication system 10 via the communication units 42A, 42B, and 42C. When the processor 12 of the authentication system 10 receives the facial image data of the user from the imaging units 30A, 30B, and 30C, it only receives the facial image data of the user transmitted from the imaging units 30A, 30B, and 30C of the service facility selected by the user, which is stored in the memory 16. In the authentication system 10, the processor 12 authenticates the user by comparing the facial image data received from the imaging units 30A, 30B, and 30C with the user's facial image data stored in the memory 16 using the authentication means 15. More specifically, if the matching rate between the user's facial image data received from the imaging units 30A, 30B, and 30C and the user's facial image data stored in the memory 16 exceeds a predetermined threshold (e.g., 80%), the authentication means 15 authenticates the user. As described above, the memory 16 stores pre-registered user identification information and identification information of the imaging units 30A, 30B, and 30C in association with the user's facial image data.

[0102] When the authentication means 15 authenticates the user, information related to the authentication result is transmitted from the processor 12 of the authentication system 10 to the imaging units 30A, 30B, and 30C via the communication unit 18. The processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C that have received the information related to the authentication result then enable the respective processing units 40A, 40B, and 40C to implement the services corresponding to the imaging units 30A, 30B, and 30C. The processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C then transmit information related to the usage status of the services to the authentication system 10. As a result, information related to the usage status of services at each service provider is stored in the memory 16 for each user in the authentication system 10.

[0103] On the other hand, if the user's facial image data received from the imaging units 30A, 30B, and 30C does not substantially match the user's facial image data stored in the memory 16 and the authentication means 15 is unable to authenticate the user, information related to the authentication result is also transmitted from the processor 12 of the authentication system 10 to the imaging units 30A, 30B, and 30C via the communication unit 18 (STEP 58). Then, upon receiving the information related to the authentication result, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C disable the service corresponding to the imaging units 30A, 30B, and 30C via their respective processing units 40A, 40B, and 40C. In this case, the processors 32A, 32B, and 32C of the imaging units 30A, 30B, and 30C also transmit information related to the service usage status (specifically, information that the user attempted to perform authentication using the imaging units 30A, 30B, and 30C but was not authenticated and was therefore unable to use the service) to the authentication system 10.

[0104] According to this authentication method, even if a user's facial image data is registered in an authentication engine (e.g., imaging unit 30A) of one service facility but not in an authentication engine (e.g., imaging unit 30B) of another service facility, by storing the user's facial image data in memory 16 of authentication system 10, the user can be authenticated by capturing the user's facial image with an imaging unit even at a service facility where the user's facial image data is not registered. In this case, the user does not need to register facial image data in all of the multiple authentication engines, thereby saving the user time and effort.

[0105] 17 also has a linking means 19. The linking means 19 links the user identification information used in the authentication engine 30D of the service provider that performs authentication other than facial authentication with the user identification information related to the user's facial image data stored in the memory 16. According to this authentication system 10, the registered facial image data (specifically, the user's facial image data) can be used in the authentication engine 30D that performs authentication other than facial authentication, thereby improving convenience.

[0106] In a further modification, in the authentication system 10 shown in FIGS. 1 to 3, the authentication means 35A, 35B, and 35C of each imaging unit 30A, 30B, and 30C may authenticate a user using the user's facial image data rather than the feature values ​​of the user's facial image. In this case, the user's facial image data registered in the authentication system 10 is transmitted to each imaging unit 30A, 30B, and 30C. In this case, the linking means 19 of the authentication system 10 shown in FIGS. 1 to 3 links the user's identification information used in the authentication engine 30D of a service provider that performs authentication other than facial authentication with the user's identification information related to the user's facial image data stored in the memory 16. Even in this authentication system 10, convenience can be improved by using the registered facial image data (specifically, the feature values ​​of the user's facial image) in the authentication engine 30D that performs authentication other than facial authentication. [Explanation of symbols]

[0107] 10 Authentication System 12 processors 13 Registration Method 14 Feature extraction method 15 Authentication Methods 16 memory 17 Information acquisition means 18 Communications Department 19 Linking Methods 20 User terminal 30A, 30B, 30C imaging unit 30D Authentication Engine 32A, 32B, and 32C processors 34A, 34B, 34C Feature extraction means 35A, 35B, 35C Authentication Methods 36A, 36B, 36C Memory 38A, 38B, 38C Imaging unit 40A, 40B, 40C Processing section 42A, 42B, 42C Communication Department 50 Authentication System 52 processors 52a Server Management Methods 53 Registration Method 54 Feature extraction method 55 Authentication Methods 56 First Server 58 Second Server 60 Third Server

Claims

1. An information processing method performed by a face authentication system, A step of registering a list of service providers in advance; receiving, from the user terminal, face image data of a user captured by the user terminal when the user is registered by a face recognition application installed in the user terminal; extracting features of the user's facial image based on the received facial image data of the user; storing the extracted feature amount of the user's face image in a memory in association with the user's identification information; receiving information on a service provider to be added from the user terminal by a user selecting the service provider from a list of service providers preregistered in the face recognition application installed in the user terminal, and storing the service provider selected by the user in the memory in association with the user's identification information; Equipped with An information processing method, wherein the feature quantities of the user's facial image stored in the memory are transmitted only to an authentication engine of a service provider selected by the user.

2. An information processing method performed by a face authentication system, A step of registering a list of service providers in advance; receiving, from the user terminal, face image data of a user captured by the user terminal when the user is registered by a face recognition application installed in the user terminal; extracting features of the user's facial image based on the received facial image data of the user; storing the extracted feature amount of the user's face image in a memory in association with the user's identification information; receiving a feature amount of a facial image of a user from an authentication engine; a step of authenticating a user by comparing a feature amount of the received face image of the user with a feature amount of a face image of the user associated with the user's identification information stored in the memory; transmitting information related to the authentication result of the user to the authentication engine to which the feature amount of the user's face image was transmitted; receiving information on a service provider to be added from the user terminal by a user selecting the service provider from a list of service providers preregistered in the face recognition application installed in the user terminal, and storing the service provider selected by the user in the memory in association with the user's identification information; Equipped with The memory stores information related to a service provider selected by a user in association with the user's identification information; When receiving features of a user's facial image from the authentication engine, the information processing method receives features of the user's facial image transmitted only from an authentication engine of a service provider selected by the user and stored in the memory.

3. An information processing method performed by a face authentication system, A step of registering a list of service providers in advance; accepting facial image data of a user; extracting features of the user's facial image based on the received facial image data of the user; storing the extracted feature amount of the user's face image in a memory in association with the user's identification information; receiving facial image data of a user from an authentication engine; extracting features of a user's facial image corresponding to the authentication engine to which the user's facial image data has been sent based on the received user's facial image data; performing user authentication by comparing the extracted facial image feature of the user with the facial image feature of the user associated with the user's identification information stored in the memory; sending information related to the authentication result of the user to the authentication engine from which the user's face image data was received; receiving information on a service provider to be added from the user terminal when the service provider is selected by the user from a list of service providers preregistered in a face recognition application installed in the user terminal, and storing the service provider selected by the user in the memory in association with the user's identification information; Equipped with The memory stores information related to a service provider selected by a user in association with the user's identification information; When receiving information related to the user's facial image data from the authentication engine, the information processing method receives the user's facial image data transmitted only from the authentication engine of a service provider selected by the user and stored in the memory.

4. A program for performing an information processing method by a face recognition system, the program being executed by a processor, When the processor executes the program, A step of registering a list of service providers in advance; receiving, from the user terminal, face image data of a user captured by the user terminal when the user is registered by a face recognition application installed in the user terminal; extracting features of the user's facial image based on the received facial image data of the user; storing the extracted feature amount of the user's face image in a memory in association with the user's identification information; receiving information on a service provider to be added from the user terminal by a user selecting the service provider from a list of service providers preregistered in the face recognition application installed in the user terminal, and storing the service provider selected by the user in the memory in association with the user's identification information; is executed, The program transmits the features of the user's facial image stored in the memory only to an authentication engine of a service provider selected by the user.

5. A program for performing an information processing method by a face recognition system, the program being executed by a processor, When the processor executes the program, A step of registering a list of service providers in advance; receiving, from the user terminal, face image data of a user captured by the user terminal when the user is registered by a face recognition application installed in the user terminal; extracting features of the user's facial image based on the received facial image data of the user; storing the extracted feature amount of the user's face image in a memory in association with the user's identification information; receiving a feature amount of a facial image of a user from an authentication engine; a step of authenticating a user by comparing a feature amount of the received facial image of the user with a feature amount of a facial image of the user associated with the user's identification information stored in the memory; transmitting information related to the authentication result of the user to the authentication engine to which the feature amount of the user's face image was transmitted; receiving information on a service provider to be added from the user terminal by a user selecting the service provider from a list of service providers preregistered in the face recognition application installed in the user terminal, and storing the service provider selected by the user in the memory in association with the user's identification information; is executed, The memory stores information related to a service provider selected by a user in association with the user's identification information; When receiving the feature amounts of the user's facial image from the authentication engine, the program receives the feature amounts of the user's facial image transmitted only from the authentication engine of the service provider selected by the user and stored in the memory.

6. A program for performing an information processing method by a face recognition system, the program being executed by a processor, When the processor executes the program, A step of registering a list of service providers in advance; accepting facial image data of a user; extracting features of the user's facial image based on the received facial image data of the user; storing the extracted feature amount of the user's face image in a memory in association with the user's identification information; receiving facial image data of a user from an authentication engine; extracting features of a user's facial image corresponding to the authentication engine to which the user's facial image data has been sent based on the received user's facial image data; performing user authentication by comparing the extracted facial image feature of the user with the facial image feature of the user associated with the user's identification information stored in the memory; sending information related to the authentication result of the user to the authentication engine from which the user's face image data was received; receiving information on a service provider to be added from the user terminal when the service provider is selected by the user from a list of service providers preregistered in a face recognition application installed in the user terminal, and storing the service provider selected by the user in the memory in association with the user's identification information; is executed, The memory stores information related to a service provider selected by a user in association with the user's identification information; When receiving information related to the user's facial image data from the authentication engine, the program receives the user's facial image data transmitted only from the authentication engine of the service provider selected by the user and stored in the memory.

7. An information processing system including a processor, When the processor executes the program, A step of registering a list of service providers in advance; receiving, from the user terminal, face image data of a user captured by the user terminal when the user is registered by a face recognition application installed in the user terminal; extracting features of the user's facial image based on the received facial image data of the user; storing the extracted feature amount of the user's face image in a memory in association with the user's identification information; receiving information on a service provider to be added from the user terminal by a user selecting the service provider from a list of service providers preregistered in the face recognition application installed in the user terminal, and storing the service provider selected by the user in the memory in association with the user's identification information; is executed, The information processing system transmits the features of the user's facial image stored in the memory only to an authentication engine of a service provider selected by the user.

8. An information processing system including a processor, When the processor executes the program, A step of registering a list of service providers in advance; receiving, from the user terminal, face image data of a user captured by the user terminal when the user is registered by a face recognition application installed in the user terminal; extracting features of the user's facial image based on the received facial image data of the user; storing the extracted feature amount of the user's face image in a memory in association with the user's identification information; receiving a feature amount of a facial image of a user from an authentication engine; a step of authenticating a user by comparing a feature amount of the received face image of the user with a feature amount of a face image of the user associated with the user's identification information stored in the memory; transmitting information related to the authentication result of the user to the authentication engine to which the feature amount of the user's face image was transmitted; receiving information on a service provider to be added from the user terminal by a user selecting the service provider from a list of service providers preregistered in the face recognition application installed in the user terminal, and storing the service provider selected by the user in the memory in association with the user's identification information; is executed, The memory stores information related to a service provider selected by a user in association with the user's identification information; When receiving the features of the user's facial image from the authentication engine, the information processing system receives the features of the user's facial image transmitted only from the authentication engine of the service provider selected by the user and stored in the memory.

9. An information processing system including a processor, When the processor executes the program, A step of registering a list of service providers in advance; accepting facial image data of a user; extracting features of the user's facial image based on the received facial image data of the user; storing the extracted feature amount of the user's face image in a memory in association with the user's identification information; receiving facial image data of a user from an authentication engine; extracting features of a user's facial image corresponding to the authentication engine to which the user's facial image data has been sent based on the received user's facial image data; performing user authentication by comparing the extracted facial image feature of the user with the facial image feature of the user associated with the user's identification information stored in the memory; sending information related to the authentication result of the user to the authentication engine from which the user's face image data was received; receiving information on a service provider to be added from the user terminal when the service provider is selected by the user from a list of service providers preregistered in a face recognition application installed in the user terminal, and storing the service provider selected by the user in the memory in association with the user's identification information; is executed, The memory stores information related to a service provider selected by a user in association with the user's identification information; When receiving information related to the user's facial image data from the authentication engine, the information processing system receives the user's facial image data transmitted only from the authentication engine of a service provider selected by the user and stored in the memory.

Citation Information

Patent Citations

  • System and method for managing commercial service utilization

    JP2002041470A

  • Method and device for data authentication

    JP2003044442A

  • Personal authentication system

    JP2006072540A

  • Service providing system, device and request processing method on counter side, and device and request processing method on service providing side

    JP2007233690A

  • Biometric authentication method and system

    JP2010165323A