Authentication information registration device, authentication information registration method, and authentication information registration system

Abstract

In the present invention, an authentication information registration device comprises: an acquisition unit that acquires first authentication information used for first authentication of a person to be authenticated and second authentication information used for second authentication different from the first authentication; an authentication unit that authenticates the person to be authenticated on the basis of the acquired first authentication information; and a registration unit that, on the basis of the first authentication result, outputs the information on the person to be authenticated and the second authentication information in association with each other and registers the resulting information in a storage device.

Description

Authentication information registration device, authentication information registration method, and authentication information registration system

[0001] The present disclosure relates to an authentication information registration device, an authentication information registration method, and an authentication information registration system.

[0002] Patent Literature 1 discloses a method for authenticating a user by determining a multi-factor password in which multiple factors, including multiple factors selected by a user, correspond to different types of information used to authenticate the user. The multi-factor password is authenticated based on the authentication results of each of the multiple factors and the authentication order of the selected factors, and at least one of the factors selected by the user belongs to a different category from the other factors.

[0003] Japanese Patent Application Publication No. 2016-42376

[0004] In recent years, the use of authentication using photographs (facial images) of people's faces has been increasing in various indoor and outdoor locations. However, when a device takes a photograph in an environment where a person's face is irradiated with sunlight or other lighting, where the person's face is backlit, or in a low-light environment such as at night or on a rainy day, the person's face in the photograph may appear overexposed or backlit, and the facial features of the person used for authentication may not be captured.

[0005] The present disclosure has been devised in view of the above-described conventional circumstances, and aims to provide an authentication information registration device, an authentication information registration method, and an authentication information registration system that acquire authentication data used for multiple different authentications.

[0006] The present disclosure provides an authentication information registration device including: an acquisition unit that acquires first authentication information used for a first authentication of a person to be authenticated and second authentication information used for a second authentication different from the first authentication; an authentication unit that authenticates the person to be authenticated based on the acquired first authentication information; and a registration unit that outputs information about the person to be authenticated and the second authentication information in association with each other based on a result of the first authentication, and registers the information in a storage device.

[0007] The present disclosure also provides an authentication information registration method performed by a registration device that registers authentication information used for authenticating a person to be authenticated, the authentication information registration method including an acquisition unit that acquires first authentication information used for a first authentication of the person to be authenticated and second authentication information used for a second authentication different from the first authentication, an authentication unit that authenticates the person to be authenticated based on the acquired first authentication information, and an authentication unit that associates information about the person to be authenticated with the second authentication information based on a result of the first authentication, outputs the information to a storage device, and registers it.

[0008] The present disclosure also provides an authentication information registration system comprising: a first authentication information acquisition device capable of acquiring first authentication information used for a first authentication of a person to be authenticated; a second authentication information acquisition device that acquires second authentication information used for a second authentication different from the first authentication; a storage device that records information of the person to be authenticated and the second authentication information used for the second authentication; and a registration device capable of communicating between the first authentication information acquisition device, the second authentication information acquisition device, and the storage device, wherein the registration device acquires the first authentication information and the second authentication information, authenticates the person to be authenticated based on the acquired first authentication information, and, based on the result of the first authentication, associates the information of the person to be authenticated with the second authentication information, outputs the associated information to the storage device, and registers it.

[0009] According to the present disclosure, authentication data that can be used for a plurality of different authentications can be obtained.

[0010] Block diagram illustrating an example of the internal configuration of an authentication system according to embodiment 1. Sequence diagram illustrating an example of the operation procedure of the authentication system according to embodiment 1. Sequence diagram illustrating an example of the operation procedure of the authentication system according to embodiment 1. Block diagram illustrating an example of the internal configuration of an authentication system according to embodiment 2. Sequence diagram illustrating an example of the operation procedure of the authentication system according to embodiment 2. Block diagram illustrating an example of the internal configuration of an authentication system according to embodiment 3. Sequence diagram illustrating an example of the operation procedure of the authentication system according to embodiment 3. Block diagram illustrating an example of the internal configuration of an authentication system according to embodiment 4. Sequence diagram illustrating an example of the operation procedure of the authentication system according to embodiment 4. Sequence diagram illustrating an example of the operation procedure of the authentication system according to embodiment 4.

[0011] Hereinafter, with reference to the drawings as appropriate, detailed descriptions will be given of embodiments that specifically disclose the configurations and operations of an authentication information registration device, authentication information registration method, and authentication information registration system according to the present disclosure. However, more detailed descriptions than necessary may be omitted. For example, detailed descriptions of well-known matters or redundant descriptions of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter recited in the claims.

[0012] Each of the authentication systems 100, 100A, 100B, and 100C described in the present disclosure enables multi-factor authentication or multi-modal authentication using multiple pieces of personal identification information by acquiring and registering new authentication data to authenticate a user when the user's identity is confirmed through user authentication (personal authentication) using the user's pre-registered biometric information (in the present disclosure, a facial image is used as an example).

[0013] The new authentication data referred to here may be, for example, biometric information such as fingerprints, veins, palm prints, voice or irises; knowledge information (memorized information) such as a personal identification number, PIN code or secret question; or possession information such as an employee ID card number, smartphone, IC card, credit card, cash card, driver's license or insurance card.

[0014] (Embodiment 1) An authentication system 100 (an example of an authentication information registration system) according to embodiment 1 will be described with reference to Fig. 1. Fig. 1 is a block diagram illustrating an example of the internal configuration of authentication system 100 according to embodiment 1.

[0015] In the following description of the first embodiment, an example will be described in which a fingerprint image of a user is acquired and registered as new authentication data for the user.

[0016] The authentication system 100 includes a first imaging device C1 (an example of a first authentication information acquisition device), a second imaging device C2 (an example of a second authentication information acquisition device), an authentication device P1 (an example of a registration device), a face authentication server S1, and a fingerprint authentication server S2 (an example of a storage device). Note that the authentication system 100 shown in FIG. 1 is merely an example and is not limited thereto. The authentication system 100 may be configured to include any device capable of acquiring new authentication data to be registered. The authentication system 100 may be a second imaging device C2 capable of capturing an image of a user's fingers as a device capable of acquiring a fingerprint image, or may be a sensor device capable of sensing a user's fingerprint. The face authentication server S1 and the fingerprint authentication server S2 may be realized by a single device.

[0017] Furthermore, for example, the authentication system 100 may include a network. The authentication device P1 and the face authentication server S1 may be connected via the network so as to be able to transmit and receive data, or may be integrated into a single device or server. The registered face image database DB1 or the registered fingerprint image database DB2 may be configured separately from the face authentication server S1.

[0018] The first imaging device C1 is controlled by the authentication device P1 to capture an image of an area including the user's face and obtain a first captured image (visible image) of the user to be used for authentication. The first imaging device C1 includes a first camera 10.

[0019] The first camera 10 is configured with at least an image sensor (not shown) and a lens (not shown). The image sensor is a solid-state imaging element including a Si photodiode and, for example, a charged-coupled device (hereinafter referred to as "CCD") or a complementary metal oxide semiconductor (hereinafter referred to as "CMOS"), and converts an optical image formed on the imaging surface using visible light into an electrical signal. The first camera 10 transmits the converted electrical signal (data of the first captured image) to the authentication device P1.

[0020] The second imaging device C2 is controlled by the authentication device P1 to capture an image of the area including the user's fingers and obtain a second captured image of the user to be used for authentication. The second imaging device C2 includes a second camera 11.

[0021] The second camera 11 is configured with at least an image sensor (not shown) and a lens (not shown). The image sensor is a solid-state imaging element including a Si photodiode and, for example, a CCD or CMOS, and converts an optical image formed on the imaging surface by incident light into an electrical signal. The second camera 11 transmits the converted electrical signal (data of the second captured image) to the authentication device P1.

[0022] The authentication device P1 is realized by, for example, a personal computer (hereinafter referred to as "PC"), a notebook PC, a tablet terminal, a smartphone, etc., and performs authentication of a user who is the authentication target. The authentication device P1 includes a communication unit 30, a control unit 31, a memory 32, and a display unit 33.

[0023] The communication unit 30 (an example of an acquisition unit) is connected to the first camera 10 of the first imaging device C1, the second camera 11 of the second imaging device C2, the communication unit 40 of the face authentication server S1, and the communication unit 50 of the fingerprint authentication server S2, each of which can communicate wirelessly or via wired communication, and performs data transmission and reception.

[0024] The control unit 31 (an example of an authentication unit and a registration unit) is configured using, for example, a Central Processing Unit (hereinafter referred to as "CPU") or a Field Programmable Gate Array (hereinafter referred to as "FPGA"), and performs various processes and controls in cooperation with the memory 32. Specifically, the control unit 31 references the programs and data stored in the memory 32 and executes the programs to realize the functions of the authentication device P1.

[0025] The control unit 31 performs image analysis processing on the first captured image captured by the first camera 10 to detect the user's face appearing in the first captured image. The control unit 31 then cuts out an area including the detected user's face from the first captured image to generate a facial image. The control unit 31 then outputs the generated facial image to the communication unit 30, which then transmits the generated facial image to the facial authentication server S1.

[0026] The control unit 31 determines whether the user appearing in the facial image (first captured image) is a registered user who has been previously registered in the registered facial image database DB1 based on whether the facial recognition score sent from the facial recognition server S1 is equal to or greater than a first threshold value.

[0027] If the control unit 31 determines that the face authentication score is equal to or greater than the first threshold, it determines whether new authentication data is required for the user. If the control unit 31 determines that registration of new authentication data is required, it proceeds to a process of acquiring new authentication data (here, a fingerprint image), generates a control command to capture an image of the user's fingers, and transmits the control command to the second image capture device C2. On the other hand, if the control unit 31 determines that registration of new authentication data is not required, it proceeds to an authentication process using authentication data (here, a fingerprint image) that has already been registered and is other than a face image, generates a control command to capture an image of the user's fingers, and transmits the control command to the second image capture device C2.

[0028] In the process of acquiring new authentication data, the control unit 31 detects the first joint of at least one finger of the user from the second captured image transmitted from the second camera 11. The control unit 31 generates a fingerprint image by cutting out an area including the first joint of the detected finger from the second captured image, and calculates a quality score indicating the likelihood that the fingerprint image is suitable for fingerprint authentication. If the control unit 31 determines that the calculated quality score is equal to or greater than a second threshold, the control unit 31 associates the user ID identified by face authentication with the generated fingerprint image and transmits them to the fingerprint authentication server S2 for registration.

[0029] If the control unit 31 determines that the calculated quality score is not equal to or greater than the second threshold, it repeatedly captures the second captured image, calculates the quality score, and determines whether or not to register the fingerprint image based on the quality score. If the control unit 31 determines that authentication using the second captured image has occurred a predetermined number of times (e.g., three times, five times, etc.), it determines that it is difficult to obtain a fingerprint image suitable for fingerprint authentication, and determines that fingerprint registration has failed. The control unit 31 generates a registration failure screen (not shown) that notifies the user of the fingerprint registration failure, and outputs the screen to the display unit 33.

[0030] The memory 32 has, for example, a random access memory (hereinafter referred to as "RAM") as a work memory used when executing each process of the control unit 31, and a read only memory (hereinafter referred to as "ROM") that stores programs and data that define the operation of the control unit 31. The RAM temporarily stores data or information generated or acquired by the control unit 31. The ROM has written therein programs that define the operation of the control unit 31.

[0031] The display unit 33 may be configured using a display device such as a Liquid Crystal Display (hereinafter referred to as "LCD") or an organic electroluminescence (hereinafter referred to as "EL"), etc. The display unit 33 displays (outputs) a registration failure screen (not shown) output from the control unit 31.

[0032] The face authentication server S1 associates the face authentication score of the user appearing in the face image (first captured image) transmitted from the authentication device P1 with the user ID of the user corresponding to the face authentication score and transmits them to the authentication device P1. The face authentication server S1 includes a communication unit 40, a control unit 41, a memory 42, and a registered face image database DB1. Note that the registered face image database DB1 may be configured separately and may be connected to the face authentication server S1 so as to be able to communicate with it.

[0033] The communication unit 40 is connected to the authentication device P1 so as to be able to communicate wirelessly or via wired communication, and transmits and receives data to and from the authentication device P1. The communication unit 40 acquires data of the face image (first captured image) transmitted from the authentication device P1, and outputs the data to the control unit 41. The communication unit 40 associates the face recognition score information output from the control unit 41 with the user ID of the user corresponding to the face recognition score, and transmits the associated data to the authentication device P1.

[0034] The control unit 41 is configured using, for example, a CPU or FPGA, and performs various processes and controls in cooperation with the memory 42. Specifically, the control unit 41 references the programs and data stored in the memory 42 and executes the programs to realize the functions of the face authentication server S1.

[0035] The control unit 41 compares the acquired face image with a registered face image of at least one user registered in advance in the registered face image database DB1, and calculates (evaluates) a face recognition score, which is an index of whether the user appearing in the face image is the same person as the registered user. The control unit 41 extracts the user ID associated with the registered face image of the user with the highest calculated face recognition score. The control unit 41 associates the extracted user ID with information on the face recognition score, outputs it to the communication unit 40, and causes it to be transmitted to the authentication device P1.

[0036] The memory 42 includes, for example, a RAM as a work memory used when the control unit 41 executes each process, and a ROM for storing programs and data that define the operation of the control unit 41. The RAM temporarily stores data or information generated or acquired by the control unit 41. The ROM stores programs that define the operation of the control unit 41.

[0037] The registered face image database DB1 is a so-called storage device, and is configured using a storage medium such as a flash memory, a hard disk drive (hereinafter referred to as an "HDD"), or a solid state drive (hereinafter referred to as an "SSD"). The registered face image database DB1 stores (registers) registered face images of users in association with information about the users, such as a user ID. Note that the information about the users is not limited to the user ID, and may include, for example, the user's name, date of birth, age, gender, address, or telephone number.

[0038] The fingerprint authentication server S2 transmits the fingerprint authentication score of the fingerprint shown in the fingerprint image (second captured image) transmitted from the authentication device P1 to the authentication device P1. The fingerprint authentication server S2 includes a communication unit 50, a control unit 51, a memory 52, and a registered fingerprint image database DB2. The registered fingerprint image database DB2 may be configured as a separate entity and may be connected to the fingerprint authentication server S2 so as to be able to communicate with it.

[0039] The communication unit 50 is connected to the authentication device P1 so as to be able to communicate wirelessly or via wired communication, and transmits and receives data to and from the authentication device P1. The communication unit 50 acquires fingerprint image (first captured image) data transmitted from the authentication device P1, and outputs the data to the control unit 51. The communication unit 50 associates the fingerprint authentication score information output from the control unit 51 with the user ID of the user corresponding to the fingerprint authentication score, and transmits the information to the authentication device P1.

[0040] The control unit 51 is configured using, for example, a CPU or FPGA, and performs various processes and controls in cooperation with the memory 52. ​​Specifically, the control unit 51 references the programs and data stored in the memory 52 and executes the programs to realize the functions of the fingerprint authentication server S2.

[0041] The control unit 51 compares the acquired fingerprint image with a registered fingerprint image of at least one user that has been registered in advance in the registered fingerprint image database DB2, and calculates (evaluates) a fingerprint authentication score, which is an index of whether the fingerprint shown in the fingerprint image and the fingerprint in the registered fingerprint image belong to the same person. The control unit 51 outputs the calculated fingerprint authentication score to the communication unit 50, which then transmits it to the authentication device P1.

[0042] The memory 52 includes, for example, a RAM as a work memory used when the control unit 51 executes each process, and a ROM for storing programs and data that define the operation of the control unit 51. The RAM temporarily stores data or information generated or acquired by the control unit 51. The ROM stores programs that define the operation of the control unit 51.

[0043] The registered fingerprint image database DB2 is a so-called storage device, and is configured using a storage medium such as a flash memory, HDD, or SSD. The registered fingerprint image database DB2 stores (registers) registered fingerprint images of users in association with information about the users, such as user IDs. Note that the information about the users is not limited to user IDs, and may include, for example, the user's name, date of birth, age, gender, address, or telephone number.

[0044] Next, the authentication operation performed by authentication system 100 will be described with reference to Fig. 2 and Fig. 3. Fig. 2 is a sequence diagram showing an example of an operation procedure of authentication system 100 according to embodiment 1. Fig. 3 is a sequence diagram showing an example of an operation procedure of authentication system 100 according to embodiment 1. Note that the process of step St17 may be performed by authentication device P1.

[0045] The first imaging device C1 starts exposure of the first camera 10 (St11) based on a control command sent from the authentication device P1 instructing the start of imaging, and ends the exposure after a predetermined exposure time has elapsed (St12).

[0046] After the exposure (image capture) is completed, the first image capture device C1 acquires the first captured image captured by the user (St13), and transmits the data of the first captured image to the authentication device P1 (St14).

[0047] The authentication device P1 performs image analysis processing on the first captured image transmitted from the first imaging device C1 to detect the user's face, and determines whether the user's face is detected from the first captured image (St15).

[0048] If the authentication device P1 determines in the processing of step St15 that the user's face has been detected from the first captured image (St15, YES), it generates a facial image by cutting out the area containing the user's face from the first captured image and transmits it to the facial authentication server S1 (St16).

[0049] On the other hand, if the authentication device P1 determines in the processing of step St15 that the user's face is not detected from the first captured image (St15, NO), it returns to the processing of step St11 and re-images the user's face.

[0050] The face authentication server S1 compares the face image transmitted from the authentication device P1 with the registered face images of each of the multiple users registered in the registered face image database DB1, and calculates a face authentication score (St17). The face authentication server S1 extracts the user ID associated with the registered face image of the user with the highest calculated face authentication score, associates the extracted user ID with information on the face authentication score, and transmits them to the authentication device P1 (St18).

[0051] The authentication device P1 acquires the face recognition score and the user ID transmitted from the face recognition server S1, and determines whether the face recognition score is equal to or greater than a first threshold value (St19).

[0052] If, in the processing of step St19, the authentication device P1 determines that the facial authentication score sent from the facial authentication server S1 is equal to or greater than the first threshold (St19, YES), it generates a control command requesting an inquiry as to whether the user ID of the user corresponding to the facial image has been registered in the registered fingerprint image database DB2, and transmits the generated control command to the fingerprint authentication server S2 in association with the user ID (St20).

[0053] On the other hand, if the authentication device P1 determines in the processing of step St19 that the facial authentication score is not greater than or equal to the first threshold (St19, NO), it determines that the authentication is "NG" (i.e., failed), generates an authentication failure screen (not shown) to notify the user of the authentication failure, and outputs (displays) it on the display unit 33 (St21).

[0054] Based on the control command transmitted from the authentication device P1, the fingerprint authentication server S2 compares the user ID of at least one user registered in the registered fingerprint image database DB2 with the user ID transmitted from the authentication device P1 (St22). The fingerprint authentication server S2 generates a query result (registration query result) indicating whether the user ID transmitted from the authentication device P1 is a user ID registered in the registered fingerprint image database DB2, and transmits the query result to the authentication device P1 (St23).

[0055] Based on the result of the inquiry sent from the fingerprint authentication server S2, the authentication device P1 determines whether the user's fingerprint image has not been registered in the registered fingerprint image database DB2 (St24).

[0056] If the authentication device P1 determines in the processing of step St24 that the user's fingerprint image is not registered in the registered fingerprint image database DB2 (St24, YES), it proceeds to processing to acquire a fingerprint image that is new authentication data.

[0057] On the other hand, if the authentication device P1 determines in the processing of step St24 that the user's fingerprint image is not unregistered in the registered fingerprint image database DB2 (NO in St24), it proceeds to fingerprint authentication processing using a fingerprint image already registered in the registered fingerprint image database DB2. Note that the fingerprint authentication processing executed thereafter is performed by a known method, and therefore a description thereof will be omitted.

[0058] The authentication device P1 generates a control command to capture an image of the user, and transmits the generated control command to the second imaging device C2 (St25).

[0059] The second image capturing device C2 starts exposure of the second camera 11 (St26), and ends the exposure after a predetermined exposure time has elapsed (St27). After the exposure (image capturing) is completed, the second image capturing device C2 acquires the captured image of the user (St28) and transmits it to the authentication device P1 (St29).

[0060] The authentication device P1 detects at least one fingertip from the second captured image transmitted from the second imaging device C2, cuts out an area including the first joint of the detected fingertip, and generates a fingerprint image. The authentication device P1 calculates a quality score indicating the likelihood that the generated fingerprint image is suitable for fingerprint authentication (St30), and determines whether the calculated quality score is equal to or greater than a second threshold (St31).

[0061] If the authentication device P1 determines in the processing of step St31 that the calculated quality score is greater than or equal to the second threshold (St31, YES), it associates the user ID sent from the face authentication server S1 with the generated fingerprint image and sends them to the fingerprint authentication server S2 (St32).

[0062] On the other hand, if the authentication device P1 determines in the processing of step St31 that the calculated quality score is not greater than or equal to the second threshold (St31, NO), it further determines whether the number of NG times that the calculated quality score is determined to be not greater than or equal to the second threshold is greater than a predetermined number (e.g., 3 times, 5 times, etc.) (St33).

[0063] If the authentication device P1 determines in the processing of step St33 that the number of NG attempts is equal to or greater than a predetermined number (YES in St33), the authentication device P1 determines that the fingerprint registration has failed. The authentication device P1 generates a fingerprint registration failure screen (not shown) that notifies the user that the fingerprint image registration has failed, and outputs (notifies) the screen to the display unit 33 (St34).

[0064] On the other hand, when the authentication device P1 determines in the process of step St33 that the number of NG attempts is not equal to or greater than the predetermined number of attempts (NO in St33), the authentication device P1 returns to the process of step St25.

[0065] The fingerprint authentication server S2 associates the fingerprint image sent from the authentication device P1 with the user ID and registers (stores) it in the registered fingerprint image database DB2 (St35). After registering the fingerprint image in the registered fingerprint image database DB2, the fingerprint authentication server S2 generates a fingerprint image registration completion notice and sends it to the authentication device P1 (St36).

[0066] Based on the fingerprint image registration completion notification sent from the fingerprint authentication server S2, the authentication device P1 generates a registration completion notification screen (not shown) notifying the completion of fingerprint image registration, and outputs (notifies) it to the display unit 33 (St37).

[0067] The process of acquiring the first captured image in steps St11 to St14 and the process of acquiring the second captured image in steps St25 to St29 may be executed consecutively or in parallel.

[0068] As described above, when the authentication system 100 according to the first embodiment is successful in user authentication using biometric information, it can acquire and register new authentication data (here, a fingerprint image) of the authenticated user. This enables the authentication system 100 to perform multimodal authentication for subsequent user authentications. Furthermore, the authentication system 100 enables authentication suitable for any service available to the user (for example, depositing money, shopping, or entering or leaving a workplace building) or multimodal authentication.

[0069] Furthermore, when user authentication based on registered authentication data (here, a facial image) is successful, the authentication system 100 according to embodiment 1 acquires and registers unregistered authentication data (here, a fingerprint image), thereby effectively preventing impersonation by others, and improving the reliability of the authentication data registered in each server even when the servers managing each authentication data are different.

[0070] (Embodiment 2) The authentication system 100 according to embodiment 1 has shown an example in which biometric information (fingerprint image) is acquired and registered as new authentication data. The authentication system 100A according to embodiment 2 will be described as an example in which stored information (PIN number) is acquired and registered as new authentication data.

[0071] Note that authentication system 100A in embodiment 2 has a configuration that is partially similar to authentication system 100 in embodiment 1. Therefore, in the following description of authentication system 100A according to embodiment 2, the same components as those in authentication system 100 in embodiment 1 are denoted by the same reference numerals, and the description thereof will be omitted.

[0072] In the following description of the second embodiment, an example of acquiring and registering a personal identification number will be described as an example of stored information, but it goes without saying that the stored information is not limited to this.

[0073] An authentication system 100A (an example of an authentication information registration system) according to the second embodiment will be described with reference to Fig. 4. Fig. 4 is a block diagram illustrating an example of the internal configuration of an authentication system 100C according to the second embodiment. Note that the stored information acquisition device C3 and the stored information authentication server S3 are connected to each other so that they can communicate data with each other, but this is not shown in Fig. 4.

[0074] The authentication system 100A includes a first imaging device C1 (an example of a first authentication information acquisition device), a stored information acquisition device C3 (an example of a second authentication information acquisition device), an authentication device P1A (an example of a registration device), a face authentication server S1, and a stored information authentication server S3 (an example of a storage device). The face authentication server S1 and the stored information authentication server S3 may be realized by a single device.

[0075] The memory information acquisition device C3 is a device capable of accepting input of memory information by a user, and is connected to the authentication device P1A and the memory information authentication server S3 so as to enable data communication between them. The memory information acquisition device C3 includes an input unit 12 and a display unit 13.

[0076] The input unit 12 is realized by a user interface such as a keyboard, a touch panel, a mouse, etc., and accepts input of stored information (e.g., a personal identification number) by the user. The input unit 12 converts the content of the accepted stored information into an electrical signal and transmits it to the stored information authentication server S3, and also generates a screen showing the content of the stored information and outputs it to the display unit 13 for display.

[0077] The display unit 13 may be configured using a display device such as an LCD or an organic EL display. The display unit 13 displays (outputs) a screen that can accept input of stored information, a screen that shows the contents of the stored information output from the input unit 12, etc.

[0078] The authentication device P1A performs user authentication based on the first captured image transmitted from the first imaging device C1, and registers the stored information transmitted from the stored information acquisition device C3, or performs user authentication based on the stored information transmitted from the stored information acquisition device C3. The authentication device P1A includes a communication unit 30A, a control unit 31A, a memory 32, and a display unit 33.

[0079] The communication unit 30A (an example of an acquisition unit) is connected to the first camera 10 of the first imaging device C1, the input unit 12 of the memory information acquisition device C3, the communication unit 40 of the face authentication server S1, and the communication unit 60 of the memory information authentication server S3, each of which can communicate wirelessly or via wired communication, and performs data transmission and reception.

[0080] The control unit 31A (an example of an authentication unit and a registration unit) is configured using, for example, a CPU or FPGA, and performs various processes and controls in cooperation with the memory 32. Specifically, the control unit 31A references the programs and data stored in the memory 32 and executes the programs to realize the functions of the authentication device P1A.

[0081] If the control unit 31A determines that the user shown in the facial image (first captured image) is a registered user who was previously registered in the registered facial image database DB1 and determines that new authentication data for this user needs to be registered, the control unit 31A proceeds to a process of acquiring new authentication data (here, stored information). The control unit 31A generates a control command requesting acquisition of the stored information and transmits it to the stored information acquisition device C3. On the other hand, if the control unit 31A determines that registration of new authentication data is not necessary, the control unit 31A proceeds to a stored information authentication process using the registered stored information.

[0082] The stored information authentication server S3 newly registers stored information transmitted from the stored information acquisition device C3, and performs user authentication based on stored information transmitted from the authentication device P1A. The stored information authentication server S3 includes a communication unit 60, a control unit 61, a memory 62, and a registered stored information database DB3.

[0083] The communication unit 60 is connected between the stored information acquisition device C3 and the authentication device P1A so as to be capable of wireless or wired communication, and executes data transmission and reception.

[0084] The control unit 61 is configured using, for example, a CPU or FPGA, and performs various processes and controls in cooperation with the memory 62. Specifically, the control unit 61 references the programs and data stored in the memory 62 and executes the programs to realize the functions of the stored information authentication server S3.

[0085] The control unit 61 registers the stored information transmitted from the stored information acquisition device C3 or performs user authentication using the stored information. The control unit 61 transmits the result of the registration of the stored information or the result of the user authentication to the authentication device P1A.

[0086] The memory 62 includes, for example, a RAM as a work memory used when the control unit 61 executes each process, and a ROM for storing programs and data that define the operation of the control unit 61. The RAM temporarily stores data or information generated or acquired by the control unit 61. The ROM stores programs that define the operation of the control unit 61.

[0087] The registered and stored information database DB3 is a so-called storage, and is configured using a storage medium such as a flash memory, HDD, SSD, etc. The registered and stored information database DB3 stores (registers) user stored information and information about the user, such as a user ID, in association with each other.

[0088] Next, the authentication operation executed by authentication system 100A will be described with reference to Fig. 5. Fig. 5 is a sequence diagram showing an example of the operation procedure of authentication system 100A according to embodiment 2. Note that steps St11 to St18 shown in Fig. 5 are the same processes as steps St11 to St18 described with reference to Figs. 2 and 3, respectively, and therefore will not be described here.

[0089] The authentication device P1A acquires the face recognition score and the user ID transmitted from the face recognition server S1, and determines whether the face recognition score is equal to or greater than a first threshold value (St19).

[0090] If, in the processing of step St19, the authentication device P1A determines that the facial recognition score sent from the facial recognition server S1 is equal to or greater than the first threshold (St19, YES), it generates a control command requesting an inquiry as to whether the user ID of the user corresponding to the facial image has been registered in the registered stored information database DB3, and associates the generated control command with the user ID and sends it to the stored information authentication server S3 (St20A).

[0091] On the other hand, if the authentication device P1A determines in the processing of step St19 that the facial authentication score is not greater than or equal to the first threshold value (St19, NO), it generates an authentication failure screen (not shown) to notify the user of authentication failure and outputs (displays) it on the display unit 33 (St21).

[0092] Based on the control command transmitted from the authentication device P1A, the stored information authentication server S3 compares the user ID of at least one user registered in the registered stored information database DB3 with the user ID transmitted from the authentication device P1A (St22A). The stored information authentication server S3 generates a query result (registration presence / absence query result) indicating whether the user ID transmitted from the authentication device P1A is a user ID registered in the registered stored information database DB3, and transmits the query result to the authentication device P1A (St23A).

[0093] The authentication device P1A determines whether or not the user's stored information has not been registered in the registered stored information database DB3 based on the query result sent from the stored information authentication server S3 (St24A).

[0094] If the authentication device P1A determines in the processing of step St24A that the user's stored information is not registered in the registered stored information database DB3 (St24A, YES), it proceeds to a process of acquiring stored information, which is new authentication data.

[0095] On the other hand, if the authentication device P1A determines in the processing of step St24A that the user's stored information is not unregistered in the registered stored information database DB3 (No in St24A), it proceeds to stored information authentication processing using stored information already registered in the registered stored information database DB3. Note that the stored information authentication processing executed thereafter is performed by a known method, and therefore a description thereof will be omitted.

[0096] The authentication device P1A generates a control command to acquire the stored information of the user, and transmits the generated control command to the stored information acquisition device C3 (St40).

[0097] The memory information acquisition device C3 acquires the user's memory information by accepting input of the memory information through a user operation (St41), and transmits the acquired memory information to the memory information authentication server S3 (St42).

[0098] The stored information authentication server S3 associates the stored information transmitted from the stored information acquisition device C3 with the user ID transmitted by the authentication device P1A, and registers (stores) the information in the registered stored information database DB3 (St43). The stored information authentication server S3 generates a notification of completion of registration of the stored information and transmits it to the authentication device P1A (St44).

[0099] Based on the notification of completion of registration of the stored information sent from the stored information authentication server S3, the authentication device P1A generates a registration completion notification screen (not shown) notifying the completion of registration of the stored information, and outputs (notifies) it to the display unit 33 (St45).

[0100] The process of acquiring the first captured image in steps St11 to St14 and the process of acquiring the stored information in steps St40 to St42 may be executed consecutively or in parallel.

[0101] As described above, when user authentication using biometric information is successful, the authentication system 100A according to the second embodiment can acquire and register new authentication data (here, stored information) of the authenticated user.

[0102] (Embodiment 3) The authentication system 100 according to embodiment 1 has shown an example in which biometric information (fingerprint image) is acquired and registered as new authentication data. The authentication system 100B according to embodiment 3 will be described as an example in which possession information (PIN number) is acquired and registered as new authentication data.

[0103] Note that authentication system 100B in embodiment 3 has a configuration that is partially similar to authentication system 100 in embodiment 1. Therefore, in the following description of authentication system 100B according to embodiment 3, the same components as those in authentication system 100 in embodiment 1 are denoted by the same reference numerals, and the description thereof will be omitted.

[0104] In the following description of the third embodiment, an example of acquiring and registering a card ID will be described as an example of possession information, but it goes without saying that possession information is not limited to this.

[0105] An authentication system 100B (an example of an authentication information registration system) according to the third embodiment will be described with reference to Fig. 6. Fig. 6 is a block diagram illustrating an example of the internal configuration of the authentication system 100B according to the third embodiment. Note that the possession information reading device C4 and the possession information authentication server S4 are connected to each other so that they can communicate data with each other, but this is not shown in Fig. 6.

[0106] The authentication system 100B includes a first imaging device C1 (an example of a first authentication information acquisition device), a possession information reading device C4 (an example of a second authentication information acquisition device), an authentication device P1B (an example of a registration device), a face authentication server S1, and a possession information authentication server S4 (an example of a storage device). The face authentication server S1 and the possession information authentication server S4 may be realized by a single device.

[0107] The possession information reading device C4 is a device capable of reading possession information relating to possessions (e.g., ID cards) that only the user possesses, and is connected to the authentication device P1B and the possession information authentication server S4 so as to be able to communicate data with each other. The possession information reading device C4 includes a reading unit 14.

[0108] The reading unit 14 reads possession information contained in the possession. The reading unit 14 may be capable of accepting input of the possession information through an input operation by the user. The reading unit 14 transmits the read possession information to the authentication device P1B.

[0109] The authentication device P1B performs user authentication based on the first captured image transmitted from the first imaging device C1, and registers the possession information transmitted from the possession information reading device C4, or performs user authentication based on the possession information transmitted from the possession information reading device C4. The authentication device P1B includes a communication unit 30B, a control unit 31B, a memory 32, and a display unit 33.

[0110] The communication unit 30B (an example of an acquisition unit) is connected to the first camera 10 of the first imaging device C1, the reading unit 14 of the possession information reading device C4, the communication unit 40 of the face authentication server S1, and the communication unit 70 of the possession information authentication server S4, each of which can communicate wirelessly or via wired communication, and performs data transmission and reception.

[0111] The control unit 31B (an example of an authentication unit and a registration unit) is configured using, for example, a CPU or FPGA, and performs various processes and controls in cooperation with the memory 32. Specifically, the control unit 31B references the programs and data stored in the memory 32 and executes the programs to realize the functions of the authentication device P1B.

[0112] If the control unit 31B determines that the user shown in the facial image (first captured image) is a registered user who was previously registered in the registered facial image database DB1 and determines that new authentication data for this user needs to be registered, the control unit 31B proceeds to a process of acquiring new authentication data (here, possession information). The control unit 31B generates a control command requesting acquisition of the possession information and transmits it to the possession information reading device C4. On the other hand, if the control unit 31B determines that registration of new authentication data is not necessary, the control unit 31B proceeds to a possession information authentication process using the registered possession information.

[0113] The possession information authentication server S4 newly registers the possession information transmitted from the possession information reading device C4 and performs user authentication based on the possession information transmitted from the authentication device P1 B. The possession information authentication server S4 includes a communication unit 70, a control unit 71, a memory 72, and a registered possession information database DB4.

[0114] The communication unit 70 is connected to the possession information reading device C4 and the authentication device P1B so as to be capable of wireless or wired communication between them, and transmits and receives data.

[0115] The control unit 71 is configured using, for example, a CPU or FPGA, and performs various processes and controls in cooperation with the memory 72. Specifically, the control unit 71 references the programs and data stored in the memory 72 and executes the programs to realize the functions of the possession information authentication server S4.

[0116] The control unit 71 registers the possession information transmitted from the possession information reading device C4 or performs user authentication using the possession information. The control unit 71 transmits the registration result of the possession information or the user authentication result to the authentication device P1B.

[0117] The memory 72 includes, for example, a RAM as a work memory used when the control unit 71 executes each process, and a ROM for storing programs and data that define the operation of the control unit 71. The RAM temporarily stores data or information generated or acquired by the control unit 71. The ROM stores programs that define the operation of the control unit 71.

[0118] The registered possession information database DB4 is a so-called storage, and is configured using a storage medium such as a flash memory, HDD, SSD, etc. The registered possession information database DB4 stores (registers) user possession information and information about the user, such as a user ID, in association with each other.

[0119] Next, the authentication operation executed by the authentication system 100B will be described with reference to Fig. 7. Fig. 7 is a sequence diagram showing an example of the operation procedure of the authentication system 100B according to the third embodiment. Note that steps St11 to St18 shown in Fig. 7 are the same processes as steps St11 to St18 described with reference to Figs. 2 and 3, respectively, and therefore will not be described here.

[0120] The authentication device P1B acquires the face recognition score and the user ID transmitted from the face recognition server S1, and determines whether the face recognition score is equal to or greater than a first threshold value (St19).

[0121] If, in the processing of step St19, the authentication device P1B determines that the facial recognition score sent from the facial recognition server S1 is equal to or greater than the first threshold (St19, YES), it generates a control command requesting an inquiry as to whether the user ID of the user corresponding to the facial image is registered in the registered possession information database DB4, and associates the generated control command with the user ID and sends it to the possession information authentication server S4 (St20B).

[0122] On the other hand, if the authentication device P1B determines in the processing of step St19 that the facial authentication score is not greater than or equal to the first threshold value (St19, NO), it generates an authentication failure screen (not shown) to notify the user of authentication failure and outputs (displays) it on the display unit 33 (St21).

[0123] Based on the control command transmitted from the authentication device P1B, the possession information authentication server S4 compares the user ID of at least one user registered in the registered possession information database DB4 with the user ID transmitted from the authentication device P1B (St22B). The possession information authentication server S4 generates a query result (registration presence / absence query result) indicating whether the user ID transmitted from the authentication device P1B is a user ID registered in the registered possession information database DB4, and transmits the query result to the authentication device P1 (St23B).

[0124] The authentication device P1B determines whether the user's possession information is not yet registered in the registered possession information database DB4 based on the inquiry result sent from the possession information authentication server S4 (St24B).

[0125] If the authentication device P1B determines in the processing of step St24B that the user's possession information is not registered in the registered possession information database DB4 (St24B, YES), it proceeds to a process of acquiring possession information, which is new authentication data.

[0126] On the other hand, if the authentication device P1B determines in the processing of step St24B that the user's possession information is not unregistered in the registered possession information database DB4 (St24B, NO), the authentication device P1B proceeds to possession information authentication processing using the possession information registered in the registered possession information database DB4. Note that the possession information authentication processing executed thereafter is performed by a known method, and therefore a description thereof will be omitted.

[0127] The authentication device P1B generates a control command to acquire the user's possession information, and transmits the generated control command to the possession information reading device C4 (St50).

[0128] The possession information reading device C4 acquires the user's possession information by accepting the input of the possession information through a user operation (St51), and transmits the acquired possession information to the possession information authentication server S4 (St52).

[0129] The possession information authentication server S4 associates the possession information transmitted from the possession information reader C4 with the user ID transmitted by the authentication device P1B, and registers (stores) the information in the registered possession information database DB4 (St53). The possession information authentication server S4 generates a registration completion notice of the possession information and transmits it to the authentication device P1B (St54).

[0130] Based on the registration completion notification of the possession information sent from the possession information authentication server S4, the authentication device P1B generates a registration completion notification screen (not shown) notifying the completion of registration of the possession information, and outputs (notifies) it to the display unit 33 (St55).

[0131] The process of acquiring the first captured image in steps St11 to St14 and the process of acquiring the possession information in steps St50 to St52 may be executed consecutively or in parallel.

[0132] As described above, when user authentication using biometric information is successful, the authentication system 100B according to the third embodiment can acquire and register new authentication data (possessive information in this case) of the authenticated user.

[0133] (Embodiment 4) The authentication system 100 according to Embodiment 1 has been described as an example in which, when a single server (here, the face authentication server S1) manages and registers only predetermined biometric information that can be used for user authentication, another server (here, the fingerprint authentication server S2) manages and acquires new authentication data other than the predetermined biometric authentication. The authentication system 100C according to Embodiment 4 will be described as an example in which a single server manages a plurality of pieces of authentication data, and when user authentication is successful using any one of the managed authentication data, biometric information (here, an invisible face image) is acquired and registered as new authentication data, or the registered authentication data is updated.

[0134] Note that authentication system 100C in embodiment 4 has a configuration that is partially similar to authentication system 100 in embodiment 1. Therefore, in the following description of authentication system 100C according to embodiment 4, the same components as those in authentication system 100 in embodiment 1 are denoted by the same reference numerals, and the description thereof will be omitted.

[0135] An authentication system 100C (an example of an authentication information registration system) according to the fourth embodiment will be described with reference to Fig. 8. Fig. 8 is a block diagram illustrating an example of the internal configuration of the authentication system 100C according to the fourth embodiment.

[0136] The authentication system 100C includes a first imaging device C1 (an example of a first authentication information acquisition device), a third imaging device C5 (an example of a second authentication information acquisition device), a lighting device L1, an authentication device P1C (an example of a registration device), and a face authentication server S1C (an example of a storage device). Note that the authentication system 100C shown in FIG. 8 is merely an example and is not limited thereto.

[0137] The third image capturing device C5 is controlled by the authentication device P1C to capture an image of an area including the user's face and obtain a third captured image (invisible image) of the user to be used for authentication. The third image capturing device C5 includes a third camera 80, a second polarizing plate 81, and a band-pass filter (hereinafter referred to as "BPF") 82.

[0138] The third camera 80 is configured to have at least an image sensor (not shown) and a lens (not shown). The image sensor is a solid-state imaging element including a Si photodiode and, for example, a CCD or CMOS, and converts an optical image formed on the imaging surface by invisible light (internally scattered light) that has passed through the BPF 82 into an electrical signal. The third camera 80 transmits the converted data (data of the third captured image) to the authentication device P1C.

[0139] The second polarizing plate 81 is arranged orthogonally (i.e., crossed Nicols) to the first polarizing plate 94, and removes the specularly reflected light and internally scattered light reflected by the user's face and the components of other light (sunlight, visible illumination light, etc.) in a first direction (i.e., the specularly reflected light components), and transmits only the internally scattered light and the components of other light in a second direction (i.e., non-visible light).

[0140] BPF 82 transmits only invisible light (i.e., near-infrared light with a wavelength of 940 nm) from among the internally scattered light and other light that has passed through second polarizing plate 81. As a result, BPF 82 can transmit only invisible light with a wavelength of 940 nm, which is within the sensor sensitivity range that can be received by the Si photodiode (not shown) of third camera 80 and is sunlight that is significantly attenuated by moisture contained in the air.

[0141] The illumination device L1 is controlled by the authentication device P1C and irradiates a user whose face is to be authenticated with invisible light including near-infrared light with a wavelength of 940 nm. The illumination device L1 includes a communication unit 90, a control unit 91, an illumination power supply unit 92, an illumination 93, and a first polarizing plate 94.

[0142] The communication unit 90 is connected to the third camera 80 of the third imaging device C5 so as to be able to communicate data with it, and outputs control commands transmitted from the third camera 80 to the control unit 91.

[0143] The control unit 91 controls the ON / OFF of the lighting power supply unit 92 (that is, controls the ON / OFF of the lighting 93) based on the control command output from the communication unit 90.

[0144] The lighting power supply unit 92 is controlled by the control unit 91 to turn on and off the power supply to the lighting 93 .

[0145] The illumination 93 is realized by at least one light-emitting diode (LED). The illumination 93 is supplied with power from an illumination power supply unit 92 and emits invisible light, which is near-infrared light with a wavelength of 940 nm. The illumination 93 may be a point light source or a surface light source.

[0146] The first polarizing plate 94 is disposed orthogonal to the second polarizing plate 81 (i.e., in a crossed Nicol configuration), and polarizes the invisible light emitted from the illumination 93 in a first direction. For example, the first polarizing plate 94 transmits only the vertical component of the invisible light from the illumination 93.

[0147] The authentication device P1C performs user authentication based on the first captured image (visible image) transmitted from the first imaging device C1, registers the third captured image (invisible image) transmitted from the third imaging device C5, performs user authentication based on the third captured image (invisible image), or updates the first captured image (visible image). The authentication device P1C includes a communication unit 30C, a control unit 31C, a memory 32, and a display unit 33.

[0148] The communication unit 30C (an example of an acquisition unit) is connected to the first camera 10 of the first imaging device C1, the third camera 80 of the third imaging device C5, and the communication unit 40C of the face authentication server S1C so that they can communicate wirelessly or via wire, respectively, and performs data transmission and reception.

[0149] The control unit 31C (an example of an authentication unit and a registration unit) is configured using, for example, a CPU or FPGA, and performs various processes and controls in cooperation with the memory 32. Specifically, the control unit 31C references the programs and data stored in the memory 32 and executes the programs to realize the functions of the authentication device P1C.

[0150] The control unit 31C detects the user's face from the first captured image (visible image) and cuts out the area containing the user's face to generate a visible face image, or detects the user's face from the third captured image (invisible image) and cuts out the area containing the user's face to generate an invisible face image.

[0151] If the control unit 31C determines that the user shown in the visible facial image is a registered user who has been registered in advance in the registered visible facial image database DB11 and that registration of new authentication data for this user is necessary, the control unit 31C proceeds to a process of acquiring new authentication data (here, the third captured image). The control unit 31C generates a control command requesting acquisition of the third captured image and transmits the control command to the second imaging device C2.

[0152] On the other hand, if the control unit 31C determines that it is not necessary to register new authentication data for the user, it determines whether it is necessary to update the visible face image already registered in the registered visible face image database DB11. If it determines that it is necessary to update the visible face image already registered in the registered visible face image database DB11, the control unit 31C proceeds to a process of acquiring the registered authentication data (here, the first captured image).

[0153] The face authentication server S1C calculates a face authentication score of a user appearing in a visible face image or an invisible face image transmitted from the authentication device P1C, registers an invisible face image in a registered invisible face image database DB12, or updates a visible face image registered in a registered visible face image database DB11. The face authentication server S1C includes a communication unit 40C, a control unit 41C, a memory 42, a registered visible face image database DB11, and a registered invisible face image database DB12. Note that the registered visible face image database DB11 and the registered invisible face image database DB12 may each be configured separately and connected to the face authentication server S1C so as to be able to communicate with each other.

[0154] The communication unit 40C is connected to the authentication device P1C so as to be capable of wireless or wired communication, and executes transmission and reception of data.

[0155] The control unit 41C is configured using, for example, a CPU or FPGA, and performs various processes and controls in cooperation with the memory 42. Specifically, the control unit 41C references the programs and data stored in the memory 42 and executes the programs to realize the functions of the face authentication server S1C.

[0156] The control unit 41C compares the acquired visible face image with a registered visible face image of at least one user registered in advance in the registered visible face image database DB11, and calculates (evaluates) a face recognition score, which is an index of whether the user appearing in the visible face image is the same person as the registered user. The control unit 41C extracts the user ID associated with the registered visible face image of the user with the highest calculated face recognition score. The control unit 41C associates the extracted user ID with information about the face recognition score, outputs it to the communication unit 40C, and causes it to be transmitted to the authentication device P1C.

[0157] In addition, the control unit 41C registers (stores) the acquired invisible face image in the registered invisible face image database DB12, and overwrites (updates) the acquired visible face image on the registered visible face image registered in the registered visible face image database DB11.

[0158] The registered visible face image database DB11 is a so-called storage device, and is configured using a storage medium such as a flash memory, HDD, SSD, etc. The registered visible face image database DB11 stores (registers) registered visible face images of users in association with information about the users, such as user IDs.

[0159] The registered invisible face image database DB12 is a so-called storage, and is configured using a storage medium such as a flash memory, HDD, SSD, etc. The registered invisible face image database DB12 stores (registers) registered invisible face images of users in association with information about the users, such as user IDs.

[0160] Next, the authentication operation executed by the authentication system 100C will be described with reference to Fig. 9 and Fig. 10. Fig. 9 is a sequence diagram showing an example of the operation procedure of the authentication system 100C according to the fourth embodiment. Fig. 10 is a sequence diagram showing an example of the operation procedure of the authentication system 100C according to the fourth embodiment. Note that steps St11 to St18 shown in Fig. 9 and Fig. 10 are similar to steps St11 to St18 described with reference to Figs. 2 and 3, respectively, and therefore will not be described here.

[0161] The authentication device P1C acquires the face recognition score and the user ID transmitted from the face recognition server S1C, and determines whether the face recognition score is equal to or greater than a first threshold value (St19).

[0162] If, in the processing of step St19, the authentication device P1C determines that the face authentication score sent from the face authentication server S1C is equal to or greater than the first threshold (St19, YES), it generates a control command requesting an inquiry as to whether the user's invisible face image has been registered in the registered invisible face image database DB12, and associates the generated control command with the user ID and sends it to the face authentication server S1C (St20C).

[0163] On the other hand, if the authentication device P1C determines in the processing of step St19 that the facial authentication score is not greater than or equal to the first threshold (St19, NO), it generates an authentication failure screen (not shown) notifying the user of authentication failure and outputs (displays) it on the display unit 33 (St21C).

[0164] Based on the control command transmitted from the authentication device P1C, the face authentication server S1C compares the user ID of at least one user registered in the registered invisible face image database DB12 with the user ID transmitted from the authentication device P1C (St22C). The face authentication server S1C generates a query result (registration presence / absence query result) indicating whether or not the invisible face image associated with the user ID transmitted from the authentication device P1C is registered in the registered invisible face image database DB12, and transmits the query result to the authentication device P1C (St23C).

[0165] The authentication device P1C determines whether or not the invisible face image of the user is unregistered based on the reference result sent from the face authentication server S1C (St24C).

[0166] If the authentication device P1C determines in the processing of step St24C that the invisible face image of the user is not registered (St24C, YES), it further determines whether the visible face image of the user needs to be updated (St61).

[0167] On the other hand, if the authentication device P1C determines in the processing of step St24C that the user's invisible face image is not unregistered (St24C, NO), it proceeds to the process of acquiring the invisible face image to be registered in the registered invisible face image database DB12.

[0168] If the authentication device P1C determines in the process of step St61 that the visible face image of the user needs to be updated (YES in St61), the authentication device P1C generates a control command requesting capturing a first captured image (visible image) and transmits the control command to the first imaging device C1. The authentication system 100C executes the processes of steps St11 to St14.

[0169] If the authentication device P1C determines in the processing of step St61 that the visible face image of the user does not need to be updated (NO in St61), the authentication device P1C proceeds to invisible face image authentication processing using invisible face images already registered in the registered invisible face image database DB12. Note that the invisible face image authentication processing executed thereafter is similar to the visible face image authentication processing, and therefore a description thereof will be omitted.

[0170] The authentication device P1C generates a visible face image by cutting out the user's facial area from the first captured image (visible image) transmitted from the first imaging device C1, calculates a quality score indicating the likelihood that the generated visible face image is a visible face image suitable for face authentication using a visible image (St62), and determines whether the calculated quality score is greater than or equal to a third threshold (St63).

[0171] If the authentication device P1C determines in the processing of step St63 that the calculated quality score is equal to or greater than the third threshold (St63, YES), it associates the user ID transmitted from the face authentication server S1C with the generated visible face image and transmits them to the face authentication server S1C (St64).

[0172] On the other hand, if the authentication device P1C determines in the processing of step St63 that the calculated quality score is not greater than or equal to the third threshold (St63, NO), it further determines whether the number of NG times that the calculated quality score is determined to be not greater than or equal to the third threshold is greater than a predetermined number (e.g., 3 times, 5 times, etc.) (St65).

[0173] If the authentication device P1C determines in the processing of step St65 that the number of NG attempts is equal to or greater than a predetermined number (YES in St65), it determines that the update of the visible face image has failed. The authentication device P1C generates an update failure screen (not shown) notifying the user that the update of the visible face image has failed, and outputs (notifies) this to the display unit 33 (St66).

[0174] On the other hand, when it is determined in the processing of step St65 that the number of NG attempts is not equal to or greater than the predetermined number of attempts (St65, NO), the authentication apparatus P1C returns to the processing of step St11.

[0175] The face authentication server S1C overwrites (updates) the visible face image transmitted from the authentication device P1C with the registered visible face image associated with the user ID transmitted from the authentication device P1C (St67). After updating the registered visible face image, the face authentication server S1C generates an update completion notice for the registered visible face image and transmits it to the authentication device P1C (St68).

[0176] Based on the update completion notification of the registered visible face image sent from the face authentication server S1C, the authentication device P1C generates an update completion notification screen (not shown) notifying the completion of updating of the registered visible face image, and outputs (notifies) it to the display unit 33 (St69).

[0177] As described above, the authentication system 100C according to the fourth embodiment can update the registered visible face images registered in the registered invisible face image database DB12.

[0178] When the process proceeds to the process of acquiring an invisible face image, the authentication device P1C generates a control command to capture an image of the user, and transmits the generated control command to the third image capturing device C5 (St70).

[0179] The third image capturing device C5 generates a control command requesting the turning on of the light 93. The third image capturing device C5 transmits the generated control command to the lighting device L1, requesting the turning on of the light 93 (St71).

[0180] The lighting device L1 starts turning on the light 93 (St72).

[0181] The third image capturing device C5 starts exposure of the third camera 80 (St73) and ends the exposure after a predetermined exposure time has elapsed (St74). After the exposure (capturing) is completed, the third image capturing device C5 acquires a third captured image (invisible image) captured by the user (St75), generates a control command requesting that the light 93 be turned off, and transmits the control command to the lighting device L1 (St76).

[0182] The lighting device L1 turns off the light 93 and ends the lighting of the light 93 (St77).

[0183] The third imaging device C5 transmits the captured third captured image (invisible image) to the authentication device P1C (St80).

[0184] The authentication device P1C generates an invisible face image by cutting out a face region of the user from the third captured image transmitted from the third imaging device C5, and calculates a quality score indicating a likelihood that the generated invisible face image is an invisible face image suitable for face authentication using invisible images (St81). The authentication device P1C determines whether the calculated quality score is equal to or greater than a fourth threshold (St82).

[0185] If the authentication device P1C determines in the processing of step St82 that the calculated quality score is equal to or greater than the fourth threshold (St82, YES), it associates the user ID transmitted from the face authentication server S1C with the generated invisible face image and transmits them to the face authentication server S1C (St83).

[0186] On the other hand, if the authentication device P1C determines in the processing of step St82 that the calculated quality score is not greater than or equal to the fourth threshold (St82, NO), it further determines whether the number of NG times that the calculated quality score is determined to be not greater than or equal to the fourth threshold is greater than a predetermined number (e.g., 3 times, 5 times, etc.) (St84).

[0187] If the authentication device P1C determines in the processing of step St84 that the number of NG attempts is equal to or greater than a predetermined number (YES in St84), it determines that the registration of the invisible face image has failed. The authentication device P1C generates a registration failure screen (not shown) that notifies the user that the registration of the invisible face image has failed, and outputs (notifies) this to the display unit 33 (St85).

[0188] On the other hand, when it is determined in the processing of step St84 that the number of NG attempts is not equal to or greater than the predetermined number of attempts (St84, NO), the authentication apparatus P1C returns to the processing of step St70.

[0189] The face authentication server S1C associates the user ID transmitted from the authentication device P1C with the invisible face image and registers (stores) the association in the registered invisible face image database DB12 (St86). After registering the invisible face image, the face authentication server S1C generates a registration completion notice for the registered invisible face image and transmits it to the authentication device P1C (St87).

[0190] Based on the registration completion notification of the registered invisible facial image sent from the facial authentication server S1C, the authentication device P1C generates a registration completion notification screen (not shown) notifying the completion of registration of the registered invisible facial image, and outputs (notifies) it to the display unit 33 (St88).

[0191] The process of acquiring the first captured image in steps St11 to St14 and the process of acquiring the third captured image in steps St70 to St80 may be executed consecutively or in parallel.

[0192] As described above, when user authentication using biometric information is successful, the authentication system 100C according to the fourth embodiment can acquire and register new authentication data (here, an invisible facial image) of the authenticated user. Furthermore, the authentication system 100C can update the registered authentication data (here, a visible facial image) registered in authentication using authentication data that changes over time, such as facial authentication, or authentication using authentication data that is or should be changed periodically, such as a password or employee ID card. Therefore, the authentication system 100C can improve the authentication accuracy of multi-factor authentication.

[0193] As described above, the authentication devices P1 to P1C (examples of authentication information registration devices) in the first to fourth embodiments include communication units 30 to 30C (examples of acquisition units) that acquire first authentication information used for a first authentication of a user (an example of a person to be authenticated) and second authentication information used for a second authentication different from the first authentication, control units 31 to 31C (examples of authentication units) that authenticate the user based on the acquired first authentication information, and control units 31 to 31C (examples of registration units) that output user information and the second authentication information in association with each other based on the result of the first authentication, and register the information in a face authentication server S1C, a fingerprint authentication server S2, a stored information authentication server S3, or a possessed information authentication server S4 (examples of storage devices). Note that the storage device may be a registered fingerprint image database DB2, a registered stored information database DB3, a registered possessed information database DB4, or a registered invisible face image database DB12.

[0194] As a result, when the authentication devices P1 to P1C in the first to fourth embodiments are successful in user authentication using the first authentication information, they can acquire and register new authentication data (i.e., second authentication information) for the authenticated user. Therefore, the authentication devices P1 to P1C enable multi-factor authentication or multi-modal authentication in the next and subsequent user authentications.

[0195] Furthermore, when the control units 31 to 31C of the authentication devices P1 to P1C in the first to fourth embodiments determine, based on the first authentication result, that the user has been authenticated, they determine whether second authentication information has been registered in the face authentication server S1C, the fingerprint authentication server S2, the stored information authentication server S3, or the possessed information authentication server S4, and when they determine that the second authentication information has not been registered, they output the user information and the second authentication information in association with each other to the face authentication server S1C, the fingerprint authentication server S2, the stored information authentication server S3, or the possessed information authentication server S4. In this way, the authentication devices P1 to P1C in the first to fourth embodiments enable multi-factor authentication or multi-modal authentication in subsequent user authentications by registering new authentication data (second authentication information).

[0196] Furthermore, when the control units 31 to 31C of the authentication devices P1 to P1C in the first to fourth embodiments determine that the second authentication information is registered in the face authentication server S1C, the fingerprint authentication server S2, the stored information authentication server S3, or the possessed information authentication server S4, they omit outputting the user information and the second authentication information. This allows the authentication devices P1 to P1C in the first to fourth embodiments to prevent the registered authentication data from being automatically updated.

[0197] Furthermore, when the communication unit 30C of the authentication device P1C in the fourth embodiment determines that the second authentication information has already been registered in the face authentication server S1C, it acquires new first authentication information for the user. The control unit 31C outputs the acquired new first authentication information and updates the registered authentication information used for matching against the first authentication information in the first authentication with the new first authentication information. As a result, in authentication using, for example, a facial image or a password, which requires updating of registered authentication data, the authentication device P1C in the fourth embodiment acquires and registers updated authentication data after user authentication, thereby preventing impersonation by other users and enabling more accurate multi-factor authentication or multi-modal authentication by updating the registered authentication data.

[0198] Furthermore, when the control units 31 to 31C of the authentication devices P1 to P1C in the first to fourth embodiments determine that the user cannot be authenticated based on the first authentication information, they omit outputting the user information and the second authentication information, thereby enabling the authentication devices P1 to P1C in the first to fourth embodiments to more effectively prevent erroneous registration of authentication data.

[0199] Furthermore, the first authentication information of the authentication devices P1 to P1C in the first to fourth embodiments is the user's biometric information. The second authentication information is the user's biometric information, knowledge information, or possession information. As a result, the authentication devices P1 to P1C in the first to fourth embodiments can register new authentication data to be used for other authentications when a user is authenticated by biometric authentication, which is a more advanced authentication method.

[0200] Furthermore, the control units 31 to 31C of the authentication devices P1 to P1C in the first to fourth embodiments authenticate the user based on the first authentication information after the first authentication information and the second authentication information are acquired by the communication units 30 to 30C. This allows the authentication devices P1 to P1C in the first to fourth embodiments to further reduce the time required to acquire two different pieces of authentication information.

[0201] Furthermore, when the communication units 30 to 30C of the authentication devices P1 to P1C in the first to fourth embodiments determine that the user has been authenticated based on the first authentication information, they acquire the second authentication information, which allows the authentication devices P1 to P1C in the first to fourth embodiments to more effectively prevent erroneous registration of authentication data.

[0202] Furthermore, the authentication systems 100 to 100C (an example of an authentication information registration system) in embodiments 1 to 4 include a first imaging device C1 (an example of a first authentication information acquisition device) capable of acquiring first authentication information used for a first authentication of a user (an example of a person to be authenticated), a second imaging device C2, a stored information acquisition device C3, a possessed information reading device C4, or a third imaging device C5 (an example of a second authentication information acquisition device) that acquires second authentication information used for a second authentication different from the first authentication, a face authentication server S1C, a fingerprint authentication server S2, a stored information authentication server S3, or a possessed information authentication server S4 (an example of a storage device) that records user information and the second authentication information used for the second authentication, and authentication devices P1 to P1C (an example of a registration device) capable of communicating with the first authentication information acquisition device, the second authentication information acquisition device, and the second imaging device C2, the stored information acquisition device C3, the possessed information reading device C4, or the third imaging device C5. The authentication devices P1 to P1C acquire first authentication information and second authentication information, authenticate the user based on the acquired first authentication information, and, based on the first authentication result, associate the user information with the second authentication information and output it to the face authentication server S1C, the fingerprint authentication server S2, the stored information authentication server S3, or the possessed information authentication server S4 for registration.

[0203] As a result, when the authentication systems 100 to 100C in the first to fourth embodiments are successful in user authentication using the first authentication information, they can acquire and register new authentication data (i.e., second authentication information) for the authenticated user. Therefore, the authentication systems 100 to 100C enable multi-factor authentication or multi-modal authentication in subsequent user authentications.

[0204] Although various embodiments have been described above with reference to the accompanying drawings, the present disclosure is not limited to such examples. It is clear that those skilled in the art can conceive of various modifications, alterations, substitutions, additions, deletions, and equivalents within the scope of the claims, and it is understood that these also fall within the technical scope of the present disclosure. Furthermore, the components of the various embodiments described above may be combined in any manner without departing from the spirit of the invention.

[0205] This application is based on a Japanese patent application (Patent Application No. 2023-108859) filed on June 30, 2023, the contents of which are incorporated herein by reference.

[0206] The present disclosure is useful as providing an authentication information registration device, an authentication information registration method, and an authentication information registration system for acquiring authentication data used for a plurality of different authentications.

[0207] 30, 30A, 30B, 30C, 40, 40C, 50, 60, 70, 90 Communication unit 31, 31A, 31B, 31C, 41, 41C, 51, 61, 71, 91 Control unit 100, 100A, 100B, 100C Authentication system C1 First imaging device C2 Second imaging device C3 Stored information acquisition device C4 Possessed information reading device C5 Third imaging device DB1 Registered face image database DB2 Registered fingerprint image database DB3 Registered stored information database DB4 Registered possessed information database DB11 Registered visible face image database DB12 Registered invisible face image database L1 Illumination device P1, P1A, P1B, P1C Authentication device S1, S1C Face authentication server S2 Fingerprint authentication server S3 Stored information authentication server S4 Possession information authentication server

Claims

1. An authentication information registration device comprising: an acquisition unit that acquires first authentication information used for a first authentication of a person to be authenticated and second authentication information used for a second authentication different from the first authentication; an authentication unit that authenticates the person to be authenticated based on the acquired first authentication information; and a registration unit that outputs information about the person to be authenticated and the second authentication information in association with each other based on a result of the first authentication, and registers the information in a storage device.

2. The authentication information registration device of claim 1, wherein when the registration unit determines that the person to be authenticated has been authenticated based on the first authentication result, it determines whether the second authentication information is registered in the storage device, and when it determines that the second authentication information is not registered, it associates information about the person to be authenticated with the second authentication information and outputs it to the storage device.

3. The authentication information registration device according to claim 2, wherein the registration unit omits output of the information on the authenticatee and the second authentication information when it determines that the second authentication information is registered in the storage device.

4. The authentication information registration device described in claim 2, wherein the acquisition unit acquires new first authentication information of the person to be authenticated when it determines that the second authentication information has already been registered in the storage device, and the registration unit outputs the acquired new first authentication information and updates the registered authentication information used for matching against the first authentication information in the first authentication to the new first authentication information.

5. The authentication information registration device according to claim 1, wherein the registration unit omits output of the information on the authenticated person and the second authentication information when it determines that the authenticated person cannot be authenticated based on the first authentication information.

6. The authentication information registration device according to claim 1, wherein the first authentication information is biometric information of the person to be authenticated, and the second authentication information is biometric information, knowledge information, or possession information of the person to be authenticated.

7. The authentication information registration device according to claim 1, wherein the authentication unit authenticates the person to be authenticated based on the first authentication information after the first authentication information and the second authentication information are acquired by the acquisition unit.

8. The authentication information registration device according to claim 1, wherein the acquisition unit acquires the second authentication information when it is determined that the person to be authenticated has been authenticated based on the first authentication information.

9. An authentication information registration method performed by a registration device that registers authentication information used for authenticating a person to be authenticated, comprising: an acquisition unit that acquires first authentication information used for a first authentication of the person to be authenticated and second authentication information used for a second authentication different from the first authentication; an authentication unit that authenticates the person to be authenticated based on the acquired first authentication information; and an authentication unit that associates information about the person to be authenticated with the second authentication information based on a result of the first authentication, outputs the information to a storage device, and registers the information.

10. An authentication information registration system comprising: a first authentication information acquisition device capable of acquiring first authentication information used for a first authentication of a person to be authenticated; a second authentication information acquisition device acquiring second authentication information used for a second authentication different from the first authentication; a storage device for recording information of the person to be authenticated and the second authentication information used for the second authentication; and a registration device capable of communicating between the first authentication information acquisition device, the second authentication information acquisition device, and the storage device, wherein the registration device acquires the first authentication information and the second authentication information, authenticates the person to be authenticated based on the acquired first authentication information, and, based on a result of the first authentication, associates the information of the person to be authenticated with the second authentication information, outputs it to the storage device and registers it.

Images