Authentication information registration device, authentication information registration method, and authentication information registration system

Abstract

To acquire authentication data to be used for a plurality of different authentication.SOLUTION: An authentication information registration device comprises: an acquisition unit for acquiring first authentication information used for first authentication of a person to be authenticated and second authentication information used for second authentication different from the first authentication; an authentication unit for authenticating the person to be authenticated on the basis of the acquired first authentication information; and a registration unit for, on the basis of the first authentication result, outputting information on the person to be authenticated in association with the second authentication information to register the same in a storage device.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an authentication information registration device, an authentication information registration method, and an authentication information registration system. [Background technology]

[0002] Patent Document 1 discloses a method for determining a multi-factor password in which multiple factors including multiple factors selected by a user correspond to different types of information used to authenticate the user, and performing authentication of the user. The multi-factor password is authenticated based on the authentication results of each of the multiple factors and the authentication order of the selected factors, and at least one of the factors selected by the user belongs to a different category from the other factors. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-42376 A Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, the use of authentication using photographs (facial images) of people's faces in various indoor and outdoor locations has been increasing. However, when a device takes a photograph in an environment where a person's face is irradiated with sunlight or other lighting, where the person's face is backlit, or where there is low illumination such as at night or on a rainy day, the person's face in the photograph may appear overexposed or backlit, and the facial features of the person used for authentication may not be captured.

[0005] The present disclosure has been devised in consideration of the above-mentioned conventional circumstances, and aims to provide an authentication information registration device, an authentication information registration method, and an authentication information registration system that acquire authentication data used for multiple different authentications. [Means for solving the problem]

[0006] The present disclosure provides an authentication information registration device including an acquisition unit that acquires first authentication information used for a first authentication of a person to be authenticated and second authentication information used for a second authentication different from the first authentication, an authentication unit that authenticates the person to be authenticated based on the acquired first authentication information, and a registration unit that outputs information of the person to be authenticated and the second authentication information in association with each other based on a result of the first authentication, and registers the information in a storage device.

[0007] The present disclosure also provides an authentication information registration method performed by a registration device that registers authentication information used for authenticating a person to be authenticated, the authentication information registration method including an acquisition unit that acquires first authentication information used for a first authentication of the person to be authenticated and second authentication information used for a second authentication different from the first authentication, an authentication unit that authenticates the person to be authenticated based on the acquired first authentication information, and an authentication unit that associates information of the person to be authenticated with the second authentication information based on a result of the first authentication, outputs the information to a storage device, and registers the information.

[0008] The present disclosure also provides an authentication information registration system comprising: a first authentication information acquisition device capable of acquiring first authentication information used for a first authentication of a person to be authenticated; a second authentication information acquisition device acquiring second authentication information used for a second authentication different from the first authentication; a storage device that records information of the person to be authenticated and the second authentication information used for the second authentication; and a registration device capable of communicating between the first authentication information acquisition device, the second authentication information acquisition device, and the storage device, in which the registration device acquires the first authentication information and the second authentication information, authenticates the person to be authenticated based on the acquired first authentication information, and, based on a result of the first authentication, associates the information of the person to be authenticated with the second authentication information, outputs the information to the storage device, and registers it. Effect of the Invention

[0009] According to the present disclosure, it is possible to obtain authentication data that can be used for a plurality of different authentications. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram illustrating an example of an internal configuration of an authentication system according to a first embodiment. [Diagram 2] FIG. 1 is a sequence diagram showing an example of an operation procedure of the authentication system according to the first embodiment. [Diagram 3] FIG. 1 is a sequence diagram showing an example of an operation procedure of the authentication system according to the first embodiment. [Figure 4] FIG. 11 is a block diagram illustrating an example of the internal configuration of an authentication system according to a second embodiment. [Diagram 5] FIG. 11 is a sequence diagram showing an example of an operation procedure of an authentication system according to a second embodiment. [Figure 6] FIG. 11 is a block diagram illustrating an example of the internal configuration of an authentication system according to a third embodiment. [Figure 7] FIG. 11 is a sequence diagram showing an example of an operation procedure of an authentication system according to a third embodiment. [Figure 8] FIG. 13 is a block diagram illustrating an example of the internal configuration of an authentication system according to a fourth embodiment. [Figure 9] FIG. 13 is a sequence diagram showing an example of an operation procedure of an authentication system according to a fourth embodiment. [Figure 10] FIG. 13 is a sequence diagram showing an example of an operation procedure of an authentication system according to a fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, with reference to the drawings as appropriate, an embodiment that specifically discloses the configuration and operation of the authentication information registration device, authentication information registration method, and authentication information registration system according to the present disclosure will be described in detail. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of already well-known matters or duplicate explanation of substantially the same configuration may be omitted. This is to avoid the following explanation becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. Note that the attached drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0012] Each of the authentication systems 100, 100A, 100B, and 100C described in this disclosure enables multi-factor authentication or multi-modal authentication using multiple pieces of personal identification information by acquiring and registering new authentication data to authenticate a user when the user's identity is confirmed through user authentication (personal authentication) using previously registered biometric information of the user (in this disclosure, a facial image as an example).

[0013] The new authentication data referred to here may be, for example, biometric information such as fingerprints, veins, palm print, voice or iris; knowledge information (memorized information) such as a PIN number, PIN code or secret question; or possessed information such as an employee ID card number, smartphone, IC card, credit card, cash card, driver's license or insurance card.

[0014] (Embodiment 1) An authentication system 100 (an example of an authentication information registration system) according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram illustrating an example of the internal configuration of the authentication system 100 according to the first embodiment.

[0015] In the following description of the first embodiment, an example will be described in which a fingerprint image of a user is acquired and registered as new authentication data for the user.

[0016] The authentication system 100 includes a first imaging device C1 (an example of a first authentication information acquisition device), a second imaging device C2 (an example of a second authentication information acquisition device), an authentication device P1 (an example of a registration device), a face authentication server S1, and a fingerprint authentication server S2 (an example of a storage device). Note that the authentication system 100 shown in FIG. 1 is an example and is not limited thereto. The authentication system 100 may be configured to include any device capable of acquiring new authentication data to be registered. The authentication system 100 may be a second imaging device C2 capable of imaging a user's finger as a device capable of acquiring a fingerprint image, or may be a sensor device capable of sensing a user's fingerprint. The face authentication server S1 and the fingerprint authentication server S2 may be realized by one device.

[0017] Also, for example, the authentication system 100 may include a network. The authentication device P1 and the face authentication server S1 may be connected to each other via the network so as to be able to transmit and receive data, or may be integrated into one device or server. The registered face image database DB1 or the registered fingerprint image database DB2 may be configured separately from the face authentication server S1.

[0018] The first imaging device C1 is controlled by the authentication device P1 to capture an image of an area including the user's face and obtain a first captured image (visible image) of the user to be used for authentication. The first imaging device C1 includes a first camera .

[0019] The first camera 10 is configured to have at least an image sensor (not shown) and a lens (not shown). The image sensor is a solid-state imaging element including a Si photodiode and, for example, a Charged-Coupled Device (hereinafter, referred to as "CCD") or a Complementary Metal Oxide Semiconductor (hereinafter, referred to as "CMOS"), and converts an optical image formed on an imaging surface by visible light into an electrical signal. The first camera 10 transmits the converted electrical signal (data of the first captured image) to the authentication device P1.

[0020] The second imaging device C2 is controlled by the authentication device P1 to capture an image of an area including the user's fingers, and obtain a second captured image of the user to be used for authentication. The second imaging device C2 includes a second camera 11.

[0021] The second camera 11 is configured to have at least an image sensor (not shown) and a lens (not shown). The image sensor is a solid-state imaging element including a Si photodiode and, for example, a CCD or CMOS, and converts an optical image formed on an imaging surface by incident light into an electrical signal. The second camera 11 transmits the converted electrical signal (data of the second captured image) to the authentication device P1.

[0022] The authentication device P1 is realized by, for example, a personal computer (hereinafter, referred to as “PC”), a notebook PC, a tablet terminal, a smartphone, etc., and performs authentication of a user who is an authentication target. The authentication device P1 includes a communication unit 30, a control unit 31, a memory 32, and a display unit 33.

[0023] The communication unit 30 (an example of an acquisition unit) is connected to the first camera 10 of the first imaging device C1, the second camera 11 of the second imaging device C2, the communication unit 40 of the face authentication server S1, and the communication unit 50 of the fingerprint authentication server S2 so as to be capable of wireless or wired communication, respectively, and performs data transmission and reception.

[0024] The control unit 31 (an example of an authentication unit and a registration unit) is configured using, for example, a Central Processing Unit (hereinafter, referred to as "CPU") or a Field Programmable Gate Array (hereinafter, referred to as "FPGA"), and performs various processes and controls in cooperation with the memory 32. Specifically, the control unit 31 refers to the programs and data held in the memory 32, and executes the programs to realize the functions of the authentication device P1.

[0025] The control unit 31 executes an image analysis process on the first captured image captured by the first camera 10 to detect the user's face appearing in the first captured image. The control unit 31 cuts out an area including the detected user's face from the first captured image to generate a facial image. The control unit 31 outputs the generated facial image to the communication unit 30 and causes it to be transmitted to the facial authentication server S1.

[0026] The control unit 31 determines whether the user appearing in the facial image (first captured image) is a registered user who has been registered in advance in the registered facial image database DB1 based on whether the facial recognition score transmitted from the facial recognition server S1 is greater than or equal to a first threshold value.

[0027] When the control unit 31 determines that the face authentication score is equal to or greater than the first threshold, it determines whether or not new authentication data is required for this user. When the control unit 31 determines that registration of new authentication data is required, it proceeds to acquisition processing of new authentication data (here, a fingerprint image), generates a control command to capture an image of the user's fingers, and transmits the control command to the second imaging device C2. On the other hand, when the control unit 31 determines that registration of new authentication data is not required, it proceeds to authentication processing using authentication data (here, a fingerprint image) that has already been registered and is other than a face image, generates a control command to capture an image of the user's fingers, and transmits the control command to the second imaging device C2.

[0028] In the process of acquiring new authentication data, the control unit 31 detects the first joint of at least one finger of the user from the second captured image transmitted from the second camera 11. The control unit 31 cuts out an area including the first joint of the detected finger from the second captured image to generate a fingerprint image, and calculates a quality score indicating the likelihood that the fingerprint image is suitable for fingerprint authentication. If the control unit 31 determines that the calculated quality score is equal to or greater than a second threshold, the control unit 31 transmits the user ID identified by face authentication and the generated fingerprint image in association with each other to the fingerprint authentication server S2 for registration.

[0029] If the control unit 31 determines that the calculated quality score is not equal to or greater than the second threshold, it repeatedly captures the second captured image again, calculates the quality score, and determines whether or not the fingerprint image can be registered based on the quality score. If the control unit 31 determines that authentication using the second captured image has occurred a predetermined number of times (e.g., three times, five times, etc.) or more, it determines that it is difficult to obtain a fingerprint image suitable for fingerprint authentication, and determines that the fingerprint registration has failed. The control unit 31 generates a registration failure screen (not shown) that notifies the user of the failure of the fingerprint registration, and outputs it to the display unit 33.

[0030] The memory 32 has, for example, a random access memory (hereinafter, referred to as "RAM") as a work memory used when executing each process of the control unit 31, and a read only memory (hereinafter, referred to as "ROM") for storing programs and data that define the operation of the control unit 31. The RAM temporarily stores data or information generated or acquired by the control unit 31. The ROM has written therein a program that defines the operation of the control unit 31.

[0031] The display unit 33 may be configured using a display device such as a Liquid Crystal Display (hereinafter, referred to as "LCD") or an organic electroluminescence (hereinafter, referred to as "EL"). The display unit 33 displays (outputs) a registration failure screen (not shown) output from the control unit 31.

[0032] The face authentication server S1 associates the face authentication score of the user appearing in the face image (first captured image) transmitted from the authentication device P1 with the user ID of the user corresponding to the face authentication score, and transmits them to the authentication device P1. The face authentication server S1 includes a communication unit 40, a control unit 41, a memory 42, and a registered face image database DB1. The registered face image database DB1 may be configured separately and connected to the face authentication server S1 so as to be able to communicate with it.

[0033] The communication unit 40 is connected to the authentication device P1 so as to be able to communicate wirelessly or via wired communication, and transmits and receives data. The communication unit 40 acquires face image (first captured image) data transmitted from the authentication device P1, and outputs it to the control unit 41. The communication unit 40 associates the face recognition score information output from the control unit 41 with the user ID of the user corresponding to the face recognition score, and transmits them to the authentication device P1.

[0034] The control unit 41 is configured using, for example, a CPU or an FPGA, and performs various processes and controls in cooperation with the memory 42. Specifically, the control unit 41 refers to the programs and data stored in the memory 42 and executes the programs to realize the functions of the face authentication server S1.

[0035] The control unit 41 compares the acquired face image with a registered face image of at least one user registered in advance in the registered face image database DB1, and calculates (evaluates) a face recognition score, which is an index of whether the user shown in the face image is the same person as the registered user. The control unit 41 extracts a user ID associated with the registered face image of the user with the highest calculated face recognition score. The control unit 41 associates the extracted user ID with information on the face recognition score, outputs it to the communication unit 40, and has it transmitted to the authentication device P1.

[0036] The memory 42 has, for example, a RAM as a work memory used when executing each process of the control unit 41, and a ROM for storing programs and data that define the operation of the control unit 41. The RAM temporarily stores data or information generated or acquired by the control unit 41. The ROM has written therein a program that defines the operation of the control unit 41.

[0037] The registered face image database DB1 is a so-called storage, and is configured using a storage medium such as a flash memory, a hard disk drive (hereinafter, referred to as "HDD"), or a solid state drive (hereinafter, referred to as "SSD"). The registered face image database DB1 stores (registers) a registered face image of a user in association with information about the user, such as a user ID. Note that the information about the user is not limited to the user ID, and may be, for example, the user's name, date of birth, age, sex, address, or phone number.

[0038] The fingerprint authentication server S2 transmits to the authentication device P1 a fingerprint authentication score of the fingerprint shown in the fingerprint image (second captured image) transmitted from the authentication device P1. The fingerprint authentication server S2 includes a communication unit 50, a control unit 51, a memory 52, and a registered fingerprint image database DB2. The registered fingerprint image database DB2 may be configured separately and connected to the fingerprint authentication server S2 so as to be able to communicate with it.

[0039] The communication unit 50 is connected to the authentication device P1 so as to be able to communicate wirelessly or via wired communication, and transmits and receives data. The communication unit 50 acquires fingerprint image (first captured image) data transmitted from the authentication device P1, and outputs it to the control unit 51. The communication unit 50 transmits to the authentication device P1 information on the fingerprint authentication score output from the control unit 51 in association with the user ID of the user corresponding to the fingerprint authentication score.

[0040] The control unit 51 is configured using, for example, a CPU or an FPGA, and performs various processes and controls in cooperation with the memory 52. ​​Specifically, the control unit 51 refers to the programs and data stored in the memory 52 and executes the programs to realize the functions of the fingerprint authentication server S2.

[0041] The control unit 51 compares the acquired fingerprint image with a registered fingerprint image of at least one user registered in advance in the registered fingerprint image database DB2, and calculates (evaluates) a fingerprint authentication score that is an index of whether the fingerprint shown in the fingerprint image and the fingerprint in the registered fingerprint registration image belong to the same person. The control unit 51 outputs the calculated fingerprint authentication score to the communication unit 50, and causes it to be transmitted to the authentication device P1.

[0042] The memory 52 has, for example, a RAM as a work memory used when executing each process of the control unit 51, and a ROM for storing programs and data that define the operation of the control unit 51. The RAM temporarily stores data or information generated or acquired by the control unit 51. The ROM has written therein a program that defines the operation of the control unit 51.

[0043] The registered fingerprint image database DB2 is a so-called storage, and is configured using a storage medium such as a flash memory, HDD, or SSD. The registered fingerprint image database DB2 stores (registers) a user's registered fingerprint image in association with information about the user, such as a user ID. Note that the information about the user is not limited to the user ID, and may be, for example, the user's name, date of birth, age, sex, address, or phone number.

[0044] Next, the authentication operation performed by authentication system 100 will be described with reference to Fig. 2 and Fig. 3. Fig. 2 is a sequence diagram showing an example of an operation procedure of authentication system 100 according to embodiment 1. Fig. 3 is a sequence diagram showing an example of an operation procedure of authentication system 100 according to embodiment 1. Note that the process of step St17 may be performed by authentication device P1.

[0045] The first imaging device C1 starts exposure of the first camera 10 (St11) based on a control command instructing the start of imaging transmitted from the authentication device P1, and ends the exposure after a predetermined exposure time has elapsed (St12).

[0046] After the exposure (imaging) is completed, the first imaging device C1 obtains a first captured image of the user (St13) The first imaging device C1 transmits data of the first captured image to the authentication device P1 (St14).

[0047] The authentication device P1 performs image analysis processing on the first captured image transmitted from the first imaging device C1 to detect the user's face. The authentication device P1 determines whether the user's face is detected from the first captured image (St15).

[0048] If the authentication device P1 determines in the processing of step St15 that the user's face has been detected from the first captured image (St15, YES), it generates a face image by cutting out the area containing the user's face from the first captured image and transmits it to the face authentication server S1 (St16).

[0049] On the other hand, when it is determined in the process of step St15 that the user's face is not detected from the first captured image (St15, NO), the authentication device P1 returns to the process of step St11 and re-images the user's face.

[0050] The face recognition server S1 compares the face image transmitted from the authentication device P1 with the registered face images of the multiple users registered in the registered face image database DB1, and calculates a face recognition score (St17). The face recognition server S1 extracts the user ID associated with the registered face image of the user with the highest calculated face recognition score, associates the extracted user ID with information on the face recognition score, and transmits them to the authentication device P1 (St18).

[0051] The authentication device P1 acquires the face recognition score and the user ID transmitted from the face recognition server S1, and determines whether the face recognition score is equal to or greater than a first threshold value (St19).

[0052] If, in the processing of step St19, the authentication device P1 determines that the face recognition score transmitted from the face recognition server S1 is equal to or greater than the first threshold value (St19, YES), it generates a control command requesting an inquiry as to whether the user ID of the user corresponding to the face image has been registered in the registered fingerprint image database DB2, and transmits the generated control command in association with the user ID to the fingerprint authentication server S2 (St20).

[0053] On the other hand, if the authentication device P1 determines in the processing of step St19 that the face recognition score is not greater than or equal to the first threshold (St19, NO), it determines that the authentication is "NG" (i.e., failed), generates an authentication failure screen (not shown) to notify the user of the authentication failure, and outputs (displays) it on the display unit 33 (St21).

[0054] Based on the control command transmitted from the authentication device P1, the fingerprint authentication server S2 compares the user ID of at least one user registered in the registered fingerprint image database DB2 with the user ID transmitted from the authentication device P1 (St22). The fingerprint authentication server S2 generates a query result (registration query result) as to whether or not the user ID transmitted from the authentication device P1 is a user ID registered in the registered fingerprint image database DB2, and transmits the query result to the authentication device P1 (St23).

[0055] The authentication device P1 determines whether or not the user's fingerprint image has not been registered in the registered fingerprint image database DB2 based on the reference result sent from the fingerprint authentication server S2 (St24).

[0056] When the authentication device P1 determines in the process of step St24 that the fingerprint image of the user is not registered in the registered fingerprint image database DB2 (St24, YES), the authentication device P1 proceeds to a process of acquiring a fingerprint image that is new authentication data.

[0057] On the other hand, when the authentication device P1 determines in the process of step St24 that the fingerprint image of the user is not unregistered in the registered fingerprint image database DB2 (St24, NO), the authentication device P1 proceeds to fingerprint authentication processing using a fingerprint image registered in the registered fingerprint image database DB2. Note that the fingerprint authentication processing executed thereafter is performed by a known method, and therefore a description thereof will be omitted.

[0058] The authentication device P1 generates a control command to capture an image of the user, and transmits the generated control command to the second imaging device C2 (St25).

[0059] The second imaging device C2 starts exposure of the second camera 11 (St26) and ends the exposure after a predetermined exposure time has elapsed (St27). After the exposure (imaging) ends, the second imaging device C2 acquires an image of the user (St28) and transmits it to the authentication device P1 (St29).

[0060] The authentication device P1 detects at least one fingertip from the second captured image transmitted from the second imaging device C2, and generates a fingerprint image by cutting out an area including the first joint of the detected fingertip. The authentication device P1 calculates a quality score indicating the likelihood that the generated fingerprint image is suitable for fingerprint authentication (St30), and determines whether the calculated quality score is equal to or greater than a second threshold (St31).

[0061] If the authentication device P1 determines in the processing of step St31 that the calculated quality score is equal to or greater than the second threshold (St31, YES), it associates the user ID transmitted from the face authentication server S1 with the generated fingerprint image and transmits them to the fingerprint authentication server S2 (St32).

[0062] On the other hand, if the authentication device P1 determines in the processing of step St31 that the calculated quality score is not greater than or equal to the second threshold (St31, NO), it further determines whether the number of NG times that the calculated quality score is determined to be less than or equal to the second threshold is greater than a predetermined number (e.g., 3 times, 5 times, etc.) (St33).

[0063] When the authentication device P1 determines that the number of NG attempts is equal to or greater than a predetermined number of attempts in the process of step St33 (St33, YES), the authentication device P1 determines that the fingerprint registration has failed. The authentication device P1 generates a fingerprint registration failure screen (not shown) for notifying the user that the fingerprint image registration has failed, and outputs (notifies) the screen to the display unit 33 (St34).

[0064] On the other hand, when it is determined in the process of step St33 that the number of NG attempts is not equal to or greater than the predetermined number of attempts (St33, NO), the authentication device P1 returns to the process of step St25.

[0065] The fingerprint authentication server S2 associates the fingerprint image transmitted from the authentication device P1 with the user ID and registers (stores) them in the registered fingerprint image database DB2 (St35). After registering the fingerprint image in the registered fingerprint image database DB2, the fingerprint authentication server S2 generates a fingerprint image registration completion notification and transmits it to the authentication device P1 (St36).

[0066] Based on the fingerprint image registration completion notification transmitted from the fingerprint authentication server S2, the authentication device P1 generates a registration completion notification screen (not shown) notifying the completion of the fingerprint image registration, and outputs (notifies) it to the display unit 33 (St37).

[0067] Note that the process of acquiring the first captured image in steps St11 to St14 and the process of acquiring the second captured image in steps St25 to St29 described above may be executed consecutively or in parallel.

[0068] As described above, when the authentication system 100 according to the first embodiment is successful in user authentication using biometric information, it can obtain and register new authentication data (here, a fingerprint image) of the authenticated user. This enables the authentication system 100 to enable multimodal authentication in subsequent user authentications. Furthermore, the authentication system 100 enables authentication suitable for any service available to the user (for example, depositing money, shopping, or entering and leaving a workplace building, etc.) or multimodal authentication.

[0069] Furthermore, when user authentication based on registered authentication data (here, a face image) is successful, authentication system 100 according to embodiment 1 acquires and registers unregistered authentication data (here, a fingerprint image), thereby effectively preventing impersonation by other people, and can improve the reliability of the authentication data registered in each server even when the servers managing each authentication data are different.

[0070] (Embodiment 2) The authentication system 100 according to the first embodiment has been described as an example in which biometric information (fingerprint image) is acquired and registered as new authentication data. The authentication system 100A according to the second embodiment will be described as an example in which stored information (password number) is acquired and registered as new authentication data.

[0071] Note that authentication system 100A in embodiment 2 has a partially similar configuration to authentication system 100 in embodiment 1. Therefore, in the following description of authentication system 100A according to embodiment 2, the same components as those in authentication system 100 in embodiment 1 are given the same reference numerals, and the description thereof will be omitted.

[0072] In the following description of the second embodiment, an example of the stored information will be described in which a personal identification number is acquired and registered, but it goes without saying that the stored information is not limited to this.

[0073] An authentication system 100A (an example of an authentication information registration system) according to the second embodiment will be described with reference to Fig. 4. Fig. 4 is a block diagram illustrating an example of the internal configuration of an authentication system 100C according to the second embodiment. Note that the stored information acquisition device C3 and the stored information authentication server S3 are connected to each other so as to be able to communicate data with each other, but are not shown in Fig. 4.

[0074] The authentication system 100A includes a first imaging device C1 (an example of a first authentication information acquisition device), a stored information acquisition device C3 (an example of a second authentication information acquisition device), an authentication device P1A (an example of a registration device), a face authentication server S1, and a stored information authentication server S3 (an example of a storage device). The face authentication server S1 and the stored information authentication server S3 may be realized by a single device.

[0075] The stored information acquisition device C3 is a device capable of accepting input operation of stored information by a user, and is connected to the authentication device P1A and the stored information authentication server S3 so as to be capable of data communication therebetween. The stored information acquisition device C3 includes an input unit 12 and a display unit 13.

[0076] The input unit 12 is realized by a user interface such as a keyboard, a touch panel, a mouse, etc., and accepts input operation of stored information (e.g., a PIN) by a user. The input unit 12 converts the contents of the accepted stored information into an electric signal and transmits it to the stored information authentication server S3, and also generates a screen showing the contents of the stored information and outputs it to the display unit 13 for display.

[0077] The display unit 13 may be configured using a display device such as an LCD or an organic EL. The display unit 13 displays (outputs) a screen capable of accepting input of stored information, a screen showing the contents of the stored information output from the input unit 12, and the like.

[0078] The authentication device P1A executes user authentication based on the first captured image transmitted from the first imaging device C1, and registers the stored information transmitted from the stored information acquisition device C3, or executes user authentication based on the stored information transmitted from the stored information acquisition device C3. The authentication device P1A includes a communication unit 30A, a control unit 31A, a memory 32, and a display unit 33.

[0079] The communication unit 30A (an example of an acquisition unit) is connected to the first camera 10 of the first imaging device C1, the input unit 12 of the stored information acquisition device C3, the communication unit 40 of the face authentication server S1, and the communication unit 60 of the stored information authentication server S3, respectively, for wireless or wired communication, and performs data transmission and reception.

[0080] The control unit 31A (an example of an authentication unit and a registration unit) is configured using, for example, a CPU or an FPGA, and performs various processes and controls in cooperation with the memory 32. Specifically, the control unit 31A refers to the programs and data held in the memory 32 and executes the programs to realize the functions of the authentication device P1A.

[0081] When the control unit 31A determines that the user appearing in the face image (first captured image) is a registered user who has been registered in advance in the registered face image database DB1 and determines that registration of new authentication data for this user is necessary, the control unit 31A proceeds to acquisition processing of new authentication data (here, stored information). The control unit 31A generates a control command requesting acquisition of the stored information and transmits it to the stored information acquisition device C3. On the other hand, when the control unit 31A determines that registration of new authentication data is not necessary, the control unit 31A proceeds to stored information authentication processing using the registered stored information.

[0082] The stored information authentication server S3 newly registers stored information transmitted from the stored information acquisition device C3, and performs user authentication based on stored information transmitted from the authentication device P1A. The stored information authentication server S3 includes a communication unit 60, a control unit 61, a memory 62, and a registered stored information database DB3.

[0083] The communication unit 60 is connected between the stored information acquisition device C3 and the authentication device P1A so as to be capable of wireless or wired communication therebetween, and transmits and receives data between them.

[0084] The control unit 61 is configured using, for example, a CPU or an FPGA, and performs various processes and controls in cooperation with the memory 62. Specifically, the control unit 61 refers to the programs and data stored in the memory 62 and executes the programs, thereby realizing the functions of the stored information authentication server S3.

[0085] The control unit 61 executes registration of the stored information transmitted from the stored information acquisition device C3 or user authentication using the stored information. The control unit 61 transmits the result of registration of the stored information or the result of user authentication to the authentication device P1A.

[0086] The memory 62 has, for example, a RAM as a work memory used when executing each process of the control unit 61, and a ROM for storing programs and data that define the operation of the control unit 61. The RAM temporarily stores data or information generated or acquired by the control unit 61. The ROM has written therein a program that defines the operation of the control unit 61.

[0087] The registered stored information database DB3 is a so-called storage, and is configured using a storage medium such as a flash memory, HDD, SSD, etc. The registered stored information database DB3 stores (registers) the user's stored information and information about the user, such as a user ID, in association with each other.

[0088] Next, an authentication operation executed by authentication system 100A will be described with reference to Fig. 5. Fig. 5 is a sequence diagram showing an example of an operation procedure of authentication system 100A according to embodiment 2. Note that steps St11 to St18 shown in Fig. 5 are similar to steps St11 to St18 described with reference to Figs. 2 and 3, respectively, and therefore will not be described here.

[0089] The authentication device P1A acquires the face recognition score and the user ID transmitted from the face recognition server S1, and determines whether the face recognition score is equal to or greater than a first threshold value (St19).

[0090] If, in the processing of step St19, the authentication device P1A determines that the face recognition score transmitted from the face recognition server S1 is equal to or greater than the first threshold value (St19, YES), it generates a control command requesting an inquiry as to whether the user ID of the user corresponding to the face image has been registered in the registered stored information database DB3, and transmits the generated control command in association with the user ID to the stored information authentication server S3 (St20A).

[0091] On the other hand, if the authentication device P1A determines in the processing of step St19 that the face recognition score is not greater than or equal to the first threshold (St19, NO), it generates an authentication failure screen (not shown) to notify the user of the authentication failure and outputs (displays) it on the display unit 33 (St21).

[0092] Based on the control command transmitted from the authentication device P1A, the stored information authentication server S3 compares the user ID of at least one user registered in the registered stored information database DB3 with the user ID transmitted from the authentication device P1A (St22A). The stored information authentication server S3 generates a query result (registration query result) as to whether or not the user ID transmitted from the authentication device P1A is a user ID registered in the registered stored information database DB3, and transmits the query result to the authentication device P1A (St23A).

[0093] The authentication device P1A judges whether or not the user's stored information is not yet registered in the registered stored information database DB3 based on the inquiry result transmitted from the stored information authentication server S3 (St24A).

[0094] When it is determined in the processing of step St24A that the user's stored information is not registered in the registered stored information database DB3 (St24A, YES), the authentication device P1A proceeds to a process of acquiring stored information that is new authentication data.

[0095] On the other hand, when the authentication device P1A determines in the process of step St24A that the user's stored information is not unregistered in the registered stored information database DB3 (St24A, NO), the authentication device P1A proceeds to a stored information authentication process using the stored information registered in the registered stored information database DB3. Note that the stored information authentication process executed thereafter is executed by a known method, and therefore a description thereof will be omitted.

[0096] The authentication device P1A generates a control command for acquiring the stored information of the user, and transmits the generated control command to the stored information acquisition device C3 (St40).

[0097] The stored information acquisition device C3 acquires the stored information of the user by accepting the input of the stored information by the user operation (St41). The stored information acquisition device C3 transmits the acquired stored information to the stored information authentication server S3 (St42).

[0098] The stored information authentication server S3 associates the stored information transmitted from the stored information acquisition device C3 with the user ID transmitted by the authentication device P1A, and registers (stores) the information in the registered stored information database DB3 (St43). The stored information authentication server S3 generates a registration completion notice of the stored information and transmits it to the authentication device P1A (St44).

[0099] Based on the registration completion notification of the stored information transmitted from the stored information authentication server S3, the authentication device P1A generates a registration completion notification screen (not shown) notifying the completion of the registration of the stored information, and outputs (notifies) it to the display unit 33 (St45).

[0100] The process of acquiring the first captured image in steps St11 to St14 and the process of acquiring the stored information in steps St40 to St42 may be executed consecutively or in parallel.

[0101] As described above, when user authentication using biometric information is successful, authentication system 100A according to the second embodiment can obtain and register new authentication data (stored information in this case) of the authenticated user.

[0102] (Embodiment 3) The authentication system 100 according to the first embodiment has been described as an example in which biometric information (fingerprint image) is acquired and registered as new authentication data. The authentication system 100B according to the third embodiment will be described as an example in which possessed information (password number) is acquired and registered as new authentication data.

[0103] Note that authentication system 100B in embodiment 3 has a configuration partially similar to authentication system 100 in embodiment 1. Therefore, in the following description of authentication system 100B according to embodiment 3, the same components as those in authentication system 100 in embodiment 1 are denoted by the same reference numerals, and the description thereof will be omitted.

[0104] In the following description of the third embodiment, an example of the possession information will be described in which a card ID is obtained and registered, but it goes without saying that the possession information is not limited to this.

[0105] An authentication system 100B (an example of an authentication information registration system) according to the third embodiment will be described with reference to Fig. 6. Fig. 6 is a block diagram illustrating an example of the internal configuration of the authentication system 100B according to the third embodiment. Note that the possessed information reading device C4 and the possessed information authentication server S4 are connected to each other so as to be able to communicate data with each other, but are not shown in Fig. 6.

[0106] The authentication system 100B includes a first imaging device C1 (an example of a first authentication information acquisition device), a possession information reading device C4 (an example of a second authentication information acquisition device), an authentication device P1B (an example of a registration device), a face authentication server S1, and a possession information authentication server S4 (an example of a storage device). The face authentication server S1 and the possession information authentication server S4 may be realized by a single device.

[0107] The possession information reading device C4 is a device capable of reading possession information related to possessions (e.g., ID cards, etc.) that only the user possesses, and is connected to the authentication device P1B and the possession information authentication server S4 so as to be capable of data communication therebetween. The possession information reading device C4 includes a reading unit 14.

[0108] The reading unit 14 reads possession information held by the possession. The reading unit 14 may be capable of accepting input of the possession information by an input operation by the user. The reading unit 14 transmits the read possession information to the authentication device P1B.

[0109] The authentication device P1B executes user authentication based on the first captured image transmitted from the first imaging device C1, and registers the possession information transmitted from the possession information reading device C4, or executes user authentication based on the possession information transmitted from the possession information reading device C4. The authentication device P1B includes a communication unit 30B, a control unit 31B, a memory 32, and a display unit 33.

[0110] The communication unit 30B (an example of an acquisition unit) is connected to the first camera 10 of the first imaging device C1, the reading unit 14 of the possessed information reading device C4, the communication unit 40 of the face authentication server S1, and the communication unit 70 of the possessed information authentication server S4, respectively, so as to be capable of wireless or wired communication, and performs data transmission and reception.

[0111] The control unit 31B (an example of an authentication unit and a registration unit) is configured using, for example, a CPU or an FPGA, and performs various processes and controls in cooperation with the memory 32. Specifically, the control unit 31B refers to the programs and data held in the memory 32 and executes the programs to realize the functions of the authentication device P1B.

[0112] When the control unit 31B determines that the user appearing in the face image (first captured image) is a registered user who has been registered in advance in the registered face image database DB1 and determines that registration of new authentication data for this user is necessary, the control unit 31B proceeds to acquisition processing of new authentication data (here, possession information). The control unit 31B generates a control command requesting acquisition of the possession information and transmits it to the possession information reading device C4. On the other hand, when the control unit 31B determines that registration of new authentication data is not necessary, the control unit 31B proceeds to possession information authentication processing using the registered possession information.

[0113] The possession information authentication server S4 newly registers the possession information transmitted from the possession information reading device C4, and executes user authentication based on the possession information transmitted from the authentication device P1B. The possession information authentication server S4 includes a communication unit 70, a control unit 71, a memory 72, and a registered possession information database DB4.

[0114] The communication unit 70 is connected between the possession information reading device C4 and the authentication device P1B so as to be capable of wireless or wired communication therebetween, and transmits and receives data between them.

[0115] The control unit 71 is configured using, for example, a CPU or an FPGA, and performs various processes and controls in cooperation with the memory 72. Specifically, the control unit 71 refers to the programs and data stored in the memory 72 and executes the programs, thereby realizing the functions of the possession information authentication server S4.

[0116] The control unit 71 executes registration of the possession information transmitted from the possession information reading device C4 or user authentication using the possession information. The control unit 71 transmits the registration result of the possession information or the user authentication result to the authentication device P1B.

[0117] The memory 72 has, for example, a RAM as a work memory used when executing each process of the control unit 71, and a ROM for storing programs and data that define the operation of the control unit 71. The RAM temporarily stores data or information generated or acquired by the control unit 71. The ROM has written therein a program that defines the operation of the control unit 71.

[0118] The registered possession information database DB4 is a so-called storage, and is configured using a storage medium such as a flash memory, HDD, SSD, etc. The registered possession information database DB4 stores (registers) the possessed information of a user in association with information about the user, such as a user ID.

[0119] Next, an authentication operation executed by authentication system 100B will be described with reference to Fig. 7. Fig. 7 is a sequence diagram showing an example of an operation procedure of authentication system 100B according to embodiment 3. Note that steps St11 to St18 shown in Fig. 7 are similar to steps St11 to St18 described with reference to Figs. 2 and 3, respectively, and therefore will not be described here.

[0120] The authentication device P1B acquires the face recognition score and the user ID transmitted from the face recognition server S1, and determines whether the face recognition score is equal to or greater than a first threshold value (St19).

[0121] If, in the processing of step St19, the authentication device P1B determines that the face recognition score transmitted from the face recognition server S1 is equal to or greater than the first threshold value (St19, YES), it generates a control command requesting an inquiry as to whether the user ID of the user corresponding to the face image has been registered in the registered possession information database DB4, and transmits the generated control command in association with the user ID to the possession information authentication server S4 (St20B).

[0122] On the other hand, if the authentication device P1B determines in the processing of step St19 that the face recognition score is not greater than or equal to the first threshold (St19, NO), it generates an authentication failure screen (not shown) to notify the user of the authentication failure and outputs (displays) it on the display unit 33 (St21).

[0123] The possessed information authentication server S4 compares the user ID of at least one user registered in the registered possessed information database DB4 with the user ID transmitted from the authentication device P1B based on the control command transmitted from the authentication device P1B (St22B). The possessed information authentication server S4 generates a query result (registration query result) as to whether or not the user ID transmitted from the authentication device P1B is a user ID registered in the registered possessed information database DB4, and transmits the query to the authentication device P1 (St23B).

[0124] The authentication device P1B judges whether or not the user's possessed information is not yet registered in the registered possessed information database DB4 based on the reference result transmitted from the possessed information authentication server S4 (St24B).

[0125] When it is determined in the process of step St24B that the user's possession information is not registered in the registered possession information database DB4 (St24B, YES), the authentication device P1B proceeds to a process of acquiring possession information that is new authentication data.

[0126] On the other hand, when the authentication device P1B determines in the process of step St24B that the user's possession information is not unregistered in the registered possession information database DB4 (St24B, NO), the authentication device P1B proceeds to possession information authentication processing using possession information registered in the registered possession information database DB4. Note that the possession information authentication processing executed thereafter is executed by a known method, and therefore a description thereof will be omitted.

[0127] The authentication device P1B generates a control command for acquiring the user's possession information, and transmits the generated control command to the possession information reading device C4 (St50).

[0128] The possession information reading device C4 acquires the user's possession information by accepting the input of the possession information by the user operation (St51). The possession information reading device C4 transmits the acquired possession information to the possession information authentication server S4 (St52).

[0129] The possessed information authentication server S4 associates the possessed information transmitted from the possessed information reader C4 with the user ID transmitted by the authentication device P1B, and registers (stores) the information in the registered possessed information database DB4 (St53). The possessed information authentication server S4 generates a registration completion notice of the possessed information and transmits it to the authentication device P1B (St54).

[0130] Based on the registration completion notification of the possessed information transmitted from the possessed information authentication server S4, the authentication device P1B generates a registration completion notification screen (not shown) notifying the completion of the registration of the possessed information, and outputs (notifies) it to the display unit 33 (St55).

[0131] Note that the process of acquiring the first captured image in steps St11 to St14 and the process of acquiring the possession information in steps St50 to St52 may be executed consecutively or in parallel.

[0132] As described above, when user authentication using biometric information is successful, authentication system 100B according to the third embodiment can obtain and register new authentication data (possessive information in this case) of the authenticated user.

[0133] (Embodiment 4) The authentication system 100 according to the first embodiment is managed by one server (here, face authentication server S1), and when only predetermined biometric information for user authentication is registered, another server (here, fingerprint authentication server S2) is managed and new authentication data other than the predetermined biometric authentication is acquired. The authentication system 100C according to the fourth embodiment is managed by one server, and when user authentication is successful using any one of the managed authentication data, an example is described in which biometric information (here, invisible face image) is acquired and registered as new authentication data, or the registered authentication data is updated.

[0134] Note that authentication system 100C in embodiment 4 has a partially similar configuration to authentication system 100 in embodiment 1. Therefore, in the following description of authentication system 100C according to embodiment 4, the same components as those in authentication system 100 in embodiment 1 are given the same reference numerals, and the description thereof will be omitted.

[0135] An authentication system 100C (an example of an authentication information registration system) according to the fourth embodiment will be described with reference to Fig. 8. Fig. 8 is a block diagram illustrating an example of the internal configuration of the authentication system 100C according to the fourth embodiment.

[0136] The authentication system 100C includes a first imaging device C1 (an example of a first authentication information acquisition device), a third imaging device C5 (an example of a second authentication information acquisition device), a lighting device L1, an authentication device P1C (an example of a registration device), and a face authentication server S1C (an example of a storage device). Note that the authentication system 100C shown in FIG. 8 is merely an example and is not limited thereto.

[0137] The third imaging device C5 is controlled by the authentication device P1C to capture an image of an area including the user's face and obtain a third captured image (invisible image) of the user to be used for authentication. The third imaging device C5 includes a third camera 80, a second polarizing plate 81, and a band-pass filter (hereinafter referred to as "BPF") 82.

[0138] The third camera 80 is configured to have at least an image sensor (not shown) and a lens (not shown). The image sensor is a solid-state imaging element including a Si photodiode and, for example, a CCD or CMOS, and converts an optical image formed on an imaging surface by non-visible light (internally scattered light) that has passed through the BPF 82 into an electrical signal. The third camera 80 transmits the converted data (data of the third captured image) to the authentication device P1C.

[0139] The second polarizing plate 81 is arranged orthogonal to the first polarizing plate 94 (i.e., crossed Nicols) and removes the specularly reflected light and internally scattered light reflected by the user's face and the components of other light (sunlight, visible illumination light, etc.) in a first direction (i.e., the specularly reflected light components), and transmits only the internally scattered light and the components of other light in a second direction (i.e., non-visible light).

[0140] The BPF 82 transmits only invisible light (i.e., near-infrared light with a wavelength of 940 nm) among the internally scattered light and other light transmitted through the second polarizing plate 81. As a result, the BPF 82 can transmit only invisible light with a wavelength of 940 nm, which is within the sensor sensitivity range that the Si photodiode (not shown) of the third camera 80 can receive and is subject to large attenuation of sunlight due to moisture contained in the air.

[0141] The illumination device L1 is controlled by the authentication device P1C to irradiate a user, whose face is to be authenticated, with invisible light including near-infrared light having a wavelength of 940 nm. The illumination device L1 includes a communication unit 90, a control unit 91, an illumination power supply unit 92, an illumination 93, and a first polarizing plate 94.

[0142] The communication unit 90 is connected to the third camera 80 of the third imaging device C5 so as to be able to perform data communication therebetween, and outputs a control command transmitted from the third camera 80 to the control unit 91.

[0143] Based on the control command output from the communication unit 90, the control unit 91 executes ON / OFF control of the lighting power supply unit 92 (that is, control of turning on / off the lighting 93).

[0144] The lighting power supply unit 92 is controlled by the control unit 91 to turn on and off the power supply to the lighting 93 .

[0145] The illumination 93 is realized by at least one Light-Emitting Diode (LED). The illumination 93 is supplied with power from an illumination power supply unit 92 and irradiates invisible light, which is near-infrared light with a wavelength of 940 nm. The illumination 93 may be a point light source or a surface light source.

[0146] The first polarizing plate 94 is disposed orthogonal to the second polarizing plate 81 (i.e., crossed Nicols), and polarizes the invisible light emitted from the illumination 93 in a first direction. For example, the first polarizing plate 94 transmits only the vertical component of the invisible light of the illumination 93.

[0147] The authentication device P1C performs user authentication based on the first captured image (visible image) transmitted from the first imaging device C1, registration of the third captured image (invisible image) transmitted from the third imaging device C5, user authentication based on the third captured image (invisible image), or updating of the first captured image (visible image). The authentication device P1C includes a communication unit 30C, a control unit 31C, a memory 32, and a display unit 33.

[0148] The communication unit 30C (an example of an acquisition unit) is connected to the first camera 10 of the first imaging device C1, the third camera 80 of the third imaging device C5, and the communication unit 40C of the face authentication server S1C so as to be capable of wireless or wired communication, respectively, and performs data transmission and reception.

[0149] The control unit 31C (an example of an authentication unit and a registration unit) is configured using, for example, a CPU or an FPGA, and performs various processes and controls in cooperation with the memory 32. Specifically, the control unit 31C refers to the programs and data held in the memory 32 and executes the programs to realize the functions of the authentication device P1C.

[0150] The control unit 31C detects the user's face from the first captured image (visible image) and cuts out the area containing the user's face to generate a visible face image, and detects the user's face from the third captured image (invisible image) and cuts out the area containing the user's face to generate an invisible face image.

[0151] When the control unit 31C determines that the user shown in the visible face image is a registered user who has been registered in advance in the registered visible face image database DB11 and that registration of new authentication data for this user is necessary, the control unit 31C proceeds to acquisition processing of new authentication data (here, the third captured image). The control unit 31C generates a control command requesting acquisition of the third captured image and transmits it to the second imaging device C2.

[0152] On the other hand, when the control unit 31C determines that registration of new authentication data of the user is not necessary, it judges whether or not it is necessary to update the visible face image already registered in the registered visible face image database DB11. When the control unit 31C determines that it is necessary to update the visible face image already registered in the registered visible face image database DB11, it proceeds to acquisition processing of the registered authentication data (here, the first captured image).

[0153] The face authentication server S1C calculates a face authentication score of a user appearing in a visible face image or an invisible face image transmitted from the authentication device P1C, registers an invisible face image in a registered invisible face image database DB12, or updates a visible face image registered in a registered visible face image database DB11. The face authentication server S1C includes a communication unit 40C, a control unit 41C, a memory 42, a registered visible face image database DB11, and a registered invisible face image database DB12. Note that the registered visible face image database DB11 and the registered invisible face image database DB12 may each be configured separately and connected to the face authentication server S1C so as to be able to communicate with each other.

[0154] The communication unit 40C is connected to the authentication device P1C so as to be capable of wireless or wired communication with the authentication device P1C, and transmits and receives data.

[0155] The control unit 41C is configured using, for example, a CPU or FPGA, and performs various processes and controls in cooperation with the memory 42. Specifically, the control unit 41C refers to the programs and data stored in the memory 42 and executes the programs to realize the functions of the face authentication server S1C.

[0156] The control unit 41C compares the acquired visible face image with a registered visible face image of at least one user registered in advance in the registered visible face image database DB11, and calculates (evaluates) a face recognition score that is an index of whether the user appearing in the visible face image is the same person as the registered user. The control unit 41C extracts a user ID associated with the registered visible face image of the user having the highest calculated face recognition score. The control unit 41C associates the extracted user ID with information on the face recognition score, outputs it to the communication unit 40C, and has it transmitted to the authentication device P1C.

[0157] In addition, the control unit 41C registers (stores) the acquired invisible face image in the registered invisible face image database DB12, and overwrites (updates) the acquired visible face image onto the registered visible face image registered in the registered visible face image database DB11.

[0158] The registered visible face image database DB11 is a so-called storage, and is configured using a storage medium such as a flash memory, HDD, SSD, etc. The registered visible face image database DB11 stores (registers) a registered visible face image of a user in association with information about the user, such as a user ID.

[0159] The registered non-visible face image database DB12 is a so-called storage, and is configured using a storage medium such as a flash memory, HDD, SSD, etc. The registered non-visible face image database DB12 stores (registers) a registered non-visible face image of a user in association with information about the user, such as a user ID.

[0160] Next, the authentication operation executed by the authentication system 100C will be described with reference to Fig. 9 and Fig. 10. Fig. 9 is a sequence diagram showing an example of an operation procedure of the authentication system 100C according to the fourth embodiment. Fig. 10 is a sequence diagram showing an example of an operation procedure of the authentication system 100C according to the fourth embodiment. Note that steps St11 to St18 shown in Figs. 9 and 10 are similar to steps St11 to St18 described with reference to Figs. 2 and 3, respectively, and therefore will not be described here.

[0161] The authentication device P1C acquires the face recognition score and the user ID transmitted from the face recognition server S1C, and determines whether or not the face recognition score is equal to or greater than a first threshold value (St19).

[0162] If, in the processing of step St19, the authentication device P1C determines that the face recognition score transmitted from the face recognition server S1C is equal to or greater than the first threshold value (St19, YES), it generates a control command requesting an inquiry as to whether the user's invisible face image has been registered in the registered invisible face image database DB12, and transmits the generated control command to the face recognition server S1C in association with the user ID (St20C).

[0163] On the other hand, if the authentication device P1C determines in the processing of step St19 that the face recognition score is not greater than or equal to the first threshold (St19, NO), it generates an authentication failure screen (not shown) to notify the user of the authentication failure and outputs (displays) it on the display unit 33 (St21C).

[0164] Based on the control command transmitted from the authentication device P1C, the face authentication server S1C checks the user ID of at least one user registered in the registered invisible face image database DB12 against the user ID transmitted from the authentication device P1C (St22C). The face authentication server S1C generates a check result (registration check result) indicating whether or not the invisible face image associated with the user ID transmitted from the authentication device P1C is registered in the registered invisible face image database DB12, and transmits the check result to the authentication device P1C (St23C).

[0165] The authentication device P1C judges whether or not the invisible face image of the user is unregistered based on the reference result transmitted from the face authentication server S1C (St24C).

[0166] When it is determined in the process of step St24C that the invisible face image of the user is unregistered (St24C, YES), the authentication device P1C further determines whether or not the visible face image of the user needs to be updated (St61).

[0167] On the other hand, when it is determined in the process of step St24C that the invisible face image of the user is not unregistered (St24C, NO), the authentication device P1C proceeds to a process of acquiring an invisible face image to be registered in the registered invisible face image database DB12.

[0168] When it is determined in the process of step St61 that the visible face image of the user needs to be updated (St61, YES), the authentication device P1C generates a control command requesting capturing a first captured image (visible image) and transmits the control command to the first imaging device C1. The authentication system 100C executes the processes of steps St11 to St14.

[0169] When the authentication device P1C determines in the process of step St61 that the visible face image of the user does not need to be updated (St61, NO), the authentication device P1C proceeds to invisible face image authentication processing using invisible face images already registered in the registered invisible face image database DB12. Note that the invisible face image authentication processing executed thereafter is similar to the visible face image authentication processing, and therefore a description thereof will be omitted.

[0170] The authentication device P1C generates a visible face image by cutting out the user's facial area from the first captured image (visible image) transmitted from the first imaging device C1, calculates a quality score indicating the likelihood that the generated visible face image is a visible face image suitable for face authentication using a visible image (St62), and determines whether the calculated quality score is greater than or equal to a third threshold (St63).

[0171] If the authentication device P1C determines in the processing of step St63 that the calculated quality score is equal to or greater than the third threshold (St63, YES), it associates the user ID transmitted from the face authentication server S1C with the generated visible face image and transmits them to the face authentication server S1C (St64).

[0172] On the other hand, if the authentication device P1C determines in the processing of step St63 that the calculated quality score is not greater than or equal to the third threshold (St63, NO), it further determines whether the number of NG times that the calculated quality score is determined to be less than or equal to the third threshold is greater than a predetermined number (e.g., 3 times, 5 times, etc.) (St65).

[0173] When the authentication device P1C determines in the process of step St65 that the NG count is equal to or greater than a predetermined count (St65, YES), it determines that the update of the visible face image has failed. The authentication device P1C generates an update failure screen (not shown) for notifying the user that the update of the visible face image has failed, and outputs (notifies) the screen to the display unit 33 (St66).

[0174] On the other hand, when it is determined in the process of step St65 that the number of NG attempts is not equal to or greater than the predetermined number of attempts (St65, NO), the authentication apparatus P1C returns to the process of step St11.

[0175] The face authentication server S1C overwrites (updates) the visible face image transmitted from the authentication device P1C with the registered visible face image associated with the user ID transmitted from the authentication device P1C (St67). After updating the registered visible face image, the face authentication server S1C generates an update completion notice of the registered visible face image and transmits it to the authentication device P1C (St68).

[0176] Based on the update completion notification of the registered visible face image sent from the face authentication server S1C, the authentication device P1C generates an update completion notification screen (not shown) notifying the completion of updating of the registered visible face image, and outputs (notifies) it to the display unit 33 (St69).

[0177] As described above, the authentication system 100C according to the fourth embodiment can update the registered visible face images registered in the registered invisible face image database DB12.

[0178] When the process proceeds to the acquisition process of the invisible face image, the authentication device P1C generates a control command to capture an image of the user, and transmits the generated control command to the third imaging device C5 (St70).

[0179] The third imaging device C5 generates a control command requesting turning on the light 93. The third imaging device C5 transmits the generated control command to the lighting device L1, requesting that the lighting device 93 be turned on (St71).

[0180] The lighting device L1 starts turning on the light 93 (St72).

[0181] The third imaging device C5 starts exposure of the third camera 80 (St73) and ends the exposure after a predetermined exposure time has elapsed (St74). After the exposure (imaging) ends, the third imaging device C5 acquires a third captured image (invisible image) captured by the user (St75), generates a control command requesting turning off the light 93, and transmits the control command to the lighting device L1 (St76).

[0182] The lighting device L1 turns off the light 93, and ends the illumination of the light 93 (St77).

[0183] The third imaging device C5 transmits the captured third captured image (invisible image) to the authentication device P1C (St80).

[0184] The authentication device P1C cuts out the user's face area from the third captured image transmitted from the third imaging device C5 to generate an invisible face image, and calculates a quality score indicating the likelihood that the generated invisible face image is an invisible face image suitable for face recognition using an invisible image (St81).The authentication device P1C determines whether the calculated quality score is equal to or greater than a fourth threshold (St82).

[0185] If the authentication device P1C determines in the processing of step St82 that the calculated quality score is equal to or greater than the fourth threshold (St82, YES), it associates the user ID transmitted from the face authentication server S1C with the generated invisible face image and transmits them to the face authentication server S1C (St83).

[0186] On the other hand, if the authentication device P1C determines in the processing of step St82 that the calculated quality score is not greater than or equal to the fourth threshold (St82, NO), it further determines whether the number of NG times that the calculated quality score is determined to be less than or equal to the fourth threshold is greater than a predetermined number (e.g., 3 times, 5 times, etc.) (St84).

[0187] When the authentication device P1C determines that the number of NG attempts is equal to or greater than a predetermined number of attempts in the process of step St84 (St84, YES), it determines that the registration of the invisible face image has failed. The authentication device P1C generates a registration failure screen (not shown) for notifying the user that the registration of the invisible face image has failed, and outputs (notifies) the screen to the display unit 33 (St85).

[0188] On the other hand, when it is determined in the process of step St84 that the number of NG attempts is not equal to or greater than the predetermined number of attempts (St84, NO), the authentication apparatus P1C returns to the process of step St70.

[0189] The face authentication server S1C associates the user ID and the invisible face image transmitted from the authentication device P1C with each other, and registers (stores) them in the registered invisible face image database DB12 (St86). After registering the invisible face image, the face authentication server S1C generates a registration completion notification for the registered invisible face image and transmits it to the authentication device P1C (St87).

[0190] Based on the registration completion notification of the registered invisible facial image sent from the face authentication server S1C, the authentication device P1C generates a registration completion notification screen (not shown) notifying the completion of registration of the registered invisible facial image, and outputs (notifies) it to the display unit 33 (St88).

[0191] Note that the process of acquiring the first captured image in steps St11 to St14 and the process of acquiring the third captured image in steps St70 to St80 described above may be executed consecutively or in parallel.

[0192] As described above, when the authentication system 100C according to the fourth embodiment succeeds in user authentication using biometric information, it can obtain and register new authentication data (here, an invisible face image) of the authenticated user. Furthermore, the authentication system 100C can update the registered authentication data (here, a visible face image) registered in authentication using authentication data that changes over time, such as face authentication, or authentication using authentication data that is / should be changed periodically, such as a password or an employee ID card. Therefore, the authentication system 100C can improve the authentication accuracy of multi-factor authentication.

[0193] As described above, the authentication devices P1 to P1C (an example of an authentication information registration device) in the first to fourth embodiments include communication units 30 to 30C (an example of an acquisition unit) that acquire first authentication information used for a first authentication of a user (an example of a person to be authenticated) and second authentication information used for a second authentication different from the first authentication, control units 31 to 31C (an example of an authentication unit) that authenticate the user based on the acquired first authentication information, and control units 31 to 31C (an example of a registration unit) that output the user information and the second authentication information in association with each other based on the first authentication result and register them in the face authentication server S1C, the fingerprint authentication server S2, the stored information authentication server S3, or the possessed information authentication server S4 (an example of a storage device). Note that the storage device may be the registered fingerprint image database DB2, the registered stored information database DB3, the registered possessed information database DB4, or the registered invisible face image database DB12.

[0194] As a result, when the authentication devices P1 to P1C in the first to fourth embodiments are successful in user authentication using the first authentication information, they can obtain and register new authentication data (i.e., second authentication information) for the authenticated user. Therefore, the authentication devices P1 to P1C enable multi-factor authentication or multi-modal authentication in the next and subsequent user authentications.

[0195] Furthermore, when the control units 31-31C of the authentication devices P1-P1C in the first to fourth embodiments determine based on the first authentication result that the user has been authenticated, they determine whether or not second authentication information has been registered in the face authentication server S1C, the fingerprint authentication server S2, the stored information authentication server S3, or the possessed information authentication server S4, and when they determine that the second authentication information has not been registered, they output the user information and the second authentication information in association with each other to the face authentication server S1C, the fingerprint authentication server S2, the stored information authentication server S3, or the possessed information authentication server S4. As a result, the authentication devices P1-P1C in the first to fourth embodiments enable multi-factor authentication or multi-modal authentication in the next and subsequent user authentications by registering new authentication data (second authentication information).

[0196] Furthermore, when the control units 31 to 31C of the authentication devices P1 to P1C in the first to fourth embodiments determine that the second authentication information is registered in the face authentication server S1C, the fingerprint authentication server S2, the stored information authentication server S3, or the possessed information authentication server S4, they omit outputting the user information and the second authentication information. This allows the authentication devices P1 to P1C in the first to fourth embodiments to prevent the registered authentication data from being automatically updated.

[0197] Furthermore, when the communication unit 30C of the authentication device P1C in the fourth embodiment determines that the second authentication information has been registered in the face authentication server S1C, it acquires new first authentication information of the user. The control unit 31C outputs the acquired new first authentication information and updates the registered authentication information used for matching with the first authentication information in the first authentication to the new first authentication information. As a result, in authentication using, for example, a face image, a password, or the like, in which updating of registered authentication data is desired, the authentication device P1C in the fourth embodiment can suppress spoofing by other users by acquiring and registering updated authentication data after user authentication, and enables more accurate multi-factor authentication or multi-modal authentication by updating the registered authentication data.

[0198] Furthermore, when the control units 31 to 31C of the authentication devices P1 to P1C in the first to fourth embodiments determine that the user is not authenticated based on the first authentication information, they omit outputting the user information and the second authentication information. This allows the authentication devices P1 to P1C in the first to fourth embodiments to more effectively prevent erroneous registration of authentication data.

[0199] Moreover, the first authentication information of the authentication devices P1 to P1C in the first to fourth embodiments is biometric information of the user. The second authentication information is biometric information, knowledge information, or possessed information of the user. This allows the authentication devices P1 to P1C in the first to fourth embodiments to register new authentication data to be used for other authentications when the user is authenticated by biometric authentication, which is a more advanced authentication.

[0200] Furthermore, the control units 31 to 31C of the authentication devices P1 to P1C in the first to fourth embodiments authenticate the user based on the first authentication information after the first authentication information and the second authentication information are acquired by the communication units 30 to 30C. This allows the authentication devices P1 to P1C in the first to fourth embodiments to further reduce the time required to acquire two different pieces of authentication information.

[0201] Furthermore, when the communication units 30-30C of the authentication devices P1-P1C in the first to fourth embodiments determine that the user is authenticated based on the first authentication information, they acquire the second authentication information, which allows the authentication devices P1-P1C in the first to fourth embodiments to more effectively prevent erroneous registration of authentication data.

[0202] Furthermore, the authentication systems 100 to 100C (an example of an authentication information registration system) in the first to fourth embodiments include a first imaging device C1 (an example of a first authentication information acquisition device) capable of acquiring first authentication information used for a first authentication of a user (an example of a person to be authenticated), a second imaging device C2, a stored information acquisition device C3, a possessed information reading device C4, or a third imaging device C5 (an example of a second authentication information acquisition device) acquiring second authentication information used for a second authentication different from the first authentication, a face authentication server S1C, a fingerprint authentication server S2, a stored information authentication server S3, or a possessed information authentication server S4 (an example of a storage device) recording user information and the second authentication information used for the second authentication, and authentication devices P1 to P1C (an example of a registration device) capable of communicating with the first authentication information acquisition device, the second authentication information acquisition device, and the second imaging device C2, the stored information acquisition device C3, the possessed information reading device C4, or the third imaging device C5. The authentication devices P1 to P1C acquire first authentication information and second authentication information, authenticate the user based on the acquired first authentication information, and, based on the result of the first authentication, associate the user information with the second authentication information and output it to the face authentication server S1C, the fingerprint authentication server S2, the stored information authentication server S3 or the possessed information authentication server S4 for registration.

[0203] As a result, when the authentication systems 100 to 100C in the first to fourth embodiments are successful in user authentication using the first authentication information, they can obtain and register new authentication data (i.e., second authentication information) for the authenticated user. Therefore, the authentication systems 100 to 100C enable multi-factor authentication or multi-modal authentication in the next and subsequent user authentications.

[0204] Although various embodiments have been described above with reference to the accompanying drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art can conceive of various modifications, corrections, substitutions, additions, deletions, and equivalents within the scope of the claims, and it is understood that these also belong to the technical scope of the present disclosure. In addition, the components in the various embodiments described above may be arbitrarily combined within the scope of the invention. [Industrial Applicability]

[0205] INDUSTRIAL APPLICABILITY The present disclosure is useful as providing an authentication information registration device, an authentication information registration method, and an authentication information registration system for acquiring authentication data used for a plurality of different authentications. [Explanation of symbols]

[0206] 30,30A,30B,30C,40,40C,50,60,70,90 Communication department 31, 31A, 31B, 31C, 41, 41C, 51, 61, 71, 91 Control unit 100, 100A, 100B, 100C Authentication System C1 First imaging device C2 Second imaging device C3 Memory information acquisition device C4 possession information reader C5 3rd imaging device DB1 Registration face image database DB2 Enrollment Fingerprint Image Database DB3 Registered Information Database DB4 Registration and possession information database DB11 Registered visible face image database DB12 Registered Non-visible Face Image Database L1 lighting system P1, P1A, P1B, P1C authentication device S1, S1C Face recognition server S2 Fingerprint Authentication Server S3 storage authentication server S4 Possession information authentication server

Claims

1. an acquisition unit that acquires first authentication information used for a first authentication of an authenticatee and second authentication information used for a second authentication different from the first authentication; an authentication unit that authenticates the person to be authenticated based on the acquired first authentication information; a registration unit that outputs information about the person to be authenticated and the second authentication information in association with each other based on a result of the first authentication, and registers the information in a storage device. Authentication information registration device.

2. when it is determined that the person to be authenticated has been authenticated based on the first authentication result, the registration unit determines whether or not the second authentication information has been registered in the storage device, and when it is determined that the second authentication information has not been registered, outputs information about the person to be authenticated and the second authentication information to the storage device in association with each other. The authentication information registration device according to claim 1 .

3. when it is determined that the second authentication information is registered in the storage device, the registration unit omits output of the information of the authenticatee and the second authentication information. The authentication information registration device according to claim 2 .

4. when it is determined that the second authentication information has been registered in the storage device, the acquisition unit acquires new first authentication information of the person to be authenticated; the registration unit outputs the acquired new first authentication information, and updates registered authentication information used for matching with the first authentication information in the first authentication to the new first authentication information. The authentication information registration device according to claim 2 .

5. When the registration unit determines that the person to be authenticated is not authenticated based on the first authentication information, the registration unit omits output of information about the person to be authenticated and the second authentication information. The authentication information registration device according to claim 1 .

6. The first authentication information is biometric information of the person to be authenticated, The second authentication information is biometric information, knowledge information, or possession information of the person to be authenticated. The authentication information registration device according to claim 1 .

7. the authentication unit authenticates the person to be authenticated based on the first authentication information after the acquisition unit acquires the first authentication information and the second authentication information. The authentication information registration device according to claim 1 .

8. when determining that the person to be authenticated has been authenticated based on the first authentication information, the acquisition unit acquires the second authentication information. The authentication information registration device according to claim 1 .

9. An authentication information registration method performed by a registration device that registers authentication information used for authenticating an authenticatee, comprising: an acquisition unit that acquires first authentication information used for a first authentication of the person to be authenticated and second authentication information used for a second authentication different from the first authentication; an authentication unit that authenticates the person to be authenticated based on the acquired first authentication information; based on the result of the first authentication, outputting information of the person to be authenticated and the second authentication information in association with each other to a storage device for registration; How to register credentials.

10. a first authentication information acquisition device capable of acquiring first authentication information used for a first authentication of an authenticatee; a second authentication information acquisition device that acquires second authentication information used for a second authentication different from the first authentication; a storage device that records information about the person to be authenticated and the second authentication information used for the second authentication; An authentication information registration system comprising: a registration device capable of communicating between the first authentication information acquisition device, the second authentication information acquisition device, and the storage device; The registration device includes: Obtaining the first authentication information and the second authentication information; authenticating the person to be authenticated based on the acquired first authentication information; based on the result of the first authentication, outputting information of the person to be authenticated and the second authentication information in association with each other to the storage device and causing the information to be registered; Credentials registration system.

Images