Information processing device, information processing method, and program

Abstract

To shorten the standby time until re-authentication when the face authentication fails.SOLUTION: The face of a user is detected from an image. The user authentication is performed on the basis of a face detection result. An authentication result of the user authentication is displayed on a display part. When the user authentication fails, it is determined, whether or not the user has an intention to perform the re-authentication based on the detection result of the face from the image. In response to determining that the user has the intention to perform the re-authentication, the display of the authentication result is updated, and the user authentication is resumed.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] In recent years, entry / exit systems that unlock doors using facial recognition technology have emerged. Such technology authenticates entrants by capturing a photograph of their face on a camera, such as a tablet PC, and displays the authentication result on a display while controlling the door lock. Patent Document 1 discloses a technology that determines whether entry is permitted or not based on the number of times facial recognition fails, and outputs the result of the determination on a display. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-38545 Summary of the Invention [Problem to be solved by the invention]

[0004] When the facial recognition result is displayed, the screen typically returns to the previous screen after a certain period of time has passed. However, in this case, even if the user wants to immediately re-authenticate after authentication has failed, the result is displayed for a certain period of time, making the user wait.

[0005] The present invention aims to shorten the waiting time until re-authentication when face authentication fails. [Means for solving the problem]

[0006] To achieve the object of the present invention, for example, an information processing device according to one embodiment comprises the following configuration: detection means for detecting a user's face from an image, authentication means for authenticating the user based on the face detection result, control means for displaying the authentication result of the user authentication on a display unit, first determination means for determining whether the user intends to be re-authenticated based on the face detection result from the image when the user authentication has failed, and restart means for updating the display of the authentication result and restarting the authentication of the user in response to determining that the user intends to be re-authenticated. and a third determination means for determining whether or not the face of the user detected when authentication of the user fails is the face of the same person as the user who performed the authentication, and the first determination means determines whether or not the user intends to be re-authenticated in response to the determination that the face is the face of the same person. . [Effects of the Invention]

[0007] To shorten the waiting time until re-authentication when face authentication fails. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an information processing apparatus according to an embodiment of the present invention. [Figure 2] 10 is a flowchart showing an example of face authentication processing according to the embodiment. [Figure 3] 10 is a flowchart showing an example of a re-authentication determination process according to the embodiment. [Figure 4] FIG. 4 is a diagram for explaining a user authentication process according to the embodiment. [Figure 5] FIG. 10 is a diagram for explaining a user re-authentication process according to the embodiment. [Figure 6] 10A and 10B are diagrams for explaining a display example of guide information at the time of re-authentication according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0010] FIG. 1(a) is a block diagram showing an example of the hardware configuration of an information processing device 100 according to an embodiment of the present invention. A CPU (Central Processing Unit) 101 is a central processing unit that performs arithmetic and logical processing for various processes and controls each component of the information processing device 100 connected to a system bus 111. A ROM (Read Only Memory) 102 is a program memory that stores programs for causing the CPU 101 to perform processes performed by each functional unit (described below). A RAM (Random Access Memory) 103 is a data memory that includes a work area for the above-mentioned programs, a data save area for error processing, and a load area for control programs. The location where the programs that control each process are stored is not particularly limited; for example, the programs may be stored in an external device of the information processing device 100 and loaded as needed.

[0011] The HDD 104 is a hard disk that stores electronic data and programs for performing each process according to this embodiment. It is not necessary for all data to be stored on the HDD 104; some or all of the data may be stored on an external device, such as a media (storage medium) and an external storage drive for accessing the media. This external device may be, for example, a flexible disk (FD), CD-ROM, DVD, USB memory, MO, or flash memory, or a server device connected to the information processing device 100 via a network.

[0012] The input device 105 is a device for acquiring user operation information (input) to the information processing device 100. The input device 105 includes, for example, a pointing device such as a mouse or a touch panel, a joystick, or a keyboard. The input device 105 may also include a weighing device such as a scale installed in a self-checkout register. The output device 106 is, for example, a device that performs display output such as a display, and is capable of displaying various processing results output by the display unit 115 in FIG. 1(b).

[0013] The communication interface (I / F) 107 connects the information processing device 100 to an external device (such as an information processing device, a communication device, or an external storage device) via a known communication technology so that they can communicate with each other via wired or wireless communication. The communication I / F 107 according to this embodiment connects to an imaging device 108, which is a network camera, via a LAN, and acquires video captured by the imaging device 108 in real time.

[0014] The imaging device 108 is a camera that transmits a captured image to the information processing device 100 via a network. In this embodiment, the imaging device 108 captures an image that captures the face of a person entering a room for which face authentication is to be performed within the angle of view, and transmits the image to the information processing device 100. The imaging device 108 according to this embodiment will be described as a network camera, but is not limited to this as long as it has similar functions, and may be, for example, a web camera or a camera connected via USB.

[0015] The management system 109 is a system that performs various processes related to unlocking or locking an electric lock depending on the result of user authentication using a face image, and performs control depending on the result of processing by the information processing device 100.

[0016] FIG. 1B is a block diagram showing an example of the functional configuration of the information processing device 100. The information processing device 100 detects a user's face in an image and authenticates the user based on the face detection result. If user authentication fails, the information processing device 100 determines whether the user intends to re-authenticate based on the face detection result, and resumes user authentication if it determines that the user intends to re-authenticate. To this end, the information processing device 100 includes a control unit 111, a face authentication unit 112, an image acquisition unit 113, a storage unit 114, and a display unit 115. The face authentication unit 112 also includes a face detection unit 116 and a face matching unit 117. Each of these functional units is implemented by the CPU 101 loading a program stored in the ROM 102 into the RAM 103 and executing processing, examples of which are shown in the flowcharts described below.

[0017] The control unit 111 is composed of a CPU 101 and other components, and reads programs and data stored in a ROM 102 into a RAM 103 to execute various processes. The face authentication unit 112 authenticates a user based on the detection result of the user's face in an image. In this embodiment, the face authentication unit 112 detects the user's face using a face detection unit 116, extracts features, and performs user authentication by comparing the detected features with registered face images stored in a memory unit 114 using a face matching unit 117. The face detection unit 116 can detect a face from an image containing the face of, for example, a person entering a predetermined area, and acquire information such as the position, size, and orientation of the face, or whether or not the face is wearing a mask. The face detection unit 116 also stores and retains the face detection result in the memory unit 114 for use in the re-authentication process described below.

[0018] As described above, the face matching unit 117 according to this embodiment performs user authentication based on the user's face detected from an image and the registered face image.

[0019] The image acquisition unit 113 acquires captured images captured by the imaging device 108. The image acquisition unit 113 according to this embodiment acquires time-sequential moving images, and can subject images included in the acquired moving images to the various processes described below. The image acquisition unit 113 may also function as a communication unit that transmits information regarding locking / unlocking to the management system 109.

[0020] The storage unit 114 stores the results of processing by the face authentication unit 112 and registered face images used in face matching. The registered face images according to this embodiment can be registered from images captured by the imaging device 108 during initial registration setup, but may also be set arbitrarily, for example, by using images received from an external device.

[0021] The display unit 115 displays the results of various processes on the output device 106. The display unit 115 according to this embodiment displays the authentication result of user authentication by the face matching unit 117 (hereinafter, when simply referred to as "authentication result," it will refer to the authentication result of user authentication) on a display. For example, if the user authentication is successful, the display unit 115 can display an authentication success screen indicating that fact. The display of the authentication success screen may be, for example, a display of a string such as "Authentication OK" as shown in screen 403 in FIG. 4 described later, or may be displayed by changing the color of a rectangle surrounding the face on the screen or the border of the screen (for example, from white to green), and is not particularly limited.

[0022] Furthermore, if user authentication has failed, for example, the display unit 115 can display an authentication failure screen indicating that fact. The display of the authentication failure screen may be, for example, a display of a character string such as "Authentication NG" as shown in screen 404 in Fig. 4, or may be a display of a rectangle surrounding the face on the screen or a change in color of the screen border (for example, from white to red), and is not particularly limited.

[0023] Furthermore, when user authentication fails (here, when an authentication failure screen is displayed), the display unit 115 determines whether the user intends to perform re-authentication based on the result of detecting the user's face from the image. In this embodiment, the display unit 115 determines whether the user intends to perform re-authentication based on the result of detecting the user's face at the time of authentication failure; this process will be described in detail later with reference to FIG. 3. In the following description, the result of detecting the user's face at the time of authentication failure is used as the above-mentioned criterion; however, this criterion is not particularly limited to this as long as it can be used to determine whether the user intends to perform re-authentication. For example, the above-mentioned criterion may be generated based on features extracted from a video captured at the time when authentication failure is displayed. That is, for example, an average of scores calculated from the video at multiple times may be used as a score, which will be described later. In the following, determining whether the user intends to perform re-authentication will also be simply referred to as "re-authentication determination."

[0024] In this embodiment, if it is determined that the user does not intend to re-authenticate, an authentication failure screen is displayed and the next authentication is started after a predetermined waiting time. On the other hand, if it is determined that the user intends to re-authenticate, the process proceeds to re-authentication processing without waiting for the predetermined waiting time. This predetermined waiting time can be set arbitrarily, for example, to 3 seconds.

[0025] 2 to 4, a description will be given of a re-authentication determination process performed by the information processing device 100 according to this embodiment when authentication fails. FIG. 2 is a flowchart showing an example of a user authentication process using an image captured by the imaging device 108, performed by the information processing device 100 according to this embodiment. FIG. 4 is a diagram for explaining the user authentication process, in which FIG. 4(a) is a schematic diagram showing how a user enters a room through facial authentication, and FIG. 4(b) shows an example of a screen displayed on the output device 106 during the facial authentication of FIG. 4(a). In this embodiment, when a user stands in front of the output device 106 as indicated by 400 in FIG. 4(a), the processes shown in FIG. 2 are started.

[0026] In S200, the display unit 115 causes the output device 106 to display a default guide. The guide display according to this embodiment is exemplified as a screen 402 in FIG. 4(b). The screen 402 displays a (circular) area on the captured image where the face should be positioned during authentication, and a character string notifying the user ("Bring your face closer"). This guide display is an example, and it is possible to simply display the captured image, or to display information not directly related to face authentication, such as body temperature detected by a detection unit (not shown), and any desired display is possible. Note that in this embodiment, the guide display generated in S210 may be displayed when re-authentication is performed.

[0027] In S201, the image acquisition unit 113 acquires a captured image from the imaging device 108. In S202, the face detection unit 116 detects the user's face from the captured image acquired in S201 and extracts feature amounts to generate a face detection result. The face detection result of the face detection unit 116 according to this embodiment may include information indicating the feature amounts of the face, the position of the center of the face in the image (X, Y coordinates), the orientation of the face (pitch angle, roll angle, and yaw angle), and the size of the face (number of pixels). In addition, the face detection unit 116 may determine whether the user is wearing a mask and include the determination result in the face detection result.

[0028] In S203, the face matching unit 117 matches the face detected in S202 with the registered face images stored in the storage unit 114. Here, the face matching unit 117 acquires the registered name of the user corresponding to the image determined to be most similar (having the highest similarity score) among the registered face images, and the similarity score. In S204, the face matching unit 117 determines whether the similarity score acquired in S203 exceeds a predetermined threshold (which can be set arbitrarily). If it exceeds the threshold, the authentication is successful and the process proceeds to S211; if it does not, the authentication is not successful and the process proceeds to S205. Note that these authentication processes performed by the face matching unit 117 can be implemented using known authentication technologies, and therefore detailed description thereof will be omitted; however, any other authentication technology may be used as long as it is capable of authenticating the user's face.

[0029] In S205, the display unit 115 causes the output device 106 to display an authentication failure screen. As described above, screen 404 in FIG. 4(b) is an example of an authentication failure screen, in which the words "Authentication NG" are displayed and a rectangle surrounding the user's face area is displayed in red. In S206, the memory unit 114 stores the face detection results (generated in S202) when authentication fails. In S207, the memory unit 114 stores the facial features extracted when authentication fails.

[0030] In S208, the face matching unit 117 determines whether or not the user intends to perform re-authentication, and if it is determined that the user intends to perform re-authentication, the process proceeds to S209, and if not, the process proceeds to S213. Here, the face matching unit 117 performs re-authentication determination based on the face detection result stored in S206. The re-authentication determination process will be described in detail with reference to FIG. 3.

[0031] In S209, the display unit 115 updates the display on the output device 106. Here, the display unit 115 cancels the display of the authentication failure screen. In S210, the display unit 115 generates a guide display to be displayed during re-authentication, and returns the process to S200. The display unit 115 may generate guide information indicating improvements required for authentication based on, for example, the face detection result (stored in S206) at the time of authentication failure and the face detection result at the time of re-authentication determination generated in S301, which will be described later, and display the guide information. This process will be described in detail with reference to FIGS. 3 and 6. The display unit 115 may generate guide information to improve the score that can be calculated in S307, which will be described later (for example, when the score is equal to or less than a predetermined threshold), and display the guide information. In the example described in FIG. 3, the display unit 115 compares the score calculated from the detection result at the time of authentication failure with the score calculated from the detection result at the time of re-authentication determination, and generates guide information to improve the score for items that have not been improved (such as the face orientation).

[0032] If the authentication is successful in S204, the display unit 115 displays an authentication success screen in S211. In S212, the control unit 111 transmits information indicating that the authentication is successful to the management system, and the process proceeds to S213. The management system 109 performs unlocking processing in response to receiving the information transmitted in S212. 402 in Fig. 4(a) shows an example in which unlocking has been performed.

[0033] In S213, the display unit 115 displays an authentication failure screen or an authentication success screen for a predetermined time, waits for a predetermined time, and then ends the process. Here, the screen is displayed for a predetermined time set so that the user can easily check the authentication result, but this time can be set arbitrarily.

[0034] Next, the re-authentication determination process in S208 will be described with reference to Fig. 3. In S300, the image acquisition unit 113 acquires a captured image from the imaging device again.

[0035] In S301, the face detection unit 116 detects the user's face from the captured image acquired in S300, extracts features, and generates a face detection result. The face detection result generated here is assumed to be the same as that generated in S202. In S302, the face matching unit 117 acquires the features of the face stored in S207 (i.e., the face that failed to be authenticated).

[0036] In S303, the face matching unit 117 determines whether the faces belong to the same person based on the facial feature amount generated in S301 and the facial feature amount acquired in S302. If they belong to the same person, the process proceeds to S304; if not, the process proceeds to S308.

[0037] In S304, the face matching unit 117 acquires the face detection result stored in S206 (i.e., the face that failed to be authenticated). In S305, the face matching unit 117 compares the face detection result generated in S301 with the face detection result acquired in S304. In S306, the face matching unit 117 saves the comparison result of S305.

[0038] In S307, the face matching unit 117 determines whether or not a predetermined condition for determining that the user intends to perform re-authentication is met, based on the comparison result of S305. If the predetermined condition is met, the process proceeds to S309; ​​if not, the process proceeds to S308. Here, the face matching unit 117 determines that the predetermined condition is met if the face detection result generated in S301 is in an improved state for user authentication compared to the face detection result acquired in S304.

[0039] An example will be described below in which the face detection result generated in S301 is improved compared to the face detection result (acquired in S304) when authentication failed. For example, the face matching unit 117 can determine whether the face position, face size, or face orientation has been improved. Here, the face matching unit 117 can determine that the face is improved when the center position of the face is closer to the center position of the captured image, when the face size is larger, or when the face orientation is closer to the front (toward the camera).

[0040] The face matching unit 117 determines that the above-mentioned improved state exists when the score calculated using, for example, any of the following formulas (1) to (4) is higher for the face detection result generated in S301 than for the face detection result acquired in S304. Formulas (1) to (4) are formulas for calculating the face position score, face orientation score, face size score, and face detection score (a score obtained by combining the above three scores), respectively. Face position score = (1 ÷ | (X coordinate of the center of the image) - (X coordinate of the center of the detected face) |) + (1 ÷ | (Y coordinate of the center of the image) - (Y coordinate of the center of the detected face) |) Equation (1) Face direction score = (1 ÷ |(pitch angle)|) + (1 ÷ |(roll angle)|) + (1 ÷ |(yaw angle)|) Equation (2) Face size score = (number of pixels of detected face) Equation (3) Face detection score = (face position score) + (face orientation score) + (face size score) Equation (4)

[0041] Note that the pitch angle, roll angle, and yaw angle included in the face orientation are each set to 0 degrees when facing forward (toward the camera), and have a value range of 180 degrees to -180 degrees. In addition, in equation (4), the face detection score is the sum of the face position score, face orientation score, and face size score. However, the face detection score may be the weighted sum of these scores, or the sum of two of these three scores. In this example, the determination is made using one of equations (1) to (4). However, for example, the determination of whether or not an improved state has been achieved may be made using multiple of these equations. For example, the face matching unit 117 may calculate a score for each of equations (1) to (3), and determine that an improved state has been achieved if the scores based on the face detection results generated in S301 for two or more of these equations are higher than the scores at the time of authentication failure.

[0042] Note that this is just one example, and the face matching unit 117 may determine whether the state has been improved under different conditions. For example, the face matching unit 117 may perform the re-authentication determination process taking into account the presence or absence of clothing such as a mask. Here, if the detection result in S304 shows that the subject is wearing a mask, but the detection result in S301 shows that the subject is not wearing a mask (the subject has removed the mask), the face matching unit 117 may determine that the subject intends to perform re-authentication. In this case, the face matching unit 117 may determine whether the subject intends to perform re-authentication by comparing the presence or absence of clothing such as sunglasses, glasses, or a hat instead of a mask. Alternatively, a score may be calculated depending on the presence or absence of a mask, and a final determination may be made taking other scores into account, as in equation (4).

[0043] In S308, the face matching unit 117 determines that the user does not intend to perform re-authentication, and the process proceeds to S213 in Fig. 2. In S309, the face matching unit 117 determines that the user intends to perform re-authentication, and the process proceeds to S209 in Fig. 2.

[0044] According to this process, when user authentication fails, it is determined whether the user intends to re-authenticate, and if it is determined that the user intends to re-authenticate, it is possible to resume user authentication. Therefore, for a user who has failed user authentication but intends to re-authenticate, the waiting time until re-authentication can be shortened.

[0045] [Specific example] Next, with reference to (a) of FIG. 5, a specific example of the process of re-authentication in the flowchart shown in FIG. 2 will be described. Image 500 in FIG. 5 is an image acquired in S201 when authentication fails, and image 501 is an image acquired in S300 when a subsequent re-authentication decision is made. When the process of FIG. 2 starts, the display unit 115 displays a guide display in S200. Here, unless otherwise specified, a character string saying "Please move your face closer" is displayed on the output device 106 as a guide display. In S201, the image acquisition unit 113 acquires an image 500 captured by the imaging device 108. In S202, the face detection unit 116 performs face detection and feature extraction from the acquired image 500. Here, the rectangle shown on the image 500 represents the detected face, and the score calculated from this detection result based on Equation (4) is referred to as SCOREa. Note that in the example of FIG. 5(a), the person entering the room adjusts their position to be better photographed upon seeing the character string displayed when authentication fails.

[0046] The face matching unit 117 performs face matching processing in S203, and determines whether user authentication is successful in S204. Here, the similarity score does not reach a predetermined threshold, so the flow is NO and the process proceeds to S205. In S205, the display unit 115 displays an authentication failure screen, and the face detection results and feature amounts are stored in the memory unit 114 in S206 and S207.

[0047] The following describes S208, which is the re-authentication determination process. In S300, the image acquisition unit 113 acquires the image 501 shown in the figure. In S301, the face detection unit 116 performs face detection and feature extraction from the acquired image 501. Here, the rectangle shown on the image 501 is the detected face, and the score calculated from this detection result based on equation (4) is SCOREb.

[0048] In S302, the face matching unit 117 acquires the facial features (stored in S207) when authentication failed. In S303, the face matching unit 117 determines whether the face from which the features have been extracted this time is the same person as the face acquired in S302. Here, it is determined that they are the same person, and the process proceeds to S304.

[0049] In S304, the face matching unit 117 obtains the detection result from when authentication failed from the storage unit 114, and in S305 compares the current detection result with the face detection result from when authentication failed. Here, the current detection result is improved in all aspects of face position, face size, and face orientation compared to when authentication failed, and SCOREb is higher than SCOREa. In S306, the face matching unit 117 saves the comparison result, and in S309 it determines to perform re-authentication, and the process proceeds to S209.

[0050] In S209, the display unit 115 cancels the display of the authentication failure screen, and in S210, guide information is generated. As described above, the comparison result saved in S306 shows improvements in all aspects of face position, face size, and face orientation compared to when authentication failed, so the message displayed in the guide remains default and the process returns to S200. The process for re-authentication is carried out according to the above processing flow.

[0051] Next, an example in which re-authentication is not performed in the flowchart of FIG. 2 will be described using the specific example of FIG. 5(b). Image 502 in FIG. 5 is the image acquired in S201 when authentication fails, and image 503 in FIG. 5 is the image acquired in S300 when re-authentication is determined. When the processing of FIG. 2 starts, a guide is displayed (S200). The processing from S200 to S304 is the same as that described in the specific example of FIG. 5(a) except that the calculated score is different, so a duplicated description will be omitted. In the example of FIG. 5(b), the person entering the room sees the message displayed when authentication fails and gives up and tries to leave.

[0052] Here, it is assumed that the face detection score acquired in S202 is SCOREc, and the face detection score acquired in S301 is SCOREd. In the example of FIG. 5(b), the face size remains the same in the current detection result compared to when authentication failed, but the face position is farther away from the center of the image and the face orientation is no longer facing forward, so SCOREd is lower than SCOEREc. The face matching unit 117 stores the score comparison result in the memory unit 114 in S306, determines in S308 not to perform re-authentication, and proceeds to S213. In S213, the display unit 113 displays an authentication failure screen for a predetermined period of time, and then ends the process.

[0053] Next, an example in which re-authentication is performed according to the flowchart of FIG. 2 and the guide is changed depending on the result of the re-authentication determination will be described using the specific example of FIG. 6. Image 600 in FIG. 6 is the image acquired in S201 when authentication fails, and image 601 in FIG. 6 is the image acquired in S300 when re-authentication determination is made. The processes from S200 to S304 are the same as those described in the specific examples of FIGS. 5(a) and (b) except that the calculated scores are different, so duplicated explanations will be omitted. In the example of FIG. 6, upon seeing the character string when authentication fails, the entrant adjusts their position to be photographed better.

[0054] Here, it is assumed that the face detection score acquired in S202 is SCOREe, and the face detection score acquired in S301 is SCOREf. In the example of Fig. 6, the face position and face orientation in the current detection result have been improved compared to when authentication failed, and SCOREf is higher than SCOREe. In S306, the face matching unit 117 saves the comparison result, and in S309, it determines to perform re-authentication, and the process proceeds to S209.

[0055] In S209, the display unit 115 cancels the display of the authentication failure screen, and in S210, guide information is generated. As described above, the comparison result saved in S306 shows that the face position and face orientation have been improved compared to when authentication failed, but the face size has not. Therefore, guide information including the character string "Please take a larger picture of your face" is generated, as shown on screen 602, and the process returns to S200. With the above process flow, it is possible to change the guide information and then perform re-authentication.

[0056] 6, guide information is generated as improvement points for items for which the score at the time of re-authentication determination has not improved from the score at the time of authentication failure. However, what is considered to be guide information is not particularly limited to this as long as it is generated as improvement points. For example, the display unit 115 refers to the detection result at the time of re-authentication determination, and when the size of the face is smaller (or larger) than a predetermined threshold, the display unit 115 determines that the face is far (or small) and generates a character string saying "Please move your face closer (away)" as guide information. In this way, the display unit 115 may generate guide information as improvement points for items for which the score at the time of re-authentication determination calculated in S307 is not within a desired range.

[0057] Furthermore, in this embodiment, the display of the authentication failure screen is described as being canceled in S209, but this display does not need to be canceled here. For example, the waiting time may be terminated and re-authentication may be performed while all or part of the authentication failure screen remains displayed. In other words, the re-authentication process may be performed while the "Authentication NG" character string as displayed in S404 is still displayed, along with a guide. In this way, by updating the display of the authentication result without canceling the display of the authentication failure screen, re-authentication can be performed without impairing the ability to confirm the authentication result.

[0058] (Other Examples) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0059] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0060] 111: control unit, 112: face authentication unit, 113: image acquisition unit, 114: storage unit, 115: display unit

Claims

1. a detection means for detecting a user's face from an image; an authentication means for authenticating the user based on the face detection result; a control means for displaying the authentication result of the user on a display unit; a first determination means for determining whether the user intends to be re-authenticated based on a result of detecting the face from the image when authentication of the user has failed; a restart means for updating the display of the authentication result and restarting authentication of the user in response to determining that the user intends to perform re-authentication; a third determination means for determining whether or not the face of the user detected when the authentication of the user fails is the face of the same person as the user who performed the authentication; The information processing apparatus is characterized in that the first determination means determines whether the user intends to be re-authenticated in response to the determination that the face is that of the same person.

2. 2. The information processing device according to claim 1, wherein the restarting means, when determining that the user does not intend to perform the re-authentication, waits for a predetermined time before restarting the authentication of the user, and when determining that the user intends to perform the re-authentication, restarts the authentication of the user without waiting for the predetermined time.

3. 3. The information processing apparatus according to claim 1, wherein the first determination means determines whether or not the user intends to perform the re-authentication based on the detected face of the user.

4. 4. The information processing apparatus according to claim 3, wherein the first determination means determines whether or not the user intends to perform the re-authentication based on at least one of a position, a size, and a direction of the user's face.

5. 5. The information processing device according to claim 4, wherein the first determination means determines that the user intends to perform the re-authentication based on any of the following: the position of the user's face is closer to the center of the image, the size of the face is larger, or the orientation of the face is more forward compared to when the authentication failed.

6. The device further includes a second determination means for determining whether the user is wearing predetermined clothing, 6. The information processing device according to claim 1, wherein the first determination means determines whether the user intends to undergo re-authentication, taking into consideration a determination result of whether the user is wearing the predetermined clothing.

7. 7. The information processing device according to claim 6, wherein the first determination means determines that the user intends to perform re-authentication if the user is wearing the specified clothing when the authentication fails and if the user is not wearing the specified clothing when determining whether the user intends to perform re-authentication.

8. 8. The information processing apparatus according to claim 6, wherein the predetermined clothing is a mask.

9. further comprising a generating means for generating guide information, which is information to be improved for authentication, when the authentication fails; The information processing apparatus according to claim 1 , wherein the restarting means updates the display of the authentication result by displaying the guide information on the display unit.

10. detecting a user's face from the image; authenticating the user based on the face detection result; a step of displaying an authentication result of the user authentication on a display unit; If authentication of the user fails, determining whether the user intends to be re-authenticated based on the face detection result from the image; updating the display of the authentication result and restarting authentication of the user in response to determining that the user intends to perform re-authentication; a step of determining whether or not the face of the user detected when the authentication of the user fails is the face of the same person as the user who performed the authentication; an information processing method, characterized in that whether or not the user intends to perform re-authentication is determined in accordance with the face being determined to be that of the same person;

11. A program for causing a computer to function as each of the means of the information processing device according to any one of claims 1 to 9.

Images