Authentication system, authentication method, and recording medium

Abstract

This authentication system comprises: an image acquisition means for acquiring an image that includes a facial authentication region through which a person-to-be-authenticated passes as they head toward an entry restricted area; a facial authentication means for authenticating the face of the person-to-be-authenticated, on the basis of the acquired image; and a display means which is disposed above the head of the person-to-be-authenticated and / or near their feet, and which displays the results of facial authentication after the person-to-be-authenticated has entered the entry restricted area-side of the facial authentication region.

Description

Authentication system, authentication method, and recording medium

[0001] The present disclosure relates to the technical fields of an authentication system, an authentication method, and a recording medium.

[0002] One such system proposed is one that, when a user's mobile terminal device enters a ticket gate area, determines whether the user's facial image captured in the ticket gate area matches the facial image corresponding to the user's identification information, and if it is determined that they match, performs entry or exit processing (see Patent Document 1).

[0003] JP 2013-191172 A

[0004] The present disclosure aims to provide an authentication system, an authentication method, and a recording medium that aim to improve upon the techniques described in prior art documents.

[0005] One aspect of the authentication system comprises an image acquisition means for acquiring an image including a facial authentication area through which a person to be authenticated passes as he or she approaches a restricted entry area, a facial authentication means for performing facial authentication of the person to be authenticated based on the acquired image, and a display means that is positioned at least either above the head or at the feet of the person to be authenticated and that displays the results of the facial authentication after the person to be authenticated exits the restricted entry area side of the facial authentication area.

[0006] One aspect of the authentication method involves acquiring an image including a facial recognition area through which a person to be authenticated passes as he or she approaches a restricted entry area, performing facial recognition of the person to be authenticated based on the acquired image, and displaying the results of the facial recognition above or at the feet of the person to be authenticated after the person to be authenticated exits the restricted entry area side of the facial recognition area.

[0007] One aspect of the recording medium has a computer program recorded on it to cause a computer to execute an authentication method that acquires an image including a facial authentication area through which a person to be authenticated who is heading towards a restricted entry area passes, performs facial authentication of the person to be authenticated based on the acquired image, and displays the results of the facial authentication at least one of above the head and below the feet of the person to be authenticated after the person to be authenticated exits the restricted entry area side of the facial authentication area.

[0008] 1 is a diagram illustrating an example of an authentication system. FIG. 2 is a diagram illustrating an example of a gate to which the authentication system is applied. FIG. 3 is a diagram illustrating an example of the configuration of a face authentication device. FIG. 4 is a diagram for explaining person tracking processing. FIG. 5 is a diagram illustrating an example of an ID correspondence table. FIG. 6 is a flowchart illustrating tracking and face authentication operations according to a second embodiment. FIG. 7 is a flowchart illustrating display control operations according to the second embodiment. FIG. 8 is a diagram illustrating an example of a screen displayed on a display device. FIG. 9 is a diagram illustrating another example of a gate to which the authentication system is applied. FIG. 10 is a diagram illustrating another example of a gate to which the authentication system is applied.

[0009] An embodiment relating to an authentication system, an authentication method, and a recording medium will be described.

[0010] First Embodiment A first embodiment of an authentication system, an authentication method, and a recording medium will be described with reference to Fig. 1. In the following, the first embodiment of an authentication system, an authentication method, and a recording medium will be described using an authentication system 1.

[0011] The authentication system 1 includes an image acquisition unit 11, a face authentication unit 12, and a display unit 13. The image acquisition unit 11 acquires an image including a face authentication area through which a person to be authenticated passes as he or she approaches the restricted entry area. The face authentication unit 12 performs face authentication of the person to be authenticated based on the image acquired by the image acquisition unit 11. The display unit 13 is disposed above or at the feet of the person to be authenticated. The display unit 13 displays the result of face authentication by the face authentication unit 12 after the person to be authenticated exits the restricted entry area side of the face authentication area.

[0012] It can be said that the authentication system 1 performs an authentication method in which the image acquisition unit 11 acquires an image including a facial authentication area, the facial authentication unit 12 performs facial authentication based on the acquired image, and after the person to be authenticated leaves the entrance restricted area side of the facial authentication area, the display unit 13 displays the result of the facial authentication above or at least one of the person's head and feet. Such authentication system 1 may be realized by a computer reading a computer program recorded on a recording medium. In this case, it can be said that the recording medium stores a computer program that causes the computer to execute an authentication method in which the computer acquires an image including a facial authentication area through which a person to be authenticated passing toward the entrance restricted area passes, performs facial authentication of the person to be authenticated based on the acquired image, and displays the result of the facial authentication above or at least one of the person's head and feet after the person to be authenticated leaves the entrance restricted area side of the facial authentication area.

[0013] (Technical Effect) The entrance restricted area is an area where a person to be authenticated who has successfully passed face authentication by the face authentication unit 12 can enter. The face authentication area is an area through which a person to be authenticated who is heading towards the entrance restricted area passes. The face authentication unit 12 performs face authentication of the person to be authenticated based on an image including the face authentication area. Therefore, the person to be authenticated does not need to stop in front of the camera. In the authentication system 1, the face authentication unit 12 performs face authentication of the person to be authenticated while the person to be authenticated is walking towards the entrance restricted area. In other words, the authentication system 1 is a system that performs walk-through face authentication.

[0014] In walk-through facial recognition, the person to be authenticated does not need to stop for facial recognition, allowing the person to smoothly enter the restricted entry area. However, the person to be authenticated may want to confirm whether or not they have been permitted to enter the restricted entry area (in other words, whether or not the facial recognition was successful). For example, the person to be authenticated may feel uneasy about entering the restricted entry area without checking the results of the facial recognition.

[0015] In the authentication system 1, the display unit 13 that displays the results of facial authentication is disposed above or at the feet of the person to be authenticated. When the display unit 13 is disposed above the head of the person to be authenticated, the person to be authenticated can relatively easily view the display unit 13, even if other people to be authenticated are present around the person to be authenticated. When the display unit 13 is disposed at the feet of the person to be authenticated, the person to be authenticated can also relatively easily view the display unit 13. Thus, whether the display unit 13 is disposed above the head of the person to be authenticated or at the feet of the person to be authenticated, the person to be authenticated can relatively easily view the display unit 13. Therefore, the person to be authenticated can relatively easily check the results of their own facial authentication. Therefore, the authentication system 1 can satisfy the above-mentioned desires of the person to be authenticated. As a result, the person to be authenticated can approach the restricted entry area with peace of mind. This allows the person to be authenticated to enter the restricted entry area more smoothly.

[0016] Second Embodiment A second embodiment of the authentication system, authentication method, and recording medium will be described with reference to Fig. 2 to Fig. 7. In the following, the second embodiment of the authentication system, authentication method, and recording medium will be described using an authentication system 2.

[0017] The authentication system 2 will be described with reference to Figures 2 and 3. The authentication system 2 includes a camera CAM arranged at the gate G, display devices M1 and M2, and a face authentication device 20 (see Figure 3). The authentication system 2 may include three or more display devices. The authentication system 2 may also include two or more cameras.

[0018] The camera CAM and the face authentication device 20 are configured to be able to communicate with each other. The display devices M1 and M2 are configured to be able to communicate with the face authentication device 20. Note that the communication between the camera CAM and the face authentication device 20 may be wired communication or wireless communication. Similarly, the communication between the display devices M1 and M2 and the face authentication device 20 may be wired communication or wireless communication. Note that wired communication is not limited to communication via a network, but also includes communication via a cable, such as a USB (Universal Serial Bus) cable, for connecting the camera CAM and at least one of the display devices M1 and M2 to the face authentication device 20. Wireless communication is not limited to communication via a network, but also includes short-range wireless communication, such as Bluetooth (registered trademark).

[0019] 3 , the face authentication device 20 includes a calculation device 21, a storage device 22, and a communication device 23. The face authentication device 20 may include an input device 24 and an output device 25. The face authentication device 20 may include a facial feature database 26 (hereinafter referred to as “facial feature DB 26”). The face authentication device 20 does not need to include at least one of the input device 24 and the output device 25. In the face authentication device 20, the calculation device 21, the storage device 22, the communication device 23, the input device 24, the output device 25, and the facial feature DB 26 may be connected via a data bus 27. The face authentication device 20 may be implemented by a terminal device such as a notebook personal computer. The face authentication device 20 may be implemented by a server device such as a cloud server.

[0020] The arithmetic device 21 may include, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), a TPU (Tensor Processing Unit), and a quantum processor.

[0021] The storage device 22 may include, for example, at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and an optical disk array. In other words, the storage device 22 may include a non-transitory recording medium. The storage device 22 is capable of storing desired data. For example, the storage device 22 may temporarily store a computer program executed by the arithmetic device 21. The storage device 22 may temporarily store data that is temporarily used by the arithmetic device 21 when the arithmetic device 21 is executing a computer program.

[0022] The communication device 23 may be capable of communicating with devices (e.g., at least one of the camera CAM and the display devices M1 and M2) external to the face authentication device 20. The communication device 23 may perform wired communication or wireless communication.

[0023] The input device 24 is a device capable of accepting information input to the face authentication device 20 from the outside. The input device 24 may include an operation device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by an operator of the face authentication device 20. The input device 24 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the face authentication device 20, such as a USB memory. Note that when information is input to the face authentication device 20 via the communication device 23 (in other words, when the face authentication device 20 acquires information via the communication device 23), the communication device 23 may function as an input device.

[0024] The output device 25 is a device capable of outputting information to the outside of the face authentication device 20. The output device 25 may output visual information such as text or images, auditory information such as sound, or tactile information such as vibration, as the information. The output device 25 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output device 25 may be capable of outputting information to a recording medium detachable from the face authentication device 20, such as a USB memory. Note that when the face authentication device 20 outputs information via the communication device 23, the communication device 23 may function as the output device.

[0025] The arithmetic device 21 may have the image acquisition unit 211, the tracking unit 212, the face authentication unit 213, and the display control unit 214 as logically realized functional blocks or as physically realized processing circuits. At least one of the image acquisition unit 211, the tracking unit 212, the face authentication unit 213, and the display control unit 215 may be realized in a format in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed. When at least some of the image acquisition unit 211, the tracking unit 212, the face authentication unit 213, and the display control unit 215 are functional blocks, at least some of the image acquisition unit 211, the tracking unit 212, the face authentication unit 213, and the display control unit 215 may be realized by the arithmetic device 21 executing a predetermined computer program.

[0026] The arithmetic device 21 may acquire (in other words, read) the predetermined computer program from the storage device 22. The arithmetic device 21 may read the predetermined computer program stored in a computer-readable, non-transitory recording medium using a recording medium reading device (not shown) included in the face authentication device 20. The arithmetic device 21 may acquire (in other words, download or read) the predetermined computer program from a device (not shown) external to the face authentication device 20 via the communication device 23. Note that the recording medium for recording the predetermined computer program executed by the arithmetic device 21 may be at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium capable of storing a program.

[0027] In Figure 2, the area behind gate G is an entry restricted area RA. Only people who have successfully passed facial authentication can enter entry restricted area RA. In other words, only people who have successfully passed facial authentication can pass through gate G. Specific examples of entry restricted areas RA include a security area in an office, an area inside a ticket gate at a train station, a security area at an airport, a paid area at a theme park, and an area inside an event venue.

[0028] The camera CAM captures an image of the face recognition area FRA through which multiple people pass as they head toward the entry restricted area RA. The camera CAM captures an image of the face recognition area FRA, thereby generating an image including the face recognition area FRA. The image acquisition unit 211 of the face recognition device 20 acquires the image generated by the camera CAM via the communication device 23. The image acquisition unit 211 stores the acquired image in the storage device 22. As shown in FIG. 2 , the entry restricted area RA and the face recognition area FRA are set so as not to overlap.

[0029] The camera CAM does not have to be installed so that the entire facial recognition area FRA is included within its angle of view. In other words, the camera CAM may be installed so that it can capture an image of at least a part of the facial recognition area FRA. In this case, the authentication system 2 may include another camera in addition to the camera CAM. In other words, the authentication system 2 may include multiple cameras. The camera CAM generates an image, so it may be referred to as an image generation means.

[0030] The facial recognition area FRA is a virtual area. The facial recognition area FRA may be, for example, an area of ​​5 meters by 5 meters. A distance of 5 meters is a distance that allows 5 to 6 people to pass through in a line. If the facial recognition area FRA is an area of ​​5 meters by 5 meters, 20 to 30 people may exist within the facial recognition area FRA.

[0031] The tracking unit 212 of the face authentication device 20 performs tracking processing of one or more persons passing through the face authentication area FRA, using the image acquired by the image acquisition unit 211 (i.e., the image generated by the camera CAM). Furthermore, the face authentication unit 213 of the face authentication device 20 performs face authentication processing of one or more persons passing through the face authentication area FRA, using the image acquired by the image acquisition unit 211. Note that the one or more persons passing through the face authentication area FRA are the targets of the face authentication processing, and may therefore be referred to as persons to be authenticated.

[0032] As a specific example of the tracking process performed by the tracking unit 212, a case where the tracking unit 212 performs tracking process on person P1 will be described with reference to Figures 4 and 5. Also, as a specific example of the face authentication process performed by the face authentication unit 213, a case where the face authentication unit 213 performs face authentication process on person P1 will be described. Note that various existing methods (for example, at least one of a two-dimensional (2D) authentication method and a three-dimensional (3D) authentication method) can be applied to the face authentication process.

[0033] Images IMG1, IMG2, and IMG3 shown in Fig. 4 are images including person P1 (in other words, images in which person P1 is captured). Image IMG1 is an image generated by camera CAM capturing an image of face recognition area FRA at time t1. Image IMG2 is an image generated by camera CAM capturing an image of face recognition area FRA at time t2, which is later than time t1. Image IMG3 is an image generated by camera CAM capturing an image of face recognition area FRA at time t3, which is later than time t2.

[0034] Each of images IMG1, IMG2, and IMG3 may be an image corresponding to one frame of a video. In this case, image IMG2 does not have to be an image corresponding to the frame immediately following the frame corresponding to image IMG1. In other words, image IMG2 may be an image corresponding to a frame that is two or more frames after the frame corresponding to image IMG1. Similarly, image IMG3 does not have to be an image corresponding to the frame immediately following the frame corresponding to image IMG2. In other words, image IMG3 may be an image corresponding to a frame that is two or more frames after the frame corresponding to image IMG2.

[0035] The tracking unit 212 detects the head of person P1 included in image IMG1 from image IMG1. Note that the method for detecting a person's head from an image is an existing technique, so a detailed description thereof will be omitted. Based on the detected head of person P1, the tracking unit 212 sets an area including the head of person P1 as a tracking area TA1.

[0036] When the tracking unit 212 sets the tracking area TA1, it sets a tracking ID, which is identification information for identifying the person P1 associated with the tracking area TA1, to the person P1. The tracking unit 212 calculates the position of the person P1 (for example, the position of the person P1's feet) based on the tracking area TA1. Note that since existing technology can be applied to a method for calculating the position of a subject included in an image from the image, a detailed description thereof will be omitted. The tracking unit 212 associates the tracking ID with the position of the person P1 and registers them in an ID correspondence table 221 (see FIG. 5) stored in the storage device 22.

[0037] When the tracking area TA1 is set, the tracking unit 212 determines whether or not the face of person P1 is captured in the tracking area TA1. In other words, the tracking unit 212 performs face detection on the tracking area TA1. When it is determined that the face of person P1 is captured in the tracking area TA1, the tracking unit 212 generates a face image including the face area of ​​person P1. The tracking unit 212 associates the generated face image with the tracking ID related to person P1 and transmits it to the face authentication unit 213. Note that when it is determined that the face of person P1 is not captured in the tracking area TA1, the tracking unit 212 does not need to generate a face image.

[0038] The face authentication unit 213 performs face authentication processing using the face image transmitted from the tracking unit 212. Specifically, the face authentication unit 213 extracts features of the face image. Since existing technology can be applied to the method of extracting features of the face image, detailed description thereof will be omitted. The face authentication unit 213 compares the extracted features with features registered in the face feature DB 26. At this time, the face authentication unit 213 calculates a matching score (or a similarity score) based on the extracted features and the registered features. The face authentication unit 213 compares the matching score with a threshold. If the matching score is equal to or greater than the threshold, the face authentication unit 213 determines that face authentication has been successful. In this case, a person corresponding to the person (here, person P1) indicated by the face image transmitted from the tracking unit 212 is identified from among the multiple people registered in the face feature DB 26. On the other hand, if the matching score is less than the threshold, the face authentication unit 213 determines that face authentication has failed. In this case, it is highly likely that the person corresponding to the person (here, person P1) indicated by the face image transmitted from the tracking unit 212 is not registered in the face feature amount DB 26.

[0039] If the facial authentication is successful, the facial authentication unit 213 associates an authentication ID indicating a person registered in the facial feature DB 26 that corresponds to the person (person P1 in this case) indicated by the facial image transmitted from the tracking unit 212 with the tracking ID associated with the facial image, and registers the ID in the ID correspondence table 221. In addition to the authentication ID, the facial authentication unit 213 may register an authentication time, which is the time when the facial authentication process was performed, in the ID correspondence table 221. If the facial authentication is unsuccessful, the facial authentication unit 213 may register information indicating that there is no corresponding person (for example, "N / A (Not Applicable)") in the ID correspondence table 221, associated with the tracking ID associated with the facial image transmitted from the tracking unit 212.

[0040] The ID correspondence table 221 will be further described with reference to FIG. 5 . As shown in FIG. 5 , in the ID correspondence table 221, a tracking ID, a tracking position (e.g., the position of the feet of person P1), an authentication ID, and an authentication time may be associated with one another. When a tracking ID is associated with a specific authentication ID in the ID correspondence table 221, this indicates that a person corresponding to the person for whom the tracking ID is set is registered in the facial feature DB 26. When a tracking ID is associated with the character string "N / A", this indicates that a person corresponding to the person for whom the tracking ID is set is not registered in the facial feature DB 26. When a tracking ID is not associated with an authentication ID (i.e., when the authentication ID field is blank), this indicates that a facial authentication process has never been performed.

[0041] The tracking unit 212 may use the image IMG2 and the image IMG1 to identify the person P1 included in the image IMG2. Identifying the person P1 included in the image IMG2 is synonymous with associating the person P1 included in the image IMG1 with the person P1 included in the image IMG2. Therefore, at least one of a matching method and an optical flow method related to association between images can be applied to identifying the person P1 included in the image IMG2. Note that various existing methods can be applied to both the matching method and the optical flow method, and therefore detailed description thereof will be omitted.

[0042] When person P1 included in image IMG2 is identified, the tracking unit 212 detects the head of person P1. Based on the detected head of person P1, the tracking unit 212 sets an area including the head of person P1 as tracking area TA2. Since person P1 included in image IMG1 and person P1 included in image IMG2 are the same person, the tracking ID of person P1 related to tracking area TA2 is the same as the tracking ID of person P1 related to tracking area TA1. The tracking unit 212 calculates the position of person P1 based on tracking area TA2.

[0043] The tracking unit 212 associates the position of the person P1 with the tracking ID related to the person P1 and registers it in the ID correspondence table 221. In this case, since the position of the person P1 calculated based on the tracking area TA1 is registered in the ID correspondence table 221, the tracking unit 212 registers the position of the person P1 calculated based on the tracking area TA2 in the ID correspondence table 221, thereby updating the position of the person P1.

[0044] When the tracking area TA2 is set, the tracking unit 212 determines whether the face of person P1 is captured in the tracking area TA2. In other words, the tracking unit 212 performs face detection on the tracking area TA2. When it is determined that the face of person P1 is captured in the tracking area TA2, the tracking unit 212 generates a face image including the face area of ​​person P1. The tracking unit 212 associates the generated face image with the tracking ID related to person P1 and transmits the image to the face authentication unit 213. Note that, when it is determined that the face of person P1 is not captured in the tracking area TA2, the tracking unit 212 does not need to generate a face image. Note that, even when it is determined that the face of person P1 is captured in the tracking area TA2, when the tracking ID related to person P1 is associated with the authentication ID in the ID correspondence table 221 (i.e., when face authentication has already been successful), the tracking unit 212 does not need to generate a face image.

[0045] The face authentication unit 213 performs face authentication processing using the face image transmitted from the tracking unit 212. If face authentication is successful, the face authentication unit 213 registers, in the ID correspondence table 221, an authentication ID indicating a person registered in the face feature DB 26 that corresponds to the person (here, person P1) indicated by the face image transmitted from the tracking unit 212, in association with the tracking ID associated with the face image. In addition to the authentication ID, the face authentication unit 213 may register, in the ID correspondence table 221, an authentication time, which is the time when the face authentication processing was performed. Note that if the authentication time has already been registered in the ID correspondence table 221 (i.e., if face authentication has been successful in the past), the face authentication unit 213 may update the authentication time registered in the ID correspondence table 221. If face authentication is unsuccessful, the face authentication unit 213 may register, in the ID correspondence table 221, information indicating that there is no corresponding person (e.g., “N / A”) in association with the tracking ID associated with the face image transmitted from the tracking unit 212.

[0046] The tracking unit 212 may use the images IMG3 and IMG2 to identify the person P1 included in the image IMG3. When the person P1 included in the image IMG3 is identified, the tracking unit 212 detects the head of the person P1. Based on the detected head of the person P1, the tracking unit 212 sets an area including the head of the person P1 as a tracking area TA3. Because the person P1 included in the image IMG2 and the person P1 included in the image IMG3 are the same person, the tracking ID of the person P1 related to the tracking area TA3 is the same as the tracking ID of the person P1 related to the tracking area TA2. The tracking unit 212 calculates the position of the person P1 based on the tracking area TA3.

[0047] The tracking unit 212 associates the position of person P1 with the tracking ID of person P1 and registers it in the ID correspondence table 321. In this case, since the position of person P1 calculated based on tracking area TA2 is registered in the ID correspondence table 221, the tracking unit 212 registers the position of person P1 calculated based on tracking area TA3 in the ID correspondence table 221, thereby updating the position of person P1.

[0048] When the tracking area TA3 is set, the tracking unit 212 determines whether the face of person P1 is captured in the tracking area TA3. In other words, the tracking unit 212 performs face detection on the tracking area TA3. When it is determined that the face of person P1 is captured in the tracking area TA3, the tracking unit 212 generates a face image including the face area of ​​person P1. The tracking unit 212 associates the generated face image with the tracking ID related to person P1 and transmits the image to the face authentication unit 213. Note that, when it is determined that the face of person P1 is not captured in the tracking area TA3, the tracking unit 212 does not need to generate a face image. Note that, even when it is determined that the face of person P1 is captured in the tracking area TA3, when the tracking ID related to person P1 is associated with the authentication ID in the ID correspondence table 221 (i.e., when face authentication has already been successful), the tracking unit 212 does not need to generate a face image.

[0049] The face authentication unit 213 performs face authentication processing using the face image transmitted from the tracking unit 212. If face authentication is successful, the face authentication unit 213 registers, in the ID correspondence table 221, an authentication ID indicating a person registered in the face feature DB 26 that corresponds to the person (here, person P1) indicated by the face image transmitted from the tracking unit 212, in association with the tracking ID associated with the face image. In addition to the authentication ID, the face authentication unit 213 may register, in the ID correspondence table 221, an authentication time, which is the time when the face authentication processing was performed. Note that if the authentication time has already been registered in the ID correspondence table 221 (i.e., if face authentication has been successful in the past), the face authentication unit 213 may update the authentication time registered in the ID correspondence table 221. If face authentication is unsuccessful, the face authentication unit 213 may register, in the ID correspondence table 221, information indicating that there is no corresponding person (e.g., “N / A”) in association with the tracking ID associated with the face image transmitted from the tracking unit 212.

[0050] However, it may become difficult for the tracking unit 212 to continue tracking the person P1, for example, because the head of the person P1 is hidden behind another person. When tracking of the person P1 is interrupted, the tracking unit 212 may perform the following process. After tracking of the person P1 is interrupted, the tracking unit 212 may determine whether a new person has been detected from the image acquired by the image acquisition unit 211 (i.e., the image generated by the camera CAM). A "new person" means a person for whom a tracking ID has not been set.

[0051] When a new person is detected, the tracking unit 212 may compare the feature amount of the tracking area related to person P1 (e.g., at least one of tracking areas TA1, TA2, and TA3) with the feature amount of the tracking area related to the new person to determine whether person P1 and the new person are the same person. If it is determined that person P1 and the new person are the same person, the tracking unit 212 may assign the tracking ID related to person P1 to the new person. As a result, the tracking unit 212 can track person P1 again. Note that the feature amount may be a feature amount related to the person's head, a feature amount related to the person's upper body, or a feature amount related to the person's entire body. In other words, the tracking area (e.g., at least one of tracking areas TA1, TA2, and TA3) may include the person's head, a feature amount related to the person's upper body, or a feature amount related to the person's entire body. Note that the feature amount may be obtained, for example, by person re-identification technology.

[0052] The tracking unit 212 and the face authentication unit 213 may repeat the above-described process until the person P1 passes through the face authentication area FRA. The tracking unit 212 and the face authentication unit 213 may perform the above-described process for all people who pass through the face authentication area FRA.

[0053] The operations of the tracking unit 212 and the face authentication unit 213 will be further described with reference to the flowchart of Fig. 6. In Fig. 6, the tracking unit 212 detects one or more people from an image acquired by the image acquisition unit 211 (i.e., an image generated by the camera CAM) (step S101). In the processing of step S101, the tracking unit 212 may detect the head of the person. In the processing of step S101, the tracking unit 212 may set a tracking area including the head of the detected person based on the head of the detected person. In the processing of step S101, the tracking unit 212 may perform face detection of the detected one or more people.

[0054] The tracking unit 212 performs a tracking process of at least one of the one or more people detected in the process of step S101 using another image acquired by the image acquisition unit 211 (step S102). In the process of step S102, the tracking unit 212 may perform face detection of the detected one or more people. If the face of at least one of the one or more people is detected in the process of at least one of steps S101 and S102, the tracking unit 212 transmits a face image including a face region of at least one person to the face authentication unit 213.

[0055] The face authentication unit 213 performs face authentication processing using the face image transmitted from the tracking unit 212 (step S103). The face authentication unit 213 registers the result of the face authentication processing in the ID correspondence table 221, or updates the ID correspondence table 221 based on the result of the face authentication processing (step S104).

[0056] The operation of the display control unit 214 of the face authentication device 20 will be described with reference to Fig. 2 and Fig. 7. In Fig. 2, a display range DR is virtually set near the gate G (in other words, near the display devices M1 and M2). The display range DR is set as an area in which a person passing through the face authentication area FRA can see at least one of the display devices M1 and M2 when the person is located within the display range DR.

[0057] 7, the display control unit 214 acquires the position of a person passing through the face authentication area FRA (in other words, a person who is the target of tracking processing by the tracking unit 212) based on the ID correspondence table 221 (step S201). When the position of person P1 is acquired in the processing of step S201, the display control unit 214 determines whether person P1 is located within the display range DR based on the position of person P1. In other words, the display control unit 214 determines whether person P1 has approached at least one of display devices M1 and M2 (step S202).

[0058] In the processing of step S202, if it is determined that person P1 is not located within the display range DR, i.e., if it is determined that person P1 is not approaching display devices M1 and M2 (step S202: No), the display control unit 214 performs the processing of step S201.

[0059] As described above, the tracking unit 212 performs tracking processing of a person (e.g., person P1) passing through the face authentication area FRA, and therefore the position of the person (e.g., person P1) registered in the ID correspondence table 221 is successively updated. In other words, the operation of the display control unit 214 shown in the flowchart of Fig. 7 and the operations of the tracking unit 212 and face authentication unit 213 shown in the flowchart of Fig. 6 are performed in parallel. For this reason, even if it is determined in the current processing of step S202 that person P1 is not approaching the display devices M1 and M2, it may be determined in the next processing of step S202 that person P1 is approaching at least one of the display devices M1 and M2.

[0060] In the processing of step S202, for example, if it is determined that person P1 is located within the display range DR, that is, if it is determined that person P1 is approaching at least one of the display devices M1 and M2 (step S202: No), the display control unit 214 generates display information related to person P1 based on the ID correspondence table 221 (step S203).

[0061] Specifically, if a specific authentication ID is associated with the tracking ID for person P1 in the ID correspondence table 221, the display control unit 214 generates display information including information indicating that facial authentication was successful and identification information for person P1. If the tracking ID for person P1 is associated with the character string "N / A" in the ID correspondence table 221, the display control unit 214 generates display information including information indicating that facial authentication was unsuccessful. In this case, since a person corresponding to person P1 has not been identified by the facial authentication process, identification information for person P1 does not need to be included in the display information. If the tracking ID for person P1 is not associated with an authentication ID in the ID correspondence table 221 (i.e., the authentication ID field is blank), the display control unit 214 may generate display information including information indicating that facial authentication was unsuccessful. In this case, the display control unit 214 may generate display information including information indicating that the person has not been authenticated.

[0062] The display control unit 214 controls the display device M1 or M2 to display the display information generated in the processing of step S203 (step S204). The display control unit 214 determines which display device (one of the display devices M1 and M2) will display the display information based on the position of the person related to the display information in the width direction of the display range DR (i.e., the direction intersecting the direction of travel of the person toward the admission restricted area RA). As shown in FIG. 2, the display range DR is set on the admission restricted area RA side of the face authentication area FRA so as not to overlap with the face authentication area RA. Therefore, the display information (e.g., the result of face authentication) is displayed on one of the display devices M1 and M2 after the person passing through the face authentication area FRA exits the admission restricted area RA side of the face authentication area FRA. The display control unit 214 may perform the processing of steps S201 to S204 for all people passing through the face authentication area FRA.

[0063] 2, persons P1, P3, and P4 are assumed to be persons whose facial authentication was successful. Person P2 is assumed to be a person whose facial authentication was unsuccessful. The display control unit 214 generates display information for person P1, including information indicating that facial authentication was successful and identification information identifying person P1. The display control unit 214 controls the display device M1 so that information indicating that facial authentication was successful (e.g., a green mark) included in the display information related to person P1 is displayed in the upper left corner of the display device M1. The display control unit 214 also controls the display device M1 so that identification information identifying person P1 (e.g., a geometric pattern) included in the display information related to person P1 is displayed in the lower left corner of the display device M1.

[0064] The display control unit 214 generates display information including information indicating that facial authentication has failed for the person P2. The display control unit 214 controls the display device M1 so that information indicating that facial authentication has failed (e.g., a red mark) included in the display information related to the person P2 is displayed in the upper right corner of the display device M1.

[0065] The display control unit 214 generates display information including information indicating that facial authentication was successful for person P3 and identification information indicating person P3. The display control unit 214 controls the display device M2 so that information indicating that facial authentication was successful (e.g., a green mark) included in the display information related to person P3 is displayed in the upper left of the display device M2. The display control unit 214 also controls the display device M2 so that identification information indicating person P3 (e.g., a geometric pattern) included in the display information related to person P3 is displayed in the lower left of the display device M2.

[0066] The display control unit 214 generates display information for person P4, including information indicating that facial authentication was successful and identification information identifying person P4. The display control unit 214 controls the display device M2 so that information indicating that facial authentication was successful (e.g., a green mark) included in the display information related to person P4 is displayed in the upper right corner of the display device M2. The display control unit 214 also controls the display device M2 so that identification information identifying person P4 (e.g., a geometric pattern) included in the display information related to person P4 is displayed in the lower right corner of the display device M2.

[0067] For example, the identification information, which is a geometric pattern, may be determined when features extracted from a person's face image are registered in the facial feature DB 26. The identification information may be determined automatically by the face authentication device 20, or may be determined by the person who registers the features. The determined identification information (e.g., a geometric pattern) is notified to the person who registered the features.

[0068] The display control unit 214 may generate display information including information indicating that a certain person (e.g., a person different from persons P1 to P4) is unauthenticated. In this case, the display control unit 214 may control one of the display devices M1 and M2 so that information indicating unauthenticated status (e.g., a gray mark) is displayed on one of the display devices M1 and M2. The display control unit 214 may control at least one of the display devices M1 and M2 to terminate the display of display information related to a person who has exited the display range DR among the people passing through the face recognition area FRA.

[0069] As described above, only people who have successfully passed facial authentication can enter the restricted entry area RA. Therefore, information indicating that facial authentication has been successful can be said to be information indicating that the person is allowed to enter the restricted entry area RA. Furthermore, information indicating that facial authentication has failed and information indicating that the person has not been authenticated can be said to be information indicating that the person is not allowed to enter the restricted entry area RA.

[0070] (Technical Effect) The results of face authentication (for example, information indicating that face authentication was successful, information indicating that face authentication was unsuccessful, and information indicating that face authentication has not been performed) are displayed on at least one of the display devices M1 and M2, which are positioned higher than the head of a person passing through the face authentication area FRA (i.e., above the head of the person). Therefore, a person passing through the face authentication area FRA can visually recognize the results of face authentication relatively easily.

[0071] As described above, the display control unit 214 determines the display device (one of the display devices M1 and M2) that displays the display information based on the position in the width direction of the display range DR of the person associated with the display information including the face authentication result. Therefore, the face authentication result is displayed at a position relatively close to the person associated with the display information. Therefore, a person passing through the face authentication area FRA can visually recognize the face authentication result relatively easily.

[0072] For a person whose face has been successfully authenticated, information indicating that the face authentication has been successful (e.g., a mark) and identification information indicating the person whose face authentication has been successful (e.g., a geometric pattern) are displayed on the display device M1 or M2. A person passing through the face authentication area FRA can recognize that the face authentication has been successful (in other words, that the person is allowed to enter the admission restricted area RA) by recognizing that his or her own identification information is displayed on the display device M1 or M2. Furthermore, a person passing through the face authentication area FRA can recognize that the face authentication has failed (in other words, that the person is not allowed to enter the admission restricted area RA) by recognizing that his or her own identification information is not displayed on the display devices M1 and M2.

[0073] As shown in FIG. 2 , display devices M1 and M2 are positioned above the head of a person passing through the face authentication area FRA. Camera CAM is positioned between display devices M1 and M2. A person passing through the face authentication area FRA looks at at least one of display devices M1 and M2 to confirm the results of face authentication. As a result, a person passing through the face authentication area FRA naturally turns their face toward camera CAM. This makes it easier for the tracking unit 212 to detect the face area of ​​a person passing through the face authentication area FRA in the tracking process. This allows the face authentication unit 213 to appropriately perform face authentication of a person passing through the face authentication area FRA.

[0074] (Modification) As shown in FIG. 8 , the display control unit 214 may control at least one of the display devices M1 and M2 so that a human figure corresponding to a person passing through the facial authentication area FRA is displayed. In this case, the display control unit 214 may control at least one of the display devices M1 and M2 so that a green human figure is displayed for a person whose facial authentication has been successful. In this case, the display control unit 214 may control at least one of the display devices M1 and M2 so that identification information (e.g., a geometric pattern) indicating the person whose facial authentication has been successful is displayed in the green human figure. The display control unit 214 may control at least one of the display devices M1 and M2 so that a red human figure is displayed for a person whose facial authentication has been unsuccessful. The display control unit 214 may control at least one of the display devices M1 and M2 so that a gray human figure is displayed for an unauthenticated person.

[0075] The display control unit 214 may determine the position and size of the human-shaped figure based on the position and size of each person included in the image generated by the camera CAM (i.e., each person passing through the face authentication area FRA). The size of each person included in the image may be represented by the number of pixels that make up each person in the image. The display control unit 214 may calculate or estimate the distance of each person included in the image from the camera CAM, gate G, or entry restriction area RA. The display control unit 214 may determine the size of the human-shaped figure corresponding to each person based on the calculated or estimated distance.

[0076] Based on the ID correspondence table 221, the display control unit 214 may make the color of the human-shaped figure corresponding to a person passing through the face authentication area FRA who is close to at least one of the display devices M1 and M2 (or the camera CAM, the gate, and one of the entry restriction areas RA) darker than the color of the human-shaped figure corresponding to a person who is far from the display devices M1 and M2.

[0077] The display control unit 214 may change the transparency of the human figure in addition to the color density of the human figure. In this case, the display control unit 214 may increase the transparency of the human figure corresponding to a person who is farthest from the display devices M1 and M2 among people passing through the face authentication area FRA, compared to the transparency of the human figure corresponding to a person who is closer to at least one of the display devices M1 and M2 (or the camera CAM, the gate, and one of the entry restriction areas RA). In other words, the display control unit 214 may increase the opacity of the human figure corresponding to a person who is closer to at least one of the display devices M1 and M2 (or the camera CAM, the gate, and one of the entry restriction areas RA).

[0078] The display control unit 214 may control at least one of the display devices M1 and M2 to change the position of a human figure displayed on at least one of the display devices M1 and M2 in accordance with the trajectory of the corresponding person, based on the ID correspondence table 221. In this case, the display control unit 214 may control at least one of the display devices M1 and M2 to display the trajectory.

[0079] The display control unit 214 may control at least one of the display devices M1 and M2 so that, among people passing through the face authentication area FRA, a human figure corresponding to a person who is close to at least one of the display devices M1 and M2 is displayed in front of a human figure corresponding to a person who is far from the display devices M1 and M2. In this case, the human figure corresponding to a person approaching at least one of the display devices M1 and M2 moves from the back side to the front side of the screen on at least one of the display devices M1 and M2.

[0080] The display control unit 214 may control at least one of the display devices M1 and M2 so that, among people passing through the face authentication area FRA, a human figure corresponding to a person who is close to at least one of the display devices M1 and M2 is displayed further back than a human figure corresponding to a person who is farther from the display devices M1 and M2. In this case, the human figure corresponding to a person approaching at least one of the display devices M1 and M2 moves from the front side to the back side of the screen on at least one of the display devices M1 and M2.

[0081] The display control unit 214 may control at least one of the display devices M1 and M2 to display an image including the facial authentication area FRA generated by the camera CAM, instead of displaying a human-shaped figure (see FIG. 8 ) corresponding to a person passing through the facial authentication area FRA. In this case, the display control unit 214 may control at least one of the display devices M1 and M2 to superimpose a green frame on a person whose face has been successfully authenticated and is included in the image. The display control unit 214 may control at least one of the display devices M1 and M2 to superimpose a red frame on a person whose face has not been authenticated and is included in the image. The display control unit 214 may control at least one of the display devices M1 and M2 to superimpose a gray frame on an unauthenticated person whose face has been authenticated and is included in the image.

[0082] The authentication ID may be linked to the email address of the person associated with the authentication ID. The face authentication device 20 may send an email, via the communication device 23, indicating that the face authentication was successful to the email address linked to the authentication ID of the person who passed through the face authentication area FRA and whose face authentication was successful.

[0083] Third Embodiment A third embodiment of an authentication system, an authentication method, and a recording medium will be described with reference to Fig. 9. Hereinafter, the third embodiment of the authentication system, the authentication method, and a recording medium will be described using an authentication system 3. Note that, for convenience, Fig. 9 does not show a person passing through the face authentication area FRA.

[0084] The authentication system 3 will be described with reference to Fig. 9. The authentication system 3 includes a camera CAM arranged at the gate G, a display device M3, and a face authentication device 20 (see Fig. 3). The display device M3 and the face authentication device 20 are configured to be able to communicate with each other. The communication between the display device M3 and the face authentication device 20 may be wired communication or wireless communication. The camera CAM and the face authentication device 20 will not be described in detail if they overlap with those in the second embodiment.

[0085] The display device M3 is placed at the feet of a person passing through the facial authentication area FRA. As shown in Fig. 9, the display device M3 extends in a direction intersecting the direction of travel of a person passing through the facial authentication area FRA. The display device M3 may be placed at a position corresponding to the end of the facial authentication area FRA on the entrance restriction area RA side. The display device M3 may be configured to include an LED (Light Emitting Diode) tape.

[0086] The operation of the display control unit 214 of the face authentication device 20 will be described. In Fig. 9, a display range DR is virtually set near the gate G (in other words, near the display device M3). The display range DR is set as an area in which a person passing through the face authentication area FRA can view the display device M3 when the person is located within the display range DR.

[0087] The display control unit 214 acquires the positions of people passing through the face authentication area FRA (in other words, people who are the targets of tracking processing by the tracking unit 212) based on the ID correspondence table 221. For example, when the position of person P1 is acquired, the display control unit 214 determines whether person P1 is located within the display range DR based on the position of person P1. In other words, the display control unit 214 determines whether person P1 has approached the display device M3.

[0088] For example, if it is determined that person P1 is located within the display range DR, that is, if it is determined that person P1 is approaching the display device M3, the display control unit 214 generates display information related to person P1 based on the ID correspondence table 221.

[0089] Specifically, when a specific authentication ID is associated with the tracking ID of person P1 in the ID correspondence table 221, the display control unit 214 generates display information including information indicating that facial authentication was successful. When a character string "N / A" is associated with the tracking ID of person P1 in the ID correspondence table 221, the display control unit 214 generates display information including information indicating that facial authentication was unsuccessful. When the tracking ID of person P1 is not associated with an authentication ID in the ID correspondence table 221 (i.e., when the authentication ID field is blank), the display control unit 214 may generate display information including information indicating that facial authentication was unsuccessful. In this case, the display control unit 214 may generate display information including information indicating that the person has not been authenticated.

[0090] The display control unit 214 controls the display device M3 to display the generated display information. The display control unit 214 determines the display position of the display information on the display device M3 based on the position of the person related to the display information in the width direction of the display range DR (i.e., the direction intersecting the direction of travel of the person heading toward the admission restricted area RA).

[0091] For example, if person P1 has been successfully authenticated, the display control unit 214 generates display information including information indicating that facial authentication was successful. The display control unit 214 controls the display device M3 so that the information indicating that facial authentication was successful, which is included in the display information, is displayed at a display position on the display device M3 that is determined based on the widthwise position of person P1's display range DR. If the display device M3 is configured to include an LED tape, the display control unit 214 may control the display device M3 so that an LED arranged at the display position emits green light.

[0092] For example, if person P1 has failed facial authentication, the display control unit 214 generates display information including information indicating that facial authentication has failed. The display control unit 214 controls the display device M3 so that the information indicating that facial authentication has failed, which is included in the display information, is displayed at a display position on the display device M3 that is determined based on the widthwise position of person P1's display range DR. If the display device M3 is configured to include an LED tape, the display control unit 214 may control the display device M3 so that an LED arranged at the display position emits red light.

[0093] For example, if person P1 is an unauthenticated person, the display control unit 214 generates display information including information indicating that person P1 is unauthenticated. The display control unit 214 controls the display device M3 so that the information indicating that person P1 is unauthenticated, which is included in the display information, is displayed at a display position on the display device M3 that is determined based on the widthwise position of person P1's display range DR. If the display device M3 is configured to include an LED tape, the display control unit 214 may control the display device M3 so that an LED arranged at the display position emits gray light.

[0094] For example, when the person P1 leaves the display range DR, the display control unit 214 controls the display device M3 to terminate the display of the display information related to the person P1. The display control unit 214 may perform the above-described process for all people passing through the face authentication area FRA.

[0095] (Technical Effect) The results of facial authentication (e.g., information indicating that facial authentication was successful, information indicating that facial authentication was unsuccessful, and information indicating that the person has not been authenticated) are displayed near the feet of the person associated with the facial authentication result. Therefore, a person passing through the facial authentication area FRA can visually recognize the results of facial authentication relatively easily. In addition, because the display information displayed on the display device M3 differs depending on the results of facial authentication, a person passing through the facial authentication area FRA can recognize whether or not the person has been successfully authenticated (in other words, whether or not the person is allowed to enter the entry-restricted area RA).

[0096] 9, the display device M3 extends linearly in a direction intersecting the direction of travel of a person passing through the facial recognition area FRA. However, the display device M3 may be disposed in an arc shape so as to intersect with the direction of travel of a person passing through the facial recognition area FRA. With this configuration, for example, even if the width of the gate G and the width of the passage are different, the results of facial recognition can be appropriately displayed on the display device M3. Furthermore, the degree of freedom in the layout of the gate G can be improved.

[0097] The display device M3 may be configured to include a display. In this case, similar to the second embodiment described above, the display control unit 214 may control the display device M3 so that, for a person whose face has been successfully authenticated, information indicating that the face authentication has been successful (e.g., a green mark) and information indicating the person (e.g., a geometric pattern) are displayed.

[0098] The authentication ID may be linked to the email address of the person associated with the authentication ID. The face authentication device 20 may send an email, via the communication device 23, indicating that the face authentication was successful to the email address linked to the authentication ID of the person who passed through the face authentication area FRA and whose face authentication was successful.

[0099] <Fourth embodiment> A fourth embodiment of an authentication system, an authentication method, and a recording medium will be described with reference to Fig. 10. Hereinafter, the fourth embodiment of an authentication system, an authentication method, and a recording medium will be described using an authentication system 4. Note that, for the sake of convenience, Fig. 10 does not show a person passing through the face authentication area FRA.

[0100] The authentication system 4 will be described with reference to Fig. 10. The authentication system 4 includes a camera CAM arranged at the gate G, display devices M3 and M4, and a face authentication device 20 (see Fig. 3). The display devices M3 and M4 and the face authentication device 20 are configured to be able to communicate with each other. Note that communication between the display devices M3 and M4 and the face authentication device 20 may be wired communication or wireless communication. Note that descriptions of the camera CAM and the face authentication device 20 that overlap with those in the second embodiment will be omitted.

[0101] The display device M3 is disposed at the feet of a person passing through the facial authentication area FRA. As shown in FIG. 10 , the display device M3 extends in a direction intersecting the direction of travel of a person passing through the facial authentication area FRA. The display device M3 may be disposed at a position corresponding to the end of the facial authentication area FRA on the entry restriction area RA side. The display device M4 is disposed at the feet of a person passing through the facial authentication area FRA. As shown in FIG. 10 , the display device M4 extends in a direction intersecting the direction of travel of a person passing through the facial authentication area FRA. As shown in FIG. 10 , the display devices M3 and M4 are disposed at a distance from each other along the direction of travel of a person passing through the facial authentication area FRA. The display devices M3 and M4 may be configured to include an LED tape.

[0102] The operation of the display control unit 214 of the face authentication device 20 will be described. In Fig. 10, a display range DR1 is virtually set near the display device M3. Also, a display range DR2 is virtually set near the display device M4. Note that the display range DR1 is set as an area in which a person passing through the face authentication area FRA can view the display device M3 when the person is located within the display range DR1. The display range DR2 is set as an area in which a person passing through the face authentication area FRA can view the display device M4 when the person is located within the display range DR2.

[0103] The display control unit 214 acquires the positions of people passing through the face authentication area FRA (in other words, people who are the targets of tracking processing by the tracking unit 212) based on the ID correspondence table 221. For example, when the position of person P1 is acquired, the display control unit 214 determines whether person P1 is located within the display range DR2 based on the position of person P1. In other words, the display control unit 214 determines whether person P1 has approached the display device M4.

[0104] For example, if it is determined that person P1 is located within the display range DR2, i.e., if it is determined that person P1 is approaching the display device M4, the display control unit 214 generates display information related to person P1 based on the ID correspondence table 221.

[0105] Specifically, when a specific authentication ID is associated with the tracking ID of person P1 in the ID correspondence table 221, the display control unit 214 generates display information including information indicating that facial authentication was successful. When a character string "N / A" is associated with the tracking ID of person P1 in the ID correspondence table 221, the display control unit 214 generates display information including information indicating that facial authentication was unsuccessful. When the tracking ID of person P1 is not associated with an authentication ID in the ID correspondence table 221 (i.e., when the authentication ID field is blank), the display control unit 214 may generate display information including information indicating that facial authentication was unsuccessful. In this case, the display control unit 214 may generate display information including information indicating that the person has not been authenticated.

[0106] The display control unit 214 controls the display device M4 to display the generated display information. The display control unit 214 determines the display position of the display information on the display device M4 based on the position of the person related to the display information in the width direction of the display range DR2 (i.e., the direction intersecting the direction of travel of the person toward the admission restricted area RA).

[0107] For example, if person P1 has been successfully authenticated, the display control unit 214 generates display information including information indicating that facial authentication was successful. The display control unit 214 controls the display device M4 so that the information indicating that facial authentication was successful, which is included in the display information, is displayed at a display position of the display information on the display device M4 that is determined based on the widthwise position of person P1's display range DR2. If the display device M4 is configured to include an LED tape, the display control unit 214 may control the display device M4 so that an LED placed at the display position emits green light.

[0108] For example, if person P1 has failed facial authentication, the display control unit 214 generates display information including information indicating that facial authentication has failed. The display control unit 214 controls the display device M4 so that the information indicating that facial authentication has failed, which is included in the display information, is displayed at a display position on the display device M4 that is determined based on the widthwise position of person P1's display range DR2. If the display device M4 is configured to include an LED tape, the display control unit 214 may control the display device M4 so that an LED arranged at the display position emits red light.

[0109] For example, if person P1 is an unauthenticated person, the display control unit 214 generates display information including information indicating that person P1 is unauthenticated. The display control unit 214 controls the display device M4 so that the information indicating that person P1 is unauthenticated, which is included in the display information, is displayed at a display position of the display information on the display device M4 that is determined based on the widthwise position of person P1's display range DR2. If the display device M4 is configured to include an LED tape, the display control unit 214 may control the display device M4 so that the LEDs arranged at the display positions emit light in gray.

[0110] For example, when person P1 leaves display range DR2, the display control unit 214 controls display device M4 to terminate the display of display information related to person P1. Thereafter, the display control unit 214 determines whether person P1 is located within display range DR1 based on the position of person P1 based on the ID correspondence table 221. In other words, the display control unit 214 determines whether person P1 has approached display device M3.

[0111] For example, if it is determined that person P1 is located within the display range DR1, i.e., if it is determined that person P1 is approaching the display device M3, the display control unit 214 generates display information related to person P1 based on the ID correspondence table 221.

[0112] The display control unit 214 controls the display device M3 to display the generated display information. The display control unit 214 determines the display position of the display information on the display device M3 based on the position of the person related to the display information in the width direction of the display range DR2 (i.e., the direction intersecting the direction of travel of the person toward the admission restricted area RA).

[0113] For example, if person P1 has been successfully authenticated, the display control unit 214 generates display information including information indicating that facial authentication was successful. The display control unit 214 controls the display device M3 so that the information indicating that facial authentication was successful, which is included in the display information, is displayed at a display position of the display information on the display device M3 that is determined based on the widthwise position of person P1's display range DR1. If the display device M3 is configured to include an LED tape, the display control unit 214 may control the display device M4 so that an LED arranged at the display position emits green light.

[0114] For example, if person P1 has failed facial authentication, the display control unit 214 generates display information including information indicating that facial authentication has failed. The display control unit 214 controls the display device M3 so that the information indicating that facial authentication has failed, which is included in the display information, is displayed at a display position on the display device M3 that is determined based on the widthwise position of person P1's display range DR1. If the display device M3 is configured to include an LED tape, the display control unit 214 may control the display device M3 so that an LED arranged at the display position emits red light.

[0115] For example, if person P1 is an unauthenticated person, the display control unit 214 generates display information including information indicating that person P1 is unauthenticated. The display control unit 214 controls the display device M3 so that the information indicating that person P1 is unauthenticated, which is included in the display information, is displayed at a display position of the display information on the display device M3 that is determined based on the widthwise position of person P1's display range DR1. If the display device M3 is configured to include an LED tape, the display control unit 214 may control the display device M3 so that the LEDs arranged at the display positions emit light in gray.

[0116] For example, when the person P1 leaves the display range DR1, the display control unit 214 controls the display device M3 to terminate the display of the display information related to the person P1. The display control unit 214 may perform the above-described process for all people passing through the face authentication area FRA.

[0117] (Technical Effect) The results of facial authentication (for example, information indicating that facial authentication was successful, information indicating that facial authentication was unsuccessful, and information indicating that the person has not been authenticated) are displayed near the feet of the person associated with the facial authentication result. Therefore, people passing through the facial authentication area FRA can visually recognize the results of facial authentication relatively easily. In particular, in this embodiment, the results of facial authentication are displayed on the display device M4, so that people who have failed facial authentication can realize relatively early on that they will not be able to enter the entry-restricted area RA.

[0118] (Modification) The display color of the information indicating that face authentication has failed, which is displayed on the display device M4, may be a color that gives a less alarming impression than the display color of the information indicating that face authentication has failed, which is displayed on the display device M3. For example, if the display color of the information indicating that face authentication has failed, which is displayed on the display device M3, is red, the display color of the information indicating that face authentication has failed, which is displayed on the display device M4, may be orange or yellow.

[0119] As in the third embodiment described above, at least one of the display devices M3 and M4 may be arranged in an arc shape so as to intersect with the traveling direction of a person passing through the facial authentication area FRA. At least one of the display devices M3 and M4 may be configured to include a display. The authentication ID may be linked to the email address of the person associated with the authentication ID. The face authentication device 20 may send an email indicating successful face authentication via the communication device 23 to the email address linked to the authentication ID of a person who has been successfully face-recognized among the people passing through the facial authentication area FRA.

[0120] Fifth Embodiment A fifth embodiment of an authentication system, an authentication method, and a recording medium will be described with reference to Fig. 11. Hereinafter, the fifth embodiment of an authentication system, an authentication method, and a recording medium will be described using an authentication system 5. For convenience, Fig. 11 does not show people passing through the face authentication area FRA.

[0121] The authentication system 5 will be described with reference to Fig. 11. The authentication system 4 includes a camera CAM arranged at the gate G, display devices M1, M2, and M3, and a face authentication device 20 (see Fig. 3). The display devices M1, M2, and M3 are configured to be able to communicate with the face authentication device 20. Note that communication between the display devices M1, M2, and M3 and the face authentication device 20 may be wired communication or wireless communication. Note that descriptions of the camera CAM and the face authentication device 20 that overlap with those in the second embodiment will be omitted.

[0122] The display device M3 is placed at the feet of a person passing through the facial authentication area FRA. As shown in Fig. 11, the display device M3 extends in a direction intersecting the direction of travel of a person passing through the facial authentication area FRA. The display device M3 may be placed at a position corresponding to the end of the facial authentication area FRA on the entrance restriction area RA side. The display device M3 may be configured to include an LED tape.

[0123] The operation of the display control unit 214 of the face authentication device 20 will be described. In Fig. 11, a display range DR is virtually set near the gate G. The display range DR is set as an area in which, when a person passing through the face authentication area FRA is located within the display range DR, the person can see at least one of the display devices M1, M2, and M3.

[0124] The display control unit 214 acquires the positions of people passing through the face authentication area FRA (in other words, people who are the targets of tracking processing by the tracking unit 212) based on the ID correspondence table 221. For example, when the position of person P1 is acquired, the display control unit 214 determines whether person P1 is located within the display range DR based on the position of person P1. In other words, the display control unit 214 determines whether person P1 has approached at least one of display devices M1, M2, and M3.

[0125] For example, if it is determined that person P1 is located within the display range DR, that is, if it is determined that person P1 is approaching at least one of the display devices M1, M2, and M3, the display control unit 214 generates display information related to person P1 based on the ID correspondence table 221.

[0126] Specifically, when a specific authentication ID is associated with the tracking ID of person P1 in the ID correspondence table 221, the display control unit 214 generates display information including information indicating that facial authentication was successful and information indicating person P1. When a character string "N / A" is associated with the tracking ID of person P1 in the ID correspondence table 221, the display control unit 214 generates display information including information indicating that facial authentication was unsuccessful. When the tracking ID of person P1 is not associated with an authentication ID in the ID correspondence table 221 (i.e., when the authentication ID field is blank), the display control unit 214 may generate display information including information indicating that facial authentication was unsuccessful. In this case, the display control unit 214 may generate display information including information indicating that the person has not been authenticated.

[0127] The display control unit 214 controls at least one of the display devices M1 and M2, and the display device M3 to display the generated display information. The display control unit 214 determines the display position of the display information on at least one of the display devices M1 and M2, and the display device M3, based on the position of the person related to the display information in the width direction of the display range DR (i.e., the direction intersecting the direction of travel of the person toward the entry restricted area RA).

[0128] For example, if person P1 has successfully undergone facial authentication, the display control unit 214 generates display information including information indicating successful facial authentication and information identifying person P1. The display control unit 214 controls one of the display devices M1 and M2 so that information indicating successful facial authentication (e.g., a green mark) included in the display information related to person P1 is displayed on one of the display devices M1 and M2. The display control unit 214 also controls one of the display devices M1 and M2 so that identification information indicating person P1 (e.g., a geometric pattern) included in the display information related to person P1 is displayed on one of the display devices M1 and M2. The display control unit 214 controls the display device M3 so that the information indicating successful facial authentication included in the display information is displayed at a display position on the display device M3 determined based on the widthwise position of person P1's display range DR. If the display device M3 includes an LED tape, the display control unit 214 may control the display device M3 so that an LED located at the display position emits green light.

[0129] For example, if person P1 has failed facial authentication, the display control unit 214 generates display information including information indicating that facial authentication has failed. The display control unit 214 controls one of the display devices M1 and M2 so that information indicating that facial authentication has failed (e.g., a red mark) included in the display information related to person P1 is displayed on one of the display devices M1 and M2. The display control unit 214 controls the display device M3 so that the information indicating that facial authentication has failed, included in the display information, is displayed at a display position on the display device M3 that is determined based on the widthwise position of person P1's display range DR. If the display device M3 is configured to include an LED tape, the display control unit 214 may control the display device M3 so that an LED located at the display position emits red light.

[0130] For example, if person P1 is an unauthenticated person, the display control unit 214 generates display information including information indicating that the person P1 is unauthenticated. The display control unit 214 controls one of the display devices M1 and M2 so that information indicating that the person P1 is unauthenticated (e.g., a gray mark) included in the display information related to person P1 is displayed on one of the display devices M1 and M2. The display control unit 214 controls the display device M3 so that the information indicating that the person P1 is unauthenticated is displayed at a display position of the display information on the display device M3 determined based on the widthwise position of the display range DR of person P1. If the display device M3 is configured to include an LED tape, the display control unit 214 may control the display device M3 so that the LEDs arranged at the display positions emit gray light.

[0131] The display control unit 214 may change the display order of one of the display devices M1 and M2 and the display device M3. For example, when person P1 enters the display range DR, the display control unit 214 may control the display device M3 so that the facial authentication result for person P1 is first displayed on the display device M3. After the facial authentication result for person P1 is displayed on the display device M3, the display control unit 214 may control one of the display devices M1 and M2 so that the facial authentication result for person P1 is displayed on one of the display devices M1 and M2. With this configuration, after person P1 checks the facial authentication result displayed on the display device M3, person P1 can again check the facial authentication result displayed on one of the display devices M1 and M2. This can increase person P1's sense of security.

[0132] The display control unit 214 may change the display order of one of the display devices M1 and M2 and the display device M3 based on the result of face authentication of the person P1 by the face authentication unit 213. If the person P1 is a person who has failed face authentication or an unauthenticated person, the person P1 is likely not facing the camera CAM (in this case, the person P1 is likely looking down at their feet). In this case, when the person P1 enters the display range DR, the display control unit 214 may control the display device M3 so that the result of face authentication of the person P1 is first displayed on the display device M3. After the result of face authentication of the person P1 is displayed on the display device M3, the display control unit 214 may control one of the display devices M1 and M2 so that the result of face authentication of the person P1 is displayed on one of the display devices M1 and M2. This configuration makes it possible to make the person P1, who is a person who has failed face authentication or an unauthenticated person, aware of the result of his or her face authentication.

[0133] If person P1 has successfully undergone facial authentication, it is highly likely that person P1 is facing the camera CAM (in other words, it is highly likely that person P1 has their face facing forward or diagonally upward). In this case, when person P1 enters the display range DR, the display control unit 214 may first control one of the display devices M1 and M2 so that the result of facial authentication for person P1 is displayed on one of the display devices M1 and M2. After the result of facial authentication for person P1 is displayed on one of the display devices M1 and M2, the display control unit 214 may control display device M3 so that the result of facial authentication for person P1 is displayed on display device M3. This configuration makes it easier for person P1, who has successfully undergone facial authentication, to notice the result of his or her own facial authentication.

[0134] For example, when person P1 leaves the display range DR, the display control unit 214 controls one of the display devices M1 and M2 and the display device M3 to terminate the display of the display information related to person P1. The display control unit 214 may perform the above-described process for all people passing through the face recognition area FRA.

[0135] (Technical effect) The results of facial recognition (for example, information indicating that facial recognition was successful, information indicating that facial recognition was unsuccessful, and information indicating that the face has not been recognized) are displayed on at least one of the display devices M1 and M2 located above the head of a person passing through the facial recognition area FRA, and on the display device M3 located at the feet of the person, so that a person passing through the facial recognition area FRA can relatively easily see the results of facial recognition.

[0136] (Modifications) The authentication system 5 can employ various aspects similar to those of the modification of the second embodiment described above. The authentication system 5 can employ various aspects similar to those of the modification of the third embodiment described above. The authentication system 5 can include a display device corresponding to the display device M4 according to the fourth embodiment described above, in addition to the display devices M1, M2, and M3.

[0137] The authentication system according to this disclosure is not limited to the above-described embodiments, and the above-described embodiments and modifications can be combined as appropriate within the scope of the inventive concept that can be understood from this disclosure.

[0138] <Supplementary Notes> The following supplementary notes are further disclosed regarding the above-described embodiment.

[0139] (Supplementary Note 1) An authentication system comprising: an image acquisition means for acquiring an image including a predetermined area through which a person to be authenticated passes as he or she approaches an entry-restricted area; a face authentication means for performing face authentication of the person to be authenticated based on the acquired image; and a display means that is placed at least either above the head or at the feet of the person to be authenticated, and that displays the results of the face authentication after the person to be authenticated leaves the entry-restricted area side of the face authentication area.

[0140] (Supplementary Note 2) The authentication system described in Supplementary Note 1, wherein the result of the facial authentication includes a first result indicating that the person to be authenticated is allowed to enter the restricted entry area, and a second result indicating that the person to be authenticated is not allowed to enter the restricted entry area.

[0141] (Supplementary Note 3) The authentication system according to Supplementary Note 1 or 2, wherein the display unit displays the result of the face authentication together with information indicating the person to be authenticated.

[0142] (Supplementary Note 4) The authentication system according to Supplementary Note 3, wherein the information indicating the person to be authenticated is a geometric pattern.

[0143] (Supplementary Note 5) The authentication system according to Supplementary Note 1 or 2, wherein the display means displays the result of the face authentication by changing a display color of a human-shaped figure corresponding to the person to be authenticated based on the result of the face authentication.

[0144] (Appendix 6) The authentication system described in any one of Appendices 1 to 5, wherein the display means includes a first display device and a second display device, the first display device and the second display device are arranged side by side above the head of the person to be authenticated, and an imaging means for imaging the person to be authenticated is arranged between the first display device and the second display device.

[0145] (Supplementary Note 7) The authentication system according to any one of Supplementary Notes 1 to 6, wherein the display means includes a third display device arranged at the feet of the person to be authenticated, and the third display device extends in a direction intersecting with a direction of travel of the person to be authenticated.

[0146] (Supplementary Note 8) The authentication system according to Supplementary Note 7, wherein the third display device is an LED tape.

[0147] (Supplementary Note 9) The authentication system described in Supplementary Note 7 or 8, wherein the display means includes a fourth display device arranged at the feet of the person to be authenticated, the third display device extends in a direction intersecting the direction of travel of the person to be authenticated, and the third display device and the fourth display device are arranged at an interval from each other along the direction of travel of the person to be authenticated.

[0148] (Supplementary Note 10) The authentication system according to any one of Supplementary Notes 1 to 9, wherein the display means is disposed between the entrance restriction area and the face authentication area.

[0149] (Supplementary Note 11) The authentication system according to any one of Supplementary Notes 1 to 10, wherein the display means is disposed at a position corresponding to an end of the face authentication area on the side of the entrance restriction area.

[0150] (Supplementary Note 12) The authentication system according to any one of Supplementary Notes 1 to 11, wherein the face authentication area is arranged in front of the entry restricted area in a direction of travel of the person to be authenticated toward the entry restricted area.

[0151] (Supplementary Note 13) The authentication system described in any one of Supplementary Notes 1 to 12, wherein the display means includes a first display device arranged above the head of the person to be authenticated and a third display device arranged at the feet of the person to be authenticated, and the display means changes the order in which the results of the face authentication are displayed on the first display device and the third display device based on the results of the face authentication.

[0152] (Supplementary Note 14) An authentication method comprising: acquiring an image including a facial recognition area through which a person to be authenticated passes as he or she approaches an entry-restricted area; performing facial recognition of the person to be authenticated based on the acquired image; and displaying the result of the facial recognition at least either above or below the head of the person to be authenticated after the person to be authenticated leaves the entry-restricted area side of the facial recognition area.

[0153] (Supplementary Note 15) A recording medium having recorded thereon a computer program for causing a computer to execute an authentication method, which includes acquiring an image including a facial recognition area through which a person to be authenticated who is heading towards an entry-restricted area passes, performing facial recognition of the person to be authenticated based on the acquired image, and displaying the result of the facial recognition at least either above the head or at the feet of the person to be authenticated after the person to be authenticated leaves the entry-restricted area side of the facial recognition area.

[0154] (Supplementary Note 16) An authentication device comprising: an image acquisition means for acquiring an image including a facial authentication area through which a person to be authenticated passes as he or she approaches an entry restricted area; a facial authentication means for performing facial authentication of the person to be authenticated based on the acquired image; and a display means for displaying the results of the facial authentication at least either above or below the head of the person to be authenticated after the person to be authenticated leaves the entry restricted area side of the facial authentication area.

[0155] This disclosure is not limited to the above-described embodiments, but may be modified as appropriate within the scope of the claims and the gist or idea of ​​the invention as can be read from the entire specification, and authentication systems, authentication methods, and recording media that involve such modifications are also included in the technical scope of this disclosure.

[0156] 1, 2, 3, 4, 5 Authentication system 11, 211 Image acquisition unit 12 Face authentication unit 13 Display unit 20 Face authentication device 21 Arithmetic unit 22 Storage device 23 Communication device 24 Input device 25 Output device 26 Face feature database 212 Tracking unit 213 Face authentication unit 214 Display control unit

Claims

1. An image acquisition means for acquiring an image including a face authentication area through which an authenticated person heading for the access restricted area passes; A face authentication means for performing face authentication of the authenticated person based on the acquired image; A display means disposed on at least one of the head and feet of the authenticated person, and displaying the result of the face authentication after the authenticated person exits to the access restricted area side of the face authentication area; An authentication system comprising the above.

2. The result of the face authentication includes a first result indicating that the authenticated person can enter the access restricted area, and a second result indicating that the authenticated person cannot enter the access restricted area. The authentication system according to Claim 1.

3. The display means displays the result of the face authentication together with information indicating the authenticated person. The authentication system according to Claim 1.

4. The information indicating the authenticated person is a geometric pattern. The authentication system according to Claim 3.

5. The display means displays the result of the face authentication by changing the display color of a human-shaped figure corresponding to the authenticated person based on the result of the face authentication. The authentication system according to Claim 1.

6. The display means includes a first display device and a second display device. The first display device and the second display device are arranged side by side above the head of the authenticated person. An imaging means for imaging the authenticated person is disposed between the first display device and the second display device. The authentication system according to Claim 1.

7. The display means includes a third display device disposed at the feet of the authenticated person. The third display device extends in a direction intersecting the traveling direction of the authenticated person. The authentication system according to Claim 1.

8. Acquire an image including a face authentication area through which an authenticated person heading for the access restricted area passes; Perform face authentication of the authenticated person based on the acquired image; After the authenticated person exits to the access restricted area side of the face authentication area, display the result of the face authentication on at least one of the head and feet of the authenticated person. An authentication method.

9. On a computer, Acquire an image including a face authentication area through which an authenticated person heading for the access restricted area passes; Perform face authentication of the authenticated person based on the acquired image; After the authenticated person exits to the access restricted area side of the face authentication area, display the result of the face authentication on at least one of the head and feet of the authenticated person. A recording medium on which a computer program for executing the authentication method is recorded.

10. Image acquisition means for acquiring an image including a face authentication area through which an authenticated person heading for the access restricted area passes; Face authentication means for performing face authentication of the authenticated person based on the acquired image; Display means for displaying the result of the face authentication on at least one of the head and feet of the authenticated person after the authenticated person exits to the access restricted area side of the face authentication area; An authentication device comprising the above.