Facial recognition system, access control system, management system, program

Abstract

To provide a technology for suitably carrying out an alarm setting.SOLUTION: A face authentication part 360 carries out face authentication processing based on images including a face taken by an imaging part 130. A control part 330 carries out control of a door 160 provided in an entrance of a prescribed area, based on a result of the face authentication processing in the face authentication part 360. An instruction part 332 instructs the alarm setting when alarm setting conditions are satisfied. An operation part 180 receives an operation for activating the alarm setting of the prescribed area. The alarm setting conditions include a case when the operation part 180 receives the operation for activating the alarm setting.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to authentication technology, and particularly to a face authentication system for authenticating a person, an entrance / exit management system, a management system, and a program.

Background Art

[0002] An entrance / exit management system manages the entrance and exit of people to a specific management area in a facility. This entrance / exit management system collates identification information for verification recorded on a recording medium such as an IC (Integrated Circuit) card with pre-registered identification information, and determines whether entrance and exit are permitted based on the collation result (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a face authentication system that performs face authentication processing based on an image of a person's face, or in an entrance / exit management system, it is desirable that the security setting for a predetermined area be appropriately executed.

[0005] The present disclosure has been made in view of such a situation, and an object thereof is to provide a technology for appropriately executing a security setting.

Means for Solving the Problems

[0006] To solve the above problems, a facial recognition system in one aspect of the present disclosure includes: a facial recognition unit that performs facial recognition processing based on an image including a face captured by an imaging unit; a control unit that performs control on a door provided at the entrance of a predetermined area based on the result of the facial recognition processing in the facial recognition unit; an instruction unit that instructs the setting of a security system for the predetermined area when security setting conditions are met; and an operation unit that receives an operation to enable the security setting for the predetermined area. The security setting conditions include the case in which, after the operation unit receives an operation to enable the security setting, the facial recognition unit succeeds in facial recognition processing and the door is closed, and before the operation unit receives an operation to enable the security setting, the control unit performs control on the door when the facial recognition unit succeeds in facial recognition processing, and after the operation unit receives an operation to enable the security setting, Before the alert setting conditions are met, Even if the facial recognition unit successfully performs facial recognition, it does not execute any control actions on the door.

[0007] Another aspect of this disclosure is an access control system. This access control system includes an ID authentication unit that performs ID authentication processing for a contactless ID device, and an access control system that performs control over doors installed at the entrance of a predetermined area based on the results of the ID authentication processing in the ID authentication unit. If the ID authentication process is successful, control over at least one of the following actions for the door: opening and unlocking. The system comprises a control unit, an operation unit that receives an operation to enable the security setting for a predetermined area, a communication unit that communicates with a facial recognition system that performs facial recognition processing based on captured images, and an instruction unit that, when the operation unit receives an operation to enable the security setting and the communication unit receives information from the facial recognition system indicating the completion of the facial recognition processing and the door is closed, instructs the system to enable the security setting for the predetermined area.

[0009] Another aspect of this disclosure is also an access control system. This access control system includes an ID authentication unit that performs ID authentication processing for a contactless ID device, a control unit that, based on the results of the ID authentication processing in the ID authentication unit, performs control on a door provided at the entrance of a predetermined area, and if the ID authentication processing is successful, performs control on at least one of opening and unlocking the door, and an operation unit that receives an operation to enable the security setting of the predetermined area, A communication unit that communicates with a facial recognition system that performs facial recognition processing based on captured images,The system includes an operating unit that accepts an operation to activate the alarm setting, an instruction unit that instructs the alarm setting to be activated in a predetermined area when the ID authentication process in the ID authentication unit is completed and the door is closed, and an operating unit that accepts an operation to activate the alarm setting in the operating unit and the ID authentication process in the ID authentication unit is completed and the door is closed.

[0011] Furthermore, any combination of the above components, as well as any conversion of the expressions of this disclosure between methods, apparatus, systems, recording media, computer programs, etc., are also valid forms of this disclosure. [Effects of the Invention]

[0012] According to this disclosure, the alert settings can be properly implemented. [Brief explanation of the drawing]

[0013] [Figure 1] Figures 1(a) and 1(b) show the configuration of the management system according to Example 1. [Figure 2] Figures 2(a)-(g) show the first pattern of operation by the management system shown in Figure 1(a). [Figure 3] Figures 3(a)-(f) show the second pattern of operation using the management system shown in Figure 1(a). [Figure 4] Figures 4(a)-(d) show the third pattern of operation using the management system shown in Figure 1(a). [Figure 5] Figures 5(a) and 5(b) show the configuration of the management system according to Example 2. [Figure 6] Figures 6(a)-(f) show the fourth pattern of operation by the management system shown in Figure 5(a). [Figure 7] Figures 7(a)-(d) show the fifth pattern of operation by the management system shown in Figure 5(a). [Figure 8] Figures 8(a)-(d) show the sixth pattern of operation by the management system according to Example 3. [Figure 9] Figures 9(a)-(d) show the seventh pattern of operation by the management system according to Example 4. [Figure 10]Figs. 10(a)-(d) are diagrams showing the eighth pattern of operations by the management system according to Example 4.

Best Mode for Carrying Out the Invention

[0014] (Example 1) Before specifically explaining the present disclosure, an overview will be described. Example 1 relates to a management system that manages the entry of people into a predetermined area in a facility or the exit of people from the area. To manage the entry or exit of people, in the management system, a person having the right to enter and exit the area (hereinafter referred to as "authorized person") is authenticated. An example of this authentication is an authentication process using a face image (hereinafter referred to as "face authentication process").

[0015] In the face authentication process, for each piece of identification information (hereinafter referred to as "face identification information") assigned to an authorized person, a face image obtained by imaging the face of the authorized person is prepared in advance as a reference image. When an authorized person arrives at the entrance of the area, the authorized person causes the imaging device installed at the entrance of the area to image their face. The management system compares the face image imaged by the imaging device with the reference image to determine whether the person is an authorized person. The management system controls the open / closed state or the locked / unlocked state of the door provided at the entrance according to the result of the face authentication process.

[0016] Such a management system has a mode called警戒設定 (警戒セット, security setting) prepared in advance. In the security setting, when the door is in the closed and locked state and an attempt is made to open the door, this is detected by a sensor, and an alarm sounds and a security company is contacted. The security setting is enabled, for example, when an operation for enabling the security setting is performed in a state where the door is closed and confirmation of an operation by an authorized person is made. Specifically, in a state where the door is closed, when an authorized person presses a button for enabling the security setting and the face authentication process for the authorized person is successful, the security setting is enabled. On the other hand, to disable (解除, cancel) the security setting, an operation for disabling the security setting and confirmation of an operation by an authorized person are required.

[0017] When the door is an automatic door, when an authorized person passes near the entrance and the face recognition process is successful, the door will be opened. As a result, the authorized person cannot enable the security setting. To address this, in this embodiment, when receiving an operation to enable the security setting, the face recognition process for opening the door is stopped, so that in the state where the door is closed, the operation to enable the security setting and the operation by the authorized person are confirmed.

[0018] FIG. 1(a)-(b), particularly FIG. 1(a), shows the configuration of the management system 1000. The management system 1000 manages the entry and exit of people in the first area 100a to the Nth area 100n provided in the facility. The first area 100a to the Nth area 100n are collectively referred to as the area 100, and in each area 100, an imaging unit 130, a monitor 140, an operation unit 180, a door control device 150, and a door 160 are installed. The management system 1000 may manage only one area 100.

[0019] The management system 1000 includes a face recognition system 300. Further, the face recognition system 300 includes an imaging unit 130, a monitor 140, an operation unit 180, and a face recognition management device 310. The face recognition management device 310 and the imaging unit 130, monitor 140, door control device 150, and operation unit 180 of each area 100 are communicably connected by a network 400 such as a LAN (Local Area Network).

[0020] The management system 1000 executes an authentication process for a person located at the entrance of the area 100, and controls at least one of opening, unlocking, closing, and locking the entrance door 160 only when the authentication is successful. For example, the management system 1000 opens the entrance door 160 that is normally closed. An example of the authentication process is a face recognition process, and based on the result of the face recognition process, it is determined whether the person is an authorized person with the right to enter the area 100.

[0021] To perform facial recognition processing, an imaging unit 130 is installed near door 160. The imaging unit 130 captures the faces of people who wish to enter or exit area 100 at the entrance to area 100. Since the captured video consists of multiple images arranged in chronological order, the video and images will be collectively referred to as images below. The faces of people extracted from the captured images are used for facial recognition processing, so the imaging unit 130 is required to capture images that can perform facial recognition processing on people located at the entrance with high accuracy. For this reason, the imaging unit 130 is installed, for example, near door 160 at the average height of a person's face, and captures video of the entrance. This is because people who are about to enter or exit area 100 usually face door 160 at the entrance. The imaging unit 130 transmits the captured images to the facial recognition management device 310 via network 400. In this case, the imaging unit 130 may also transmit information identifying the area 100 in which the imaging unit 130 is installed (hereinafter referred to as "area information") to the facial recognition management device 310 via the network 400.

[0022] The facial recognition management device 310 performs facial recognition processing on the images received from the imaging unit 130, specifically on the faces of people contained in the images. Facial recognition processing is the process of determining whether a person is an authorized person with the right to enter area 100, based on the faces contained in the images. Based on the results of the facial recognition processing, the facial recognition management device 310 determines the control content for door 160. The control content may be, for example, to open door 160 or to close door 160. Alternatively, the control content may be to unlock or lock the electronic lock installed on door 160. The facial recognition management device 310 transmits the control content as control information to the monitor 140 and door control device 150 via the network 400.

[0023] Near door 160, a monitor 140 is installed along with the aforementioned imaging unit 130. The monitor 140 receives control information from the facial recognition management device 310. The monitor 140 displays the control content in the control information as a message. The message may be, for example, that door 160 is to be opened or closed. The message may also be to unlock or lock the electronic lock installed on door 160. At the entrance to area 100, a person who wishes to enter or exit area 100 can check the message displayed on the monitor 140 to determine, for example, whether door 160 will be opened or not.

[0024] The door control device 150 receives control information from the facial recognition management device 310 and controls the opening and closing of the door 160, i.e., open or closed, according to the received control information. Opening the door 160 may include unlocking the electronic lock on the door 160 or opening the door 160 as an automatic door. Closing the door 160 may include locking the electronic lock on the door 160 or closing the door 160 as an automatic door. In its normal state, the door control device 150 keeps the door 160 closed. The door 160 is located at the entrance to area 100 and is the part that people entering area 100 pass through. The door 160 is, for example, a door with an electronic lock or an automatic door.

[0025] The management system 1000 has a pre-configured mode called "alert setting." This alert setting is sometimes also called "alert set." In alert setting mode, when door 160 is closed and locked, if someone attempts to open door 160, a sensor (not shown) connected to door 160, or a sensor (not shown) installed near door 160, detects this. The sensor notifies the facial recognition management device 310 of the detection result via the network 400. Upon receiving the detection result from the sensor, the facial recognition management device 310 sounds an alarm (not shown) or notifies the security company of the detection result.

[0026] The alarm setting is activated, for example, when the door 160 is closed, after the action to activate the alarm setting has been performed and the operation has been confirmed by an authorized person. The action to activate the alarm setting is performed by operating the control unit 180 installed near the door 160. The control unit 180 is, for example, a button, and pressing the button down corresponds to the action to activate the alarm setting. Furthermore, confirmation of the operation by an authorized person corresponds to the successful facial recognition processing for the authorized person in the facial recognition management device 310.

[0027] To disable (cancel) the alarm setting, for example, an action to disable the alarm setting and confirmation of the operation by an authorized person are required. The action to disable (cancel) the alarm setting is performed by operating a button on the control unit 180 installed near the door 160. A separate button may be provided for enabling the alarm setting and a separate button for disabling (cancel) the alarm setting. Here, confirmation of the operation by an authorized person corresponds to the success of the facial recognition process for the authorized person in the facial recognition management device 310.

[0028] As mentioned above, if door 160 is an automatic door, when an authorized person passes near area 100, the imaging unit 130 captures the authorized person's face, and if the facial recognition process is successful in the facial recognition management device 310, door 160 will open. In this state, even if the authorized person operates the control unit 180, the alarm setting will not be activated. It is desirable to be able to execute the alarm setting even in such a situation.

[0029] Figure 1(b) shows the configuration of the facial recognition management device 310. The facial recognition management device 310 includes a communication unit 320, a control unit 330, a face detection unit 340, a face information storage unit 350, a facial recognition unit 360, and a notification unit 370. The control unit 330 includes an instruction unit 332. The communication unit 320 is a communication interface for connecting to the network 400 and can communicate with the imaging unit 130, monitor 140, door control device 150, and operation unit 180 shown in Figure 1 via the network 400. The communication unit 320 can also communicate via the network 400 with sensors (not shown), alarms (not shown), and security company servers (not shown) used in security settings. The face detection unit 340 receives images from the imaging unit 130 via the communication unit 320 and the control unit 330. The face detection unit 340 also detects faces from the received images using face detection information stored in the face information storage unit 350. The face detection unit 340 outputs information indicating the region of the detected face, or information indicating the characteristics of the detected face, to the face recognition unit 360. Face detection in the face detection unit 340 is performed periodically.

[0030] The face information storage unit 350 stores face detection information for detecting a face from an image containing a face. The face detection information represents features of the face image, such as Gabor feature quantities of the face obtained from a large number of face image samples, and image patterns of each facial component such as the eyes and mouth. The face information storage unit 350 also stores face reference information to be referenced in order to determine whether the detected face is the face of an authorized person, associating it with the face identification information of that authorized person for each authorized person's face. The face reference information shows features of the face, such as the width of the face and the ratio of the distance between the outer corners of the eyes and the distance between the corners of the mouth. Furthermore, the face information storage unit 350 also stores authorized area information indicating the area 100 that the authorized person corresponding to the face identification information is permitted to enter. In the authorized area information, for example, the first area 100a is indicated as the area 100 that the authorized person is permitted to enter. The information stored in the facial information storage unit 350 may be set by an administrator via a user interface (not shown) such as a monitor, keyboard, and mouse provided by the facial recognition management device 310, or it may be set remotely from an external device (not shown).

[0031] The facial recognition unit 360 uses the facial reference information from the facial information storage unit 350 to perform facial recognition processing on the face detected by the facial detection unit 340. Here, if a person is standing at the entrance for a long time, the facial recognition processing may be performed multiple times. If the facial recognition processing is successful, the facial recognition unit 360 identifies the facial identification information of the authorized person corresponding to the facial reference information at that time. The facial recognition unit 360 outputs the result of the facial recognition processing to the control unit 330. If the result of the facial recognition processing is successful, the facial recognition unit 360 also outputs the identified facial identification information to the control unit 330.

[0032] If the facial recognition process from the facial recognition unit 360 is successful, the control unit 330 transmits control information from the communication unit 220 to the monitor 140 and the door control device 150 instructing at least one of opening and unlocking the door 160. The control information may also instruct at least one of closing and locking the door 160. On the other hand, if the facial recognition process from the facial recognition unit 360 is unsuccessful, the control unit 330 transmits control information from the communication unit 220 to the monitor 140 and the door control device 150 instructing the door 160 to be closed for a certain period of time. In other words, the control unit 330 controls at least one of opening, unlocking, closing, and locking the door 160 located at the entrance to a predetermined area 100.

[0033] Furthermore, if the facial recognition process from the facial recognition unit 360 is successful, the control unit 330 may manage authorized personnel within the facility based on the facial identification information received from the facial recognition unit 360. In addition, the control unit 330 may acquire and manage the status of the door 160 by communicating with the door control device 150 via the communication unit 320. The status of the door 160 indicates whether the door 160 is open, unlocked, closed, or locked.

[0034] The notification unit 370 acquires the control content determined by the control unit 330 and generates a screen in which the control content is displayed as a message. The notification unit 370 notifies the control content by displaying the generated screen on the monitor 140 in Figure 1 via the communication unit 320 and the network 400.

[0035] The process for activating the alert settings in this embodiment is performed using one of the following three patterns: (1) Pattern 1, (2) Pattern 2, or (3) Pattern 3. The following will describe the process in the order of (1) Pattern 1, (2) Pattern 2, and (3) Pattern 3. (1) Pattern 1 Here, we also use Figures 2(a)-(g) to explain the first pattern. Figures 2(a)-(g) show the first pattern of operation by the management system 1000. Figures 2(a)-(e) show the screen displayed on the monitor 140. Figure 2(f) shows the operation of the facial recognition system 300, in particular the facial recognition management device 310, where a high level indicates the execution of facial recognition processing and a low level indicates the non-execution of facial recognition processing. Figure 2(g) shows the operation of the door 160, where a high level indicates opening and a low level indicates closing. In these, the horizontal axis represents time.

[0036] At time T1, door 160 is closed, and when an authorized person who wants to activate the security setting passes in front of the imaging unit 130, the imaging unit 130 captures the authorized person's face. The facial recognition unit 360 of the facial recognition management device 310 performs facial recognition processing based on the image including the face captured by the imaging unit 130. If the facial recognition processing in the facial recognition unit 360 is successful, the control unit 330 performs control on door 160 located at the entrance to area 100. Here, door 160 is opened at time T2.

[0037] At time T3, when door 160 is open, an authorized person operates the operation unit 180 shown in Figure 2(a), causing the operation unit 180 to receive an operation to activate the security setting for area 100 (hereinafter referred to as the "activation operation"). The operation unit 180 notifies the face recognition management device 310 of the activation operation via the network 400. The communication unit 320 of the face recognition management device 310 receives the activation operation from the operation unit 180. The control unit 330 has predetermined that the operation unit 180 receiving the activation operation is a condition for authentication suspension, and when it receives the activation operation from the communication unit 320, it determines that the authentication suspension condition has been met. If the authentication suspension condition is met, the control unit 330 stops at least one of the imaging unit 130 and the face recognition unit 360. As a result, face recognition processing ceases from time T3. The suspension of face recognition processing continues until time T4, when the open door 160 is closed. During this time, the screen shown in Figure 2(b) is displayed on the monitor 140.

[0038] At time T4, door 160 is closed. When the control unit 330 receives notification from the door control device 150, it resumes the facial recognition process. As a result, the imaging unit 130 captures the face of the authorized person, and the facial recognition unit 360 performs facial recognition processing based on the image including the face captured by the imaging unit 130. Even if the facial recognition process in the facial recognition unit 360 is successful, the control unit 330 does not perform the aforementioned control to door 160 if it has received a valid operation from the communication unit 320. On the other hand, the instruction unit 332 pre-defines the condition for setting the alarm as the case when the facial recognition unit 360 has completed the facial recognition process and the operation unit 180 has received an operation to enable the alarm setting. The instruction unit 332 receives a valid operation at time T3 and the facial recognition process is completed at time T4, so it determines that the alarm setting condition is met. At time T5, if the alarm setting condition is met, the instruction unit 332 decides to enable the alarm setting for area 100. Following this, the instruction unit 332 instructs the door control device 150 to execute the security setting for area 100. At that time, the screen shown in Figure 2(d) is displayed on the monitor 140.

[0039] If the door control device 150 is instructed to perform an alarm setting by the facial recognition management device 310 at time T5, it performs the alarm setting. While the alarm setting is being performed, if the door control device 150 detects that the door 160 is about to be opened by a sensor (not shown), it transmits the detection result to the facial recognition management device 310 via the network 400. When the communication unit 320 of the facial recognition management device 310 receives the detection result from the sensor, the control unit 330 sounds an alarm (not shown) or notifies the security company of the detection result. Also, if the alarm setting for area 100 is active, the control unit 330 stops at least one of the imaging unit 130 and the facial recognition unit 360. If the alarm setting is active, the screen shown in Figure 2(e) is displayed on the monitor 140.

[0040] (2) Second pattern Here, we also use Figures 3(a)-(f) to explain the second pattern. Figures 3(a)-(f) show the second pattern of operation by the management system 1000. Figures 3(a)-(d) show the screen displayed on the monitor 140. Figure 3(e) shows the operation of the facial recognition system 300, in particular the facial recognition management device 310, where a high level indicates the execution of facial recognition processing and a low level indicates the non-execution of facial recognition processing. Figure 3(f) shows the operation of the door 160, where a high level indicates opening and a low level indicates closing. In these, the horizontal axis represents time.

[0041] The processing from time T1 to time T4 is the same as in the first pattern. Therefore, Figures 3(a)-(b) are the same as Figures 2(a)-(b). At time T4, door 160 is closed. The control unit 330 receives notification from door control device 150. The instruction unit 332 pre-defines the condition for setting the alarm as the case where the operation unit 180 receives an operation to activate the alarm setting within a predetermined period after the face recognition unit 360 has completed the face recognition processing. The instruction unit 332 determines that the alarm setting condition is met if the face recognition processing is completed at time T1, the activation operation is received at time T3, and the time difference between time T1 and time T3 is within the predetermined period. This is equivalent to using the face recognition processing that was performed before the activation operation was received, rather than re-executing the face recognition processing after the activation operation was received, as in the first pattern, if the time difference between time T1 and time T3 is within the predetermined period. At time T4, the instruction unit 332 decides to activate the alarm setting for area 100 if the alarm setting conditions are met. Subsequently, the instruction unit 332 instructs the door control device 150 to execute the alarm setting for area 100. At that time, the screen shown in Figure 3(c) is displayed on the monitor 140.

[0042] If the door control device 150 receives an instruction from the facial recognition management device 310 to perform an alarm setting at time T4, it performs the alarm setting. The execution of the alarm setting is the same as in the first pattern, so the explanation is omitted here. If the alarm setting is active, the screen shown in Figure 3(d) is displayed on the monitor 140.

[0043] (3) Third pattern Here, we also use Figures 4(a)-(d) to explain the third pattern. Figures 4(a)-(d) show the third pattern of operation by the management system 1000. Figures 4(a)-(b) show the screen displayed on the monitor 140. Figure 4(c) shows the operation of the facial recognition system 300, in particular the facial recognition management device 310, where a high level indicates the execution of facial recognition processing and a low level indicates the non-execution of facial recognition processing. Figure 4(d) shows the operation of the door 160, where a high level indicates opening and a low level indicates closing. In these, the horizontal axis represents time. The alarm setting condition in the third pattern is different from before, and is defined as when the operation unit 180 receives an operation to activate the alarm setting.

[0044] At time T1, the operator operates the operation unit 180 shown in Figure 4(a), and the operation unit 180 receives a valid operation. The operation unit 180 notifies the facial recognition management device 310 of the valid operation via the network 400. The communication unit 320 of the facial recognition management device 310 receives the valid operation from the operation unit 180. When the instruction unit 332 receives the valid operation from the communication unit 320, it determines that the alarm setting conditions are met. At time T2, if the alarm setting conditions are met, the instruction unit 332 decides to activate the alarm setting for area 100. Subsequently, the instruction unit 332 instructs the door control device 150 to execute the alarm setting for area 100.

[0045] If the door control device 150 receives an instruction from the facial recognition management device 310 to perform an alarm setting at time T2, it performs the alarm setting. In addition, if the alarm setting for area 100 is active, the control unit 330 stops at least one of the imaging unit 130 and the facial recognition unit 360. If the alarm setting is active, the screen shown in Figure 4(b) is displayed on the monitor 140.

[0046] The subject of the apparatus, system, or method in this disclosure comprises a computer. The functions of the subject of the apparatus, system, or method in this disclosure are realized by the computer executing a program. The computer comprises a processor as its main hardware component, which operates according to the program. The processor is of any type as long as it can realize its functions by executing the program. The processor consists of one or more electronic circuits, including semiconductor integrated circuits (ICs) or LSIs (Large Scale Integrations). Multiple electronic circuits may be integrated on one chip or provided on multiple chips. Multiple chips may be aggregated in one device or provided on multiple devices. The program is recorded on a non-temporary recording medium such as a ROM, optical disc, or hard disk drive that is readable by the computer. The program may be pre-stored on the recording medium or supplied to the recording medium via a wide-area communication network, including the Internet.

[0047] According to this embodiment, when the authentication stop condition is met, at least one of the imaging unit 130 and the face recognition unit 360 is stopped, so the face recognition process can be stopped. Also, since the face recognition process is stopped when the authentication stop condition is met, the face recognition process can be executed appropriately. Furthermore, since the authentication stop condition includes when the operation unit 180 receives an operation to enable the alarm setting, the face recognition process can be stopped appropriately. Furthermore, since the authentication stop condition includes when the operation unit 180 receives an operation to enable the alarm setting within a predetermined period after the face recognition unit 360 has completed the face recognition process, the face recognition process can be stopped appropriately.

[0048] Furthermore, if the alarm setting conditions are met, the system will instruct the system to set up an alarm in a predetermined area, so the alarm setting can be properly executed. Also, since the alarm setting conditions include the case where the operation unit 180 receives an operation to enable the alarm setting, the alarm setting can be properly executed. Also, since the alarm setting conditions include the case where the face recognition unit 360 completes the face recognition process and the operation unit 180 receives an operation to enable the alarm setting, the alarm setting can be properly executed. Also, since the alarm setting conditions include the case where the operation unit 180 receives an operation to enable the alarm setting within a predetermined period after the face recognition unit 360 completes the face recognition process, the alarm setting can be properly executed.

[0049] An outline of one aspect of this disclosure is as follows: A facial recognition system (300) in one aspect of this disclosure includes a facial recognition unit (360) that performs facial recognition processing based on an image including a face captured by an imaging unit (130), and a control unit (330) that controls at least one of the imaging unit (130) and the facial recognition unit (360). The control unit (330) stops at least one of the imaging unit (130) and the facial recognition unit (360) when authentication stop conditions are met.

[0050] The authentication suspension conditions may include cases where the image from the imaging unit (130) contains a face with a predetermined facial expression.

[0051] The system may further include an operating unit (180) that accepts an operation to enable the security setting for a predetermined area. The authentication deactivation condition may also include the case when the operating unit (180) accepts an operation to enable the security setting.

[0052] The authentication deactivation conditions may also include cases where the operation unit (180) receives an operation to activate the alert setting within a predetermined period after the facial recognition unit (360) has completed the facial recognition process.

[0053] Another aspect of this disclosure is also a facial recognition system (300). This facial recognition system (300) includes a facial recognition unit (360) that performs facial recognition processing based on an image including a face captured by an imaging unit (130), a control unit (330) that performs control on a door provided at the entrance of a predetermined area based on the results of the facial recognition processing in the facial recognition unit (360), and an instruction unit (332) that instructs the setting of security for the predetermined area when security setting conditions are met.

[0054] The system may further include an operating unit (180) that accepts an operation to activate the alarm setting for a predetermined area. The alarm setting conditions may include the case when the operating unit (180) accepts an operation to activate the alarm setting.

[0055] The alarm setting conditions may also include the case where the facial recognition unit (360) has completed facial recognition processing and the operation unit (180) has received an operation to activate the alarm setting.

[0056] The alarm setting conditions may also include cases where the operation unit (180) receives an operation to activate the alarm setting within a predetermined period after the facial recognition unit (360) has completed the facial recognition process.

[0057] (Example 2) Next, Example 2 will be described. Similar to Example 1, Example 2 relates to a management system for managing the entry of people into or exit from a designated area within a facility. In Example 1, facial recognition processing is performed as an example of authentication. In Example 2, in addition to facial recognition processing, authentication using an IC (Integrated Circuit) card (hereinafter referred to as "ID authentication processing") is also performed.

[0058] In the ID authentication process, an IC card containing identification information assigned to the authorized person (hereinafter referred to as "card identification information") is provided to that authorized person in advance. When the authorized person arrives at the entrance of the area, they bring the IC card close to a card reader installed at the entrance of the area. When the card reader obtains the card identification information from the IC card, the management system determines whether the person is an authorized person based on the obtained card identification information. The management system controls the open / closed or locked / unlocked state of the door installed at the entrance according to the result of the ID authentication process.

[0059] In Example 2, the alarm setting is activated, for example, when the door is closed, after the action to activate the alarm setting has been performed and the operation has been confirmed by an authorized person. Specifically, when the door is closed, the alarm setting is activated when an authorized person presses down the button to activate the alarm setting and the ID authentication process for the authorized person is successful. On the other hand, in order to disable (deactivate) the alarm setting, the action to disable the alarm setting and confirmation of the operation by an authorized person are required.

[0060] If the door is an automatic door, the door will open when an authorized person passes near the entrance and the facial recognition process is successful. This prevents the authorized person from activating the security setting. To address this, in this embodiment, when an action to activate the security setting is received, the facial recognition process to open the door is stopped. This allows the action to activate the security setting and the operation by the authorized person to be confirmed while the door is closed. This section will focus on explaining the differences from previous versions.

[0061] Figures 5(a) and 5(b), particularly Figure 5(a), show the configuration of the management system 1000. Areas 100a to Nth 100n are installed in the facility in the same manner as in Figure 1(a). Each area 100 is equipped with a card reader 110, an imaging unit 130, a monitor 140, an operation unit 180, a door control device 150, and a door 160.

[0062] The management system 1000 includes an access control system 200 and a facial recognition system 300. The access control system 200 includes a card reader 110, an operating unit 180, and an access control device 210, while the facial recognition system 300 includes an imaging unit 130, a monitor 140, and a facial recognition management device 310. The access control device 210 and the facial recognition management device 310, along with the card reader 110, imaging unit 130, monitor 140, door control device 150, and operating unit 180 of each area 100, are communicated via a network 400.

[0063] Another example of authentication processing in the management system 1000 is ID authentication processing, which determines whether the person is an authorized person with the right to enter area 100 based on the result of ID authentication processing. The person holds an IC card 120, and the IC card 120 stores card identification information such as a string assigned to the authorized person.

[0064] When the IC card 120 is brought close to the card reader 110 installed near the door 160, it wirelessly transmits card identification information to the card reader 110. If the IC card 120 is a contactless IC card, it wirelessly transmits the card identification information to the card reader 110 using electromagnetic induction. In this case, the communication distance between the card reader 110 and the IC card 120 is approximately 2 mm to approximately 70 cm. The card reader 110 acquires the card identification information from the IC card 120 only when an IC card operation is performed. The card reader 110 transmits the acquired card identification information to the access control device 210 via the network 400. At that time, the card reader 110 also transmits information identifying the area 100 where the card reader 110 is installed (hereinafter referred to as "area information") to the access control device 210 via the network 400.

[0065] The access control device 210 receives card identification information from the card reader 110 and performs ID authentication processing based on the card identification information. ID authentication processing is the process of determining whether a person is an authorized person with the right to enter area 100 based on the card authentication information. Based on the result of the ID authentication processing, the access control device 210 determines the control content for door 160. The control content may be, for example, to open door 160 or to close door 160. Alternatively, the control content may be to unlock or lock the electronic lock installed on door 160. The access control device 210 transmits the control content as control information to the monitor 140 and door control device 150 via the network 400.

[0066] As described above, the facial recognition management device 310 performs facial recognition processing on the images captured by the imaging unit 130 installed near the door 160, and on the human faces contained in the images. Based on the results of the facial recognition processing, the facial recognition management device 310 determines the control content for the door 160. The facial recognition management device 310 transmits the control content as control information to the monitor 140 and the door control device 150 via the network 400.

[0067] A monitor 140 installed near door 160 receives control information from the access control device 210 or the facial recognition control device 310. The monitor 140 displays the control content of the control information as a message. Here, whether door 160 is to be opened or not may be recognized by a person wishing to enter area 100 or leave area 100 by the illumination of an LED (Light Emitting Diode) provided on the card reader 110. The door control device 150 receives control information from the access control device 210 or the facial recognition control device 310 and controls the opening and closing of door 160, i.e., opening or closing, according to the received control information.

[0068] The management system 1000 has a pre-configured mode called "alert setting." The alert setting is activated, for example, when the door 160 is closed, after the action to activate the alert setting has been performed and the operation has been confirmed by an authorized person. In Embodiment 1, the action to activate the alert setting is performed by operating the operation unit 180, and the confirmation of the operation by an authorized person corresponds to the successful facial recognition process for the authorized person in the facial recognition management device 310. On the other hand, in Embodiment 2, the action to activate the alert setting is performed by operating the operation unit 180, and the confirmation of the operation by an authorized person corresponds to the successful ID authentication process for the authorized person in the access control device 210. The action to disable (deactivate) the alert setting is similar.

[0069] Similar to Example 1, if door 160 is an automatic door, when an authorized person passes near area 100, the imaging unit 130 captures the authorized person's face, and if the facial recognition management device 310 successfully performs facial recognition, door 160 is opened. In this state, even if the authorized person operates the control unit 180, the alarm setting will not be activated. It is desirable to be able to perform the alarm setting even in such a situation.

[0070] Figure 5(b) shows the configuration of the access control device 210. The access control device 210 includes a communication unit 220, a control unit 230, a card information storage unit 240, an ID authentication unit 250, and a storage unit 260. The control unit 230 includes an instruction unit 232. The communication unit 220 is a communication interface for connecting to the network 400 and can communicate with the card reader 110, door control device 150, operation unit 180, and facial recognition management device 310 shown in Figure 1 via the network 400. The control unit 230 can also communicate with sensors (not shown), alarms (not shown), and security company servers (not shown) used in security settings via the network 400.

[0071] The card information storage unit 240 stores identification information for the card. The card information storage unit 240 also stores authorized area information, which indicates the area 100 that an authorized person corresponding to the card identification information is permitted to enter. In the authorized area information, for example, the first area 100a is indicated as the area 100 that the authorized person is permitted to enter. The information stored in the card information storage unit 240 may be set by an administrator via a user interface (not shown) such as a monitor, keyboard, and mouse provided by the card information storage unit 240, or it may be set remotely from an external device (not shown).

[0072] The ID authentication unit 250 receives card identification information from the card reader 110 via the communication unit 220. Based on the received card identification information, the ID authentication unit 250 performs ID authentication processing for the person located at the entrance. Specifically, the ID authentication unit 250 determines whether the received card identification information matches any of the multiple card identification information stored in the card information storage unit 240. This is equivalent to performing ID authentication processing for the IC card 120 (contactless ID device). The ID authentication unit 250 also receives area information from the card reader 110 via the communication unit 220 and may use the received area information in the ID authentication processing as well. If the ID authentication processing is successful, the ID authentication unit 250 outputs "authentication successful" to the control unit 230, and if the ID authentication processing fails, it outputs "authentication failed" to the control unit 230.

[0073] If the control unit 230 receives a successful authentication from the ID authentication unit 250, it transmits control information from the communication unit 220 to the monitor 140 and the door control device 150 instructing at least one of opening and unlocking the door 160. The control information may also instruct at least one of closing and locking the door 160. On the other hand, if the control unit 230 receives a failed authentication from the ID authentication unit 250, it transmits control information from the communication unit 220 to the monitor 140 and the door control device 150 instructing the door 160 to be closed for a certain period of time. In other words, the control unit 230 controls at least one of opening, unlocking, closing, and locking the door 160 provided at the entrance of a predetermined area 100.

[0074] Furthermore, if the ID authentication process from the ID authentication unit 250 is successful, the control unit 230 manages authorized persons inside the facility based on the card identification information received from the ID authentication unit 250. Information on authorized persons inside the facility is exchanged with the facial recognition management device 310 via the communication unit 220. In addition, the control unit 230 obtains and manages the status of the door 160 by communicating with the door control device 150 via the communication unit 220. The status of the door 160 indicates whether the door 160 is open, unlocked, closed, or locked. This managed information is stored in the storage unit 260.

[0075] The process for enabling the alert setting in this embodiment is performed using either (4) Pattern 4 or (5) Pattern 5. The process will be described below in the order of (4) Pattern 4 and (5) Pattern 5. (4) Fourth pattern Here, we also use Figures 6(a)-(f) to explain the fourth pattern. Figures 6(a)-(f) show the fourth pattern of operation by the management system 1000. Figures 6(a)-(c) show the screen displayed on the monitor 140. Figure 6(d) shows the operation of the facial recognition system 300, in particular the facial recognition management device 310, where high levels indicate the execution of facial recognition processing and low levels indicate the non-execution of facial recognition processing. Figure 6(e) shows the operation of the access control system 200, in particular the access control device 210. Figure 6(f) shows the operation of the door 160, where high levels indicate opening and low levels indicate closing. In these, the horizontal axis represents time.

[0076] At time T1, door 160 is closed, and when an authorized person who wants to activate the security setting passes in front of the imaging unit 130, the imaging unit 130 captures the authorized person's face. The facial recognition unit 360 of the facial recognition management device 310 performs facial recognition processing based on the image including the face captured by the imaging unit 130. During this time, the screen shown in Figure 6(a) is displayed on the monitor 140. If the facial recognition processing in the facial recognition unit 360 is successful, the control unit 330 performs control on door 160 located at the entrance to area 100. Here, door 160 is opened at time T2.

[0077] At time T3, when door 160 is open, the ID authentication unit 250 of the access control device 210 performs ID authentication processing on the IC card 120 when the IC card 120 is brought close to the card reader 110 shown in Figure 5(a). Subsequently, at time T4, when an authorized person operates the operation unit 180 shown in Figure 5(a), the operation unit 180 accepts an activation operation to activate the security setting for area 100. The operation unit 180 notifies the access control device 210 of the activation operation via the network 400.

[0078] The communication unit 220 of the access control device 210 receives an effective operation from the operation unit 180. The instruction unit 232 determines that the ID authentication process was completed at time T3 and that an effective operation was received at time T4, but the door 160 is open, so the alarm setting conditions are not met. Therefore, after time T5 when the door 160 is closed, the instruction unit 232 determines that the alarm setting conditions are met. If the alarm setting conditions are met, the instruction unit 232 decides to activate the alarm setting for area 100. The instruction unit 232 instructs the door control device 150 to execute the alarm setting for area 100. At that time, the screen shown in Figure 6(b) is displayed on the monitor 140.

[0079] Meanwhile, if the operation unit 180 receives a valid operation at time T4, the instruction unit 232 transmits information (hereinafter referred to as a "stop instruction") from the communication unit 220 to the face recognition management device 310 to stop at least one of the face recognition processing and image capture performed by the face recognition management device 310. The communication unit 320 of the face recognition management device 310 receives the stop instruction from the access control device 210 via the network 400 within a predetermined period after the face recognition unit 360 completes the face recognition processing. The control unit 330 has predetermined that the communication unit 320 receiving the stop instruction within a predetermined period after the face recognition unit 360 completes the face recognition processing is a condition for authentication to stop, and when it receives the stop instruction from the communication unit 320, it determines that the authentication to stop condition is met. If the authentication to stop condition is met, the control unit 330 stops at least one of the image capture unit 130 and the face recognition unit 360. As a result, face recognition processing is no longer performed from time T4 onwards.

[0080] At time T5, door 160 is closed. As described above, the instruction unit 232 of the access control device 210 instructs the door control device 150 to execute the alarm setting. If the door control device 150 is instructed by the access control device 210 to execute the alarm setting at time T5, it executes the alarm setting. While the alarm setting is being executed, if the door control device 150 detects that door 160 is about to be opened by a sensor (not shown), it transmits the detection result to the access control device 210 via the network 400. When the communication unit 220 of the access control device 210 receives the detection result from the sensor, the control unit 230 sounds an alarm (not shown) or contacts the security company with the detection result. If the alarm setting is active, the screen shown in Figure 6(c) is displayed on the monitor 140.

[0081] (5) Fifth pattern Here, we will also use Figures 7(a)-(d) to explain the fifth pattern. Figures 7(a)-(d) show the fifth pattern of operation by the management system 1000. Figure 7(a) shows the screen displayed on the monitor 140. Figure 7(b) shows the operation of the facial recognition system 300, in particular the facial recognition management device 310, where a high level indicates the execution of facial recognition processing and a low level indicates the non-execution of facial recognition processing. Figure 7(c) shows the operation of the access control system 200, in particular the access control device 210. Figure 7(d) shows the operation of the door 160, where a high level indicates opening and a low level indicates closing. In these, the horizontal axis represents time.

[0082] In the fifth pattern, unlike the fourth pattern, no facial recognition processing is performed by the facial recognition management device 310. At time T1, by bringing the IC card 120 close to the card reader 110 shown in Figure 5(a), the ID authentication unit 250 of the access control device 210 performs ID authentication processing on the IC card 120. Subsequently, at time T2, by having an authorized person operate the operation unit 180 shown in Figure 5(a), the operation unit 180 accepts an activation operation to activate the security setting for area 100. The operation unit 180 notifies the access control device 210 of the activation operation via the network 400.

[0083] The communication unit 220 of the access control device 210 receives an effective operation from the operation unit 180. The instruction unit 232 determines that the alarm setting conditions are met because, with the door 160 closed, the ID authentication process was completed at time T1 and an effective operation was received at time T2. If the alarm setting conditions are met, the instruction unit 232 decides to activate the alarm setting for area 100. The instruction unit 232 instructs the door control device 150 to execute the alarm setting for area 100.

[0084] If the door control device 150 is instructed to perform a security setting by the access control device 210 at time T3, it performs a security setting. While the security setting is being performed, if the door control device 150 detects that the door 160 is about to be opened by a sensor (not shown), it transmits the detection result to the access control device 210 via the network 400. When the communication unit 220 of the access control device 210 receives the detection result from the sensor, the control unit 230 sounds an alarm (not shown) or notifies the security company of the detection result. If the security setting is active, the screen shown in Figure 7(a) is displayed on the monitor 140.

[0085] Meanwhile, if the operation unit 180 receives a valid operation at time T2, the instruction unit 232 sends a stop instruction from the communication unit 220 to the facial recognition management device 310. The communication unit 320 of the facial recognition management device 310 receives the stop instruction from the access control device 210 via the network 400. The control unit 330 has predetermined that the communication unit 320 receiving the stop instruction is an authentication stop condition, and when it receives the stop instruction from the communication unit 320, it determines that the authentication stop condition has been met. If the authentication stop condition is met, the control unit 330 stops at least one of the imaging unit 130 and the facial recognition unit 360. As a result, facial recognition processing ceases from time T2 onwards.

[0086] In this embodiment, the authentication stop condition includes when the communication unit 320 receives a stop instruction, so that the face recognition process can be stopped appropriately. Furthermore, the authentication stop condition also includes when the communication unit 320 receives a predetermined signal within a predetermined period after the face recognition unit 360 has completed the face recognition process, so that the face recognition process can be stopped appropriately. In addition, when the operation unit 180 receives an operation to enable the alert setting, it transmits information to the face recognition management device 310 to stop at least one of the face recognition process and image capture performed by the face recognition management device 310, so that the face recognition process can be stopped appropriately.

[0087] An outline of one aspect of this disclosure is as follows: It may further include a communication unit (320) that communicates with the outside. The authentication suspension condition may include when the communication unit (320) receives a predetermined signal.

[0088] The authentication suspension conditions may also include the case where the communication unit (320) receives a predetermined signal within a predetermined period after the facial recognition unit (360) has completed the facial recognition process.

[0089] Another aspect of this disclosure is an access control system (200). This access control system (200) includes an ID authentication unit (250) that performs ID authentication processing for a contactless ID device, a control unit (230) that performs control for a door provided at the entrance of a predetermined area based on the result of the ID authentication processing in the ID authentication unit (250), an operation unit (180) that receives an operation to enable the security setting for the predetermined area, and a communication unit (220) that communicates with a facial recognition system (300) that performs facial recognition processing based on an image captured. When the operation unit (180) receives an operation to enable the security setting, the communication unit (220) transmits information to the facial recognition system (300) to stop at least one of the facial recognition processing and image capture performed by the facial recognition system (300).

[0090] (Example 3) Next, we will describe Example 3. Example 3 relates to a management system for managing the entry of people into or exit from a designated area within a facility, similar to the previous examples. In Example 3, as in Example 2, facial recognition and ID authentication processes are performed. In Example 3, the alarm setting is activated, for example, when the door is closed, after the action to activate the alarm setting and confirmation of the operation by an authorized person have been performed. However, as confirmation of the operation by an authorized person, the alarm setting is activated only after successful facial recognition of the authorized person. Here, we will focus on explaining the differences from the previous examples.

[0091] In the following section, we will describe (6) Pattern 6 as a process for enabling the alert settings according to this embodiment. (6) Sixth pattern Here, we will also use Figures 8(a)-(d) to explain the sixth pattern. Figures 8(a)-(d) show the sixth pattern of operation by the management system 1000. Figure 8(a) shows the screen displayed on the monitor 140. Figure 8(b) shows the operation of the facial recognition system 300, in particular the facial recognition management device 310, where a high level indicates the execution of facial recognition processing and a low level indicates the non-execution of facial recognition processing. Figure 8(c) shows the operation of the access control system 200, in particular the access control device 210. Figure 8(d) shows the operation of the door 160, where a high level indicates opening and a low level indicates closing. In these, the horizontal axis represents time.

[0092] At time T1, when an authorized person operates the operation unit 180 shown in Figure 5(a), the operation unit 180 receives an activation operation to activate the security setting for area 100. The operation unit 180 notifies the access control device 210 of the activation operation via the network 400. The communication unit 220 of the access control device 210 receives the activation operation from the operation unit 180. When the communication unit 220 receives the activation operation, the instruction unit 232 causes the communication unit 220 to send information (hereinafter referred to as the "request signal") to the facial recognition management device 310 to request the execution of facial recognition processing.

[0093] When the communication unit 320 of the facial recognition management device 310 receives a request signal from the access control device 210, the control unit 330 instructs the imaging unit 130 to capture the face of the authorized person. At time T2, the facial recognition unit 360 performs facial recognition processing based on the image including the face captured by the imaging unit 130. During this time, the screen shown in Figure 8(a) is displayed on the monitor 140. If the facial recognition processing in the facial recognition unit 360 is successful, the control unit 330 instructs the communication unit 320 to transmit information indicating the completion of the facial recognition processing (hereinafter referred to as the "completion signal") to the access control device 210.

[0094] At time T3, the communication unit 220 of the access control device 210 receives a completion signal from the facial recognition management device 310. The instruction unit 232 determines that the alarm setting conditions are met because, with the door 160 closed, it received an effective operation at time T1 and received information from the facial recognition management device 310 at time T3 indicating the completion of the facial recognition process. If the alarm setting conditions are met, the instruction unit 232 decides to activate the alarm setting for area 100. The instruction unit 232 instructs the door control device 150 to execute the alarm setting for area 100.

[0095] The door control device 150 executes the alarm setting when instructed to do so by the access control device 210. While the alarm setting is being executed, if a sensor (not shown) detects that the door 160 is about to be opened, the door control device 150 transmits the detection result to the access control device 210 via the network 400. When the communication unit 220 of the access control device 210 receives the detection result from the sensor, the control unit 230 sounds an alarm (not shown) or notifies the security company of the detection result.

[0096] In this embodiment, when the operation unit 180 receives an operation to enable the alarm setting, it sends a request signal to the facial recognition management device 310, so that the facial recognition process can be executed appropriately. Furthermore, when a completion signal is received, it instructs the system to set the alarm, so that the alarm setting can be executed appropriately.

[0097] An outline of one aspect of this disclosure is as follows. Yet another aspect of this disclosure is also an access control system (200). This access control system (200) includes an ID authentication unit (250) that performs ID authentication processing for a contactless ID device, a control unit (230) that performs control for a door provided at the entrance of a predetermined area based on the result of the ID authentication processing in the ID authentication unit (250), an operation unit (180) that receives an operation to enable the security setting for the predetermined area, a communication unit (220) that communicates with a facial recognition system (300) that performs facial recognition processing based on an image captured, and an instruction unit (232) that instructs the security setting for the predetermined area when the operation unit (180) receives an operation to enable the security setting and the communication unit (220) receives information from the facial recognition system (300) indicating the completion of the facial recognition processing.

[0098] (Example 4) Next, we will describe Example 4. Example 4 relates to a management system for managing the entry of people into or exit from a designated area within a facility, similar to the previous examples. In Example 4, as in Examples 2 and 3, facial recognition and ID authentication processes are performed. The alert setting in Example 4 is activated, for example, when the door is closed, there are no authorized persons inside the facility, and facial recognition of an authorized person is successful. Here, we will focus on explaining the differences from the previous examples.

[0099] The process for enabling the alert setting in this embodiment is performed using either (7) Pattern 7 or (8) Pattern 8. The process will be described below in the order of (7) Pattern 7 and (8) Pattern 8. (7) Pattern 7 Here, we will also use Figures 9(a)-(d) to explain the seventh pattern. Figures 9(a)-(d) show the seventh pattern of operation by the management system 1000. Figure 9(a) shows the settings for the alarm system, where high level indicates enabled and low level indicates disabled. Figure 9(b) shows the operation of the door 160, where high level indicates open and low level indicates closed. Figure 9(c) shows the operation of the facial recognition system 300, in particular the facial recognition management device 310, where high level indicates the execution of facial recognition processing and low level indicates the non-execution of facial recognition processing. Figure 9(d) shows the operation of the access control system 200, in particular the access control device 210. In these, the horizontal axis represents time.

[0100] At time T1, door 160 is closed, and when an authorized person who wants to activate the security setting passes in front of the imaging unit 130, the imaging unit 130 captures the authorized person's face. The facial recognition unit 360 of the facial recognition management device 310 performs facial recognition processing based on the image including the face captured by the imaging unit 130. If the facial recognition processing in the facial recognition unit 360 is successful, the control unit 330 performs control on door 160 located at the entrance to area 100. Here, door 160 is opened at time T2. When door 160 is opened due to successful facial recognition processing in the facial recognition unit 360, the control unit 330 causes the communication unit 320 to transmit information indicating the completion of the facial recognition process (hereinafter referred to as the "completion signal") to the access control device 210. The completion signal includes information about the authorized person whose facial recognition processing was successful, such as facial identification information.

[0101] The communication unit 220 of the access control device 210 receives a completion signal from the facial recognition management device 310. The control unit 230 updates the information of authorized persons inside the facility based on the information of authorized persons included in the completion signal. If the information of authorized persons inside the facility is no longer available after the update, the control unit 230 determines that the last person to exit has left. The instruction unit 232 pre-defines the condition for setting an alert as the case when the last person to exit leaves area 100 and the communication unit 220 receives information from the facial recognition management device 310 indicating the completion of the facial recognition process. If the condition for setting an alert is met at time T3, the instruction unit 232 decides to activate the alert setting for area 100.

[0102] Meanwhile, when the last person to exit area 100 leaves, the instruction unit 232 sends a stop instruction from the communication unit 220 to the facial recognition management device 310. The communication unit 320 of the facial recognition management device 310 receives the stop instruction from the access control device 210 via the network 400 within a predetermined period after the facial recognition unit 360 has completed the facial recognition process. The control unit 330 has predefined that the communication unit 320 receiving the stop instruction within a predetermined period after the facial recognition unit 360 has completed the facial recognition process as an authentication stop condition, and when it receives the stop instruction from the communication unit 320, it determines that the authentication stop condition has been met. If the authentication stop condition is met, the control unit 330 stops at least one of the imaging unit 130 and the facial recognition unit 360. As a result, facial recognition processing ceases from time T3 onwards.

[0103] At time T4, the instruction unit 232 of the access control device 210 instructs the door control device 150 to execute the alarm setting. If the door control device 150 is instructed by the access control device 210 to execute the alarm setting at time T4, it executes the alarm setting. While the alarm setting is being executed, if the door control device 150 detects that the door 160 is about to be opened by a sensor (not shown), it transmits the detection result to the access control device 210 via the network 400. When the communication unit 220 of the access control device 210 receives the detection result from the sensor, the control unit 230 sounds an alarm (not shown) or notifies the security company of the detection result.

[0104] (8) Pattern 8 Here, we will also use Figures 10(a)-(d) to explain the eighth pattern. Figures 10(a)-(d) show the eighth pattern of operation by the management system 1000. Figure 10(a) shows the settings for the alarm system, where high level indicates enabled and low level indicates disabled. Figure 10(b) shows the operation of the door 160, where high level indicates open and low level indicates closed. Figure 10(c) shows the operation of the facial recognition system 300, in particular the facial recognition management device 310, where high level indicates the execution of facial recognition processing and low level indicates the non-execution of facial recognition processing. Figure 10(d) shows the operation of the access control system 200, in particular the access control device 210. In these, the horizontal axis represents time.

[0105] At time T1, door 160 is closed, and when an authorized person who wants to activate the security setting passes in front of the imaging unit 130, the imaging unit 130 captures the authorized person's face. The facial recognition unit 360 of the facial recognition management device 310 performs facial recognition processing based on the image including the face captured by the imaging unit 130. If the facial recognition processing in the facial recognition unit 360 is successful, the control unit 330 performs control on door 160 located at the entrance to area 100. Here, door 160 is opened at time T2. When door 160 is opened due to successful facial recognition processing in the facial recognition unit 360, the control unit 330 causes the communication unit 320 to send a completion signal to the access control device 210.

[0106] The communication unit 220 of the access control device 210 receives a completion signal from the facial recognition management device 310. The control unit 230 updates the information of authorized persons inside the facility based on the information of authorized persons included in the completion signal. If the information of authorized persons inside the facility is no longer available after the update, the control unit 230 determines that the last person to exit has left. The instruction unit 232 pre-defines the condition for setting an alert as when the last person to exit has left area 100 and the communication unit 220 has received information from the facial recognition management device 310 indicating the completion of the facial recognition process. If the alert setting condition is met at time T3, the instruction unit 232 decides to activate the alert setting for area 100. The instruction unit 232 sends a notification indicating that the alert setting condition is met and a stop instruction from the communication unit 220 to the facial recognition management device 310.

[0107] The communication unit 320 of the facial recognition management device 310 receives a stop instruction from the access control device 210 via the network 400 within a predetermined period after the facial recognition unit 360 has completed the facial recognition process. The control unit 330 has predefined that the communication unit 320 receiving a stop instruction within a predetermined period after the facial recognition unit 360 has completed the facial recognition process as a condition for stopping authentication. When the control unit 330 receives a stop instruction from the communication unit 320, it determines that the authentication stop condition has been met. If the authentication stop condition is met, the control unit 330 stops at least one of the imaging unit 130 and the facial recognition unit 360. As a result, facial recognition processing ceases from time T4 onwards.

[0108] At time T4, the instruction unit 332 instructs the door control device 150 to execute the alarm setting. If the door control device 150 is instructed to execute the alarm setting by the access control device 210 at time T4, it executes the alarm setting. While the alarm setting is being executed, if the door control device 150 detects that the door 160 is about to be opened by a sensor (not shown), it transmits the detection result to the facial recognition management device 310 via the network 400. When the communication unit 320 of the facial recognition management device 310 receives the detection result from the sensor, the control unit 330 sounds an alarm (not shown) or notifies the security company of the detection result.

[0109] According to this embodiment, when the last person to leave the designated area has left and the communication unit 220 has received a completion signal from the facial recognition management device 310, it instructs the system to set an alert, so that the alert can be set appropriately.

[0110] An outline of one aspect of this disclosure is as follows. Yet another aspect of this disclosure is also an access control system (200). This access control system (200) includes an ID authentication unit (250) that performs ID authentication processing for a contactless ID device, a control unit (230) that performs control for a door provided at the entrance of a predetermined area based on the result of the ID authentication processing in the ID authentication unit (250), a communication unit (220) that communicates with a facial recognition system (300) that performs facial recognition processing based on captured images, and an instruction unit (232) that instructs the setting of security for a predetermined area when the last person to leave the predetermined area has left and the communication unit (220) has received information from the facial recognition system (300) indicating the completion of the facial recognition processing.

[0111] The present disclosure has been described above based on examples. These examples are illustrative, and it will be understood by those skilled in the art that various modifications are possible for each component or combination of processing steps, and that such modifications are also within the scope of the present disclosure.

[0112] In Example 1, the approval suspension condition includes the case when the operation unit 180 receives a valid operation. However, it is not limited to this, for example, the authentication suspension condition may also include the case when the image from the imaging unit 130 contains a face with a predetermined expression. According to this modification, a valid operation to the operation unit 180 can be made unnecessary. [Explanation of Symbols]

[0113] 100 Area, 110 Card reader, 120 IC card, 130 Imaging unit, 140 Monitor, 150 Door control unit, 160 Door, 180 Operation unit, 200 Access control system, 210 Access control device, 220 Communication unit, 230 Control unit, 232 Instruction unit, 240 Card information storage unit, 250 ID authentication unit, 260 Storage unit, 300 Face recognition system, 310 Face recognition management device, 320 Communication unit, 330 Control unit, 332 Instruction unit, 340 Face detection unit, 350 Face information storage unit, 360 Face recognition unit, 370 Notification unit, 400 Network, 1000 Management system.

Claims

1. A facial recognition unit performs facial recognition processing based on an image containing a face captured by the imaging unit, A control unit that performs control on a door installed at the entrance of a predetermined area based on the results of the facial recognition processing in the facial recognition unit, If the alarm setting conditions are met, an instruction unit instructs the setting of the alarm for the predetermined area, An operating unit that receives an operation to enable the aforementioned security setting for the predetermined area, Equipped with, The aforementioned alarm setting conditions include the case where, after the operation unit receives an operation to activate the alarm setting, the facial recognition unit succeeds in the facial recognition process and the door is closed, The control unit, Before the operation unit receives an operation to enable the alarm setting, the facial recognition unit executes control over the door if it succeeds in the facial recognition process. A facial recognition system in which, after the operation unit receives an operation to enable the alarm setting, the facial recognition unit does not execute control on the door even if it succeeds in the facial recognition process before the alarm setting conditions are met.

2. An ID authentication unit that performs ID authentication processing for a contactless ID device, Based on the results of the ID authentication process in the ID authentication unit, a control unit executes control over a door provided at the entrance to a predetermined area, and if the ID authentication process is successful, executes control over at least one of opening and unlocking the door. An operating unit that receives an operation to enable the security setting for the predetermined area, A communication unit that communicates with a facial recognition system that performs facial recognition processing based on captured images, When the operation unit receives an operation to activate the alarm setting, and the communication unit receives information from the facial recognition system indicating the completion of the facial recognition process, and the door is closed, an instruction unit instructs the alarm setting for the predetermined area, An access control system equipped with the following features.

3. An ID authentication unit that performs ID authentication processing for a contactless ID device, Based on the results of the ID authentication process in the ID authentication unit, a control unit executes control over a door provided at the entrance to a predetermined area, and if the ID authentication process is successful, executes control over at least one of opening and unlocking the door. An operating unit that receives an operation to enable the security setting for the predetermined area, A communication unit that communicates with a facial recognition system that performs facial recognition processing based on captured images, When the operation unit receives an operation to enable the alarm setting, and the ID authentication process in the ID authentication unit is completed and the door is closed, the instruction unit instructs the alarm setting for the predetermined area, An access control system equipped with the following features.

4. The access control system according to claim 3, wherein the instruction unit instructs the use of the security setting for a predetermined area when the operation unit receives an operation to enable the security setting and the ID authentication process in the ID authentication unit is completed, and the door is open when the door is closed.

5. A communication unit that communicates with the access control system described in any one of claims 2 to 4, A facial recognition system comprising an imaging unit and a facial recognition unit that performs facial recognition processing based on an image including a face captured by the imaging unit.

6. A management system comprising an access control system according to any one of claims 2 to 4 and a facial recognition system according to claim 5.

7. A program to be executed by the facial recognition system according to claim 1 or 5.

8. A program to be executed by the access control system according to any one of claims 2 to 4.

Images