Facial recognition system, entrance / exit control system, management system, program

The face authentication system addresses the challenge of managing vigilance settings by controlling imaging and authentication units based on specific conditions, enabling secure and efficient face recognition processing.

JP7584078B2Active Publication Date: 2024-11-15PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2020099279
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-06-08
Publication Date
2024-11-15
Estimated Expiration
2040-06-08

AI Technical Summary

Technical Problem

Existing face recognition systems struggle to appropriately execute face authentication processing, particularly in scenarios where vigilance settings need to be managed effectively, such as when authorized individuals attempt to enable alert settings while the door is closed.

Method used

A face authentication system that includes a control unit to stop imaging and authentication units when specific conditions are met, such as receiving an operation to enable vigilance settings, ensuring that face authentication processing is appropriately executed by managing alert settings through a combination of imaging, authentication, and communication units.

Benefits of technology

Facial recognition processing can be appropriately executed by stopping unnecessary operations, allowing for effective management of vigilance settings and ensuring secure access control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007584078000001
    Figure 0007584078000001
  • Figure 0007584078000002
    Figure 0007584078000002
  • Figure 0007584078000003
    Figure 0007584078000003
Patent Text Reader

Abstract

To provide a technique that appropriately performs face authentication processing.SOLUTION: A face authentication management apparatus 310 in a face authentication system 300 includes a control unit 330 and a face authentication unit 360. The face authentication unit 360 performs face authentication processing based on an image including a face picked up by an imaging unit 130. The control unit 330 controls at least one of the imaging unit 130 and the face authentication unit 360. The control unit 330 causes at least one of the imaging unit 130 and the face authentication unit 360 to be stopped when an authentication stop condition is met.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to authentication technology, in particular to a face authentication system for authenticating a person, an entrance / exit management system, Management systems, Regarding the program. [Background technology]

[0002] An entrance / exit management system manages the entry and exit of people to a specific management section in a facility. This entrance / exit management system compares identification information for verification recorded on a recording medium such as an IC (Integrated Circuit) card with pre-registered identification information, and determines whether or not to permit entry and exit based on the comparison result (for example, see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-36469 A Summary of the Invention [Problem to be solved by the invention]

[0004] A face recognition system that performs face recognition processing based on an image of a person's face is used for entrance / exit management. In such a case, it is desirable that the face recognition processing be performed appropriately.

[0005] The present disclosure has been made in consideration of these circumstances, and has a purpose to provide a technique for appropriately executing face recognition processing. [Means for solving the problem]

[0006] In order to solve the above problems, a face authentication system according to an embodiment of the present disclosure includes a face authentication unit that executes face authentication processing based on an image including a face captured by an imaging unit, and a control unit that controls at least one of the imaging unit and the face authentication unit. The control unit stops at least one of the imaging unit and the face authentication unit when an authentication stop condition is satisfied. The authentication stop condition includes a case where the operation unit receives an operation for enabling the alert setting for the predetermined area. .

[0007] Another aspect of the present disclosure The embodiment is also a face authentication system. This face authentication system includes a face authentication unit that executes face authentication processing based on an image including a face captured by an imaging unit, a control unit that controls at least one of the imaging unit and the face authentication unit, and a communication unit that communicates with the outside. The control unit stops at least one of the imaging unit and the face authentication unit when an authentication stop condition is satisfied, and the authentication stop condition includes a case where the communication unit receives a predetermined signal within a predetermined period after the face authentication unit completes the face authentication processing.

[0008] Yet another aspect of the present disclosure is an entrance / exit management system. This entrance / exit management system includes an ID authentication unit that executes ID authentication processing for a non-contact ID device, a control unit that executes control of a door provided at an entrance to a predetermined area based on the result of the ID authentication processing in the ID authentication unit, an operation unit that accepts an operation to enable an alert setting for the predetermined area, and a communication unit that communicates with a face authentication system that executes face authentication processing based on a captured image. When the operation unit accepts the operation to enable the alert setting, the communication unit transmits information to the face authentication system for stopping at least one of the face authentication processing and image capture performed in the face authentication system.

[0011] Any combination of the above components, and conversion of the present disclosure into a method, device, system, recording medium, computer program, etc. are also valid aspects of the present disclosure. Effect of the Invention

[0012] According to the present disclosure, face authentication processing can be appropriately performed. [Brief description of the drawings]

[0013] [Figure 1] 1A and 1B are diagrams illustrating a configuration of a management system according to a first embodiment. [Diagram 2] 2(a)-(g) are diagrams showing a first pattern of operations performed by the management system of FIG. 1(a). [Diagram 3] 3(a)-(f) are diagrams showing a second pattern of operation by the management system of FIG. 1(a). [Figure 4] 4(a)-(d) are diagrams showing a third pattern of operation of the management system of FIG. 1(a). [Diagram 5] 5(a) and 5(b) are diagrams illustrating a configuration of a management system according to a second embodiment. [Figure 6] 6(a)-(f) are diagrams showing a fourth pattern of operation by the management system of FIG. 5(a). [Figure 7] 7(a)-(d) are diagrams showing a fifth pattern of operation of the management system of FIG. 5(a). [Figure 8] 8(a)-(d) are diagrams illustrating a sixth pattern of the operation of the management system according to the third embodiment. [Figure 9] 9(a)-(d) are diagrams illustrating a seventh pattern of the operation of the management system according to the fourth embodiment. [Figure 10] 10A to 10D are diagrams illustrating an eighth pattern of the operation of the management system according to the fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Example 1 Before describing the present disclosure in detail, an overview will be provided. Example 1 relates to a management system that manages people's entry into a predetermined area in a facility or their exit from the area. In order to manage people's entry or exit, the management system authenticates people who have the authority to enter and exit the area (hereinafter referred to as "authorized persons"). One example of this authentication is authentication processing using a face image (hereinafter referred to as "face authentication processing").

[0015] In the face recognition process, for each identification information assigned to an authorized person (hereinafter referred to as "face identification information"), a facial image of the authorized person is prepared in advance as a reference image. When the authorized person arrives at the entrance of the area, the face is captured by an imaging device installed at the entrance of the area. The management system compares the facial image captured by the imaging device with the reference image to determine whether the person is an authorized person. The management system controls the open / closed state or the locked / unlocked state of the door installed at the entrance according to the result of the face recognition process.

[0016] In such a management system, a mode called an alert setting (alert set) is prepared in advance. In the alert setting, if an attempt is made to open the door when the door is closed and locked, a sensor detects this, an alarm sounds, and a security company is contacted. The alert setting is enabled, for example, when the door is closed and an operation for enabling the alert setting is performed and an authorized person confirms the operation. To be more specific, when the door is closed and an authorized person presses a button for enabling the alert setting and face authentication processing for the authorized person is successful, the alert setting is enabled. On the other hand, in order to disable (cancel) the alert setting, an operation for disabling the alert setting and confirmation of the operation by the authorized person are required.

[0017] If the door is an automatic door, when an authorized person passes near the entrance, the face recognition process will be successful and the door will be opened. This will prevent the authorized person from activating the security setting. To address this, in this embodiment, when an action to activate the security setting is accepted, the face recognition process to open the door is stopped, so that the action to activate the security setting and the operation by the authorized person are confirmed while the door is closed.

[0018] 1(a)-(b), particularly FIG. 1(a), shows the configuration of a management system 1000. The management system 1000 manages people's entry and exit from a first area 100a to an Nth area 100n provided in a facility. The first area 100a to the Nth area 100n are collectively referred to as areas 100, and each area 100 is provided with an imaging unit 130, a monitor 140, an operation unit 180, a door control device 150, and a door 160. The management system 1000 may manage only one area 100.

[0019] The management system 1000 includes a face authentication system 300. The face authentication system 300 also includes an imaging unit 130, a monitor 140, an operation unit 180, and a face authentication management device 310. The face authentication management device 310, the imaging unit 130, the monitor 140, the door control device 150, and the operation unit 180 of each area 100 are communicatively connected to each other via a network 400 such as a LAN (Local Area Network).

[0020] The management system 1000 executes an authentication process for a person positioned at the entrance of the area 100, and controls at least one of opening, unlocking, closing, and locking the entrance door 160 only if the authentication is successful. For example, the management system 1000 opens the entrance door 160, which is normally closed. An example of the authentication process is a face recognition process, and based on the result of the face recognition process, it is determined whether or not the person is an authorized person who has the right to enter the area 100.

[0021] In order to execute the face recognition process, the imaging unit 130 is installed near the door 160. The imaging unit 130 captures the face of a person who wishes to enter or exit the area 100 at the entrance of the area 100. Since a plurality of images are arranged in time series in the captured video, the video and the image are collectively referred to as images below. Since the face of a person extracted from the captured image is used for face recognition process, the imaging unit 130 is required to capture an image that can execute face recognition process for a person located at the entrance with high accuracy. For this reason, the imaging unit 130 is installed, for example, at a position at the average height of a person's face near the door 160, and captures the video of the entrance. This is because a person who wishes to enter or exit the area 100 usually faces the door 160 at the entrance. The imaging unit 130 transmits the captured image to the face recognition management device 310 via the network 400. At that time, the imaging unit 130 may also transmit information for identifying the area 100 in which the imaging unit 130 is installed (hereinafter, referred to as “area information”) to the face authentication management device 310 via the network 400.

[0022] The face authentication management device 310 executes face authentication processing on the face of a person included in an image received from the imaging unit 130. The face authentication processing is processing to determine whether or not a person included in an image is an authorized person who has the right to enter the area 100 based on the face of the person. The face authentication management device 310 determines the control content for the door 160 based on the result of the face authentication processing. The control content may be, for example, opening the door 160 or closing the door 160. The control content may also be unlocking or locking an electronic lock provided on the door 160. The face authentication management device 310 transmits the control content as control information to the monitor 140 and the door control device 150 via the network 400.

[0023] Near the door 160, a monitor 140 is also installed together with the imaging unit 130 described above. The monitor 140 receives control information from the face authentication management device 310. The monitor 140 displays the control content in the control information as a message. The message may be, for example, that the door 160 is to be opened or that the door 160 is to be closed. The message may also be that the electronic lock provided on the door 160 is to be unlocked or locked. At the entrance of the area 100, a person who wishes to enter or exit the area 100 can recognize, for example, whether the door 160 is to be opened or not opened by checking the message displayed on the monitor 140.

[0024] The door control device 150 receives control information from the face authentication management device 310, and controls the opening and closing of the door 160, i.e., opening or closing, according to the received control information. Opening the door 160 may include unlocking the electronic lock of the door 160 and opening the door 160 as an automatic door. Closing the door 160 may include locking the electronic lock of the door 160 and closing the door 160 as an automatic door. The door control device 150 closes the door 160 in a normal state. The door 160 is provided at the entrance of the area 100, and is a part through which people entering the area 100 pass. The door 160 is, for example, a door with an electronic lock or an automatic door.

[0025] The management system 1000 is provided with a mode called an alert setting in advance. The alert setting is sometimes called an alert set. In the alert setting, when the door 160 is closed and locked and an attempt is made to open the door 160, a sensor (not shown) connected to the door 160 or a sensor (not shown) installed near the door 160 detects this. The sensor notifies the face authentication management device 310 of the detection result via the network 400. When the face authentication management device 310 receives the detection result from the sensor, it sounds an alarm (not shown) or notifies a security company of the detection result.

[0026] The security setting is enabled, for example, when the door 160 is closed, an operation for enabling the security setting is performed, and the operation is confirmed by an authorized person. The operation for enabling the security setting is performed by operating an operation unit 180 installed near the door 160. The operation unit 180 is, for example, a button, and pressing the button corresponds to the operation for enabling the security setting. Furthermore, confirmation of the operation by the authorized person corresponds to the face authentication process for the authorized person being successful in the face authentication management device 310.

[0027] To disable (cancel) the security setting, for example, an operation for disabling the security setting and confirmation of the operation by an authorized person are required. The operation for disabling (cancel) the security setting is performed by operating a button on the operation unit 180 installed near the door 160. A button for enabling the security setting and a button for disabling (cancel) the security setting may be provided separately. Here, too, confirmation of the operation by the authorized person corresponds to the face authentication process for the authorized person being successful in the face authentication management device 310.

[0028] As described above, if the door 160 is an automatic door, when an authority passes near the area 100, the imaging unit 130 captures an image of the authority's face, and the face authentication process is successful in the face authentication management device 310, allowing the door 160 to be opened. Even if the authority operates the operation unit 180 in this state, the security setting will not be enabled. It is desirable to execute the security setting even in this situation.

[0029] FIG. 1(b) shows the configuration of the face authentication management device 310. The face authentication management device 310 includes a communication unit 320, a control unit 330, a face detection unit 340, a face information storage unit 350, a face authentication unit 360, and a notification unit 370. The control unit 330 includes an instruction unit 332. The communication unit 320 is a communication interface for connecting to a network 400, and can communicate with the imaging unit 130, the monitor 140, the door control device 150, and the operation unit 180 in FIG. 1 via the network 400. The communication unit 320 can also communicate with a sensor (not shown), an alarm device (not shown), and a security company server (not shown) used in the alert setting via the network 400. The face detection unit 340 receives an image from the imaging unit 130 via the communication unit 320 and the control unit 330. The face detection unit 340 also detects a face from the received image using the face detection information stored in the face information storage unit 350. The face detection section 340 outputs information indicating the area of ​​the detected face or information indicating the features of the detected face to the face authentication section 360. Face detection in the face detection section 340 is performed periodically.

[0030] The face information storage unit 350 stores face detection information for detecting a face from an image including the face. The face detection information indicates features of a face image, such as Gabor features of a face obtained from a large number of face image samples, and image patterns of each face part, such as eyes and a mouth. The face information storage unit 350 also stores face reference information to be referenced for determining whether a detected face is the face of an authorized person, in association with the face identification information of the authorized person for each face of the authorized person. The face reference information indicates features of a face, such as the ratio of the width of the face to the distance between the corners of the left and right eyes and the distance between the corners of the left and right mouth. Furthermore, the face information storage unit 350 also stores permitted area information indicating the area 100 to which the authorized person corresponding to the face identification information is permitted to enter. In the permitted area information, for example, the first area 100a is indicated as the area 100 to which the authorized person is permitted to enter. The information stored in the face information storage unit 350 may be set by an administrator via a user interface (not shown) such as a monitor, keyboard, and mouse provided in the face authentication management device 310, or may be set remotely from an external device (not shown).

[0031] The face authentication unit 360 uses the face reference information in the face information storage unit 350 to perform face authentication processing on the face detected by the face detection unit 340. Here, in a case where a person stands at the entrance for a long time, the face authentication processing may be performed multiple times. If the face authentication processing is successful, the face authentication unit 360 specifies the face identification information of the authorized person corresponding to the face reference information at that time. The face authentication unit 360 outputs the result of the face authentication processing to the control unit 330. If the result of the face authentication processing is successful, the face authentication unit 360 also outputs the specified face identification information to the control unit 330.

[0032] When the result of the face authentication process from the face authentication unit 360 indicates success, the control unit 330 transmits control information instructing at least one of opening and unlocking the door 160 from the communication unit 220 to the monitor 140 and the door control device 150. The control information may instruct at least one of closing and locking the door 160. On the other hand, when the result of the face authentication process from the face authentication unit 360 indicates failure, the control unit 330 transmits control information instructing to close the door 160 for a certain period of time from the communication unit 220 to the monitor 140 and the door control device 150. In other words, the control unit 330 controls at least one of opening, unlocking, closing, and locking the door 160 provided at the entrance to the specified area 100.

[0033] Furthermore, when the result of the face authentication process from the face authentication unit 360 indicates success, the control unit 330 may manage the authorized persons present inside the facility based on the face identification information received from the face authentication unit 360. Furthermore, the control unit 330 may acquire the status of the door 160 by communicating with the door control device 150 via the communication unit 320, and manage the status of the door 160. The status of the door 160 indicates whether the door 160 is open, unlocked, closed, or locked.

[0034] The notification unit 370 acquires the control content determined by the control unit 330, and generates a screen showing the control content as a message. The notification unit 370 notifies the user of the control content by displaying the generated screen on the monitor 140 in FIG. 1 via the communication unit 320 and the network 400.

[0035] The process for enabling the alert setting according to this embodiment is performed in any one of the following patterns: (1) Pattern 1, (2) Pattern 2, and (3) Pattern 3. In the following, the process will be described in the order of (1) Pattern 1, (2) Pattern 2, and (3) Pattern 3. (1) First pattern Here, Fig. 2(a)-(g) are also used to explain the first pattern. Fig. 2(a)-(g) shows the first pattern of operation by the management system 1000. Fig. 2(a)-(e) shows the screen displayed on the monitor 140. Fig. 2(f) shows the operation of the face recognition system 300, particularly the face recognition management device 310, where a high level indicates execution of face recognition processing and a low level indicates non-execution of face recognition processing. Fig. 2(g) shows the operation of the door 160, where a high level indicates opening and a low level indicates closing. In these, the horizontal axis indicates time.

[0036] At time T1, the door 160 is closed, and when an authorized person who wants to activate the security setting passes in front of the imaging unit 130, the imaging unit 130 captures an image of the authorized person's face. The face authentication unit 360 of the face authentication management device 310 executes face authentication processing based on an image including the face captured by the imaging unit 130. If the face authentication processing in the face authentication unit 360 is successful, the control unit 330 executes control over the door 160 provided at the entrance to the area 100. Here, the door 160 is opened at time T2.

[0037] At time T3 when the door 160 is open, an authorized person operates the operation unit 180 shown in FIG. 2(a), and the operation unit 180 accepts an operation for validating the alert setting of the area 100 (hereinafter, referred to as a "valid operation"). The operation unit 180 notifies the face authentication management device 310 of the valid operation via the network 400. The communication unit 320 of the face authentication management device 310 receives the valid operation from the operation unit 180. The control unit 330 predefines the case where the operation unit 180 accepts a valid operation as an authentication stop condition, and when the control unit 330 accepts a valid operation from the communication unit 320, it determines that the authentication stop condition is satisfied. When the authentication stop condition is satisfied, the control unit 330 stops at least one of the imaging unit 130 and the face authentication unit 360. As a result, face authentication processing is not performed from time T3. The stop of face authentication processing continues until time T4 when the open door 160 closes. During that time, the screen shown in FIG. 2(b) is displayed on the monitor 140.

[0038] At time T4, the door 160 is closed. When the control unit 330 receives a notification from the door control device 150, it resumes the face authentication process. As a result, the imaging unit 130 captures the face of the authorized person, and the face authentication unit 360 executes the face authentication process based on the image including the face captured by the imaging unit 130. Even if the face authentication process in the face authentication unit 360 is successful, the control unit 330 does not execute the above-mentioned control over the door 160 if a valid operation is received from the communication unit 320. On the other hand, the instruction unit 332 predefines the case where the face authentication unit 360 completes the face authentication process and the operation unit 180 receives an operation to enable the alert setting as an alert setting condition. The instruction unit 332 determines that the alert setting condition is met because the valid operation was received at time T3 and the face authentication process was completed at time T4. At time T5, the instruction unit 332 determines that the alert setting of the area 100 is enabled if the alert setting condition is met. Following this, the instruction unit 332 instructs the door control device 150 to execute the alert setting for the area 100. At this time, the screen shown in FIG.

[0039] When the door control device 150 is instructed to execute the alert setting by the face authentication management device 310 at time T5, the door control device 150 executes the alert setting. While executing the alert setting, if a sensor (not shown) detects that the door 160 is about to be opened, the door control device 150 transmits the detection result to the face authentication management device 310 via the network 400. When the communication unit 320 of the face authentication management device 310 receives the detection result from the sensor, the control unit 330 sounds an alarm (not shown) or notifies the security company of the detection result. In addition, when the alert setting of the area 100 is enabled, the control unit 330 stops at least one of the imaging unit 130 and the face authentication unit 360. When the alert setting is enabled, the screen shown in FIG. 2(e) is displayed on the monitor 140.

[0040] (2) Second pattern Here, to explain the second pattern, Fig. 3(a)-(f) will also be used. Fig. 3(a)-(f) shows the second pattern of operation by the management system 1000. Fig. 3(a)-(d) shows screens displayed on the monitor 140. Fig. 3(e) shows the operation of the face recognition system 300, particularly the face recognition management device 310, where a high level indicates execution of face recognition processing and a low level indicates non-execution of face recognition processing. Fig. 3(f) shows the operation of the door 160, where a high level indicates opening and a low level indicates closing. In these figures, the horizontal axis indicates time.

[0041] The process from time T1 to time T4 is the same as the first pattern. Therefore, FIG. 3(a)-(b) is the same as FIG. 2(a)-(b). At time T4, the door 160 is closed. The control unit 330 receives a notification from the door control device 150. The instruction unit 332 predefines, as an alert setting condition, a case in which the operation unit 180 receives an operation for enabling the alert setting within a predetermined period after the face authentication unit 360 completes the face authentication process. The instruction unit 332 determines that the alert setting condition is satisfied if the face authentication process is completed at time T1, a valid operation is received at time T3, and the time difference between time T1 and time T3 is within a predetermined period. This corresponds to using the face authentication process performed before the valid operation is received, rather than executing the face authentication process again after the valid operation is received as in the first pattern, if the time difference between time T1 and time T3 is within the predetermined period. At time T4, if the alert setting conditions are met, the instruction unit 332 determines to enable the alert setting for the area 100. Following this, the instruction unit 332 instructs the door control device 150 to execute the alert setting for the area 100. At that time, the screen shown in FIG. 3(c) is displayed on the monitor 140.

[0042] When the door control device 150 is instructed to execute the security setting from the face authentication management device 310 at time T4, the door control device 150 executes the security setting. The execution of the security setting is the same as the first pattern, so a description is omitted here. When the security setting is enabled, the screen shown in FIG. 3(d) is displayed on the monitor 140.

[0043] (3) Third pattern Here, to explain the third pattern, Fig. 4(a)-(d) will also be used. Fig. 4(a)-(d) shows the third pattern of the operation by the management system 1000. Fig. 4(a)-(b) shows the screen displayed on the monitor 140. Fig. 4(c) shows the operation of the face authentication system 300, particularly the face authentication management device 310, where a high level indicates execution of face authentication processing and a low level indicates non-execution of face authentication processing. Fig. 4(d) shows the operation of the door 160, where a high level indicates opening and a low level indicates closing. In these figures, the horizontal axis indicates time. The alert setting condition in the third pattern is defined as a case where the operation unit 180 accepts an operation to enable the alert setting, unlike the previous cases.

[0044] At time T1, an authorized person operates the operation unit 180 shown in FIG. 4(a), and the operation unit 180 accepts a valid operation. The operation unit 180 notifies the face authentication management device 310 of the valid operation via the network 400. The communication unit 320 of the face authentication management device 310 receives the valid operation from the operation unit 180. When the instruction unit 332 accepts the valid operation from the communication unit 320, it determines that the alert setting condition is satisfied. At time T2, if the alert setting condition is satisfied, the instruction unit 332 decides to enable the alert setting of the area 100. Following this, the instruction unit 332 instructs the door control device 150 to execute the alert setting of the area 100.

[0045] When the door control device 150 is instructed to execute the alert setting by the face authentication management device 310 at time T2, the door control device 150 executes the alert setting. Furthermore, when the alert setting of the area 100 is enabled, the control unit 330 stops at least one of the imaging unit 130 and the face authentication unit 360. When the alert setting is enabled, the screen shown in FIG. 4(b) is displayed on the monitor 140.

[0046] The subject of the device, system, or method in the present disclosure includes a computer. The computer executes a program to realize the function of the subject of the device, system, or method in the present disclosure. The computer includes a processor that operates according to a program as a main hardware configuration. The type of the processor does not matter as long as it can realize the function by executing the program. The processor is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or an LSI (Large Scale Integration). The multiple electronic circuits may be integrated into one chip or may be provided on multiple chips. The multiple chips may be integrated into one device or may be provided on multiple devices. The program is recorded on a non-transitory recording medium such as a computer-readable ROM, an optical disk, or a hard disk drive. The program may be stored in the recording medium in advance, or may be supplied to the recording medium via a wide area communication network including the Internet.

[0047] According to this embodiment, when the authentication stop condition is satisfied, at least one of the imaging unit 130 and the face authentication unit 360 is stopped, so that the face authentication process can be stopped. Furthermore, when the authentication stop condition is satisfied, the face authentication process is stopped, so that the face authentication process can be executed appropriately. Furthermore, the authentication stop condition includes a case where the operation unit 180 receives an operation for enabling the alert setting, so that the face authentication process can be stopped appropriately. Furthermore, the authentication stop condition includes a case where the operation unit 180 receives an operation for enabling the alert setting within a predetermined period after the face authentication unit 360 completes the face authentication process, so that the face authentication process can be stopped appropriately.

[0048] Furthermore, when the alert setting condition is satisfied, an alert setting for a predetermined area is instructed, so that the alert setting can be appropriately executed. Furthermore, the alert setting condition includes a case where the operation unit 180 has accepted an operation for enabling the alert setting, so that the alert setting can be appropriately executed. Furthermore, the alert setting condition includes a case where the face authentication unit 360 has completed face authentication processing and the operation unit 180 has accepted an operation for enabling the alert setting, so that the alert setting can be appropriately executed. Furthermore, the alert setting condition includes a case where the operation unit 180 has accepted an operation for enabling the alert setting within a predetermined period after the face authentication unit 360 has completed face authentication processing, so that the alert setting can be appropriately executed.

[0049] An overview of one aspect of the present disclosure is as follows. An overview of one aspect of the present disclosure is as follows. A face authentication system (300) according to one aspect of the present disclosure includes a face authentication unit (360) that executes face authentication processing based on an image including a face captured by an imaging unit (130), and a control unit (330) that controls at least one of the imaging unit (130) and the face authentication unit (360). When an authentication stop condition is satisfied, the control unit (330) stops at least one of the imaging unit (130) and the face authentication unit (360).

[0050] The authentication suspension condition may include a case where an image from the imaging unit (130) contains a face with a predetermined expression.

[0051] The device may further include an operation unit (180) that accepts an operation for enabling an alert setting for a predetermined area. The authentication suspension condition may include a case where the operation unit (180) accepts an operation for enabling the alert setting.

[0052] The authentication stop condition may include a case where the operation unit (180) receives an operation for enabling the alert setting within a predetermined period of time after the face authentication unit (360) completes the face authentication process.

[0053] Another aspect of the present disclosure is also a face authentication system (300). This face authentication system (300) includes a face authentication unit (360) that executes face authentication processing based on an image including a face captured by an imaging unit (130), a control unit (330) that executes control over a door provided at an entrance to a predetermined area based on a result of the face authentication processing in the face authentication unit (360), and an instruction unit (332) that instructs alert setting of the predetermined area when alert setting conditions are satisfied.

[0054] The security setting condition may further include a case where the operation unit (180) receives an operation for enabling the security setting for the predetermined area.

[0055] The alert setting condition may include a case where the face authentication unit (360) completes face authentication processing and the operation unit (180) accepts an operation for enabling the alert setting.

[0056] The alert setting condition may include a case where the operation unit (180) receives an operation for enabling the alert setting within a predetermined period of time after the face authentication unit (360) completes the face authentication process.

[0057] Example 2 Next, a second embodiment will be described. As with the first embodiment, the second embodiment relates to a management system that manages people entering a predetermined area in a facility or people exiting from the area. In the first embodiment, face recognition processing is executed as an example of authentication. In the second embodiment, in addition to the face recognition processing, authentication using an IC (Integrated Circuit) card (hereinafter, referred to as "ID authentication processing") is also executed.

[0058] In the ID authentication process, an IC card holding identification information assigned to an authorized person (hereinafter referred to as "card identification information") is given to the authorized person in advance. When the authorized person arrives at the entrance to the area, he or she brings the IC card close to a card reader installed at the entrance to the area. When the card reader acquires the card identification information from the IC card, the management system determines whether or not the person is an authorized person based on the acquired card identification information. Depending on the result of the ID authentication process, the management system controls the open / closed state or the locked / unlocked state of the door installed at the entrance.

[0059] In the second embodiment, the security setting is enabled, for example, when the door is closed and an action for enabling the security setting is performed and the action is confirmed by an authorized person. More specifically, when the door is closed and an authorized person presses a button for enabling the security setting and ID authentication processing for the authorized person is successful, the security setting is enabled. On the other hand, in order to disable (cancel) the security setting, an action for disabling the security setting and confirmation of the action by the authorized person are required.

[0060] If the door is an automatic door, when an authorized person passes near the entrance, the face recognition process will be successful and the door will be opened. This will prevent the authorized person from activating the security setting. To deal with this, in this embodiment as well, when an action to activate the security setting is accepted, the face recognition process to open the door is stopped, so that the action to activate the security setting and the operation by the authorized person are confirmed while the door is closed. Here, the differences from the past will be mainly explained.

[0061] 5(a)-(b), especially FIG. 5(a), shows the configuration of a management system 1000. A first area 100a to an Nth area 100n are provided in the facility in the same manner as in FIG. 1(a). In each area 100, a card reader 110, an imaging unit 130, a monitor 140, an operation unit 180, a door control device 150, and a door 160 are provided.

[0062] The management system 1000 includes an entrance / exit management system 200 and a face authentication system 300. The entrance / exit management system 200 includes a card reader 110, an operation unit 180, and an entrance / exit management device 210, and the face authentication system 300 includes an imaging unit 130, a monitor 140, and a face authentication management device 310. The entrance / exit management device 210 and the face authentication management device 310 are communicatively connected to the card reader 110, the imaging unit 130, the monitor 140, the door control device 150, and the operation unit 180 of each area 100 via a network 400.

[0063] Another example of authentication processing in the management system 1000 is ID authentication processing, and based on the result of the ID authentication processing, it is determined whether or not the person is an authorized person who has the right to enter the area 100. The person holds an IC card 120, and the IC card 120 stores card identification information, such as a character string, assigned to the authorized person.

[0064] When the IC card 120 is brought close to the card reader 110 installed near the door 160, the IC card 120 wirelessly transmits the card identification information to the card reader 110. When the IC card 120 is a non-contact type IC card, the IC card 120 wirelessly transmits the card identification information between the card reader 110 and the card reader 110 by electromagnetic induction. In this case, the communication distance between the card reader 110 and the IC card 120 is about 2 mm to about 70 cm. The card reader 110 acquires the card identification information from the IC card 120 only when an IC card operation is performed. The card reader 110 transmits the acquired card identification information to the entrance / exit management device 210 via the network 400. At that time, the card reader 110 also transmits information for identifying the area 100 in which the card reader 110 is installed (hereinafter referred to as "area information") to the entrance / exit management device 210 via the network 400.

[0065] The entrance / exit management device 210 receives card identification information from the card reader 110 and executes ID authentication processing based on the card identification information. The ID authentication processing is processing for determining whether or not the person is an authorized person who has the right to enter the area 100 based on the card authentication information. The entrance / exit management device 210 determines the control content for the door 160 based on the result of the ID authentication processing. The control content may be, for example, opening the door 160 or closing the door 160. The control content may also be unlocking or locking an electronic lock provided on the door 160. The entrance / exit management device 210 transmits the control content as control information to the monitor 140 and the door control device 150 via the network 400.

[0066] As described above, the face authentication management device 310 performs face authentication processing on the face of a person included in an image captured by the imaging unit 130 installed near the door 160. Based on the result of the face authentication processing, the face authentication management device 310 determines the control content for the door 160. The face authentication management device 310 transmits the control content as control information to the monitor 140 and the door control device 150 via the network 400.

[0067] The monitor 140 installed near the door 160 receives control information from the entrance / exit management device 210 or the face authentication management device 310. The monitor 140 displays the control content in the control information as a message. Here, whether the door 160 is opened or not may be recognized by a person who wishes to enter the area 100 or a person who wishes to exit the area 100 by lighting an LED (Light Emitting Diode) provided in the card reader 110. The door control device 150 receives control information from the entrance / exit management device 210 or the face authentication management device 310, and controls the opening and closing of the door 160, that is, opening or closing, according to the received control information.

[0068] The management system 1000 is provided with a mode called an alert setting. The alert setting is enabled, for example, when the door 160 is closed and an operation for enabling the alert setting is performed and the operation is confirmed by an authorized person. In the first embodiment, the operation for enabling the alert setting is performed by operating the operation unit 180, and the confirmation of the operation by the authorized person corresponds to the success of face authentication processing for the authorized person in the face authentication management device 310. On the other hand, in the second embodiment, the operation for enabling the alert setting is performed by operating the operation unit 180, and the confirmation of the operation by the authorized person corresponds to the success of ID authentication processing for the authorized person in the entrance / exit management device 210. The operation for disabling (cancelling) the alert setting is also similar.

[0069] As in the first embodiment, if the door 160 is an automatic door, when an authority passes near the area 100, the imaging unit 130 captures an image of the authority's face, and the face authentication process is successful in the face authentication management device 310, allowing the door 160 to be opened. Even if the authority operates the operation unit 180 in this state, the security setting is not enabled. It is desirable to execute the security setting even in this situation.

[0070] 5(b) shows the configuration of the entrance / exit management device 210. The entrance / exit management device 210 includes a communication unit 220, a control unit 230, a card information storage unit 240, an ID authentication unit 250, and a storage unit 260. The control unit 230 includes an instruction unit 232. The communication unit 220 is a communication interface for connecting to a network 400, and can communicate with the card reader 110, the door control device 150, the operation unit 180, and the face authentication management device 310 in FIG. 1 via the network 400. In addition, the control unit 230 can also communicate with a sensor (not shown), an alarm device (not shown), and a security company server (not shown) used in alert settings via the network 400.

[0071] The card information storage unit 240 stores card identification information. The card information storage unit 240 also stores permitted area information indicating the area 100 to which the authorized person corresponding to the card identification information is permitted to enter. In the permitted area information, for example, the first area 100a is indicated as the area 100 to which the authorized person is permitted to enter. The information stored in the card information storage unit 240 may be set by an administrator via a user interface (not shown) such as a monitor, keyboard, and mouse provided in the card information storage unit 240, or may be set remotely from an external device (not shown).

[0072] The ID authentication unit 250 receives card identification information from the card reader 110 via the communication unit 220. The ID authentication unit 250 executes ID authentication processing for a person located at the entrance based on the received card identification information. Specifically, the ID authentication unit 250 judges whether the received card identification information matches any of a plurality of pieces of card identification information stored in the card information storage unit 240. This corresponds to executing ID authentication processing for the IC card 120 (non-contact ID device). The ID authentication unit 250 may also receive area information from the card reader 110 via the communication unit 220, and may also use the received area information in the ID authentication processing. The ID authentication unit 250 outputs authentication success to the control unit 230 when the ID authentication processing is successful, and outputs authentication failure to the control unit 230 when the ID authentication processing is unsuccessful.

[0073] When the control unit 230 receives a successful authentication from the ID authentication unit 250, the control unit 230 transmits control information instructing at least one of opening and unlocking the door 160 from the communication unit 220 to the monitor 140 and the door control device 150. The control information may instruct at least one of closing and locking the door 160. On the other hand, when the control unit 230 receives a failed authentication from the ID authentication unit 250, the control unit 230 transmits control information instructing to close the door 160 for a certain period of time from the communication unit 220 to the monitor 140 and the door control device 150. In other words, the control unit 230 controls at least one of opening, unlocking, closing, and locking the door 160 provided at the entrance to the specified area 100.

[0074] Furthermore, when the result of the ID authentication process from the ID authentication unit 250 indicates success, the control unit 230 manages the authorized person present inside the facility based on the card identification information received from the ID authentication unit 250. Information on the authorized person present inside the facility is exchanged with the face authentication management device 310 via the communication unit 220. Furthermore, the control unit 230 communicates with the door control device 150 via the communication unit 220 to obtain the status of the door 160 and manage the status of the door 160. The status of the door 160 indicates whether the door 160 is open, unlocked, closed, or locked. This managed information is stored in the storage unit 260.

[0075] The process for enabling the alert setting according to this embodiment is performed in either pattern (4) 4 or pattern (5) 5. In the following, the process will be described in the order of pattern (4) 4 and pattern (5) 5. (4) Fourth pattern Here, to explain the fourth pattern, Fig. 6(a)-(f) will also be used. Fig. 6(a)-(f) shows the fourth pattern of operation by the management system 1000. Fig. 6(a)-(c) shows screens displayed on the monitor 140. Fig. 6(d) shows the operation of the face authentication system 300, particularly the face authentication management device 310, where a high level indicates that face authentication processing is being performed, and a low level indicates that face authentication processing is not being performed. Fig. 6(e) shows the operation of the entrance / exit management system 200, particularly the entrance / exit management device 210. Fig. 6(f) shows the operation of the door 160, where a high level indicates that the door is open, and a low level indicates that the door is closed. In these figures, the horizontal axis indicates time.

[0076] At time T1, the door 160 is closed, and when an authorized person who wants to activate the security setting passes in front of the imaging unit 130, the imaging unit 130 captures an image of the authorized person's face. The facial authentication unit 360 of the facial authentication management device 310 executes facial authentication processing based on an image including the face captured by the imaging unit 130. During this time, the screen shown in FIG. 6(a) is displayed on the monitor 140. If the facial authentication processing in the facial authentication unit 360 is successful, the control unit 330 executes control over the door 160 provided at the entrance to the area 100. Here, the door 160 is opened at time T2.

[0077] At time T3 when door 160 is open, IC card 120 is brought close to card reader 110 shown in Fig. 5(a), causing ID authentication unit 250 of entrance / exit management device 210 to execute ID authentication processing on IC card 120. Following this, at time T4, an authorized person operates operation unit 180 shown in Fig. 5(a), causing operation unit 180 to accept a valid operation for enabling the alert setting of area 100. Operation unit 180 notifies entrance / exit management device 210 of the valid operation via network 400.

[0078] The communication unit 220 of the entrance / exit management device 210 receives a valid operation from the operation unit 180. The instruction unit 232 determines that the alert setting condition is not met because the ID authentication process is completed at time T3 and a valid operation is accepted at time T4, but the door 160 is open. Therefore, the instruction unit 232 determines that the alert setting condition is met at time T5 when the door 160 is closed. If the alert setting condition is met, the instruction unit 232 decides to enable the alert setting of the area 100. The instruction unit 232 instructs the door control device 150 to execute the alert setting of the area 100. At that time, the screen shown in FIG. 6(b) is displayed on the monitor 140.

[0079] On the other hand, when the operation unit 180 accepts a valid operation at time T4, the instruction unit 232 transmits information (hereinafter, referred to as a "stop instruction") for stopping at least one of the face authentication processing and image capture performed in the face authentication management device 310 from the communication unit 220 to the face authentication management device 310. The communication unit 320 of the face authentication management device 310 receives the stop instruction from the entrance / exit management device 210 via the network 400 within a predetermined period after the face authentication unit 360 completes the face authentication processing. The control unit 330 predefines the case where the communication unit 320 receives the stop instruction within a predetermined period after the face authentication unit 360 completes the face authentication processing as an authentication stop condition, and when the control unit 330 accepts the stop instruction from the communication unit 320, it determines that the authentication stop condition is satisfied. When the authentication stop condition is satisfied, the control unit 330 stops at least one of the image capture unit 130 and the face authentication unit 360. As a result, the face authentication processing is not performed from time T4.

[0080] At time T5, the door 160 is closed. As described above, the instruction unit 232 of the entrance / exit management device 210 instructs the door control device 150 to execute the alert setting. When the door control device 150 is instructed to execute the alert setting from the entrance / exit management device 210 at time T5, the door control device 150 executes the alert setting. While executing the alert setting, if a sensor (not shown) detects that the door 160 is about to be opened, the door control device 150 transmits the detection result to the entrance / exit management device 210 via the network 400. When the communication unit 220 of the entrance / exit management device 210 receives the detection result from the sensor, the control unit 230 sounds an alarm (not shown) or notifies the security company of the detection result. When the alert setting is enabled, the screen shown in FIG. 6(c) is displayed on the monitor 140.

[0081] (5) Fifth pattern Here, to explain the fifth pattern, Fig. 7(a)-(d) are also used. Fig. 7(a)-(d) show the fifth pattern of operation by the management system 1000. Fig. 7(a) shows a screen displayed on the monitor 140. Fig. 7(b) shows the operation of the face authentication system 300, particularly the face authentication management device 310, where a high level indicates that face authentication processing is being performed, and a low level indicates that face authentication processing is not being performed. Fig. 7(c) shows the operation of the entrance / exit management system 200, particularly the entrance / exit management device 210. Fig. 7(d) shows the operation of the door 160, where a high level indicates that the door is open, and a low level indicates that the door is closed. In these figures, the horizontal axis indicates time.

[0082] In the fifth pattern, as compared with the fourth pattern, the face authentication process is not performed by the face authentication management device 310. At time T1, the IC card 120 is brought close to the card reader 110 shown in Fig. 5(a), whereby the ID authentication unit 250 of the entrance / exit management device 210 executes the ID authentication process on the IC card 120. Following this, at time T2, an authorized person operates the operation unit 180 shown in Fig. 5(a), whereby the operation unit 180 accepts a valid operation for validating the alert setting of the area 100. The operation unit 180 notifies the entrance / exit management device 210 of the valid operation via the network 400.

[0083] The communication unit 220 of the entrance / exit management device 210 receives a valid operation from the operation unit 180. The instruction unit 232 determines that the alert setting conditions are met because, with the door 160 closed, the ID authentication process is completed at time T1 and a valid operation is received at time T2. If the alert setting conditions are met, the instruction unit 232 decides to enable the alert setting of the area 100. The instruction unit 232 instructs the door control device 150 to execute the alert setting of the area 100.

[0084] When the door control device 150 is instructed to execute the alert setting by the entrance / exit management device 210 at time T3, the door control device 150 executes the alert setting. While the alert setting is being executed, if a sensor (not shown) detects that the door 160 is about to be opened, the door control device 150 transmits the detection result to the entrance / exit management device 210 via the network 400. When the communication unit 220 of the entrance / exit management device 210 receives the detection result from the sensor, the control unit 230 sounds an alarm (not shown) or notifies a security company of the detection result. When the alert setting is enabled, the screen shown in FIG. 7(a) is displayed on the monitor 140.

[0085] On the other hand, when the operation unit 180 accepts a valid operation at time T2, the instruction unit 232 transmits a stop instruction from the communication unit 220 to the face authentication management device 310. The communication unit 320 of the face authentication management device 310 receives the stop instruction from the entrance / exit management device 210 via the network 400. The control unit 330 predefines the case where the communication unit 320 receives the stop instruction as an authentication stop condition, and when the control unit 330 accepts the stop instruction from the communication unit 320, it determines that the authentication stop condition is satisfied. When the authentication stop condition is satisfied, the control unit 330 stops at least one of the imaging unit 130 and the face authentication unit 360. As a result, face authentication processing is not performed from time T2.

[0086] According to this embodiment, the authentication stop condition includes a case where the communication unit 320 receives a stop instruction, so that the face authentication process can be stopped appropriately. Also, the authentication stop condition includes a case where the communication unit 320 receives a predetermined signal within a predetermined period after the face authentication unit 360 completes the face authentication process, so that the face authentication process can be stopped appropriately. Also, when the operation unit 180 accepts an operation for enabling the alert setting, information for stopping at least one of the face authentication process and image capture performed in the face authentication management device 310 is transmitted to the face authentication management device 310, so that the face authentication process can be stopped appropriately.

[0087] The outline of one aspect of the present disclosure is as follows: The authentication device may further include a communication unit (320) that communicates with the outside. The authentication stop condition may include a case where the communication unit (320) receives a predetermined signal.

[0088] The authentication stop condition may include a case where the communication unit (320) receives a predetermined signal within a predetermined period of time after the face authentication unit (360) completes the face authentication process.

[0089] Yet another aspect of the present disclosure is an entrance / exit management system (200). This entrance / exit management system (200) includes an ID authentication unit (250) that executes ID authentication processing for a non-contact ID device, a control unit (230) that executes control of a door provided at an entrance to a predetermined area based on the result of the ID authentication processing in the ID authentication unit (250), an operation unit (180) that accepts an operation to enable an alert setting for the predetermined area, and a communication unit (220) that communicates with a face authentication system (300) that executes face authentication processing based on a captured image. When the operation unit (180) accepts an operation to enable the alert setting, the communication unit (220) transmits information to the face authentication system (300) for stopping at least one of the face authentication processing and image capture performed in the face authentication system (300).

[0090] Example 3 Next, a third embodiment will be described. As in the past, the third embodiment relates to a management system that manages the entry of people into a predetermined area in a facility or the exit of people from the area. In the third embodiment, face authentication processing and ID authentication processing are executed as in the second embodiment. In the third embodiment, the alert setting is also enabled when, for example, the door is closed and an operation for enabling the alert setting is performed and the operation is confirmed by an authorized person. However, as confirmation of the operation by the authorized person, the alert setting is enabled when the face authentication processing for the authorized person is successful. Here, the differences from the past embodiments will be mainly described.

[0091] In the following, (6) the sixth pattern will be described as a process for enabling the alert setting according to this embodiment. (6) Sixth Pattern Here, to explain the sixth pattern, Fig. 8(a)-(d) will also be used. Fig. 8(a)-(d) show the sixth pattern of operation by the management system 1000. Fig. 8(a) shows a screen displayed on the monitor 140. Fig. 8(b) shows the operation of the face authentication system 300, particularly the face authentication management device 310, where a high level indicates that face authentication processing is being performed, and a low level indicates that face authentication processing is not being performed. Fig. 8(c) shows the operation of the entrance / exit management system 200, particularly the entrance / exit management device 210. Fig. 8(d) shows the operation of the door 160, where a high level indicates that the door is open, and a low level indicates that the door is closed. In these figures, the horizontal axis indicates time.

[0092] At time T1, an authorized person operates the operation unit 180 shown in Fig. 5(a), whereby the operation unit 180 accepts a valid operation for enabling the alert setting of the area 100. The operation unit 180 notifies the entrance / exit management device 210 of the valid operation via the network 400. The communication unit 220 of the entrance / exit management device 210 receives the valid operation from the operation unit 180. When the communication unit 220 receives the valid operation, the instruction unit 232 causes the communication unit 220 to transmit information for requesting the face authentication management device 310 to execute face authentication processing (hereinafter referred to as a "request signal") to the face authentication management device 310.

[0093] When the communication unit 320 of the face authentication management device 310 receives a request signal from the entrance / exit management device 210, the control unit 330 causes the imaging unit 130 to capture an image of the face of the authorized person. At time T2, the face authentication unit 360 executes face authentication processing based on the image including the face captured by the imaging unit 130. During this time, the screen shown in FIG. 8(a) is displayed on the monitor 140. If the face authentication processing in the face authentication unit 360 is successful, the control unit 330 causes the communication unit 320 to transmit information indicating the completion of the face authentication processing (hereinafter referred to as a "completion signal") to the entrance / exit management device 210.

[0094] At time T3, the communication unit 220 of the entrance / exit management device 210 receives a completion signal from the face authentication management device 310. The instruction unit 232 determines that the alert setting condition is met because, while the door 160 is closed, the door 160 receives a valid operation at time T1 and receives information indicating the completion of the face authentication process from the face authentication management device 310 at time T3. If the alert setting condition is met, the instruction unit 232 determines to enable the alert setting of the area 100. The instruction unit 232 instructs the door control device 150 to execute the alert setting of the area 100.

[0095] The door control device 150 executes the alert setting when instructed to do so by the entrance / exit management device 210. While the alert setting is being executed, if a sensor (not shown) detects that the door 160 is about to be opened, the door control device 150 transmits the detection result to the entrance / exit management device 210 via the network 400. When the communication unit 220 of the entrance / exit management device 210 receives the detection result from the sensor, the control unit 230 sounds an alarm (not shown) or notifies a security company of the detection result.

[0096] According to this embodiment, when the operation unit 180 receives an operation to enable the alert setting, it transmits a request signal to the face authentication management device 310, so that the face authentication process can be appropriately executed. Also, when a completion signal is received, it instructs the alert setting, so that the alert setting can be appropriately executed.

[0097] An overview of one aspect of the present disclosure is as follows. Yet another aspect of the present disclosure is also an entrance / exit management system (200). This entrance / exit management system (200) includes an ID authentication unit (250) that executes ID authentication processing for a non-contact ID device, a control unit (230) that executes control of a door provided at an entrance to a predetermined area based on a result of the ID authentication processing in the ID authentication unit (250), an operation unit (180) that accepts an operation for enabling an alert setting for the predetermined area, a communication unit (220) that communicates with a face authentication system (300) that executes face authentication processing based on a captured image, and an instruction unit (232) that instructs an alert setting for the predetermined area when the operation unit (180) accepts an operation for enabling the alert setting and the communication unit (220) receives information indicating the completion of the face authentication processing from the face authentication system (300).

[0098] Example 4 Next, a fourth embodiment will be described. As in the past, the fourth embodiment relates to a management system that manages the entry of people into a predetermined area in a facility or the exit of people from the area. In the fourth embodiment, face authentication processing and ID authentication processing are executed as in the second and third embodiments. The alert setting in the fourth embodiment is enabled, for example, when the door is closed, there is no authorized person inside the facility, and the face authentication processing for the authorized person is successful. Here, the differences from the past embodiments will be mainly described.

[0099] The process for enabling the alert setting according to this embodiment is performed in either (7) Pattern 7 or (8) Pattern 8. In the following, the process will be described in the order of (7) Pattern 7 and (8) Pattern 8. (7) Seventh Pattern Here, to explain the seventh pattern, Fig. 9(a)-(d) are also used. Fig. 9(a)-(d) show the seventh pattern of operation by the management system 1000. Fig. 9(a) shows the setting contents of the alert setting, where a high level indicates enabled and a low level indicates disabled. Fig. 9(b) shows the operation of the door 160, where a high level indicates open and a low level indicates closed. Fig. 9(c) shows the operation of the face authentication system 300, particularly the face authentication management device 310, where a high level indicates execution of face authentication processing and a low level indicates non-execution of face authentication processing. Fig. 9(d) shows the operation of the entrance / exit management system 200, particularly the entrance / exit management device 210. In these figures, the horizontal axis indicates time.

[0100] At time T1, the door 160 is closed, and an authorized person who wants to enable the alert setting passes in front of the imaging unit 130, causing the imaging unit 130 to capture an image of the authorized person's face. The facial authentication unit 360 of the facial authentication management device 310 executes facial authentication processing based on an image including the face captured by the imaging unit 130. If the facial authentication processing in the facial authentication unit 360 is successful, the control unit 330 executes control over the door 160 provided at the entrance to the area 100. Here, the door 160 is opened at time T2. If the facial authentication processing in the facial authentication unit 360 is successful and the door 160 is opened, the control unit 330 causes the communication unit 320 to transmit information indicating the completion of the facial authentication processing (hereinafter referred to as a "completion signal") to the entrance / exit management device 210. The completion signal includes information about the authorized person whose facial authentication processing has been successful, such as face identification information.

[0101] The communication unit 220 of the entrance / exit management device 210 receives a completion signal from the face authentication management device 310. The control unit 230 updates the information on the authorized person existing inside the facility based on the information on the authorized person included in the completion signal. If the information on the authorized person existing inside the facility is no longer available due to the update, the control unit 230 determines that the last person to leave has left. The instruction unit 232 predefines, as an alert setting condition, a case in which the last person to leave the area 100 has left and the communication unit 220 has received information indicating the completion of face authentication processing from the face authentication management device 310. If the alert setting condition is met at time T3, the instruction unit 232 decides to enable the alert setting of the area 100.

[0102] On the other hand, when the last person to leave the area 100 leaves, the instruction unit 232 transmits a stop instruction from the communication unit 220 to the face authentication management device 310. The communication unit 320 of the face authentication management device 310 receives the stop instruction from the entrance / exit management device 210 via the network 400 within a predetermined period after the face authentication unit 360 completes the face authentication process. The control unit 330 predefines the case where the communication unit 320 receives the stop instruction within a predetermined period after the face authentication unit 360 completes the face authentication process as an authentication stop condition, and when the control unit 330 receives the stop instruction from the communication unit 320, it determines that the authentication stop condition is satisfied. When the authentication stop condition is satisfied, the control unit 330 stops at least one of the imaging unit 130 and the face authentication unit 360. As a result, the face authentication process is not performed from time T3.

[0103] At time T4, the instruction unit 232 of the entrance / exit management device 210 instructs the door control device 150 to execute the alert setting. When the door control device 150 is instructed to execute the alert setting by the entrance / exit management device 210 at time T4, the door control device 150 executes the alert setting. While the alert setting is being executed, if a sensor (not shown) detects that the door 160 is about to be opened, the door control device 150 transmits the detection result to the entrance / exit management device 210 via the network 400. When the communication unit 220 of the entrance / exit management device 210 receives the detection result from the sensor, the control unit 230 sounds an alarm (not shown) or notifies a security company of the detection result.

[0104] (8) Eighth Pattern Here, to explain the eighth pattern, Fig. 10(a)-(d) are also used. Fig. 10(a)-(d) show the eighth pattern of operation by the management system 1000. Fig. 10(a) shows the setting contents of the alert setting, where a high level indicates enabled and a low level indicates disabled. Fig. 10(b) shows the operation of the door 160, where a high level indicates open and a low level indicates closed. Fig. 10(c) shows the operation of the face authentication system 300, particularly the face authentication management device 310, where a high level indicates execution of face authentication processing and a low level indicates non-execution of face authentication processing. Fig. 10(d) shows the operation of the entrance / exit management system 200, particularly the entrance / exit management device 210. In these figures, the horizontal axis indicates time.

[0105] At time T1, the door 160 is closed, and when an authorized person who wants to enable the alert setting passes in front of the imaging unit 130, the imaging unit 130 captures an image of the authorized person's face. The facial authentication unit 360 of the facial authentication management device 310 executes facial authentication processing based on an image including the face captured by the imaging unit 130. If the facial authentication processing in the facial authentication unit 360 is successful, the control unit 330 executes control over the door 160 provided at the entrance to the area 100. Here, the door 160 is opened at time T2. If the facial authentication processing in the facial authentication unit 360 is successful and the door 160 is opened, the control unit 330 causes the communication unit 320 to transmit a completion signal to the entrance / exit management device 210.

[0106] The communication unit 220 of the entrance / exit management device 210 receives a completion signal from the face authentication management device 310. The control unit 230 updates the information of the authorized person existing inside the facility based on the information of the authorized person included in the completion signal. If the information of the authorized person existing inside the facility is no longer available due to the update, the control unit 230 determines that the last person to leave has left. The instruction unit 232 predefines, as an alert setting condition, a case in which the last person to leave the area 100 has left and the communication unit 220 has received information indicating the completion of the face authentication process from the face authentication management device 310. If the alert setting condition is satisfied at time T3, the instruction unit 232 determines that the alert setting of the area 100 is enabled. The instruction unit 232 transmits a notification indicating that the alert setting condition is satisfied and a stop instruction from the communication unit 220 to the face authentication management device 310.

[0107] The communication unit 320 of the face authentication management device 310 receives a stop instruction from the entrance / exit management device 210 via the network 400 within a predetermined period after the face authentication unit 360 completes the face authentication process. The control unit 330 predefines, as an authentication stop condition, a case in which the communication unit 320 receives a stop instruction within a predetermined period after the face authentication unit 360 completes the face authentication process, and determines that the authentication stop condition is satisfied when the control unit 330 receives the stop instruction from the communication unit 320. When the authentication stop condition is satisfied, the control unit 330 stops at least one of the imaging unit 130 and the face authentication unit 360. As a result, face authentication processing is not performed from time T4.

[0108] At time T4, the instruction unit 332 instructs the door control device 150 to execute the alert setting. When the door control device 150 is instructed to execute the alert setting from the entrance / exit management device 210 at time T4, the door control device 150 executes the alert setting. While the alert setting is being executed, if a sensor (not shown) detects that the door 160 is about to be opened, the door control device 150 transmits the detection result to the face authentication management device 310 via the network 400. When the communication unit 320 of the face authentication management device 310 receives the detection result from the sensor, the control unit 330 sounds an alarm (not shown) or notifies a security company of the detection result.

[0109] According to this embodiment, when the last person to leave the predetermined area leaves and the communication unit 220 receives a completion signal from the face authentication management device 310, an alert setting is instructed, so that the alert setting can be appropriately executed.

[0110] An overview of one aspect of the present disclosure is as follows. Yet another aspect of the present disclosure is also an entrance / exit management system (200). This entrance / exit management system (200) includes an ID authentication unit (250) that executes ID authentication processing for a non-contact ID device, a control unit (230) that executes control of a door provided at an entrance to a predetermined area based on a result of the ID authentication processing in the ID authentication unit (250), a communication unit (220) that communicates with a face authentication system (300) that executes face authentication processing based on a captured image, and an instruction unit (232) that instructs an alert setting for the predetermined area when the last person to leave the predetermined area has left and the communication unit (220) has received information indicating the completion of the face authentication processing from the face authentication system (300).

[0111] The present disclosure has been described above based on the embodiments. These embodiments are merely illustrative, and it will be understood by those skilled in the art that various modifications are possible in the combination of each component or each treatment process, and that such modifications are also within the scope of the present disclosure.

[0112] In the first embodiment, the approval suspension condition includes a case where the operation unit 180 accepts a valid operation. However, the authentication suspension condition is not limited to this, and may include, for example, a case where a face with a predetermined expression is included in an image from the imaging unit 130. According to this modification, a valid operation on the operation unit 180 can be made unnecessary. [Explanation of symbols]

[0113] 100 area, 110 card reader, 120 IC card, 130 imaging unit, 140 monitor, 150 door control device, 160 door, 180 operation unit, 200 entrance / exit control system, 210 entrance / exit control device, 220 communication unit, 230 control unit, 232 instruction unit, 240 card information storage unit, 250 ID authentication unit, 260 storage unit, 300 face authentication system, 310 face authentication management device, 320 communication unit, 330 control unit, 332 instruction unit, 340 face detection unit, 350 face information storage unit, 360 face authentication unit, 370 notification unit, 400 network, 1000 management system.

Claims

1. a face authentication unit that executes face authentication processing based on an image including a face captured by the imaging unit; A control unit that controls at least one of the imaging unit and the face authentication unit, When an authentication stop condition is satisfied, the control unit stops at least one of the imaging unit and the face authentication unit, An operation unit that receives an operation for enabling the alert setting for the predetermined area is further provided, A face authentication system, wherein the authentication suspension condition includes a case where the operation unit receives an operation for enabling the alert setting.

2. The face authentication system according to claim 1 , wherein the authentication stop condition includes a case where the image from the imaging unit contains a face with a predetermined facial expression.

3. 3. The face recognition system according to claim 1, wherein the authentication stop condition includes a case where the operation unit receives an operation to enable the alert setting within a predetermined period after the face recognition unit completes the face recognition process.

4. a face authentication unit that executes face authentication processing based on an image including a face captured by the imaging unit; A control unit that controls at least one of the imaging unit and the face authentication unit; A communication unit that communicates with an external device, When an authentication stop condition is satisfied, the control unit stops at least one of the imaging unit and the face authentication unit, A face recognition system, wherein the authentication stop condition includes a case where the communication unit receives a predetermined signal within a predetermined period of time after the face recognition unit completes the face recognition process.

5. an ID authentication unit that executes an ID authentication process for the contactless ID device; a control unit that executes control over a door provided at an entrance of a predetermined area based on a result of the ID authentication process in the ID authentication unit; an operation unit that receives an operation for enabling a security setting for the predetermined area; A communication unit that communicates with a face recognition system that executes face recognition processing based on a captured image, The communication unit transmits information to the facial recognition system to stop at least one of the facial recognition processing and image capture performed in the facial recognition system when the operation unit receives an operation to enable the alert setting.

6. A management system comprising the face authentication system according to claim 4 and the entrance / exit management system according to claim 5.

7. A program executed by the face authentication system according to any one of claims 1 to 4.

8. A program to be executed by the entrance / exit management system according to claim 5.

Citation Information

Patent Citations

  • Entrance / exit management system and method

    JP2015036469A

  • Exit management system for person to be managed

    JP2015152986A

  • Information processing apparatus and information processing method

    JP2019174855A

  • Approval terminal, settlement system, and settlement method

    JP2020030669A