Entrance-exit management system, and method
The access control system simplifies setup and reduces processing load by using facial recognition to authenticate users within a defined unlockable area, improving security and efficiency in room entry/exit management.
Patent Information
- Application Number
- JP2023082284
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-18
- Publication Date
- 2024-11-28
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing room entry/exit management systems face challenges in reducing processing load and requiring cumbersome setup when multiple doors need to be configured for entry and exit sides, especially with facial recognition technologies.
An access control system that includes a photographing means to capture a user's face, a display to superimpose an unlockable area, an authentication means to verify the user's face relative to the unlockable area, and an electric lock control to unlock doors based on authentication, with a setting means to easily configure the unlockable area.
The system simplifies setup and reduces processing load by focusing authentication on users within the unlockable area, minimizing unnecessary processing and enhancing security.
Smart Images

Figure 2024165790000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a technique for entrance and exit management. [Background technology]
[0002] In recent years, entry and exit management systems that use face recognition technology to unlock doors are becoming more common. Patent Document 1 discloses a system that has an authorization means for permitting passage of a person when the size of the person's face area is equal to or larger than a predetermined judgment reference value, and changes the judgment reference value according to the position of the face area in an input image.
[0003] In addition, the system described in Patent Document 2 presets two areas on an image (a face detection area and an entrance / exit) and detects whether a detected person is facing the entrance. Furthermore, in Patent Document 2, when a person faces the entrance, it is determined whether the person is permitted to enter or exit the managed area, and the open / close state of the entrance is controlled according to the result. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent No. 6151582 [Patent Document 2] Patent No. 7075702 Summary of the Invention [Problem to be solved by the invention]
[0005] In Patent Document 1, authentication is performed simultaneously on people detected across the entire surface of an image captured by a camera. As a result, authentication processing is performed even on people who do not unlock the door, resulting in a lot of unnecessary processing and a heavy load on the server that performs face authentication.
[0006] On the other hand, in Patent Document 2, when a person faces the entrance direction, it is judged whether the person is permitted to enter or exit, thereby narrowing down the target and reducing the load. However, in Patent Document 2, the user is required to set two conditions: a condition for detection and an area condition for unlocking. Usually, when introducing an entrance / exit management system, there are many places where the entrance side and exit side of the door must be set for multiple doors, which is troublesome work for the user.
[0007] The present invention aims to realize entrance and exit management that is easy to set up and reduces the processing load. [Means for solving the problem]
[0008] An access control system according to one embodiment of the present invention comprises an imaging means for imaging a user's face, a display means for superimposing an unlockable area on the image captured by the imaging means, an authentication means for authenticating the user based on the relationship between the unlockable area and the user's face displayed on the display means, an electric lock control means for unlocking an electric lock based on the authentication result of the authentication means, and a setting means for setting the unlockable area to be displayed on the display means. Effect of the Invention
[0009] According to the present invention, it is possible to realize entrance and exit management that is easy to set up and reduces the processing load. [Brief description of the drawings]
[0010] [Figure 1] 1 is an explanatory diagram of an entrance / exit management system according to a first embodiment of the present invention; [Diagram 2] 1 is a block diagram showing a hardware configuration of an entry / exit management system according to a first embodiment of the present invention. [Diagram 3] 1 is a block diagram showing a functional configuration of an entrance / exit management system according to a first embodiment of the present invention. [Figure 4] 1 is a diagram showing a data structure of an entry / exit management system according to a first embodiment of the present invention. FIG. [Diagram 5] 4 is an example of data stored in a behavior storage unit in the first embodiment of the present invention. [Figure 6] 5A to 5C are diagrams illustrating a method for setting an unlockable area in the first embodiment of the present invention. [Figure 7] FIG. 2 is a diagram relating to a method of calculating a proximity degree in the first embodiment of the present invention. [Figure 8] 3 shows a software processing procedure in the first embodiment of the present invention. [Figure 9] FIG. 4 is a diagram illustrating a method for setting a proximity threshold in the first embodiment of the present invention. [Figure 10] FIG. 11 is a block diagram showing a functional configuration of an entrance / exit management system according to a second embodiment of the present invention. [Figure 11] 13A and 13B are diagrams showing a frequency distribution table and a cumulative distribution when a threshold analysis of proximity is performed in the second embodiment of the present invention. [Figure 12] 13A to 13C are explanatory diagrams of face direction determination according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, the embodiments of the present invention will be described with reference to the drawings. Note that the following embodiments do not limit the invention according to the claims, and all of the combinations of features described in the embodiments are not necessarily essential to the solution of the invention.
[0012] [First embodiment] 1 is an explanatory diagram of an entrance / exit management system according to a first embodiment of the present invention. This system is installed in facilities such as schools and companies, and manages the entrance and exit of users. Here, management when a user enters a room will be described.
[0013] In the first embodiment of the present invention, when the face of user 1 is detected near a preset unlockable area 3, a decision is made as to whether or not to authenticate user 1 depending on the distance between the detected face and the unlockable area 3.
[0014] A camera 1310 of an authentication terminal 1300 installed on a door 2 that is subject to entrance management captures an image of the face of a user 1. A display unit 1320 of the authentication terminal 1300 displays a frame indicating an unlockable area 3 superimposed on a live image captured by the camera 1310.
[0015] While looking at the display on the display unit 1320, the user 1 faces the unlockable area 3 displayed on the display unit 1320. When the user 1 is authenticated, the electric lock 1210 of the door 2 is unlocked, the door 2 opens, and the user 1 can enter the room.
[0016] FIG. 2 is a block diagram showing a hardware configuration of the entrance / exit management system according to the first embodiment of the present invention. Each item will be described. The entrance / exit management system 1000 has a face authentication server 1100, an entrance / exit management server 1200, an authentication terminal 1300, and a PC 1400. The face authentication server 1100, the entrance / exit management server 1200, the authentication terminal 1300, and the PC 1400 are connected via a network NW. The entrance / exit management server 1200 and the electric lock 1210 are connected by a dedicated signal line. A combination of the authentication terminal 1300 and the electric lock 1210 is installed on the entrance side and the exit side of each door that is the target of entrance / exit management. The face authentication server 1100 is an example of a face authentication device. The entrance / exit management server 1200 is an example of an entrance / exit management device.
[0017] Fig. 3 is a block diagram showing the functional configuration of the entrance / exit management system according to the first embodiment of the present invention Fig. 4 is a diagram showing the data structure of the entrance / exit management system according to the first embodiment of the present invention.
[0018] The face authentication server 1100 detects a face from an image captured by a camera 1310 provided in the authentication terminal 1300 and performs face authentication. The face authentication server 1100 authenticates the face in the captured image against a face registered in advance, and if the authentication is successful, transmits a message to that effect to the entrance / exit management server 1200 via the communication unit 1150.
[0019] The face authentication server 1100 includes a face detection unit 1110 , a face authentication unit 1120 , a behavior analysis unit 1130 , a setting storage unit 1140 , and a communication unit 1150 .
[0020] The face detection unit 1110 detects the face image of a person appearing in an image captured by the camera 1310. Here, the result of face detection is composed of information such as the position and size of the face, and the face direction (values of yaw angle, pitch angle, and roll angle). The position and size of the face are indicated by the area surrounding the face. In this embodiment, the area surrounding the face is a square, and is managed by the coordinates of the center position of the square and the width of the area.
[0021] The face authentication unit 1120 performs authentication by comparing the face detected by the face detection unit 1110 with faces registered in advance in a face information management unit 1123. The face authentication unit 1120 includes a face feature extraction unit 1121, a face matching unit 1122, and a face information management unit 1123.
[0022] The face feature extraction unit 1121 extracts features from the face detected by the face detection unit 1110. The feature extraction process calculates features from image data using a multi-layered neural network called a deep neural network that is trained using deep learning.
[0023] The face matching unit 1122 compares the facial features detected by the face detection unit 1110 with the facial features registered in advance in the face information management unit 1123 to perform matching. As a result of the matching, the face matching unit 1122 outputs the user ID 103 (see FIG. 4(A)) of the person who is most similar among the registered people. If the result of the matching is that there is no person corresponding to the registered person, the face matching unit 1122 outputs information to the effect that the person to be met is an unregistered person.
[0024] The face information management unit 1123 holds face information of a user. The face information of a user includes information on the user's affiliation, such as an employee working at a facility. The face information includes a face image and face features. The face image includes a frontal face image of the same person photographed from the front. The face image may also include face images photographed from multiple directions to improve authentication accuracy. The face features are features extracted from each face image.
[0025] 4A, the face information management unit 1123 includes an ID 101, a name 102, and a user ID 103. The ID 101 is an ID that can be uniquely identified in the face information management unit 1123.
[0026] The name 102 is the name of a user of the facility who is authenticated by the face authentication server 1100. The user ID 103 is the ID of the user of the facility. The face information management unit 1123 manages the name 102 and the user ID 103 by linking them to the ID 101.
[0027] The behavior analysis unit 1130 associates the same person between consecutive images captured by each camera 1310, stores the position and size of the face, and stores and analyzes the behavior. As a means for associating the same person, an analysis process is performed in which the movement distance of the detected face position and the features of the upper body are learned. The behavior analysis unit 1130 calculates the distance from the unlockable area 3 that has been set based on the detected face.
[0028] The behavior analysis unit 1130 includes a behavior storage unit 1131 and a matching determination unit 1132. The behavior storage unit 1131 stores the results of face detection and authentication of one person from a captured image acquired by the camera 1310. The behavior storage unit 1131 generates a table when a new person is observed in the captured video, and discards the table when the person is no longer present in the captured video.
[0029] 4(B), the behavior memory unit 1131 stores a management ID 401, a time stamp 402, a detected position P 403, a face size W 404, a distance L 405, a proximity 406, an authentication execution result 407, and a user ID 408. The management ID 401 is an ID that can be uniquely identified in the behavior memory unit 1131. FIG. 5 shows an example of the contents stored in the behavior memory unit 1131.
[0030] The time stamp 402 is the date and time when the image was acquired. The detection position P403 is the X and Y coordinates of the center position of the face detected by the face detection unit 1110. The face size W404 is the size of the face detected by the face detection unit 1110. The distance L405 is the distance from the detection position P403 to the unlocked area 3 calculated by the behavior analysis unit 1130. The proximity 406 indicates whether or not the face detected by the face detection unit 1110 is close to the unlocked area 3, and indicates the degree of proximity. If the proximity 406 is small, the face is close to the unlocked area 3, and if the proximity 406 is large, the face is far from the unlocked area 3. The authentication execution result 407 holds the authentication result. If authentication is not performed, the authentication execution result 407 holds NA. NA is an abbreviation for Not Applicable. The user ID 408 is matched with the face information management unit 1133 when authentication of the person is executed, and holds the ID of the person with the highest degree of match. When authentication is not executed, the user ID 408 holds NA. The behavior memory unit 1131 manages the management ID 401 by linking it with the time stamp 402, the detection position P403, the face size W404, the distance L405, the proximity 406, the authentication execution result 407, and the user ID 408.
[0031] The matching determination unit 1132 extracts features from the detected face and performs matching. The matching determination unit 1132 determines whether or not the face of the person undergoing behavior analysis is present near a spatial position reflected in the unlockable area 3.
[0032] The setting storage unit 1140 holds setting values necessary for the processing of the behavior analysis unit 1130 and the face authentication unit 1120. Specifically, the setting storage unit 1140 holds the shape of the unlockable area 3, the threshold t of the proximity, and the like.
[0033] The communication unit 1150 includes a circuit for communicating with an external device in accordance with a predetermined communication standard (e.g., LAN, Wi-Fi (registered trademark), Bluetooth (registered trademark), USB, HDMI (registered trademark)). LAN is an abbreviation for Local Area Network. USB is an abbreviation for Universal Serial Bus.
[0034] The entrance / exit management server 1200 receives a signal from the face authentication server 1100 and transmits the signal to the electric lock 1211. The electric lock 1211 receiving this signal unlocks the door 2, making it possible to open and close the door. The entrance / exit management server 1200 includes an electric lock control unit 1210, a user information management unit 1220, a user matching unit 1230, and a communication unit 1240.
[0035] The electric lock control unit 1210 locks or unlocks the electric lock 1211 and controls the opening and closing of the door 2 by the electric lock 1211 .
[0036] The user information management unit 1220 stores information about users who can unlock the electric lock 1211. As shown in Fig. 4(C), the user information management unit 1220 includes an ID 101, a name 102, a user ID 103, and an available door 104. The ID 101 is an ID that can be uniquely identified in the user information management unit 1220.
[0037] Name 102 is the name of a facility user who is authenticated by face authentication server 1100. User ID 103 is the ID of the facility user. Allowed entry door 104 is information on the door through which the user can enter. Door information is managed by the ID assigned to that door. User information management unit 1220 manages name 102, user ID 103, and allowed entry door 104 in association with ID 101.
[0038] The user matching unit 1230 judges whether or not to permit authentication based on the user ID to be face-recognized, which is the unlocking request content received from the authentication terminal 1300, and the ID number of the authentication terminal 1300. If the authentication is approved as a result of the matching, the user matching unit 1230 outputs a permission signal to the electric lock control unit 1210.
[0039] The communication unit 1240 includes a circuit for communicating with an external device in accordance with a predetermined communication standard (for example, LAN, Wi-Fi (registered trademark), Bluetooth (registered trademark), USB, or HDMI (registered trademark)).
[0040] The authentication terminal 1300 is installed near the door 2 that performs unlocking control, and is a device for performing face authentication of a user. The authentication terminal 1300 transmits an image acquired from a camera 1310 to the face authentication server 1100, and transmits an unlocking request to the entrance / exit management server 1200 according to the collation result. The authentication terminal 1300 displays the collation result.
[0041] The authentication terminal 1300 includes a camera 1310 and a display unit 1320. The camera 1310 is a camera including an imaging element such as a CCD image sensor, a CMOS image sensor, or an NMOS image sensor. CCD is an abbreviation for Charge Coupled Device. CMOS is an abbreviation for Complementary Metal-Oxide-Semiconductor. NMOS is an abbreviation for Negative-channel Metal-Oxide-Semiconductor. The display unit 1320 is configured, for example, with a liquid crystal display or an organic EL display. EL is an abbreviation for Electro-Luminescence.
[0042] The PC 1400 is a personal computer that is set by an administrator of the entrance and exit management system 1000 for a user in the unlockable area 3, the face information management unit 1123, and the user information management unit 1220. The PC 1400 includes a setting application 1410, and a communication unit 1420.
[0043] The setting application 1410 is an application for setting the entrance / exit management system 1000, and connects to and sets the face authentication server 1100 and the entrance / exit management server 1200. The setting contents are stored in the setting storage unit 1140, the face information management unit 1123, and the user information management unit 1220.
[0044] The communication unit 1420 includes a circuit for communicating with an external device in accordance with a predetermined communication standard (for example, LAN, Wi-Fi (registered trademark), Bluetooth (registered trademark), USB, or HDMI (registered trademark)).
[0045] <How to set unlockable areas> An example of a method for setting the unlockable area 3 is shown in FIG. 6. The person who sets the unlockable area 3 starts the PC 1400 and executes the setting application 1410. When the person who sets the unlockable area 3 selects the authentication terminal 1300 to be set this time in the setting application 1410, the PC 1400 communicates with the selected authentication terminal 1300. The display unit 1320 of the selected authentication terminal 1300 displays the screen of FIG. 6(A). On the screen of FIG. 6(A), a message "Please set an unlockable area" is displayed, and a current image captured by the camera 1310 is displayed as a preview below the message. In this embodiment, the person who sets the area operates the PC 1400 and sets the vertex positions of a polygon on the screen of FIG. 6(A), so that the area of the unlockable area 3 can be set by the polygon (see the screen of FIG. 6(B)). When the setting button is pressed to complete the setting, the display unit 1320 displays the unlockable area 3 as shown in FIG. 6(C). The set position and shape of the unlockable area 3 are stored in the shape setting storage unit 1140.
[0046] <Authentication Judgment Method> As described above, the unlockable area 3, which is set in advance by a frame line on the captured image, becomes a pyramid-like space K with the camera 1310 as the apex as shown in Fig. 7(A) in the three-dimensional space captured by the camera 1310. The proximity is the distance between the face of the user 1 and the space K. In order to perform smooth authentication and unlocking processing, it is necessary to perform a match in advance when the proximity is less than a certain value.
[0047] In this embodiment, this proximity is estimated from the distance L on the captured image. The relationship between the distance L and the proximity changes depending on the distance between the camera 1310 of the authentication terminal 1300 and the user 1, but by standardizing it by the size of the person's face, the proximity can be calculated with high accuracy, although there may be some individual differences.
[0048] The method of calculating the proximity will be described with reference to Fig. 7(B). When a user 1 with a face size W is detected in a captured image, and the face detection frame G, its center point P, and the unlockable area 3 exist as shown in Fig. 7(B), the distance L from the center point P to the shortest point on the boundary line between the unlockable area 3 is calculated. The proximity between the space K and the user 1 is expressed by formula (1). Proximity = L / W Equation (1)
[0049] In this embodiment, the threshold value t of the degree of proximity is set to 1.5. If the value is equal to or less than this value, it is determined that matching is to be performed, and if the value is exceeded, it is determined that matching is not to be performed.
[0050] Furthermore, the face size W is the width of the detection frame when the face is detected, but is not limited to this, and W may be anything related to the size of the person. For example, it may be the height or diagonal length of the face detection frame. If facial organs (eyes, nose, mouth, etc., and their characteristic points) are detected, it may be the distance between the organs, such as the width between the eyes. Furthermore, correction may be performed based on the direction of the face (for example, if the face is 30 degrees to the side, the eye width is multiplied by √3 / 2). And if the head or upper body is detected, it may be the width of the head or shoulders.
[0051] Furthermore, the method of calculating the distance L is not limited to this. Taking into account the motion vector, the distance to the intersection point between the extended movement trajectory between frames and the boundary line of the unlockable area 3 may be taken as L.
[0052] 8 is a flowchart of a process in which a user 1 executes authentication processing using the authentication terminal 1300 in the entrance and exit management system 1000 according to the first embodiment of the present invention. The face information management unit 1123 acquires information on registered persons in advance, and the user ID to be managed is registered as a user ID managed by the user information management unit 1220.
[0053] In step S101, the authentication terminal 1300 acquires an image from the camera 1310 and transmits it to the face authentication server 1100. In step S102, the face authentication server 1100 performs face detection on the received image with the face detection unit 1110.
[0054] In step S103, the behavior analysis unit 1130 determines whether or not a face has been detected. If a face has been detected, the behavior analysis unit 1130 executes the process of step S104. If a face has not been detected, the behavior analysis unit 1130 executes the process of step S116.
[0055] In step S104, the behavior analysis unit 1130 calculates the proximity. In step S105, the behavior analysis unit 1130 stores in the behavior storage unit 1131 the face detection information, the time stamp of the image acquisition timing, the detection position P, the face size W, the distance L, and the proximity by the comparison determination unit 1132.
[0056] In step S106, the behavior analysis unit 1130 compares the proximity with a threshold t stored in the setting storage unit 1140. If the proximity is equal to or less than the threshold t, the behavior analysis unit 1130 executes the process of step S107. If the proximity is not equal to or less than the threshold t, the behavior analysis unit 1130 executes the process of step S116.
[0057] In step S107, the behavior analysis unit 1130 determines whether the face detection frame is contained within the unlockable area 3. If the face detection frame is within the unlockable area 3, the behavior analysis unit 1130 executes processing of step S108. If the face detection frame is not within the unlockable area 3, the behavior analysis unit 1130 executes processing of step S109.
[0058] In step S108, the behavior analysis unit 1130 determines whether there is a matched history and whether authentication has been performed. If authentication has been performed, the behavior analysis unit 1130 executes the process of step S113. If authentication has not been performed, the behavior analysis unit 1130 executes the process of step S109.
[0059] In step S109, the facial feature extraction unit 1121 extracts features from the detected face and transmits them to the facial matching unit 1122. In step S110, the facial matching unit 1122 compares the features received from the facial feature extraction unit 1121 with the facial information registered in the facial information management unit 1123 to perform matching. In step S111, the behavior analysis unit 1130 stores the matching result in the behavior storage unit 1131 by the facial matching unit 1130.
[0060] In step S112, the behavior analysis unit 1130 determines whether the face detection frame is included in the unlockable area 3, has a matching history, and has been authenticated. If the face detection frame is within the unlockable area 3 and has been authenticated, the behavior analysis unit 1130 executes the process of step S113. If the face detection frame is within the unlockable area 3 and has not been authenticated, the behavior analysis unit 1130 ends the process.
[0061] In step S113, the behavior analysis unit 1130 transmits the matched user ID as an unlocking instruction to the authentication terminal 1300. Furthermore, in step S113, the authentication terminal 1300 transmits an unlocking instruction including the user ID received in step S111 and its own authentication terminal ID to the entrance / exit management server 1200.
[0062] In step S114, the user matching unit 1230 of the entrance / exit management server 1200 matches the received user ID and authentication terminal ID with the information in the user information management unit 1220. If the user matching unit 1230 finds approval as a result of the matching, the process proceeds to step S115. If the user matching unit 1230 finds no approval as a result of the matching, the process ends.
[0063] In step S115, the electric lock control unit 1210 transmits an unlock signal to the electric lock 1211. As a result, the door 2 opens.
[0064] In step S116, the behavior analysis unit 1130 transmits a signal to the authentication terminal 1300 indicating that unlocking is not permitted.
[0065] As described above, according to this embodiment, while the information of a person who has been detected and authenticated is maintained in the behavior storage unit 1131, processing is executed together with the acquisition of an image.
[0066] According to the method described above, a matching process is performed in advance on faces present in the vicinity of the set unlockable area 3, and the unlocking process is performed at the timing when the face detection frame of the user is enclosed within the frame of the unlockable area 3. As a result, simple settings are sufficient, no extra processing is required, and smoother authentication is possible.
[0067] (Variation 1-1) A modified example 1-1 of the entrance / exit management system according to the first embodiment will be described. In the first embodiment, the necessary condition is that the number of authentications in steps S108 and S112 is one, but the present invention is not limited to this. In the modified example 1-1, in order to improve the authentication accuracy, a necessary condition is added that the same person is authenticated multiple times.
[0068] The entrance / exit management system according to this modification has a setting means for allowing a user to set the required authentication count X, and has a means for proportionally changing the proximity threshold value t in accordance with the required authentication count X. Specifically, the relationship between the required authentication count X, the proximity threshold value t, and the proportionality constant a satisfies formula (2). t=aX...Equation (2)
[0069] According to this modification, even if the number of required authentication times is changed by the user, it is possible to secure a frame that can be appropriately matched.
[0070] (Variation 1-2) A description will be given of a modified example 1-2 of the entry / exit management system according to the first embodiment. Modified example 1-2 has a means in which the behavior analysis unit 1130 calculates a time difference d between the timestamp 402 of an image sent from the authentication terminal 1300 to the face authentication server 1100 and the timestamp of the previous frame, and changes the proximity threshold value t in proportion to the time difference d. Specifically, the relationship between the time difference d, the proximity threshold value t, and the proportionality constant b satisfies formula (3). t=bd...Equation (3)
[0071] According to this modification, even if the image update timing changes, it is possible to hold a frame to be matched appropriately.
[0072] (Variation 1-3) A description will be given of a modified example 1-3 of the entrance / exit management system according to the first embodiment. Modified example 1-3 has a means for transmitting a locking signal after the behavior analysis unit 1130 of the face authentication server 1100 issues an unlocking command in step S112. Specifically, if the same person continues to be detected and has been present for a certain period of time (e.g., 10 seconds), the face authentication server 1100 transmits a locking signal to the entrance / exit management server 1200 via the authentication terminal 1300. Alternatively, if the same person continues to be detected and the face size becomes a certain size or less (e.g., 1 / 2) from the authentication timing, the locking signal is transmitted.
[0073] According to this modification, depending on the behavior of the user 1 after unlocking, it is possible to lock the door after unlocking, which prevents the door from being left unlocked and makes it possible to maintain security.
[0074] (Variation 1-4) A description will be given of a modified example 1-4 of the entrance and exit control system according to the first embodiment. The modified example 1-4 has a means for the user to arbitrarily change the threshold value t of the proximity.
[0075] An example of a method for setting the proximity threshold is shown in FIG. 9. The person setting the proximity threshold starts the PC 1400 and executes the setting application 1410. When the person sets the authentication terminal 1300 to be set this time in the setting application 1410, the PC 1400 communicates with the selected authentication terminal 1300. After the unlockable area 3 is set as described in FIG. 6, the display unit 1320 of the selected authentication terminal 1300 displays the screen of FIG. 9(A). On the screen of FIG. 9(A), a message "Please adjust the arrow to the face size" is displayed, and below that, an arrow A is superimposed on a preview of the current image captured by the camera 1310. The face size of the target user is set with the size of the arrow A, and the setting button is pressed, and then the screen of FIG. 9(B) is displayed. On the screen of FIG. 9(B), a message "Please set the authentication area" is displayed, and below that, a preview of the current image captured by the camera 1310 is displayed. When the person setting the setting clicks on the screen of Fig. 9(B), a boundary line 90 is displayed at the same distance as the clicked position for the previously set unlockable area 3. The person setting the setting completes the setting by adjusting the size of this boundary line 90 and then pressing the setting button.
[0076] [Second embodiment] In the second embodiment of the present invention, the proximity threshold t is adjusted based on the detection and matching history up to that point. This allows for a smoother door unlocking process while reducing unnecessary authentication processes with simple settings.
[0077] Fig. 10 shows an example of the configuration of an entrance / exit management system according to a second embodiment of the present invention. The difference from Fig. 3 is that it has an authentication history storage unit 1160 that performs past behavior analysis and stores optimal proximity information. Specifically, in step S108 or S112, past frames are traced back the number of times required for authentication processing from the frame at the time when the face detection frame was included in the unlockable area 3, and the proximity at that time is stored in the authentication history storage unit 1160.
[0078] Next, a method for updating the proximity threshold t will be described. In the behavior analysis unit 1130, the optimal proximity information at the time of past detection and matching in the authentication history storage unit 1160 for each authentication terminal 1300 is analyzed using a frequency distribution (bar graph) and cumulative frequency distribution (solid line) as shown in Fig. 11. In this embodiment, the proximity threshold t is set after calculating a proximity threshold t that can cover 95% of the total.
[0079] 11 shows an example in which the number of data items is 300. The calculation is performed with a bin width of 0.2, and the optimum value is calculated to be 1.4 based on the result of interpolation. In this embodiment, the proximity threshold t is updated for the past 300 histories at the time when 100 authenticated histories are accumulated, but this is not limited thereto, and it may be updated every time a history is accumulated.
[0080] [Third embodiment] The third embodiment of the present invention not only determines whether or not to perform authentication based on the proximity in step S106 of the first embodiment, but also predicts the passage of user 1 through a door based on changes in the facial direction and size of the user, and determines whether or not to authenticate the user.
[0081] An example of the configuration of the entrance / exit management system 1000 according to the third embodiment is the same as that of the first embodiment in Fig. 3. The difference is that in the processes of steps S107 and S112, a condition for determining the face direction detected by the face detection unit 1110 is added.
[0082] The face direction conditions will be described with reference to the explanatory diagram of face direction determination in Fig. 12. In this embodiment, when the face faces directly ahead (yaw angle is within ±10 degrees) or toward the unlockable area 3, the face direction is determined to be toward passing through the door.
[0083] Whether or not the person is facing the unlockable area 3 is determined as follows. The face detection unit 1110 acquires the face direction angle. As shown in Fig. 12, the face detection unit 1110 draws a straight line m that passes through the center position P of the face detection frame 50 and has the same angle as the face direction roll angle r. Here, if the face direction yaw angle is toward the larger of the two regions obtained by dividing the unlockable area 3 by the line m, it is determined that the person is facing the unlockable area 3, and the face direction determination indicates that the person is heading to pass through the door.
[0084] In this embodiment, the detection result of the face direction angle is used, but the present invention is not limited to this. A similar determination may be made based on the detection result of the gaze using a gaze detection means.
[0085] (Variation 3-1) A modified example 3-1 of the entry / exit management system according to the third embodiment will be described. In modified example 3-12, a change in face size detected by the face detection unit 1110 is added as a condition in the processes of steps S107 and S112. In this modified example, whether or not the face size in the current frame is larger than the face size in the previous frame is added as a condition in the processes of steps S107 and S112, and authentication is performed only if the face size is larger. This makes it possible to reduce calculation processing costs by authenticating only faces approaching the unlockable area 3.
[0086] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.
[0087] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention.
[0088] The disclosure of this embodiment includes the following configurations and methods. (Configuration 1) An imaging means for imaging a face of a user; a display means for displaying an unlockable area by superimposing it on the image captured by the imaging means; an authentication means for authenticating the user according to a relationship between the unlockable area and the face of the user displayed by the display means; an electric lock control means for unlocking the electric lock in accordance with the authentication result of the authentication means; A setting means for setting the unlockable area to be displayed on the display means; An entrance / exit control system having the above structure. (Configuration 2) the authentication means performs authentication of the user according to a size of the user's face displayed on the display means. 2. The entrance / exit control system according to configuration 1. (Configuration 3) The authentication means authenticates the user according to a proximity between the unlockable area and the face of the user, the proximity being displayed by the display means; a proximity setting means for setting the proximity 3. The entrance / exit management system according to configuration 1 or 2. (Configuration 4) The authentication means authenticates the user according to the proximity between the unlockable area and the face of the user, which is displayed by the display means. 4. An entrance / exit management system according to any one of configurations 1 to 3. (Configuration 5) The authentication means authenticates the user when the face of the user is displayed within the unlockable area. 5. An entrance / exit management system according to any one of configurations 1 to 4. (Method 1) A photographing process of photographing the face of the user; a display step of superimposing and displaying an unlockable area on the image captured in the photographing step; an authentication step of authenticating the user according to a relationship between the unlockable area and a face of the user displayed in the display step; an electric lock control means for unlocking the electric lock in accordance with the authentication result of the authentication process; a setting step for setting the unlockable area to be displayed in the display step; The method according to claim 1, [Explanation of symbols]
[0089] 1300 PC 1100 Face Recognition Server 1200 Entrance / Exit Management Server 1210 Electric Lock 1300 Authentication Terminal
Claims
1. An imaging means for imaging a face of a user; a display means for displaying an unlockable area by superimposing it on the image captured by the imaging means; an authentication means for authenticating the user according to a relationship between the unlockable area and the face of the user displayed by the display means; an electric lock control means for unlocking the electric lock in accordance with the authentication result of the authentication means; A setting means for setting the unlockable area to be displayed on the display means; An entrance / exit control system having the above structure.
2. the authentication means performs authentication of the user according to a size of the user's face displayed on the display means. The entrance / exit management system according to claim 1.
3. The authentication means authenticates the user according to a proximity between the unlockable area and the face of the user, the proximity being displayed by the display means; a proximity setting means for setting the proximity The entrance / exit management system according to claim 1.
4. The authentication means authenticates the user according to the proximity between the unlockable area and the face of the user, which is displayed by the display means. The entrance / exit management system according to claim 1.
5. The authentication means authenticates the user when the face of the user is displayed within the unlockable area. The entrance / exit management system according to claim 1.
6. A photographing process of photographing the face of the user; a display step of superimposing and displaying an unlockable area on the image captured in the photographing step; an authentication step of authenticating the user according to a relationship between the unlockable area and a face of the user displayed in the display step; an electric lock control means for unlocking the electric lock in accordance with the authentication result of the authentication process; a setting step for setting the unlockable area to be displayed in the display step; The method according to claim 1,
Citation Information
Patent Citations
Direction searching device
JP1986051582A
Entry / exit authentication system and entry / exit authentication method
JP7075702B2
