Room entry and exit management system, information processing device, room entry and exit management method, and computer-readable recording medium
By combining ID information and facial authentication, the entry and exit room management system solves the problem of impersonation and identification of suspicious users in the prior art, realizes accurate authority determination and management of users entering the facility partition, and improves security.
Patent Information
- Application Number
- CN202311136217.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-05-31
- Filing Date
- 2023-09-04
- Publication Date
- 2024-12-03
AI Technical Summary
The prior art cannot deal with impersonating users when providing wristband terminals, and cannot determine whether suspicious users after entering the facility, especially if they have access permissions after entering the divided partition.
A room entry and exit management system is designed. By combining ID information and facial authentication, the user's authority to enter the partition is determined, and the user's attributes are determined by using the pass control, facial authentication and user judgment departments. It is divided into normal, undetermined and Three types of suspicious.
Effectively determine and manage users entering partitions in the facility to prevent impersonation, improve the accuracy and security of user attributes, and ensure the rationality of entry permissions.
Smart Images

Figure CN119068588A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a technology of an entry-exit management system for managing the entry-exit of users to divided rooms in a facility. Background Art
[0002] Patent document 1 discloses a technology related to a wristband terminal that functions as an electronic ticket. In this technology, a wristband terminal is provided to a user at a ticket office or the like. A camera is provided at the ticket office to capture a facial image of the user when the wristband terminal is provided to the user. The captured facial image is stored in a ticket authentication server together with user information and the like. Surveillance cameras are respectively provided in a plurality of areas that a user may pass through when entering a venue, capture images within each range, and send the camera images to a ticket authentication server. When it is detected that a user is wearing a wristband when going to the venue, the facial image registered in the ticket authentication server is compared with the facial image extracted from the camera image of the surveillance camera to authenticate the user.
[0003] Prior art literature
[0004] Patent Literature
[0005] Patent Document 1: Japanese Patent Application Publication No. 2015-194930 Summary of the invention
[0006] Problem that the invention aims to solve
[0007] In the technology of Patent Document 1, the user's facial image is captured when the wristband terminal is provided to the user at the ticket office, so it is impossible to deal with the situation of impersonating a user when the wristband terminal is provided. In addition, once entering the venue, it is impossible to identify a suspicious user. In this way, in the prior art, there is room for improvement in the situation of additionally determining whether a user entering a zone as a management target is a suspicious user after entering the zone.
[0008] The present disclosure has been made to solve the above-mentioned problems, and an object of the present disclosure is to provide a technique that is advantageous in that after a user who enters a partitioned section in a facility has entered the partition, it is additionally determined whether the user has entry authority to enter the section.
[0009] Means used to solve problems
[0010] The room entry and exit management system disclosed in the present invention manages the entry and exit of users according to each partition divided in the facility, and comprises: a passage control unit, which performs entry determination processing, in which whether the user can enter each partition is determined based on the ID information stored in the user's belongings; a facial authentication unit, which performs facial authentication processing, in which the user's entry into each partition is authenticated based on the user's facial image captured in the partition; and a user determination unit, which performs determination processing, in which the user attribute related to the user's entry authority to enter each partition is determined based on the result of the entry determination processing and the result of the facial authentication processing, and in the determination processing, the user determination unit performs The following processing is performed: the user attribute of the user who is determined in the entry permission determination process as the user allowed to enter the first partition and the user's entry into the first partition is authenticated in the face recognition process is determined as a normal user, the user attribute of the user who is determined in the entry permission determination process as the user allowed to enter the first partition and the user's entry into the first partition is not authenticated in the face recognition process is determined as an undetermined user, and in the case where the user is determined in the entry permission determination process as the user allowed to enter the first partition and the user's entry into the first partition is not authenticated in the face recognition process, and in the case where the user's entry into a second partition different from the first partition is authenticated in the entry permission determination process, the user attribute of the user is determined as a suspicious user.
[0011] In addition, the information processing device of the present disclosure manages the entry and exit of users according to each partition divided in the facility, and comprises: a passage control unit, which performs entry determination processing, in which whether the user can enter each partition is determined based on the ID information stored in the user's belongings; and a user determination unit, which performs determination processing, in which the user attribute related to the user's entry authority to enter each partition is determined based on the result of the facial recognition processing and the result of the entry determination processing, wherein in the facial recognition processing, the user's entry into each partition is authenticated based on the user's facial image captured in the partition, and in the determination processing, the user determination unit performs the following processing, The user attribute of a user who is determined in the entry permission determination process as being able to enter the first partition and whose entry into the first partition is authenticated in the facial recognition process is determined as a normal user, and the user attribute of a user who is determined in the entry permission determination process as being able to enter the first partition and whose entry into the first partition is not authenticated in the facial recognition process is determined as an undetermined user. In a state in which it is determined in the entry permission determination process that the user is able to enter the first partition and whose entry into the first partition is not authenticated in the facial recognition process, if the user's entry into a second partition different from the first partition is authenticated in the entry permission determination process, the user attribute of the user is determined as a suspicious user.
[0012] In addition, the room entry and exit management method disclosed in the present invention enables a computer to execute a process of managing the user's room entry and exit according to each partition divided in the facility, wherein the process comprises the following steps: performing an entry permission determination process, in which whether the user can enter each partition is determined based on the ID information stored in the user's belongings; performing a facial recognition process, in which the user's entry into each partition is authenticated based on the user's facial image captured in the partition; and performing a determination process, in which the user's attributes related to the user's entry authority to enter each partition are determined based on the result of the entry permission determination process and the result of the facial recognition process, and in the determination process, the user's attributes related to the user's entry authority to enter each partition are determined. The user attribute of a user who is determined in the entry permission determination process as being able to enter the first partition and whose entry into the first partition is authenticated in the facial recognition process is determined as a normal user; the user attribute of a user who is determined in the entry permission determination process as being able to enter the first partition and whose entry into the first partition is not authenticated in the facial recognition process is determined as an undetermined user; in a state in which it is determined in the entry permission determination process that the user is able to enter the first partition and whose entry into the first partition is not authenticated in the facial recognition process, if the user's entry into a second partition different from the first partition is authenticated in the entry permission determination process, the user attribute of the user is determined as a suspicious user.
[0013] In addition, a computer-readable recording medium of the present disclosure records a program that causes a computer to execute a process for managing the entry and exit of users according to each partition divided in a facility, wherein the program is configured to perform an entry determination process, in which whether the user can enter each partition is determined based on ID information stored in the user's belongings, perform a facial recognition process, in which the user's entry into each partition is authenticated based on the user's facial image captured in the partition, and perform a determination process, in which the user's attributes related to the user's entry authority to enter each partition are determined based on the result of the entry determination process and the result of the facial recognition process, and in the determination process, the program The sequence is constructed as follows: the user attribute of a user who is determined in the entry permission determination process as being able to enter the first partition and whose entry into the first partition is authenticated in the face recognition process is determined as a normal user; the user attribute of a user who is determined in the entry permission determination process as being able to enter the first partition and whose entry into the first partition is not authenticated in the face recognition process is determined as an undetermined user; in a state where the user is determined in the entry permission determination process as being able to enter the first partition and whose entry into the first partition is not authenticated in the face recognition process, if the user's entry into a second partition different from the first partition is authenticated in the entry permission determination process, the user attribute of the user is determined as a suspicious user.
[0014] Effects of the Invention
[0015] According to the technology of the present disclosure, it is possible to provide a technology that is advantageous in that after a user who has entered a partitioned section in a facility has entered the section, it is additionally determined whether the user has the entry authority to enter the section. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1 It is a diagram showing a configuration example of a room entry and exit management system in the embodiment.
[0017] Figure 2 It is a diagram showing a configuration example of a room entry and exit management system in the embodiment.
[0018] Figure 3 This is a flowchart for explaining the function of the ID reading unit of the first authentication device.
[0019] Figure 4 This is a flowchart for explaining the function of the ID authentication unit of the first authentication device.
[0020] Figure 5 This is a flowchart for explaining the function of the access control unit of the first authentication device.
[0021] Figure 6 This is a flowchart for explaining the function of the user determination unit of the first authentication device.
[0022] Figure 7 This is a flowchart for explaining the function of the grace time calculation unit of the first authentication device.
[0023] Figure 8 This is a flowchart for explaining the function of the map generation unit of the first authentication device.
[0024] Fig. 9 This is a flowchart for explaining the function of the facial image acquisition unit of the facial image acquisition device.
[0025] Fig.10 This is a flowchart for explaining the function of the face authentication unit of the second authentication device.
[0026] Fig.11 It is a diagram schematically showing an operation example of the room entry and exit management system.
[0027] Fig.12 FIG. 1 is a diagram showing an example of hardware resources of the first authentication device.
[0028] Fig.13 This is a diagram showing another example of hardware resources of the first authentication device.
[0029] Description of Reference Numerals
[0030] 10 first authentication device, 12 processor, 14 memory, 16 processing circuit, 18 dedicated hardware, 20 second authentication device, 30 facial image acquisition device, 40 card reader, 50 external device, 60 camera device, 100 room entry and exit management system, 101 ID reading unit, 102 ID authentication unit, 103 access control unit, 104 user determination unit, 105 grace time calculation unit, 106 map generation unit, 110 user data unit, 111 partition data unit, 201 facial authentication unit, 210 facial data unit, 301 facial image acquisition unit. DETAILED DESCRIPTION
[0031] Hereinafter, the embodiments will be described with reference to the drawings. In addition, the same reference numerals are given to common elements in the drawings, and duplicate descriptions are omitted.
[0032] Implementation method.
[0033] 1. Configuration Example of the Room Entry and Exit Management System in the Embodiment
[0034] Figure 1 and Figure 21 is a diagram showing a configuration example of a room entry and exit management system in an embodiment. The room entry and exit management system 100 is a system for managing the entry and exit of users for each partition divided in a facility such as a building. The room entry and exit management system 100 includes a first authentication device 10, a second authentication device 20, a facial image acquisition device 30, a card reader 40, an external device 50, and a camera 60. The first authentication device 10 is configured to be able to communicate with the second authentication device 20, the card reader 40, and the external device 50 via a network. The facial image acquisition device 30 is configured to be able to communicate with the second authentication device 20 via a network. The second authentication device 20 is configured to be able to communicate with the first authentication device 10 and the facial image acquisition device 30 via a network. The facial image acquisition device 30 is configured to be able to communicate with the camera 60 and the second authentication device 20 via a network.
[0035] The first authentication device 10 is an information processing device that determines the user attributes according to each partition divided within the facility. As an example, the first authentication device 10 is implemented by a server device. The first authentication device 10 is set in the same building as the building with the partition as the management object. Alternatively, the first authentication device 10 can also be set in a building different from the building. As another example, the first authentication device 10 can also be implemented by a server on the cloud. The user attributes here are attributes related to whether the users located in each partition have the entry authority to enter the partition. Specifically, the user attributes are classified into three categories: normal users with normal entry authority, undetermined users whose normal entry authority is not determined, and suspicious users who do not have normal entry authority.
[0036] The first authentication device 10 includes an ID reading unit 101 , an ID authentication unit 102 , a traffic control unit 103 , a user determination unit 104 , a grace time calculation unit 105 , a map generation unit 106 , a user data unit 110 , and a partition data unit 111 as its functional blocks.
[0037] The second authentication device 20 as a facial authentication system is a device that authenticates the user's entry into the partition based on the user's facial image captured in the partition. As an example, the second authentication device 20 is implemented by a server device in the same manner as the first authentication device 10. The second authentication device 20 can be set in a building having the partition as a management object, or in other buildings, and can also be implemented by a server on the cloud. The second authentication device 20 has a facial authentication unit 201 and a facial data unit 210 as its functional blocks.
[0038] The facial image acquisition device 30 is a device that acquires a facial image included in a camera image captured by the camera device 60 that captures the partition. As an example, the facial image acquisition device 30 is implemented by a server device. The facial image acquisition device 30 is set in the same building as the building having the partition as the management object. Alternatively, the facial image acquisition device 30 may also be set in a building different from the building. As another example, the facial image acquisition device 30 may also be implemented by a server on the cloud.
[0039] The imaging device 60 is exemplified by one or more surveillance cameras. In this case, the facial image acquisition device 30 is configured as a part of a surveillance camera system, for example. The facial image acquisition device 30 includes a facial image acquisition unit 301 as a functional block thereof.
[0040] The card reader 40 is an ID reading device that reads ID information from a user's belongings that store readable ID information. Such belongings include, for example, an ID card that stores an ID number, a portable terminal, etc. The card reader 40 is, for example, provided near the entrance to each partition. The card reader 40 is operated when the user enters the target partition corresponding to the card reader 40.
[0041] The external device 50 is a device that performs an operation based on the attributes of the user. Examples of the external device 50 include a display device that displays images, a notification device that issues an alarm, and a restriction device such as a door that restricts entry from an entrance to each section.
[0042] 2. Functions of the room entry and exit management system 100
[0043] Below, also refer to Figures 3 to 10 The functions of the room entry and exit management system 100 are described below. Figures 3 to 10 The processing of the flowchart shown represents a part of a room entry and exit management method for causing a computer to execute a method for managing the entry and exit of users for each of the divided areas within a facility.
[0044] 2-1. User Data Unit 110
[0045] The user data unit 110 functions as a storage unit for storing data for each user. The user data unit 110 stores ID information in which a unique user ID of a user and an ID number are associated with each other.
[0046] 2-2. Partition data unit 111
[0047] The partition data unit 111 functions as a storage unit for storing data for each partition. In the partition data unit 111, entry permission information, partition information, and camera information are stored for each partition. Specifically, the entry permission information is information that determines the entry permission of each user in correspondence with the user ID and is determined for each partition. The partition information is the area of the partition, the position coordinate range, the number of cameras, and information about each partition where the camera is set. The camera information is information including the position coordinates and IP addresses of the cameras set in each partition. In addition, the position coordinates here are position coordinates of the absolute position coordinate system.
[0048] 2-3. ID reading unit 101
[0049] Figure 3 This is a flowchart for explaining the function of the ID reading unit 101 of the first authentication device 10. The ID reading unit 101 executes Figure 3 The steps shown in the figure perform an ID reading process of reading the ID number of the ID card. Specifically, in step S001, the ID reading unit 101 determines whether the user has performed an operation to make the card reader 40 read the ID card. If the determination result is not established, the process of step S001 is executed again. On the other hand, if the determination result is established, the process proceeds to step S002.
[0050] In step S002 , the ID reading unit 101 obtains the ID number stored in the ID card and sends the obtained ID number to the ID authentication unit 102 in association with the partition identifier of the target partition to which the card reader 40 corresponds.
[0051] 2-4. ID authentication unit 102
[0052] Figure 4 This is a flowchart for explaining the function of the ID authentication unit 102 of the first authentication device 10. The ID authentication unit 102 executes Figure 4 In the steps shown, a user ID determination process for determining the user ID of the user is performed. In the user data unit 110, user ID information that corresponds the user's inherent user ID to the ID number is stored. Here, specifically, the ID authentication unit 102 determines whether the ID number has been obtained from the ID reading unit 101 in step S101. In the case where the determination result is not established, the process of step S101 is executed again. On the other hand, in the case where the determination is established, the process enters step S102. In step S102, the ID authentication unit 102 compares the ID number sent from the ID reading unit 101 with the user ID information of the user data unit 110, and determines the user ID corresponding to the ID number. The determined user ID is sent to the ID authentication unit 102 in correspondence with the partition identifier corresponding to the ID number.
[0053] 2-5. Traffic control unit 103
[0054] Figure 5 1 is a flowchart for explaining the function of the access control unit 103 of the first authentication device 10. When the ID authentication unit 102 identifies the user ID, the access control unit 103 executes Figure 5 In the steps shown, an entry permission determination process is performed to determine whether the user can enter the target partition. Specifically, in step S201, the passage control unit 103 refers to the entry permission information of the partition data unit 111 to confirm the entry permission corresponding to the user ID and the partition identifier obtained from the ID authentication unit 102. The confirmed entry permission is sent to the user determination unit 104 as the entry permission result corresponding to the user ID and the partition identifier in step S202.
[0055] 2-6. User determination unit 104
[0056] Figure 6 104 is a flowchart for explaining the function of the user determination unit 104 of the first authentication device 10. The user determination unit 104 executes the following operation when the entry permission result confirmed by the access control unit 103 includes a result indicating that the user can enter the target section. Figure 6 The user determination unit 104 executes Figure 6 The steps shown in the figure are used to perform the user attribute determination processing for determining the user attribute. In step S301, the user determination unit 104 determines the user attribute of the user ID included in the entry permission result as "undetermined user". In the next step S302, the user determination unit 104 measures the elapsed time from the user entering the target partition, and determines whether the elapsed time is within the grace time. The grace time here uses the value calculated by the grace time calculation unit 105 described in detail later. If the determination result is not established, the processing proceeds to step S303, and if the determination result is established, the processing proceeds to step S304.
[0057] In step S303, the user determination unit 104 determines the user attribute of the user of the user ID as a "suspicious user". In addition, in step S303, the user determination unit 104 performs a report process for issuing an alarm for notifying the existence of a suspicious user. Here, an alarm report instruction is issued to the terminals of all users, guards, managers, etc. of the zone where the suspicious user is located, which are registered in advance.
[0058] In step S304, the user determination unit 104 compares the facial authentication result obtained from the facial authentication unit 201 of the second authentication device 20 described in detail later with the facial authentication result of the user located in the target partition, and determines whether the user ID of the user determined as an unidentified user in step S301 is correctly facially authenticated in the facial authentication result. If the determination result is not established, the process proceeds to step S305.
[0059] In step S305, the user determination unit 104 determines whether the user has operated the card reader 40 corresponding to a partition different from the target partition. Here, the user determination unit 104 determines whether the user ID of the user corresponding to the different partition identifier has been obtained from the ID authentication unit 102. In the case where the determination result is not established, the process enters step S302 again. On the other hand, in the case where the determination result is established, it can be determined that the user has not been determined to move to the entrance of another partition. In this case, the process enters step S303, and the user attribute of the user of the user ID is determined to be a "suspicious user".
[0060] If the result of determination in step S304 is positive, the process proceeds to step S306. In step S306, the user determination unit 104 determines that the user attribute of the user of the user ID is a "normal user".
[0061] 2-7. Grace Time Calculation Unit 105
[0062] Figure 7 1 is a flowchart for explaining the function of the grace time calculation unit 105 of the first authentication device 10. The grace time calculation unit 105 executes Figure 7 The grace time setting process of setting the grace time is performed according to the steps shown in FIG. 401. In step S401, the grace time calculation unit 105 calculates the grace time based on the partition information stored in the partition data unit 111. Here, for example, the larger the area of the partition, the longer the grace time is set. Alternatively, the more the number of cameras as the camera device 60 is, the shorter the grace time is set. In step S402, the grace time calculation unit 105 sends the calculated grace time to the user determination unit 104.
[0063] 2-8. Map Generation Unit 106
[0064] Figure 8 is a flowchart for explaining the function of the map generation unit 106 of the first authentication device 10. The map generation unit 106 executes Figure 8In the steps shown, a map generation process is performed to generate a heat map that visualizes the user's location and user attributes on a partition map. In step S501, the map generation unit 106 determines whether a heat map generation request is issued from the first authentication device 10. The heat map generation request includes information that specifies the partition for generating the heat map and the output destination. If the determination result is established, the process proceeds to step S502, and if the determination result is not established, the process proceeds to step S503.
[0065] In step S502, the map generation unit 106 generates a heat map obtained by plotting the user attributes of each user by distinguishing by color or the like at the position coordinates of all users located in the block on the block map requested in the heat map generation request. The position coordinates of each user are the position coordinates of the camera 60 that has captured the user in the facial image acquisition process described later. The generated heat map is published to the output destination requested by the heat map generation request.
[0066] In step S503, the map generation unit 106 determines whether a warning regarding the presence of a suspicious user has been issued by the user determination unit 104. If the determination result is affirmative, the process proceeds to step S504, and if the determination result is not affirmative, the process returns to step S501 again.
[0067] In step S504, the map generation unit 106 generates a heat map by plotting the user attributes of each user at the positions of all users in the zone where the suspicious user to be the alarm target is located by distinguishing them by color, etc. The generated heat map is distributed to the pre-registered portable terminals, etc. of the users, guards, managers, etc. in the zone.
[0068] 2-9. Facial Image Acquisition Unit 301
[0069] Fig. 9 FIG. 2 is a flowchart for explaining the functions of the facial image acquisition unit 301 of the facial image acquisition device 30. The facial image acquisition unit 301 executes Fig. 9601, the facial image acquisition processing of acquiring a facial image from the camera image of the camera device 60 is performed. In step S601, the facial image acquisition unit 301 acquires the camera image of the camera device 60. In the next step S602, the facial image acquisition unit 301 determines whether the facial image included in the acquired camera image is detected using a well-known image recognition technology. In addition, the facial image detection method is not limited. In the case where the determination result is not established, the processing moves to step S601 again, and in the case where the determination result is established, the processing enters step S603. In step S603, the facial image acquisition unit 301 sends the facial image data obtained by matching the camera information of the camera device 60 that has taken the image with the detected facial image to the facial authentication unit 201 of the second authentication device 20.
[0070] 2-10. Facial data unit 210
[0071] The face data unit 210 functions as a storage unit for storing data. The face data unit 210 stores face information in which a face image of a user captured in advance is associated with each user ID.
[0072] 2-11. Face Authentication Unit 201
[0073] Fig.10 2 is a flowchart for explaining the function of the face authentication unit 201 of the second authentication device 20. The face authentication unit 201 executes Fig.10 In the steps shown, a facial authentication process is performed to determine whether the facial image acquired by the facial image acquisition device 30 is a facial authentication process of a user to whom a user ID is assigned. In step S701, the facial authentication unit 201 determines whether facial image data is received from the facial image acquisition device 30. If the determination result is not established, the process returns to step S701 again. On the other hand, if the determination result is established, the process proceeds to step S702.
[0074] In step S702, the facial authentication unit 201 compares the facial image data from the facial image acquisition device 30 with the facial information stored in the facial data unit 210, and searches the facial information for a facial image of the same person as the facial image in the facial image data. Then, the facial authentication unit 201 sends the facial authentication result obtained by matching the camera information with the user ID of the facial image that has been successfully matched to the user determination unit 104 of the first authentication device 10. In this way, according to the facial authentication process, the user corresponding to the facial image captured by the facial image acquisition process is authenticated to have entered the captured partition.
[0075] 3. Operation Example of the Room Entry and Exit Management System According to the Embodiment
[0076] Next, several operation examples executed in the room entry and exit management system 100 of the present embodiment will be described. Fig.11 : is a diagram schematically showing an operation example of the room entry and exit management system 100. In the example shown in the figure, the building to which the room entry and exit management system 100 is applied is divided into a first zone S1 and a second zone S2. Each zone S1, S2 has an entrance G1, G2 for entering the zone. Restriction devices for restricting users from entering the zones S1, S2 are provided at the entrances G1, G2. In addition, card readers 40 are provided near the entrances G1, G2, respectively. In the rooms of each zone S1, S2, a plurality of cameras 60 for photographing the interior of the zone are provided, respectively. In addition, in Fig.11 In the example above, locations are defined in an XY coordinate system within a building. Floors can also be further defined in a Z coordinate system within a building.
[0077] 3-1. First action example
[0078] In the first operation example, the room entry and exit management system 100 determines the user attribute of the user H1 who enters the first partition S1. First, when the user H1 reads the ID card in the card reader 40 corresponding to the first partition S1, the ID reading unit 101 performs the ID reading process to obtain the ID number of the user H1. Then, the ID authentication unit 102 performs the user ID determination process to determine the user ID corresponding to the ID number of the user H1.
[0079] The determined user ID of the user H1 is sent to the access control unit 103 in correspondence with the partition identifier of the first partition S1. The access control unit 103 performs entry permission determination processing to confirm whether the user H1 has the entry permission right to enter the first partition S1. The confirmed entry permission is sent to the user determination unit 104 as an entry permission result corresponding to the user ID and the partition identifier.
[0080] The user determination unit 104 performs a user attribute determination process to determine the attribute of the user H1. Here, when the entry permission result includes a result indicating that the user H1 can enter, the user determination unit 104 determines the user attribute of the user H1 as "unconfirmed user" in the entry permission determination process. On the other hand, when the entry permission result includes a result indicating that the user H1 cannot enter, the user determination unit 104 determines the user attribute of the user H1 as "suspicious user" in the entry permission determination process.
[0081] When the user H1 is determined as an "unconfirmed user", the user H1 can enter the first partition S1. Here, for example, the entrance G1 of the first partition S1 is unlocked. On the other hand, when the user H1 is determined as a "suspicious user", for example, the restriction device of the entrance G1 of the first partition S1 is operated to restrict the user H1 from entering the first partition S1.
[0082] The facial image acquisition unit 301 performs facial image acquisition processing to acquire a facial image from the camera image of the camera device 60 installed in the first zone S1. When the user H1 enters the first zone S1 as an "undetermined user", the camera device 60 captures the user H1, thereby also acquiring the facial image of the user H1 in the facial image acquisition processing. The facial image acquisition unit 301 transmits facial image data obtained by associating the camera information of the camera device 60 that captured the image with the detected facial image of the user H1 to the facial authentication unit 201 of the second authentication device 20.
[0083] The facial authentication unit 201 performs facial authentication processing to determine whether the user H1 is a user assigned a user ID. If the determination is successful, the facial authentication unit 201 sends a facial authentication result in which the camera information is associated with the user ID of the user H1 to the user determination unit 104 of the first authentication device 10.
[0084] The user determination unit 104 performs a user attribute determination process to determine the user attribute of the user H1. In the user attribute determination process, if the face authentication result of the user H1 is received before the time elapsed from the user H1 entering the first section S1 exceeds the grace period, the user determination unit 104 determines the user attribute of the user H1 as a "normal user". On the other hand, if the face authentication result of the user H1 is not received and the time elapsed exceeds the grace period, the user determination unit 104 determines that there is a possibility that the user H1 is impersonating another person and determines that the user H1 is a "suspicious user", and issues an alarm.
[0085] Furthermore, in the user attribute determination process, when the user H1 causes the card reader 40 corresponding to the second partition S2 to read the ID card without receiving the face authentication result of the user H1, the user determination unit 104 determines that there is a possibility that the action of the user H1 is suspicious and determines that the user H1 is a "suspicious user". Furthermore, at this time, the user determination unit 104 operates the restriction device of the entrance G2 of the second partition S2 to restrict entry from the entrance G2 and issues an alarm.
[0086] According to the first operation example of the room entry and exit management system 100 described above, the user H1 who has become an "unconfirmed user" who can enter the first partition S1 through the entry permission determination process based on the user ID can be additionally authenticated through the face recognition process after entering the first partition S1. In this way, it is possible to prevent user impersonation and accurately grasp whether the user H1 is a "normal user" or a "suspicious user".
[0087] Furthermore, the camera device 60 used for the face authentication process can use a camera installed in the first zone S1 for the purpose of security or surveillance, so that the system for the face authentication process can be constructed at low cost.
[0088] 3-2. Second action example
[0089] In the second action example, the room entry and exit management system 100 calculates the grace time based on the partition information of the first partition S1. The grace time calculation unit 105 performs the grace time setting process to calculate the grace time. In the facial image acquisition process of the facial image acquisition unit 301, the larger the range of the first partition S1 or the narrower the camera range of the camera device 60, the less the chance of acquiring the user's facial image. In the grace time setting process, the partition information of the first partition S1 is used to calculate the grace time corresponding to the chance of acquiring the user's facial image. According to the room entry and exit management system 100 of the second action example, it is possible to reduce erroneous judgments in the user attribute judgment process.
[0090] 3-3. Third action example
[0091] In the third action example, the room entry and exit management system 100 creates a heat map that visualizes the locations and user attributes of multiple users in the first partition S1. The map generation unit 106 receives a request to create a heat map, executes a map generation process, and creates a heat map. In the map generation process, the map generation unit 106 obtains the position coordinates of the camera device 60 that photographed each user from the camera information included in the facial recognition results of each user located in the first partition S1, as the position coordinates of each user. The map generation unit 106 plots the user attributes of each user determined by the user attribute determination process at the obtained position coordinates of each user on the map of the first partition S1 in a manner that visually distinguishes them, thereby generating a heat map. The generated heat map is published to pre-registered portable terminals, etc., of users, guards, managers, etc. located in the partition.
[0092] According to the third operation example of the room entry and exit management system 100 described above, the position and user attributes of users in each zone can be visually grasped, thereby improving the efficiency of monitoring users in each zone and promoting safe behavior of users.
[0093] 4. Modifications
[0094] The room entry and exit management system 100 of the present embodiment may adopt the following modified forms.
[0095] 4-1. Hardware resources of the room entry and exit management system 100
[0096] Fig.12 1 is a diagram showing an example of hardware resources of the first authentication device 10. The first authentication device 10 includes a processing circuit 16 including a processor 12 and a memory 14 as hardware resources. The processing circuit 16 may include a plurality of processors 12. The processing circuit 16 may include a plurality of memories 14.
[0097] In this embodiment, the components indicated by reference numerals 101 to 111 represent functions of the first authentication device 10. The functions of the user data unit 110 and the partition data unit 111 as storage units are implemented by the memory 14. The functions of the components indicated by reference numerals 101 to 111 can be implemented by software, firmware, or a combination of software and firmware described in the form of a program. The program is stored in the memory 14. Alternatively, the program may be recorded in a computer-readable recording medium. The first authentication device 10 implements the functions of the components indicated by reference numerals 101 to 111 by executing the program stored in the memory 14 by the processor 12 (computer).
[0098] The processor 12 is also called a CPU (Central Processing Unit), a central processing device, a processing device, an arithmetic device, a microprocessor, a microcomputer, or a DSP. As the memory 14, a semiconductor memory, a magnetic disk, a floppy disk, an optical disk, a high-density disk, a mini disk, or a DVD may also be used. The semiconductor memory that can be used includes a RAM, a ROM, a flash memory, an EPROM, an EEPROM, and the like.
[0099] Fig.13 FIG. 1 is a diagram showing another example of hardware resources of the first authentication device 10. Fig.13 In the example shown, the first authentication device 10 includes a processing circuit 16 including a processor 12 , a memory 14 , and dedicated hardware 18 . Fig.13 The example in which a part of the functions of the first authentication device 10 is implemented by the dedicated hardware 18 is shown. All the functions of the first authentication device 10 may be implemented by the dedicated hardware 18. As the dedicated hardware 18, a single circuit, a complex circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof can be used.
[0100] The hardware resources of the second authentication device 20 are Fig.12 or Fig.13 The second authentication device 20 has a processing circuit including a processor and a memory as hardware resources. The second authentication device 20 implements the functions of the components shown in reference numerals 201 and 202 by executing a program stored in the memory by the processor. The second authentication device 20 may also have a processing circuit including a processor, a memory, and dedicated hardware as hardware resources. Part or all of the functions of the second authentication device 20 may also be implemented by dedicated hardware.
[0101] The hardware resources of the facial image acquisition device 30 are Fig.12 or Fig.13 The facial image acquisition device 30 is the same as the example shown. The facial image acquisition device 30 has a processing circuit including a processor and a memory as hardware resources. The facial image acquisition device 30 implements the function shown by reference numeral 301 by executing a program stored in the memory by the processor. The facial image acquisition device 30 may also have a processing circuit including a processor, a memory and dedicated hardware as hardware resources. It is also possible to implement a part or all of the functions of the facial image acquisition device 30 by dedicated hardware.
[0102] In addition, the room entry and exit management system 100 may also mount all or part of the functions of the first authentication device 10 on the second authentication device 20 or the facial image acquisition device 30 .
[0103] 4-2. Facial image acquisition device 30
[0104] The facial image acquisition device 30 may use a terminal device with a camera held by a user in the partition as the imaging device 60. As such a terminal device, for example, a smart phone is exemplified. When the imaging device 60 is a terminal device with a camera that can acquire position coordinates of an absolute coordinate system, the facial image acquisition unit 301 performs facial image acquisition processing to acquire a facial image from a camera image captured by the terminal device with a camera.
[0105] Typically, in Fig. 9 In step S601 shown, the facial image acquisition unit 301 acquires a camera image of the camera device 60 held by the user in the partition. In the next step S602, the facial image acquisition unit 301 determines whether the facial image included in the acquired camera image is detected using a known image recognition technology. If the determination result is not established, the process moves to step S601 again, and if the determination result is established, the process enters step S602. In step S602, the facial image acquisition unit 301 sends the facial image data obtained by matching the position coordinates of the terminal device with the camera with the detected facial image to the facial authentication unit 201 of the second authentication device 20.
[0106] According to the structure of the face image acquisition device 30 of such a modified example, even when there is no permanent camera in the partition, it is possible to perform face image acquisition processing and face authentication processing. In addition, the user's position coordinates can be acquired more accurately than with a permanent fixed camera based on the terminal device with a camera held by the user, thereby improving the accuracy of the user attribute determination processing and the accuracy of the map generation processing.
[0107] 4-3. Camera device 60
[0108] The camera device 60 configured in the partition can be any structure capable of photographing the face of the user in the partition, and its number and configuration are not limited. In addition, regarding the camera device 60, a terminal device with a camera held by the user in the partition and a surveillance camera fixedly arranged in the partition can also be mixed.
[0109] 4-4. User determination unit 104
[0110] If the result of the determination in step S305 is positive, the restriction device at the entrance of another partition may be operated in step S303 to restrict entry from the entrance. In addition, the reporting of the alarm in step S303 is not an essential process.
[0111] 4-5. Report processing
[0112] There is no limitation on the reporting method of the reporting process performed by the user determination unit 104. That is, in the reporting process, a warning sound or a warning announcement may be issued, or a warning message may be displayed.
[0113] 5. Others
[0114] As mentioned above, although the preferred embodiments and the like have been described in detail, the present disclosure is not limited to the above-mentioned embodiments and the like, and various modifications and substitutions can be made to the above-mentioned embodiments and the like without departing from the scope described in the claims.
[0115] Hereinafter, various aspects of the present disclosure are collectively described in the form of supplementary notes.
[0116] (Note 1)
[0117] A room entry and exit management system manages the entry and exit of users according to each partition in a facility, wherein:
[0118] The room entry and exit management system has:
[0119] a traffic control unit that performs an entry permission determination process in which it is determined whether the user can enter each of the sections based on ID information stored in the user's belongings;
[0120] a facial authentication unit that performs facial authentication processing in which entry of the user into each of the partitions is authenticated based on a facial image of the user captured within the partitions; and
[0121] a user determination unit that performs determination processing in which a user attribute related to the user's entry authority to enter each of the partitions is determined based on a result of the entry permission determination processing and a result of the face authentication processing;
[0122] In the determination process, the user determination unit performs the following processing:
[0123] determining the user attribute of the user who is determined to be allowed to enter the first partition in the entry permission determination process and whose entry into the first partition is authenticated in the face authentication process as a normal user,
[0124] determining the user attribute of a user who is determined as being allowed to enter the first partition in the entry permission determination process and whose entry into the first partition is not authenticated in the face authentication process as an undetermined user,
[0125] In a state where it is determined in the entry permission determination process that the user can enter the first partition and the user's entry into the first partition is not authenticated in the facial recognition process, if in the entry permission determination process the user's entry into a second partition different from the first partition is authenticated, the user attribute of the user is determined to be a suspicious user.
[0126] (Note 2)
[0127] According to the room entry and exit management system described in Supplement 1,
[0128] In the determination process, the user determination unit reports when the user attribute is determined to be the suspicious user.
[0129] (Note 3)
[0130] According to the room entry and exit management system described in Appendix 1 or 2,
[0131] The room entry and exit management system is provided with a restriction device for restricting entry into the second partition.
[0132] In the determination process, when the user attribute is determined to be the suspicious user, the user determination unit restricts access to the second zone by the restriction device.
[0133] (Note 4)
[0134] A room entry and exit management system according to any one of Annexes 1 to 3, wherein:
[0135] In the determination process, the user determination unit performs the following processing:
[0136] When it is determined in the entry permission determination process that the user can enter the first section and a grace period has elapsed while the user's entry into the first section is not authenticated in the face authentication process, the user attribute of the user is determined as the suspicious user.
[0137] (Note 5)
[0138] According to the room entry and exit management system described in Supplement 4,
[0139] The room entry and exit management system further includes a grace time calculation unit configured to set the grace time based on the partition information of the first partition.
[0140] (Note 6)
[0141] According to any one of the appendixes 1 to 5, the room entry and exit management system,
[0142] The room entry and exit management system has:
[0143] a partition data unit storing access permission information for determining whether a user can access each partition; and
[0144] An ID reading device is provided corresponding to the first partition and reads the ID information from the held object.
[0145] In the entry permission determination process, the user determination unit determines whether a user corresponding to the ID information read by the ID reading device can enter the first section based on the entry permission information.
[0146] (Note 7)
[0147] The room entry and exit management system according to any one of Notes 1 to 6, wherein:
[0148] The room entry and exit management system has:
[0149] a facial data unit storing facial information in which the user ID of each user is associated with the facial image of each user; and
[0150] a camera device for capturing a face of a user located in the first zone,
[0151] In the facial authentication process, the facial authentication unit searches for a facial image of the same person as the facial image captured by the camera device from the facial information stored in the facial data unit, and authenticates entry into the first partition for the user with the user ID corresponding to the searched facial image.
[0152] (Note 8)
[0153] According to the room entry and exit management system described in Supplement 7,
[0154] The camera device includes one or more surveillance cameras arranged in the first partition.
[0155] (Note 9)
[0156] The room entry and exit management system according to Appendix 7 or 8, wherein:
[0157] The imaging device includes a portable terminal with a camera held by a user located in the first zone.
[0158] (Note 10)
[0159] A room entry and exit management system according to any one of Annexes 1 to 9, wherein:
[0160] The room entry and exit management system further includes a map generating unit that generates a heat map that visualizes the user attributes at the position coordinates on the map of the first section based on the position coordinates where the facial image is captured and the user attributes determined in the determination process.
[0161] (Note 11)
[0162] According to the room entry and exit management system described in Supplement 10,
[0163] The map generation section distributes the heat map generated in the map generation section to an output destination.
[0164] (Note 12)
[0165] An information processing device that manages the entry and exit of users for each partition in a facility, wherein:
[0166] The information processing device comprises:
[0167] a traffic control unit that performs an entry permission determination process in which it is determined whether the user can enter each of the sections based on ID information stored in the user's belongings; and
[0168] a user determination unit that performs determination processing in which a user attribute related to the user's entry authority to each of the partitions is determined based on a result of a facial authentication process and a result of the entry permission determination process, wherein in the facial authentication process, the entry of the user into each of the partitions is authenticated based on a facial image of the user captured in the partitions,
[0169] In the determination process, the user determination unit performs the following processing:
[0170] determining the user attribute of the user who is determined to be allowed to enter the first partition in the entry permission determination process and whose entry into the first partition is authenticated in the face authentication process as a normal user,
[0171] determining the user attribute of a user who is determined as being allowed to enter the first partition in the entry permission determination process and whose entry into the first partition is not authenticated in the face authentication process as an undetermined user,
[0172] In a state where it is determined in the entry permission determination process that the user can enter the first partition and the user's entry into the first partition is not authenticated in the facial recognition process, if in the entry permission determination process the user's entry into a second partition different from the first partition is authenticated, the user attribute of the user is determined to be a suspicious user.
[0173] (Note 13)
[0174] A room entry and exit management method is provided, which causes a computer to execute a process of managing the entry and exit of users for each partition divided in a facility, wherein:
[0175] The in-and-out management method comprises the following steps:
[0176] performing an entry permission determination process in which it is determined whether the user can enter each of the partitions based on ID information stored in the user's belongings;
[0177] performing a facial authentication process in which entry of the user into each of the partitions is authenticated based on a facial image of the user captured within the partition; and
[0178] performing a determination process in which a user attribute related to the user's entry authority to enter each of the partitions is determined based on a result of the entry permission determination process and a result of the face authentication process,
[0179] In the determination process,
[0180] determining the user attribute of the user who is determined to be allowed to enter the first partition in the entry permission determination process and whose entry into the first partition is authenticated in the face authentication process as a normal user,
[0181] determining the user attribute of a user who is determined as being allowed to enter the first partition in the entry permission determination process and whose entry into the first partition is not authenticated in the face authentication process as an undetermined user,
[0182] In a state where it is determined in the entry permission determination process that the user can enter the first partition and the user's entry into the first partition is not authenticated in the facial recognition process, if in the entry permission determination process the user's entry into a second partition different from the first partition is authenticated, the user attribute of the user is determined to be a suspicious user.
[0183] (Note 14)
[0184] A computer-readable recording medium having a program recorded thereon, the program causing a computer to execute a process for managing the entry and exit of users for each partition divided within a facility, wherein:
[0185] The program is composed of:
[0186] performing an entry permission determination process in which it is determined whether the user can enter each of the partitions based on the ID information stored in the user's belongings,
[0187] performing a facial authentication process in which the user's entry into each of the partitions is authenticated based on a facial image of the user captured within the partitions,
[0188] performing a determination process in which a user attribute related to the user's entry authority to enter each of the partitions is determined based on a result of the entry permission determination process and a result of the face authentication process,
[0189] In the determination process, the program is configured as follows:
[0190] determining the user attribute of the user who is determined to be allowed to enter the first partition in the entry permission determination process and whose entry into the first partition is authenticated in the face authentication process as a normal user,
[0191] determining the user attribute of a user who is determined as being allowed to enter the first partition in the entry permission determination process and whose entry into the first partition is not authenticated in the face authentication process as an undetermined user,
[0192] In a state where it is determined in the entry permission determination process that the user can enter the first partition and the user's entry into the first partition is not authenticated in the facial recognition process, if in the entry permission determination process the user's entry into a second partition different from the first partition is authenticated, the user attribute of the user is determined to be a suspicious user.
Claims
1. A room entry and exit management system that manages the entry and exit of users according to each partition in a facility, wherein: The room entry and exit management system has: a traffic control unit that performs an entry permission determination process in which it is determined whether the user can enter each of the sections based on ID information stored in the user's belongings; a facial authentication unit that performs facial authentication processing in which entry of the user into each of the partitions is authenticated based on a facial image of the user captured within the partitions; as well as a user determination unit that performs determination processing in which a user attribute related to the user's entry authority to enter each of the partitions is determined based on a result of the entry permission determination processing and a result of the face authentication processing; In the determination process, the user determination unit performs the following processing: determining the user attribute of the user who is determined to be allowed to enter the first partition in the entry permission determination process and whose entry into the first partition is authenticated in the face authentication process as a normal user, determining the user attribute of a user who is determined as being allowed to enter the first partition in the entry permission determination process and whose entry into the first partition is not authenticated in the face authentication process as an undetermined user, In a state where it is determined in the entry permission determination process that the user can enter the first partition and the user's entry into the first partition is not authenticated in the facial recognition process, if in the entry permission determination process the user's entry into a second partition different from the first partition is authenticated, the user attribute of the user is determined to be a suspicious user.
2. The room entry and exit management system according to claim 1, wherein: In the determination process, the user determination unit reports when the user attribute is determined to be the suspicious user.
3. The room entry and exit management system according to claim 1 or 2, wherein: The room entry and exit management system is provided with a restriction device for restricting entry into the second partition. In the determination process, when the user attribute is determined to be the suspicious user, the user determination unit restricts access to the second zone by the restriction device.
4. The room entry and exit management system according to claim 1 or 2, wherein: In the determination process, the user determination unit performs the following processing: When it is determined in the entry permission determination process that the user can enter the first section and a grace period has elapsed while the user's entry into the first section is not authenticated in the face authentication process, the user attribute of the user is determined as the suspicious user.
5. The room entry and exit management system according to claim 4, wherein: The room entry and exit management system further includes a grace time calculation unit configured to set the grace time based on the partition information of the first partition.
6. The room entry and exit management system according to claim 1 or 2, wherein: The room entry and exit management system has: a partition data unit storing access permission information for determining whether a user can access each partition; as well as An ID reading device is provided corresponding to the first partition and reads the ID information from the held object. In the entry permission determination process, the user determination unit determines whether a user corresponding to the ID information read by the ID reading device can enter the first section based on the entry permission information.
7. The room entry and exit management system according to claim 1 or 2, wherein: The room entry and exit management system has: a facial data unit storing facial information in which the user ID of each user is associated with the facial image of each user; and a camera device for capturing a face of a user located in the first zone, In the facial authentication process, the facial authentication unit searches for a facial image of the same person as the facial image captured by the camera device from the facial information stored in the facial data unit, and authenticates entry into the first partition for the user with the user ID corresponding to the searched facial image.
8. The room entry and exit management system according to claim 7, wherein: The camera device includes one or more surveillance cameras arranged in the first partition.
9. The room entry and exit management system according to claim 7 or 8, wherein: The imaging device includes a portable terminal with a camera held by a user located in the first zone.
10. The room entry and exit management system according to claim 1 or 2, wherein: The room entry and exit management system further includes a map generating unit that generates a heat map that visualizes the user attributes at the position coordinates on the map of the first section based on the position coordinates where the facial image is captured and the user attributes determined in the determination process.
11. The room entry and exit management system according to claim 10, wherein: The map generation section distributes the heat map generated in the map generation section to an output destination.
12. An information processing device that manages the entry and exit of users for each partition in a facility, wherein: The information processing device comprises: a traffic control unit that performs an entry permission determination process in which it is determined whether the user can enter each of the sections based on ID information stored in the user's belongings; as well as a user determination unit that performs determination processing in which a user attribute related to the user's entry authority to each of the partitions is determined based on a result of a facial authentication process and a result of the entry permission determination process, wherein in the facial authentication process, the entry of the user into each of the partitions is authenticated based on a facial image of the user captured in the partitions, In the determination process, the user determination unit performs the following processing: determining the user attribute of the user who is determined to be allowed to enter the first partition in the entry permission determination process and whose entry into the first partition is authenticated in the face authentication process as a normal user, determining the user attribute of a user who is determined as being allowed to enter the first partition in the entry permission determination process and whose entry into the first partition is not authenticated in the face authentication process as an undetermined user, In a state where it is determined in the entry permission determination process that the user can enter the first partition and the user's entry into the first partition is not authenticated in the facial recognition process, if in the entry permission determination process the user's entry into a second partition different from the first partition is authenticated, the user attribute of the user is determined to be a suspicious user.
13. A room entry and exit management method, which causes a computer to execute a process of managing the entry and exit of users for each partition divided in a facility, wherein: The in-and-out management method comprises the following steps: performing an entry permission determination process in which it is determined whether the user can enter each of the partitions based on ID information stored in the user's belongings; performing a facial authentication process in which entry of the user into each of the partitions is authenticated based on a facial image of the user captured within the partition; as well as performing a determination process in which a user attribute related to the user's entry authority to enter each of the partitions is determined based on a result of the entry permission determination process and a result of the face authentication process, In the determination process, determining the user attribute of the user who is determined to be allowed to enter the first partition in the entry permission determination process and whose entry into the first partition is authenticated in the face authentication process as a normal user, determining the user attribute of a user who is determined as being allowed to enter the first partition in the entry permission determination process and whose entry into the first partition is not authenticated in the face authentication process as an undetermined user, In a state where it is determined in the entry permission determination process that the user can enter the first partition and the user's entry into the first partition is not authenticated in the facial recognition process, if in the entry permission determination process the user's entry into a second partition different from the first partition is authenticated, the user attribute of the user is determined to be a suspicious user.
14. A computer-readable recording medium having a program recorded thereon, the program causing a computer to execute a process for managing the entry and exit of users for each partition divided within a facility, wherein: The program is composed of: performing an entry permission determination process in which it is determined whether the user can enter each of the partitions based on the ID information stored in the user's belongings, performing a facial authentication process in which the user's entry into each of the partitions is authenticated based on a facial image of the user captured within the partitions, performing a determination process in which a user attribute related to the user's entry authority to enter each of the partitions is determined based on a result of the entry permission determination process and a result of the face authentication process, In the determination process, the program is configured as follows: determining the user attribute of the user who is determined to be allowed to enter the first partition in the entry permission determination process and whose entry into the first partition is authenticated in the face authentication process as a normal user, determining the user attribute of a user who is determined as being allowed to enter the first partition in the entry permission determination process and whose entry into the first partition is not authenticated in the face authentication process as an undetermined user, In a state where it is determined in the entry permission determination process that the user can enter the first partition and the user's entry into the first partition is not authenticated in the facial recognition process, if in the entry permission determination process the user's entry into a second partition different from the first partition is authenticated, the user attribute of the user is determined to be a suspicious user.
Citation Information
Patent Citations
Information processing device and information processing system
JP2015194930A
