Entrance / exit management system, entrance / exit management device, and entrance / exit management method

Abstract

To provide an entry / exit management system, an entry / exit management device, and an entry / exit management method for allowing a last exiting person remaining in facilities or the like to exit when operation not allowing single exit from the facilities or the like is performed.SOLUTION: In an entry / exit management system, an entry / exit management device 10 authenticates an employee card A1 based on data of the employee card A1 held over by an employee A at the time of a final exit when an attendance mode is shifted to a remote attendance mode, and authenticates a card R1 for a remote attendance based on the data of the card R1 for the remote attendance held over by a remote attendant person R of a remote attendant center acquired through a remote attendant device 80. When the employee card A1 and the card R1 for the remote attendance are valid, unlocking control of an electronic lock 30 is performed.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an entrance / exit management system, an entrance / exit management device, and an entrance / exit management method that allow the last person remaining in a facility to exit when the facility does not allow individuals to leave alone. [Background technology]

[0002] Conventionally, strict entrance and exit management has been implemented in facilities requiring extremely strict security, such as data centers and development laboratories. For example, Patent Document 1 discloses a gate management system that performs an authentication process to authenticate a person when the person moves from a first area to a second area in the facility, and an inspection process to inspect any baggage carried by the person.

[0003] In such cases, facilities requiring particularly strict security may adopt two-person authentication, which requires authentication by another person when entering or leaving the facility. For example, there is a known system in which when person A tries to leave a facility, he or she must not only hold the card given to him or her over the reader, but also hold the card given to another person, person B, over the reader in order for the door to be unlocked. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2020-129235 Summary of the Invention [Problem to be solved by the invention]

[0005] However, with such a conventional system, if there is one person left in the facility, that person may be left behind and become trapped in the facility. This situation can occur particularly in an environment where it is not possible to grasp the number of people remaining in the facility, or when one person has to remain behind due to work reasons.

[0006] For this reason, when a facility is operated in a way that does not allow individuals to leave alone, how to ensure that the last person remaining in the facility can leave is an important issue. This issue arises not only when exiting various facilities, but also when exiting a mobile object, etc.

[0007] The present invention has been made to solve the problems (issues) associated with the above-mentioned conventional technology, and aims to provide an entry / exit management system, an entry / exit management device, and an entry / exit management method that enable the last person remaining in a facility to exit to exit when operations do not allow individuals to exit the facility alone. [Means for solving the problem]

[0008] In order to solve the above-mentioned problems and achieve the object, the present invention provides an entrance / exit management system having an entrance / exit management device that, when a user located in a predetermined facility leaves the facility, unlocks a lock on a door of the facility to allow the user to leave the facility, on the condition that both a first medium carried by the user and a second medium carried by an attendant who witnesses the user's exit from the facility have been legitimately authenticated, and the entrance / exit management device is configured to switch from an attendance mode in which the attendant is present to a remote attendance mode in which a predetermined remote attendant is present. the remote witness is provided with a switching control means for authenticating whether the first medium, the second medium or the third medium held by the remote witness is legitimate; an authentication means for authenticating whether the first medium, the second medium or the third medium held by the remote witness is legitimate; a determination means for determining whether the user who will be the last person to leave the facility is able to leave based on at least the authentication results of the first medium and the third medium by the authentication means when the switching control means controls to switch to the remote witness mode; and a control means for controlling the lock on the door of the facility to be unlocked when the determination means determines that the user is able to leave.

[0009] In addition, the present invention is characterized in that, in the above invention, it has a remote attendance device communicatively connected to the entry / exit management device, and the remote attendance device has a communication means that enables communication with the user within the facility when controlled to switch to the remote attendance mode, and an authentication request means that requests the entry / exit management device to authenticate the third medium.

[0010] In the present invention, the switching control means controls switching from the witness mode to the remote witness mode when a predetermined operation by the witness is received.

[0011] In addition, in the above invention, the present invention is characterized in that the switching control means controls switching from the attendance mode to the remote attendance mode when the user is the last person to leave the facility and no other users are present in the facility.

[0012] Furthermore, in the present invention, the switching control means controls switching from the remote attendance mode to the attendance mode when the attendant enters the facility.

[0013] In addition, in the above invention, the present invention is characterized in that the entry and exit management device further includes a schedule management means for managing a schedule for remote attendance by the remote attendant, and the switching control means controls switching from the attendance mode to the remote attendance mode based on the schedule managed by the schedule management means.

[0014] In addition, in the above invention, the switching control means controls switching from the attendance mode to the remote attendance mode when there is no response from the witness after a predetermined period of time has elapsed since the user made a attendance request to the witness.

[0015] In addition, the present invention is characterized in that, in the above invention, the remote attendance device further comprises an image acquisition means for acquiring an image of the user, a calculation means for inputting the image of the user acquired by the image acquisition means into a predetermined trained model and calculating a risk score that will arise when the user is allowed to leave the premises based on an output value output from the trained model, and a display control means for controlling the display of the risk score calculated by the calculation means on a predetermined display unit.

[0016] Furthermore, in the above invention, the present invention is characterized in that the trained model is a trained model obtained by performing supervised learning on a predetermined multilayer neural network using multiple images capturing legitimate and fraudulent behavior of the user and correct answer data for legitimate or fraudulent behavior as training data.

[0017] The present invention also provides an entry / exit management device that, when a user located within a specified facility leaves the facility, unlocks a lock on the door of the facility, allowing the user to leave the facility, provided that both a first medium carried by the user and a second medium carried by an attendant who witnesses the user's exit from the facility are legitimately authenticated.The device is characterized by comprising: a switching control means for controlling switching from an attendance mode in which the attendant is present to a remote attendance mode in which a specified remote attendant is present; an authentication means for authenticating whether the first medium, the second medium, or a third medium carried by the remote attendant is legitimate; a determination means for determining whether the user who will be the last to leave is able to leave, based on at least the authentication results of the first medium and the third medium by the authentication means, when the switching control means controls switching to the remote attendance mode; and a control means for controlling the lock on the door of the facility to be unlocked when the determination means determines that the user is able to leave.

[0018] The present invention also provides an entrance / exit management method for an entrance / exit management system having an entrance / exit management device that, when a user located within a predetermined facility leaves the facility, unlocks a lock on a door of the facility to allow the user to leave the facility on the condition that both a first medium carried by the user and a second medium carried by an attendant who witnesses the user's exit from the facility have been properly authenticated, the method comprising: a switching control step of the entrance / exit management device switching from an attendance mode in which the attendant is present to a remote attendance mode in which a predetermined remote attendant is present; The system is characterized by including an authentication process for authenticating whether the first medium, the second medium, or the third medium held by the remote witness is legitimate; a determination process for determining whether the user who will be the last person to leave the facility is able to leave based on at least the authentication results of the first medium and the third medium by the authentication process when the entry / exit management device is controlled to switch to the remote witness mode by the switching control process; and a control process for controlling the entry / exit management device to unlock a lock arranged on a door of the facility when the determination process determines that the user is able to leave. [Effects of the Invention]

[0019] According to the present invention, when an operation is performed in which an individual is not permitted to leave a facility or the like alone, the last person remaining in the facility or the like to leave can leave. [Brief explanation of the drawings]

[0020] [Figure 1] FIG. 1 is an explanatory diagram for explaining a situation in which an employee leaves a building while two-person authentication is being performed in the building entry / exit management system according to the first embodiment. [Figure 2] FIG. 2 is an explanatory diagram for explaining a situation in which the last person to leave the building leaves the building in the entrance / exit management system according to the first embodiment. [Figure 3] FIG. 3 is a functional block diagram showing the configuration of the entrance / exit management device. [Figure 4]FIG. 4 is a diagram showing an example of the data structure of the employee card data and the remote attendance card data shown in FIG. [Figure 5] FIG. 5 is a functional block diagram showing the configuration of the remote witness device. [Figure 6] FIG. 6 is a sequence diagram (part 1) showing the procedure for processing exit processing using the remote attendance card R1 by the entrance / exit management system shown in FIG. [Figure 7] FIG. 7 is a sequence diagram (part 2) showing the procedure for processing exit processing using the remote attendance card R1 by the entrance / exit management system shown in FIG. [Figure 8] FIG. 8 is an explanatory diagram for explaining an overview of the entrance / exit management system according to the second embodiment. [Figure 9] FIG. 9 is a functional block diagram showing the configuration of the remote witness device shown in FIG. [Figure 10] FIG. 10 is a diagram illustrating an example of the trained model illustrated in FIG. [Figure 11] FIG. 11 is an explanatory diagram for explaining calculation of the risk score. [Figure 12] FIG. 12 is a sequence diagram (part 1) showing the processing procedure of the entrance / exit control system shown in FIG. [Figure 13] FIG. 13 is a sequence diagram (part 2) showing the processing procedure of the entrance / exit control system shown in FIG. DETAILED DESCRIPTION OF THE INVENTION

[0021] Hereinafter, embodiments of an entrance / exit management system, an entrance / exit management device, and an entrance / exit management method according to the present invention will be described in detail with reference to the drawings. Note that the embodiments shown below will show a case where employee A leaves the building, provided that authentication of both employee A, who is in the work area, and employee B, who is in the monitoring area, is performed. Hereinafter, the mode in which employee A, who is in the work area, leaves the building in the presence of an attendant (employee B), will be referred to as "attendance mode," and the mode in which employee A leaves the building in the presence of a remote attendant (remote attendant R) at the remote attendance center will be referred to as "remote attendance mode."

[0022] [Embodiment 1] <Overview of the access control system> First, an entrance / exit management system according to the first embodiment will be described. Fig. 1 is an explanatory diagram for explaining a situation in which an employee leaves a building while performing two-person authentication in the entrance / exit management system according to the first embodiment. As shown in Fig. 1, the building is provided with an entrance / exit area, a work area, and a monitoring area. Employee A is located in the work area, and employee B is located in the monitoring area.

[0023] A card reader 21 is provided in the entrance / exit area, a card reader 20, a personal camera 60, and an intercom 61 are provided in the work area, and an entrance / exit control device 10 and a card reader 15 are provided in the monitoring area. A door 31 is provided between the entrance / exit area and the work area, and this door 31 is locked and unlocked by an electronic lock 30.

[0024] The entrance / exit management device 10 is a management device that manages the entrance / exit of employees, and is used to issue employee cards and remote attendance cards, which will be described later. Specifically, the entrance / exit management device 10 is used to register card information in association with the card ID of an unregistered card prepared in advance. As a result, an employee ID card or a remote attendance card is issued. Note that, when an employee himself / herself leaves the building, a condition can be set so that the employee ID card of this employee cannot be used as a remote attendance card.

[0025] Card readers 15, 20, and 21 are readers that read data stored on employee cards, which are contactless IC cards. Interphone 61 is connected to the entrance / exit management device 10 and is an interphone for communication between the work area and the monitoring area. When employee A, who is in the work area, leaves the building, interphone 61 is used to notify employee B, who is in the monitoring area, of his or her intention to leave. Personal belongings camera 60 is a camera that captures images of personal belongings carried by employee A as he or she leaves the work area.

[0026] The entrance / exit management device 10 performs authentication processing of the employee card B1 read by the card reader 15, and also performs authentication processing of the employee card A1 read by the card reader 20, and if the employee cards B1 and A1 are legitimate, it controls the electronic lock 30 to unlock and open the door 31, allowing employee A to leave the building.

[0027] Specifically, employee A notifies employee B of his intention to leave the building via intercom 61a (1). Employee B checks the image of employee A's belongings captured by the personal belongings camera 60, and if there are no problems, employee B holds employee card B1 over card reader 15. Card reader 15 reads the data stored on employee card B1 and notifies the entrance / exit management device 10 (2). The entrance / exit management device 10 certifies whether employee B is a legitimate employee based on the data stored on employee card B1 (3).

[0028] Employee A then holds employee card A1 over card reader 20. This causes card reader 20 to read the data stored on employee card A1 (4) and output it to entrance / exit control device 10. The entrance / exit control device 10 certifies that employee A is a legitimate employee based on the data stored on employee card A1 (5). If the entrance / exit control device 10 certifies that both employees A and B are legitimate employees, it controls electronic lock 30 to open (6), allowing employee A to leave the building.

[0029] Here, if employee B, who is in the monitored area, leaves the building at 5:00 p.m., which is the regular time, there will be no employees in the monitored area. In such a case, if there are multiple employees in the work area, one employee can move to the monitored area and act in place of employee B, allowing the employees in the work area to leave the building. On the other hand, if only employee A is in the work area and no other employees are present, there is a problem in that employee A will be unable to leave the building. For this reason, the entry / exit management system according to the first embodiment is configured so that even if only employee A is in the work area and there is no one in the monitored area, remote witness R in the remote witness area can act in place of employee B, allowing employee A to leave the building.

[0030] 2 is an explanatory diagram for explaining a situation in which the last person to leave the building leaves the building in the entrance / exit management system according to Embodiment 1. As shown in Fig. 2, when there is no one in the monitored area, employee B performs a predetermined operation to switch the entrance / exit management device 10 from the presence mode to the remote presence mode so that the last person to leave can leave alone.

[0031] When the entrance / exit control device 10 is switched to the remote attendance mode, the interphone 61 is connected to the remote attendance device 80 via the entrance / exit control device 10. When employee A, who is in the work area, leaves the building, the interphone 61 is used to notify remote attendant R in the remote attendance area that employee A is leaving the building.

[0032] Thereafter, the entry / exit management device 10 performs authentication processing of the remote attendance card R1 read by the card reader 85 provided on the remote attendance device 80, and also performs authentication processing of the employee card A1 read by the card reader 20. If the remote attendance card R1 and employee card A1 are legitimate, the electronic lock 30 is controlled to unlock, allowing the door 31 to be opened and closed, and employee A to leave the building.

[0033] Specifically, when employee B in the monitored area leaves the building, employee B performs a predetermined operation to switch the entrance / exit management device 10 to remote attendance mode (11). After that, when employee A intends to leave the building alone, employee A notifies remote attendant R via intercom 61 that he or she is leaving the building (12).

[0034] Then, remote witness R checks the image of employee A's belongings captured by the belongings camera 60, and if there are no problems, holds the remote witness card R1 over the card reader 85 connected to the remote witness device 80. The card reader 85 reads (13) the data stored on the remote witness card R1 and outputs it to the entrance / exit control device 10 via the remote witness device 80. The entrance / exit control device 10 certifies whether the remote witness card R1 is legitimate based on the data stored on the remote witness card R1 (14).

[0035] When employee A holds employee card A1 over card reader 20, card reader 20 reads (15) the data stored on employee card A1 and outputs it to entrance / exit control device 10. Based on the data stored on employee card A1, entrance / exit control device 10 certifies (16) whether employee card A1 is legitimate.

[0036] As a result, if the employee card A1 is found to be valid and the remote attendance card R1 is also valid, the electronic lock 30 is controlled to be unlocked (17), allowing employee A to leave the building. In this way, in the entry / exit management system according to the first embodiment, by reading the remote attendance card R1 at the remote attendance center, employee A, who is in the work area, can leave the building even if employee B is not in the monitored area.

[0037] <Configuration of entrance / exit management device 10> Next, we will explain the configuration of the entrance and exit control device 10. Fig. 3 is a functional block diagram showing the configuration of the entrance and exit control device 10. As shown in Fig. 3, the entrance and exit control device 10 is connected to a display unit 11, an input unit 12, a microphone 13, a speaker 14, and a card reader 15, and has a communication I / F unit 16, a memory unit 17, and a control unit 18.

[0038] The display unit 11 is a display device such as a liquid crystal display that displays various information. The input unit 12 is an input device such as a mouse or keyboard. The microphone 13 is a device that converts sound into an electrical signal, and the speaker 14 is a device that converts an electrical signal into sound. The card reader 15 is a device that reads data stored on the employee card B1 via short-range wireless communication such as Bluetooth (registered trademark). The communication I / F unit 16 is an interface unit for communicating with the card readers 20 and 21, the electronic lock 30, the personal belongings camera 60, the remote attendance device 80, etc.

[0039] The storage unit 17 is a storage device such as a hard disk drive or nonvolatile memory, and stores employee card data 17a, remote attendance card data 17b, exit data 17c, entry data 17d, and image data 17e.

[0040] The employee card data 17a is data that associates the card ID of the employee card with the employee's name, affiliation, contact information, etc. The remote witness card data 17b is data that associates the card ID of the remote witness card with the remote witness's name, affiliation, contact information, etc.

[0041] Exit data 17c is data associating the card ID of an employee who has left the building with the time of departure, and entry data 17d is data associating the card ID of an employee who has entered the building with the time of entry. Note that exit data 17c may associate the card ID of an employee who has left the building with the card information of employee B or remote witness R who witnessed the exit. Image data 17e is data of an image (still image or video image) captured by personal camera 60.

[0042] The control unit 18 is a control unit that controls the entire entrance / exit control device 10, and includes a remote attendance mode switching processing unit 18a, a card data acquisition unit 18b, an authentication processing unit 18c, a determination unit 18d, an electronic lock control unit 18e, an imaging control unit 18f, an intercom control unit 18g, and an image data transfer unit 18h. In practice, by loading and executing these programs into a CPU, the remote attendance mode switching processing unit 18a, the card data acquisition unit 18b, the authentication processing unit 18c, the determination unit 18d, the electronic lock control unit 18e, the imaging control unit 18f, the intercom control unit 18g, and the image data transfer unit 18h will execute processes corresponding to them, respectively.

[0043] The remote attendance mode switching processor 18a switches from attendance mode to remote attendance mode in response to a predetermined operation by employee B, so that employee A in the work area can leave the building when employee B in the monitored area is not present. When the remote attendance mode is selected, the intercom 61 is connected to the remote attendance device 80 via the entrance / exit management device 10. When the remote attendance mode is selected, authentication processing is not performed on a card held over the card reader 15 installed in the monitored area, but authentication processing is performed on a card held over the card reader 85 installed in the remote attendance center.

[0044] The card data acquisition unit 18b is a processing unit that acquires data stored on a card held over the card readers 15, 20, 21, and 85.

[0045] When authenticating two employees, employee A who is in the work area and employee B who is in the monitoring area, the authentication processing unit 18c certifies whether employee card A1 and employee card B1 are legitimate based on the data stored on the cards obtained from card reader 15 and card reader 20, and outputs the authentication result to the judgment unit 18d.

[0046] In addition, when authenticating two people, employee A located in the work area and remote witness R located in the remote witness center, the authentication processing unit 18c certifies whether the employee card A1 and the remote witness card R1 are legitimate based on the data stored on the cards obtained from the card reader 20 and the card reader 85, and outputs the authentication result to the judgment unit 18d.

[0047] When authenticating two employees, employee A in the work area and employee B in the monitoring area, if employee card A1 and employee card B1 are valid, the judgment unit 18d determines that employee A is allowed to leave the building and outputs the judgment result to the electronic lock control unit 18e.

[0048] In addition, when performing authentication using the remote attendance card R1 held by employee A located in the work area and remote attendant R located at the remote attendance center, the judgment unit 18d determines that employee A is allowed to leave the premises if the employee card A1 and the remote attendance card R1 are legitimate, and outputs the judgment result to the electronic lock control unit 18e.

[0049] When the electronic lock control unit 18e receives a determination result from the determination unit 18d that employee A is permitted to leave the building, it controls the electronic lock 30 to be unlocked. Furthermore, when a predetermined time has elapsed since the electronic lock was unlocked, it controls the electronic lock 30 to be locked.

[0050] The imaging control unit 18f controls the imaging of the personal camera 60, acquires an image, and stores it in the storage unit 17 as image data 17e.

[0051] The interphone control unit 18g controls the calls between the interphone 61 and the entry / exit control device 10 in the attendance mode, and controls the calls between the interphone 61 and the remote attendance device 80 in the remote attendance mode. The interphone 61 can also be configured as an interphone camera, and the image from the interphone camera can be transferred from the entry / exit control device 10 to the remote attendance device 80. The image data transfer unit 18h performs a process of transferring image data captured by the personal camera 60 to the remote attendance device 80 when switched to the remote attendance mode.

[0052] Next, we will explain the employee card data 17a and remote attendance card data 17b of the entrance and exit control device 10. Fig. 4 is a diagram showing an example of the data structure of the employee card data 17a and remote attendance card data 17b shown in Fig. 3. As shown in Fig. 4(a), the employee card data 17a is data in which the employee card ID, name, affiliation, contact information, etc. are associated with each other.

[0053] This example shows that employee card ID "A0001" is associated with the name "Sato △ko", department "Accounting Department", and contact number "090-xxxx-yyyy". Also, employee card ID "A0002" is associated with the name "Tanaka □o", department "Engineering Department", and contact number "080-aaaa-cccc", and employee card ID "A0003" is associated with the name "Yamada ☐suke", department "Engineering Department", and contact number "080-dddd-ffff".

[0054] Also, as shown in FIG. 4(b), the remote attendance card data 17b shows a situation in which the card ID "R0001" is associated with the name "Yamamoto △Taro", the affiliation "A Security", and the contact number "090-dddd-hhhh".

[0055] <Configuration of the remote witness device 80> Next, we will explain the configuration of the remote witness device 80. Figure 5 is a functional block diagram showing the configuration of the remote witness device 80. As shown in Figure 5, the remote witness device 80 is connected to a display unit 81, an input unit 12, a microphone 83, a speaker 84, and a card reader 85, and has a communication I / F 86, a memory unit 87, and a control unit 88.

[0056] The display unit 81 is a display device such as a liquid crystal display that displays various information. The input unit 82 is an input device such as a mouse or keyboard. The microphone 83 is a device that converts sound into an electrical signal, and the speaker 84 is a device that converts an electrical signal into sound. The card reader 85 is a device that reads data stored on the remote attendance card R1 via short-range wireless communication such as Bluetooth (registered trademark). The communication I / F unit 16 is an interface unit for communicating with the entrance / exit management device 10 and the like.

[0057] The storage unit 87 is a storage device such as a hard disk drive or nonvolatile memory, and stores programs corresponding to the functions of the control unit 88.

[0058] The control unit 88 is a control unit that controls the entire remote witness device 80, and has a switching processing unit 88a, an image data reception processing unit 88b, a call control unit 88c, and an authentication request notification unit 88d. In practice, by loading these programs into the CPU and executing them, the switching processing unit 88a, the image data reception processing unit 88b, the call control unit 88c, and the authentication request notification unit 88d execute processes corresponding to them, respectively.

[0059] The switching processing unit 88a performs processing to receive camera images and control intercom calls when it receives a switching notification to the remote attendance mode from the entrance / exit control device 10. The image data reception processing unit 88b receives image data captured by the personal camera 60 and transferred from the entrance / exit control device 10, and controls the display on the display unit 81.

[0060] The call control unit 88c receives a signal from the interphone 61 transferred from the entry / exit management device 10, plays the audio on the speaker 84, and transmits the audio data obtained from the microphone 83 to the interphone 61 via the entry / exit management device 10.

[0061] When the authentication request notification unit 88d receives the data stored in the remote attendance card R1 from the card reader 85, it sends an authentication request including the card data of this card to the entrance and exit control device 10.

[0062] <Access control system processing procedures> Next, the procedure for exit processing using the remote attendance card R1 will be described. Figures 6 and 7 are sequence diagrams showing the procedure for exit processing using the remote attendance card R1 by the entrance and exit management system.

[0063] 6, when employee B, who is in the monitored area, leaves the monitored area, he or she switches the entry / exit control device 10 to a predetermined remote attendance mode. When the entry / exit control device 10 receives the switch operation to the remote attendance mode (step S101), it controls the switch from attendance mode to remote attendance mode and outputs a message to that effect to the remote attendance device 80 (step S102). When the remote attendance device 80 receives an output indicating that it has switched to the remote attendance mode (S103), it becomes able to receive each data transmitted from the entry / exit control device 10.

[0064] When employee A leaves the work area, he / she operates the intercom 61 to notify the remote witness R that he / she is leaving (step S104). Thereafter, the entrance / exit control device 10 transfers the image data captured by the personal camera 60 to the remote witness device 80 (step S105). When the remote witness device 80 receives the image captured by the personal camera 60 (step S106), it controls the display unit 81 connected to the remote witness device 80 to display the received image data (step S107).

[0065] Then, the card reader 85 reads the data stored on the remote attendance card R1 held by the remote witness R, and outputs the data to the remote attendance device 80. When the remote attendance device 80 receives the data written on the remote attendance card R1 from the card reader 85 (step S108), it outputs an authentication request including the data to the entrance and exit management device 10 (step S109).

[0066] When the entrance / exit control device 10 receives an authentication request including data stored in the remote attendance card R1 from the remote attendance device 80 (step S110), it authenticates whether the remote attendance card R1 is legitimate based on the data stored in the remote attendance card R1 (step S111). As a result, if the remote attendance card R1 is not legitimate (step S111; No), it outputs authentication NG to the card reader 85 via the remote attendance device 80 (step S112), and proceeds to step S102.

[0067] On the other hand, if the remote attendance card R1 is valid (step S111; Yes), the card reader 20 reads the data stored on employee A's employee card A1 (step S113), and if the entry / exit control device 10 accepts the data, it authenticates whether or not employee card A1 is valid based on the data (step S114). As a result, if employee card A1 is not valid (step S114; No), authentication NG is output to the card reader 20 (step S115), and the process proceeds to step S102.

[0068] On the other hand, if the employee card A1 is valid (step S114; Yes), the electronic lock 30 is controlled to be unlocked (step S116), allowing the employee to leave the building, and the above series of processes is completed.

[0069] In this way, in the entry / exit management system according to the first embodiment, when the entry / exit control device 10 shifts from attendance mode to remote attendance mode, the entry / exit control device 10 authenticates the employee card A1 based on the data on the employee card A1 held up by employee A when he or she last left the building, and also authenticates the remote attendance card R1 based on the data on the remote attendance card R1 held up by remote witness R at the remote attendance center obtained via the remote attendance device 80. The entry / exit control device 10 is configured to control the unlocking of the electronic lock 30 if the employee card A1 and the remote attendance card R1 are legitimate, so that employee A can leave the building even if employee B is not present in the monitored area.

[0070] In the first embodiment, the case where the remote witness R is authenticated using the remote witness card R1 has been described, but the present invention is not limited to this, and the remote witness R can also be authenticated using an ID, a password, biometric information such as face, etc. Also, authentication of the remote witness R can be omitted.

[0071] [Embodiment 2] <Overview of the access control system> In this embodiment 2, when employee A, who is in the work area, leaves the building, a risk score for employee A is calculated based on image data from a panoramic camera, and a remote witness R is assisted in deciding whether or not to hold up a remote witness card R1 (whether or not to allow the employee to leave) based on the risk score.

[0072] An overview of the entrance / exit management system according to the present embodiment 2 will be described. Fig. 8 is an explanatory diagram for explaining the overview of the entrance / exit management system according to the embodiment 2. Note that the same parts as those in the embodiment 1 will be given the same reference numerals, and detailed explanations thereof will be omitted.

[0073] As shown in Fig. 8, a panoramic camera 70 capable of capturing images of employee A's behavior when he leaves the building is installed in the work area. In addition, a remote attendance device 90 having a trained model that calculates a risk score based on image data captured by the panoramic camera 70 is installed in the remote attendance center.

[0074] Specifically, when employee B in the monitored area leaves the building, the entrance / exit control device 10 is switched from attendance mode to remote attendance mode (21). If employee A subsequently attempts to leave the building alone, he or she operates the intercom 61 to notify remote witness R that he or she will be leaving (22). Then, when the remote attendance device 90 receives the transferred image data captured by the panoramic camera 70 from the entrance / exit control device 10, it inputs the image data into the trained model and calculates a risk score based on the risk probability output from the trained model (23).

[0075] The remote witness R uses the image of employee A's belongings captured by the personal belongings camera 60 and the displayed risk score as auxiliary indicators to determine whether or not to hold the remote witness card R1 over the card reader 85 connected to the remote witness device 90. Specifically, if there is no problem with the image of employee A's belongings captured by the personal belongings camera 60 and the displayed risk score is less than a predetermined value, the remote witness R holds the remote witness card R1 over the card reader 85 connected to the remote witness device 90. The card reader 85 reads (25) the data stored on the remote witness card R1, and the remote witness device 90 makes an authentication request including the data stored on the remote witness card R1 to the entrance and exit management device 10.

[0076] The entrance / exit control device 10 certifies whether the remote attendance card R1 is legitimate based on the data stored on the remote attendance card R1 (25). The card reader 20 then reads the data stored on the employee card A1 (26) and outputs it to the entrance / exit control device 10. The entrance / exit control device 10 certifies whether the employee card A1 is legitimate based on the data stored on the employee card A1 (27).

[0077] As a result, if the employee card A1 is found to be valid and the remote witness card R1 is found to be valid, the electronic lock 30 is controlled to be unlocked (28), allowing employee A to leave the building.

[0078] <Configuration of the remote witness device 90> Next, the configuration of the remote witness device 90 will be described. Fig. 9 is a functional block diagram showing the configuration of the remote witness device 90 shown in Fig. 8. Note that the same components as those in the first embodiment are given the same reference numerals, and detailed description thereof will be omitted. As shown in Fig. 9, the remote witness device 90 has a memory unit 97 and a control unit 98.

[0079] The storage unit 97 stores training image data 97a and a trained model 97b used in supervised training. The training image data 97a is a training image of a person leaving a work area. The trained model 97b is a trained model obtained by training a multilayer neural network (CNN; Convolutional Neural Network) through deep learning.

[0080] Here, the layer structure of the trained model 97b will be described. The trained model 97b shown in FIG. 10 is a diagram showing an example of the layer structure of the trained model 97b, and is assumed to have a convolution layer 100, a convolution layer 101, an average pooling layer 102, a convolution layer 103, an average pooling layer 104, a fully connected layer 105, a fully connected layer 106, and an output layer 107. However, the layer structure of the CNN is not limited to this.

[0081] Convolution layers 100, 101, and 103 generate feature maps by convolving filters with nearby nodes in the previous layer to extract local features. Average pooling layers 102 and 104 further reduce the feature maps output from the previous convolution layer to create new feature maps in order to aggregate local features. In this way, the hidden layers of a CNN are formed by convolution layers and average pooling layers.

[0082] The fully connected layers 105 and 106 connect the feature maps from which the feature portions have been extracted to one node and output values ​​converted by a predetermined activation function. This activation function can be a well-known technique such as ReLU (Rectified Linear Unit). The output layer 107 converts the output (feature variables) from the fully connected layer 106 into probabilities using a softmax function and outputs the probability of correct classification for each. A dropout layer can also be added to avoid overfitting. The basic structure of CNN is well-known technology, so a detailed explanation of it will be omitted here.

[0083] 9, the control unit 98 has a learning processing unit 98a, a risk score calculation unit 98b, and a display control unit 98c. The learning processing unit 98a is a processing unit that performs supervised deep learning using the learning image data 97a and the correct answer data, and specifically, inputs the learning image data 97a into CNN data, performs backpropagation based on the correct answer data, and repeats the supervised learning process of determining the weight of each bus to generate a learned model 97b.

[0084] The risk score calculation unit 98b is a processing unit that inputs the image data of the panoramic camera 70 transferred from the entrance and exit control device 10 into the trained model 97b and calculates a risk score. Specifically, as shown in FIG. 11, the image data of the panoramic camera is input into the trained model 97b, the risk probability (0.00 to 1.00) output from the trained model 97b is obtained, and this risk probability is normalized to 0 to 10 to obtain a risk score. The risk score obtained in this manner is output to the display control unit 98c. The display control unit 98c controls the display of the risk score calculated by the risk score calculation unit 98b on the display unit 81.

[0085] <Access control system processing procedures> Next, a description will be given of the processing procedure of the entrance / exit control system shown in Fig. 8. Fig. 12 and Fig. 13 are sequence diagrams showing the processing procedure of the entrance / exit control system shown in Fig. 8.

[0086] As shown in Fig. 12, when employee B, who is in the monitored area, leaves the monitored area, he or she performs a predetermined transition operation on the entry / exit control device 10 to transition from attendance mode to remote attendance mode. Upon receiving this predetermined transition operation (step S201), the entry / exit control device 10 controls the transition from attendance mode to remote attendance mode. The entry / exit control device 10 outputs to the remote attendance device 90 a notice that the transition to remote attendance mode has been controlled (step S202). Upon receiving the output that the transition to remote attendance mode has been controlled (S203), the remote attendance device 80 makes it possible to receive each data transmitted from the entry / exit control device 10.

[0087] When employee A leaves the building, employee A operates the intercom 61 to output a message to the remote witness R indicating that he or she is leaving (step S204). Then, the entry / exit control device 10 captures an image of employee A's belongings using the personal belongings camera 60 and transfers the image data to the remote attendance device 90, and also transfers image data captured by the panoramic camera 70 to the remote attendance device 90 (step S205). The remote attendance device 90 receives the image data of the panoramic camera 70 transmitted from the entry / exit control device 10 (step S206), inputs the received image data into the trained model 97b, and calculates a risk score (step S207). Then, the remote attendance device 90 controls the display unit 81 to display the calculated risk score (step S208).

[0088] Thereafter, if the remote witness R determines that there are no problems with the image of employee A's belongings captured by the belongings camera 60 and the displayed risk score is less than a predetermined value, the remote witness R holds the remote witness card R1 over the card reader 85. The card reader 85 reads the data stored on the remote witness card R1 and outputs it to the remote witness device 90. When the remote witness device 90 receives the data stored on the remote witness card R1 (step S209), it outputs an authentication request including the data to the entrance and exit management device 10 (step S210).

[0089] When the entrance / exit control device 10 receives an authentication request including data stored in the remote attendance card R1 from the remote attendance device 90 (step S211), it authenticates whether the remote attendance card R1 is legitimate based on the data stored in the remote attendance card R1 (step S212). As a result, if the remote attendance card R1 is not legitimate (step S212; No), it outputs authentication NG to the card reader 85 via the remote attendance device 80 (step S213), and proceeds to step S202.

[0090] On the other hand, if the remote attendance card R1 is valid (step S212; Yes), the card reader 20 reads the data stored on employee A's employee card A1, and if the entry / exit control device 10 accepts the data (step S214), it authenticates whether employee card A1 is valid or not based on this data (step S215). As a result, if employee card A1 is not valid (step S215; No), authentication NG is output to the card reader 20 (step S216), and the process proceeds to step S202.

[0091] On the other hand, if the employee card A1 is valid (step S215; Yes), the electronic lock 30 is controlled to be unlocked (step S217), allowing the employee to leave the building, and the above series of processes is terminated.

[0092] As described above, in the second embodiment, when the entry / exit control device 10 switches to remote attendance mode, the entry / exit control device 10 performs authentication based on the data of the employee card A1 held up by employee A when he or she last left the building. The remote attendance device 90 inputs the image data from the panoramic camera received via the entry / exit control device 10 into the trained model 97b to calculate and display a risk score. If the risk score is less than a predetermined value, the remote attendant R holds up the remote attendance card R1 over the card reader 85. The entry / exit control device 10 performs authentication based on the data of the held up remote attendance card R1. The entry / exit control device 10 is configured to control the unlocking of the electronic lock 30 by authenticating the employee card A1 and the remote attendance card R1, so that employee A can leave the building even if employee B is not present in the monitored area.

[0093] In the above-described second embodiment, a case where a trained model is generated by deep learning is described, but the present invention is not limited to this, and trained models can also be generated by various types of machine learning. Furthermore, in the above-described second embodiment, a case where a risk score is calculated by normalizing the risk probability output from the trained model is described, but the present invention is not limited to this, and a risk score can also be calculated by normalizing the value obtained by multiplying the risk probability output from the trained model by a coefficient based on the employee's attributes (whether or not the employee is a manager). For example, if the employee's attribute is a managerial position, the coefficient is reduced because the risk of fraud when leaving the building is lower.

[0094] In addition, in the above-described second embodiment, a trained model is generated by prior supervised learning, but once a certain number of captured image data has been acquired, the trained model can be reconstructed by adding the captured image data and performing supervised learning again. Furthermore, it is also possible to repeat trial-and-error learning using reinforcement learning or deep reinforcement learning, and learn to maximize the reward according to the state.

[0095] Furthermore, in the above-mentioned first and second embodiments, the case where an employee card (contactless IC card) is used as a medium for managing entrance and exit has been described, but the present invention is not limited to this, and a contact-type IC card, an IC card with a barcode, a smartphone, a mobile terminal, etc. can also be used as a medium. When a contact-type IC card is used, the IC card is inserted into the card insertion slot of the card reader.

[0096] Furthermore, although the transition to remote attendance mode has been described as being performed by an operation by employee B in the monitored area, a schedule management unit that manages periodic schedules may be provided in the entrance / exit control device 10, and the transition to remote attendance mode may be automatic according to the managed schedule. For example, the system may be configured to automatically transition from attendance mode to remote attendance mode at 5:30 PM on weekdays (Monday to Friday). Alternatively, the system may be configured to automatically transition from attendance mode to remote attendance mode at 12:00 PM on weekdays, and automatically return from remote attendance mode to attendance mode at 1:00 PM.

[0097] Furthermore, if employee A notifies the entrance / exit control device 10 of his / her intention to leave the building via the intercom 61 and there is no response from the entrance / exit control device 10 within a predetermined time, the mode may be automatically switched to remote attendance mode. After such switching, attendance in attendance mode will not be performed, and the mode will be automatically switched from attendance mode to remote attendance mode. However, if the attendant temporarily leaves his / her seat for a break, the mode will also be automatically switched from attendance mode to remote attendance mode. Therefore, in preparation for temporary absences, the mode may be configured so that when the attendant returns from their seat, the remote attendance mode can be switched to attendance mode by the attendant performing a predetermined operation on the entrance / exit control device 10. It is also possible to configure the mode to automatically switch from remote attendance mode to attendance mode by performing facial authentication of the attendant without requiring the attendant to perform a predetermined operation.

[0098] Furthermore, based on the exit data 17c and the entry data 17d of the entrance and exit management device 10, when there is only one person present, the mode may automatically switch to the remote attendance mode.

[0099] Furthermore, although the transition to the remote attendance mode was previously performed by the entrance / exit management device 10, the remote attendance devices 80 and 90 may also be provided with a switching function. Furthermore, when employee B (attendant) in the monitored area enters the building, the mode may be switched from the remote attendance mode to the attendance mode.

[0100] In addition, although the case has been shown in which authentication of the remote witness R's remote witness card R1 is performed by the entrance / exit control device 10, the present invention is not limited to this, and authentication may be performed by the remote witness devices 80 and 90. Authentication may also be performed using the user ID and password of the remote witness R that have been registered in advance in the remote witness devices. In this case, the remote witness devices 80 and 90 notify the entrance / exit control device 10 that authentication of the remote witness R has been completed and that employee A is permitted to leave the building.

[0101] The configurations illustrated in the above embodiments are merely functional schematics and are not necessarily physically configured as shown. In other words, the distribution and integration of each device is not limited to that illustrated, and all or part of the devices can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc. [Industrial Applicability]

[0102] The entry / exit management system, entry / exit management device, and entry / exit management method of the present invention are suitable for operations that do not allow individuals to exit a facility alone, and for allowing the last person remaining in the facility to exit. [Explanation of symbols]

[0103] 10 Entrance / exit control device 11 Display section 12 Input section 13. Mike 14 Speaker 15, 20, 21 Card reader 16 Communication I / F section 17 Memory section 17a Employee card data 17b Card data for remote witnessing 17c Exit Data 17d Admission Data 17e Image data 18 Control Unit 18a Remote witness mode switching processing unit 18b Card data acquisition section 18c Authentication processing section 18d Judgment section 18e Electronic lock control unit 18f Imaging control unit 18g Intercom control unit 18h Image data transfer section 30 Electronic Lock 31 Door 60 Inventory Camera 61 Intercom 70 Panoramic Camera 80 Remote witnessing device 81 Display section 82 Input section 83 Mike 84 Speaker 85 Card Reader 86 Communication I / F section 87 Memory section 88 Control Unit 88a Switching processing section 88b Image data receiving processing unit 88c Call control unit 88d Authentication request notification section 90 Remote witnessing device 97 Control Unit 97a Learning image data 97b Pre-trained model 98 Control Unit 98a Learning processing section 98b Risk score calculation section 98c Display control unit 100, 101, 103 convolution layers 102, 104 Average pooling layer 105, 106 fully connected layer 107 Output layer

Claims

1. An entrance / exit management system having an entrance / exit management device that, when a user located within a predetermined facility leaves the facility, unlocks a lock provided on a door of the facility to allow the user to leave the facility, on condition that both a first medium carried by the user and a second medium carried by an attendant who witnesses the user's exit from the facility have been legitimately authenticated, The entrance / exit management device a switching control means for controlling switching from a witness mode attended by the witness to a remote witness mode attended by a predetermined remote witness; an authentication means for authenticating whether the first medium, the second medium, or the third medium held by the remote witness is authentic; a determination means for determining whether the user who will be the last person to leave the building is able to leave the building based on at least the authentication results of the first medium and the third medium by the authentication means when the switching control means controls the switching to the remote attendance mode; and a control means for controlling a lock provided on a door of the facility to be unlocked when the determination means determines that the user is allowed to leave; An entrance / exit management system comprising:

2. a remote attendance device communicably connected to the entrance / exit management device; The remote witness device is a communication means for enabling communication with the user in the facility when the mode is switched to the remote attendance mode; authentication request means for requesting the entrance / exit management device to authenticate the third medium; 2. The entrance / exit management system according to claim 1, further comprising:

3. The switching control means 3. The entrance / exit management system according to claim 1, wherein when a predetermined operation by the witness is received, the entrance / exit management system controls switching from the witness mode to the remote witness mode.

4. The switching control means An entry / exit management system as described in claim 1 or 2, characterized in that when the user is the last person to leave the facility and no other users are present in the facility, the system switches from the attendance mode to the remote attendance mode.

5. The switching control means The entrance / exit management system according to claim 4, wherein when the attendant enters the facility, the mode is switched from the remote attendance mode to the attendance mode.

6. The entrance / exit management device a schedule management unit for managing a schedule for remote witnessing by the remote witness; The switching control means 3. The entrance / exit management system according to claim 1, wherein switching from the attendance mode to the remote attendance mode is controlled based on a schedule managed by the schedule management means.

7. The switching control means An entry / exit management system as described in claim 1 or 2, characterized in that if there is no response from the attendant after a predetermined period of time has passed since the user made a request for attendance to the attendant, the system switches from the attendance mode to the remote attendance mode.

8. The remote witness device is image acquisition means for acquiring an image of the user; A calculation means for inputting the image of the user acquired by the image acquisition means into a predetermined trained model and calculating a risk score that will occur when the user is allowed to leave the building based on an output value output from the trained model; a display control means for controlling the display of the risk score calculated by the calculation means on a predetermined display unit; 3. The entrance / exit management system according to claim 2, further comprising:

9. The trained model is The entrance / exit management system according to claim 8, characterized in that it is a trained model obtained by performing supervised learning on a predetermined multilayer neural network using multiple images of the user's legitimate and illegitimate behaviors and correct answer data for legitimate or illegitimate behaviors as training data.

10. An entrance / exit management device that, when a user located in a predetermined facility exits the facility, unlocks a lock provided on a door of the facility to allow the user to exit the facility, on condition that both a first medium carried by the user and a second medium carried by an attendant who witnesses the user's exit from the facility have been legitimately authenticated, a switching control means for controlling switching from a witness mode attended by the witness to a remote witness mode attended by a predetermined remote witness; an authentication means for authenticating whether the first medium, the second medium, or the third medium held by the remote witness is authentic; a determination means for determining whether the user who will be the last person to leave the building is able to leave the building based on at least the authentication results of the first medium and the third medium by the authentication means when the switching control means controls the switching to the remote attendance mode; and a control means for controlling a lock provided on a door of the facility to be unlocked when the determination means determines that the user is allowed to leave; An entrance / exit management device comprising:

11. An entrance / exit management method in an entrance / exit management system having an entrance / exit management device that, when a user located within a predetermined facility leaves the facility, unlocks a lock on a door of the facility to allow the user to leave the facility, on the condition that both a first medium carried by the user and a second medium carried by an attendant who witnesses the user's exit from the facility have been legitimately authenticated, comprising: a switching control step of controlling the entrance / exit management device to switch from a presence mode in which the witness is present to a remote presence mode in which a predetermined remote witness is present; an authentication step in which the entrance / exit management device authenticates whether the first medium, the second medium, or the third medium held by the remote witness is legitimate; a determination step of determining whether the user who will be the last person to leave the facility is allowed to leave the facility based on at least the authentication results of the first medium and the third medium in the authentication step, when the entrance / exit management device is controlled to switch to the remote attendance mode by the switching control step; a control step of controlling the entrance / exit management device to unlock a lock provided on a door of the facility when it is determined in the determination step that the user is allowed to leave; An entrance / exit management method comprising:

Images