Stay management device, stay management method, and program

Abstract

To provide a stay management apparatus, a stay management method, and a program for appropriately managing the stay of a visitor.SOLUTION: A stay management apparatus (100) comprises: a registration unit (101) for acquiring a facial image of a visitor and registering the facial image in an authentication apparatus; an entrance control unit (110) for authenticating the visitor based on authentication target information that is associated with identification information of the visitor and allowing the visitor to enter a building; an acquisition unit (120) for acquiring visited place information on a visited place in the building that is associated with the identification information of the visitor; a determining unit (130) for determining a permitted stay duration for the visitor in the building based on the acquired visited place information; a detection unit (140) for detecting the stay of the visitor according to facial authentication using the authentication apparatus with respect to surveillance images sequentially captured with one or more surveillance cameras in the building; and an output unit (150) for outputting an alert if the stay of the visitor is detected by the facial authentication after the permitted stay duration has elapsed from the authentication of entry.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a stay management device, a stay management method, a non-transitory computer-readable medium having a program stored thereon, and a stay management system. [Background technology]

[0002] Patent Document 1 discloses an entrance / exit management system that controls entrance / exit through face recognition. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2006-293913 A Summary of the Invention [Problem to be solved by the invention]

[0004] Companies and other businesses need to allow temporary entry of visitors from outside companies and other organizations for business purposes. However, in such cases, security issues may arise if visitors enter unnecessary places or stay longer than necessary.

[0005] The present disclosure has been made to solve such problems, and aims to provide a stay management device and the like for appropriately managing a visitor's stay. [Means for solving the problem]

[0006] The stay management device according to the first aspect of the present disclosure includes a registration unit that acquires a face image of a visitor and registers the face image in an authentication device; an entrance control unit that authenticates the visitor based on authentication target information associated with the visitor's identification information and permits the visitor to enter the building; an acquisition unit that acquires visiting destination information within the building associated with the visitor's identification information; a determination unit that determines an allowable stay time for the visitor in the building based on the acquired visit destination information; a detection unit that detects the presence of the visitor by face recognition using the authentication device in surveillance images captured by one or more surveillance cameras in the building; an output unit that outputs an alert when the presence of the visitor is detected by the face authentication after the permitted stay time has elapsed since the permission of entry; Equipped with.

[0007] A stay management method according to a second aspect of the present disclosure includes acquiring a face image of a visitor, registering the face image in an authentication device, authenticating the visitor using authentication target information associated with the visitor's identification information and permitting the visitor to enter the building; Acquire destination information within the building associated with the visitor's identification information; determining an allowable stay time for the visitor in the building based on the acquired visit destination information; Detecting the presence of the visitor by face recognition using the authentication device in surveillance images captured by one or more surveillance cameras in the building; When the presence of the visitor is detected by the face authentication after the permitted stay time has elapsed from the time of the permission of entry, an alert is output.

[0008] A non-transitory computer-readable medium storing a program according to a third aspect of the present disclosure includes a process of acquiring a face image of a visitor and registering the face image in an authentication device; a process of authenticating the visitor based on authentication target information associated with the visitor's identification information and permitting the visitor to enter the building; acquiring information about a visitor in the building associated with the visitor's identification information; A process of determining an allowable stay time for the visitor in the building based on the acquired visit destination information; A process of detecting the presence of the visitor by face recognition using the authentication device for surveillance images captured by one or more surveillance cameras in the building; and outputting an alert if the visitor's presence is detected by the face authentication after the permitted stay time has elapsed from the time of the entry permission.

[0009] A stay management system according to a fourth aspect of the present disclosure includes: A gate device for controlling the entry and exit of visitors; Cameras installed inside the building; The stay management device, an authentication device including a storage means for storing face feature information of the plurality of persons and an authentication means for performing face authentication using the set of face feature information; a management terminal that receives the output of the alert; Equipped with. Effect of the Invention

[0010] The present disclosure makes it possible to provide a stay management device and the like for appropriately managing a visitor's stay. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram showing a configuration of a stay management device according to a first embodiment. [Diagram 2] 4 is a flowchart showing an operation of the stay management device according to the first embodiment. [Diagram 3] FIG. 11 is a block diagram showing the configuration of a stay management system according to a second embodiment. [Figure 4] FIG. 11 is a block diagram showing a configuration of a gate device according to a second embodiment. [Diagram 5] FIG. 11 is a block diagram showing a configuration of a stay management device according to a second embodiment. [Figure 6] FIG. 11 is a diagram for explaining an example of an arrangement on a floor in a building according to a second embodiment. [Figure 7] FIG. 2 is a block diagram showing a configuration of an authentication device. [Figure 8] 10 is a flowchart showing a flow of a face information registration process performed by the authentication device. [Figure 9] 10 is a flowchart showing a flow of face authentication processing by the authentication device. [Figure 10] 13 is a flowchart illustrating a procedure for accepting a visitor according to the second embodiment. [Figure 11] 11 is a flowchart illustrating a process in which a visitor passes through an entrance gate using face authentication. [Figure 12] 13 is a flowchart illustrating a flow of creating a monitoring target list according to the second embodiment. [Figure 13] 13 is a flowchart illustrating a flow of stay management according to the second embodiment. [Figure 14] FIG. 11 is a block diagram showing a configuration of a stay management device according to a third embodiment. [Figure 15] FIG. 13 is a diagram for explaining an example of layout on the first floor according to the third embodiment. [Figure 16] FIG. 13 is a diagram for explaining an example of layout on the second floor according to the third embodiment. [Figure 17] 13 is a flowchart illustrating a flow of stay management according to the third embodiment. [Figure 18] FIG. 13 is a block diagram showing a configuration of a stay management device according to a fourth embodiment. [Figure 19] 13 is a flowchart illustrating a process of determining an allowed stay time according to the fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] (Embodiment 1) Hereinafter, specific embodiments to which the present invention is applied will be described in detail with reference to the drawings. However, the present invention is not limited to the following embodiments. In addition, the following description and drawings are appropriately simplified for clarity of explanation.

[0013] FIG. 1 is a block diagram of a configuration of a stay management device according to the first embodiment. The stay management device 100 is an information processing device that allows temporary entry of a visitor who arrives at the entrance (reception) of a building and manages the visitor's stay, and is, for example, a server device realized by a computer. As shown in FIG. 1, the stay management device 100 includes a registration unit 101, an entrance control unit 110, an acquisition unit 120, a determination unit 130, a detection unit 140, and an output unit 150.

[0014] The registration unit 101 acquires a facial image of the visitor and registers the facial image in the authentication device. The registration unit 101 may acquire the facial image of the visitor by the visitor transmitting a facial image scanned from a photo ID or a facial image photographed by a mobile terminal (e.g., a smartphone) to the stay management device 100 in advance. In addition, if the facial image of the visitor is not registered in advance, the registration unit 101 may acquire a facial image of the visitor photographed by an entrance camera at the visited place via a network and store the facial image in advance in the authentication device.

[0015] The entrance control unit 110 authenticates the visitor by authentication target information associated with the visitor's identification information and permits the visitor to enter the building. The entrance control unit 110 usually performs entrance control on a gate device that may be placed at the reception desk of the building or a PC (personal computer) operated by a receptionist. The method of authenticating the visitor when permitting entry may be authentication by identification information (e.g., QR code (registered trademark)) issued to the visitor in advance, or face authentication by a facial image of the visitor registered in advance. The authentication target information may be identification information (e.g., QR code (registered trademark)) issued to the visitor in advance, or may be a facial image of the visitor. The authentication target information may be any other suitable object associated with the visitor's identification number. Furthermore, a pass (e.g., an electronic card) may be issued to the visitor who is permitted entry.

[0016] The acquiring unit 120 acquires the visiting destination information in the building associated with the identification information of the visitor. The visiting destination information in the building may be, for example, location information in the building such as the number of floors in the building, the number of a conference room in the building, and the seat position in the conference room. The visiting destination information in the building may be, for example, time information (e.g., meeting time 9:00 to 11:00) associated with the location information (e.g., the conference room number).

[0017] The determination unit 130 determines the permitted stay time of the visitor in the building based on the acquired destination information. For example, the permitted stay time may be determined based on the distance or required time from the reception desk to the destination, or the stay time at the destination (e.g., meeting time). That is, the permitted stay time may differ for each destination information. When the destination information includes distance information from the visitor's current location to the destination, or the required time from the current location to the destination, the determination unit 130 may determine the permitted stay time to be longer as the distance or required time becomes longer. Specifically, the permitted stay time is shorter for a destination close to the entrance, and longer for a destination far from the entrance. When the destination information includes visit purpose information, the determination unit 130 may determine different permitted stay times depending on the purpose. If the purpose of the visit is simply a delivery, the permitted stay time may be set to be short, and if the purpose is a meeting, the permitted stay time may be set to be long depending on the content. Alternatively, the permitted stay time may be determined to be a predetermined time (e.g., 2 hours) uniformly.

[0018] The detection unit 140 detects the presence of a visitor by facial recognition using an authentication device in which the visitor's facial image is pre-registered in association with the visitor's identification information, based on surveillance images captured sequentially by one or more surveillance cameras within the building.

[0019] When a visitor's presence is detected by face authentication after the permitted stay time has elapsed since entry was permitted, the output unit 150 outputs an alert. The output unit 150 can output the alert to, for example, a management terminal for monitoring the inside of the building and managing visitors.

[0020] Next, with reference to FIG. 2, a flow of operations of the stay management device according to the first embodiment will be described. FIG. 2 is a flowchart showing the operation of the stay management device.

[0021] First, the registration unit 101 registers a face image of a visitor in an authentication device (step S101). The visitor may use a computer to transmit his / her own face image to the registration unit 101 in advance. Alternatively, the visitor's face image may be acquired by an entrance camera or the like at the reception of a company or the like and transmitted to the registration unit 101. The entrance control unit 110 authenticates the visitor by authentication target information associated with the visitor's identification information and permits the visitor to enter the building (step S102). The acquisition unit 120 acquires destination information in the building associated with the visitor's identification information (step S103). The determination unit 130 determines the visitor's permitted stay time (for example, 2 hours) in the building based on the acquired destination information (step S104). The detection unit 140 detects the visitor's stay by face authentication using an authentication device (step S105). The detection unit 140 detects the visitor's stay by face authentication using an authentication device for surveillance images sequentially captured by one or more surveillance cameras in the building. When the presence of a visitor is detected by face authentication after the permitted stay time has elapsed since the entry permission, the output unit 150 outputs an alert (step S106). The alert may include the visitor's identification information and the location where the photograph was taken (for example, the location where the surveillance camera is installed).

[0022] According to the present embodiment described above, it is possible to appropriately manage visitor stays, detect visitors who stay longer than necessary, and output an alert. This makes it possible to discover suspicious individuals among multiple visitors, thereby improving security.

[0023] (Embodiment 2) FIG. 3 is a block diagram illustrating a configuration of the stay management system according to the second embodiment. As shown in FIG. The stay management system may be used to manage the stay time of visitors from outside in order to ensure security in a building of an organization such as a company. As shown in FIG. 3, the stay management system includes an entrance camera 410, a gate device 400, a plurality of surveillance cameras 300 (300a, 300b, . . . 300n) arranged in the building, an authentication device 200, a stay management device 100a, and a management terminal 600. The entrance camera 410, the gate device 400, the plurality of surveillance cameras 300 (300a, 300b, . . . 300n), the authentication device 200, the stay management device 100a, and the management terminal 600 are connected to each other via a wired or wireless network 500. Note that, although the entrance camera 410 and the gate device 400 are shown as separate devices in FIG. 3, they may be integrated devices.

[0024] The entrance camera 410 and the gate device 400 may usually be placed near the entrance or reception of the building. The entrance camera 410 is controlled by the gate device 400, photographs a visitor who arrives at the building entrance, and outputs the photographed image to the gate device 400. The entrance camera 410 may be a digital camera that takes still images or videos. The entrance camera 410 may be remotely controlled by the stay management device 100a, in which case the entrance camera 410 may output the photographed image to the stay management device 100a via the network 500.

[0025] FIG. 4 is a block diagram of a gate device according to the second embodiment. As shown in FIG. The gate device 400 transmits the image captured by the entrance camera 410 to the stay management device 100a via the network, and receives and displays the authentication result from the stay management device 100a via the network. In this example, the image captured by the entrance camera 410 is an image of the visitor's face, but authentication may also be performed using identification information (e.g., QR code (registered trademark)) of the visitor captured by the entrance camera 410.

[0026] 4, the gate device 400 includes a storage unit 420, a communication unit 430, a display unit 440, a control unit 450, and a gate 460. The control unit 450 further includes an imaging control unit 451 and a gate control unit 452. The gate 460 does not have to be built into the gate device 400. In other words, the gate device 400 may be realized by being connected to an external gate 460.

[0027] The storage unit 420 stores images of visitors captured by the entrance camera 410 and programs for implementing the various functions of the gate device 400. The storage unit 420 is configured, for example, by a semiconductor memory, an optical disk, or a hard disk (HD).

[0028] The communication unit 430 is a communication interface with the network 500. The communication unit 430 is used to communicate with other network node devices constituting the stay management system. The communication unit 430 may be used to perform wireless communication. For example, the communication unit 430 may be used to perform wireless LAN communication defined in the IEEE 802.11 series or mobile communication defined in 3GPP (3rd Generation Partnership Project). Alternatively, the communication unit 430 may include, for example, a network interface card (NIC) conforming to the IEEE 802.3 series.

[0029] Display unit 440 is configured, for example, by a liquid crystal display, a touch screen display, etc. When display unit 440 is configured by a touch screen display, display unit 440 also functions as a reception unit that receives operational input by a visitor.

[0030] The control unit 450 is composed of a processor (such as a CPU) and a memory, and performs various processes of the gate device by reading and executing software (computer programs) from the memory. The photography control unit 451 controls photography by the entrance camera 410. The gate control unit 452 controls the opening and closing of the gate 460.

[0031] The gate device 400 includes a gate 460 that restricts a person's entry into the building, and lifts the gate restriction if the authentication result indicates successful face authentication. Furthermore, when a visitor leaves the building, the gate device 400 can lift the restriction of another gate (exit gate) and transmit identification information (visitor ID) of the exiting visitor photographed by an exit camera (not shown) to the stay management device. Alternatively, if a pass (e.g., an electronic card) was given to the visitor upon entry, the visitor's exit may be managed by the visitor holding the pass over the gate device.

[0032] FIG. 5 is a block diagram of a configuration of the stay management device according to the second embodiment. As shown in FIG. The stay management device 100a is an information processing device that allows temporary entry of a visitor who has arrived at the entrance of a building and manages the visitor's stay. The stay management device 100a is, for example, a server realized by a computer.

[0033] As shown in FIG. 5, the stay management device 100a includes a control unit 10a, a memory 11a, a communication unit 12a, and a storage unit 13a.

[0034] The control unit 10a is composed of a processor (CPU, etc.) and performs various processes of the stay management device by reading and executing software (computer programs) from the memory 11a. The control unit 10a includes a registration unit 101a, an authentication control unit 103a, an entrance control unit 110a, an acquisition unit 120a, a determination unit 130a, a detection unit 140a, and an output unit 150a.

[0035] The registration unit 101a acquires a facial photograph of the visitor and registers it in the authentication device 200. For example, the registration unit 101a may acquire the facial image obtained by the entrance camera 410 photographing the visitor or the visitor's photo identification card via a network, or may acquire the facial image of the visitor photographed by a mobile terminal (e.g., a smartphone) carried by the visitor via a network. Furthermore, when the registration unit 101a receives visitor identification information and the designation of the destination, it can register the visitor identification information and the destination in the destination storage unit in association with each other.

[0036] The authentication control unit 103a transmits an authentication request to the authentication device based on the surveillance images sent from the surveillance camera, and receives the authentication result from the authentication device. The authentication control unit 103a also manages a monitoring target list indicating one or more visitor IDs to be monitored, and removes the visitor IDs that are no longer monitored (for example, people who have left) from the list.

[0037] The entrance control unit 110a performs face authentication of the visitor using an image captured by the entrance camera and a registered face image associated with the visitor's identification information, and allows the visitor to enter the building. The entrance control unit 110 performs entrance control for a gate device that may be placed at the reception desk of the building. The visitor authentication method when allowing entry can be performed by face authentication using a pre-registered face image of the visitor.

[0038] The acquiring unit 120a refers to the visiting destination storage unit and acquires visiting destination information of a building associated with a visitor who has been successfully face-authenticated. The visiting destination information in a building may be, for example, location information in a building, such as the number of floors in the building, the number of a conference room in the building, and the seating position in the conference room. The visiting destination information in a building may be, for example, time information (for example, meeting time 9:00 to 11:00) associated with the location information (for example, the number of the conference room). The acquiring unit 120a refers to the visiting destination storage unit and acquires visiting destination information associated with a visitor who has been successfully face-authenticated. As a result, the visiting destination is automatically identified by face authentication when the visitor visits due to the pre-registration of the visitor's face image, and the visitor can enter the building only by face authentication without inputting the visiting destination.

[0039] The determination unit 130a determines the permitted stay time of the visitor in the building based on the acquired destination information. For example, the permitted stay time may be determined based on the distance from the reception desk to the destination, the stay time at the destination (e.g., meeting time), and the like. That is, the permitted stay time may differ for each destination information. Specifically, the permitted stay time is shorter for a destination close to the entrance, and longer for a destination far from the entrance. In addition, when the destination information includes visit purpose information, the determination unit 130a may determine a different permitted stay time according to the purpose. If the purpose of the visit is simply a delivery, the permitted stay time may be set to be short, and if the purpose is a meeting, the permitted stay time may be set to be long depending on the content. Alternatively, the permitted stay time may be determined so that a predetermined time (e.g., 2 hours) is uniformly given to each visitor.

[0040] The detection unit 140a detects the presence of a visitor by face recognition using an authentication device in which a visitor's face image is registered in advance in association with the visitor's identification information, for surveillance images sequentially captured by one or more surveillance cameras in the building. The detection unit 140a can also detect surveillance images based on a surveillance target list of visitors who have not yet left the premises after the permitted stay time has elapsed.

[0041] When the visitor's presence is detected by the face authentication after the permitted stay time has elapsed from the permission of entry, the output unit 150a outputs an alert. The output unit 150 can output the alert to, for example, a management terminal 600 for monitoring the inside of the building and managing visitors.

[0042] The communication unit 12a is a communication interface with the network 500. The communication unit 12a is used to communicate with other network node devices constituting the stay management system. The communication unit 430 may be used to perform wireless communication. For example, the communication unit 12a may be used to perform wireless LAN communication defined in the IEEE 802.11 series or mobile communication defined in 3GPP (registered trademark) (3rd Generation Partnership Project). Alternatively, the communication unit 12a may include, for example, a network interface card (NIC) conforming to the IEEE 802.3 series.

[0043] The storage unit 13a stores a program for realizing each function of the stay management device 100a. The storage unit 13a is composed of, for example, an optical disk, a HD (hard disk), or the like. Furthermore, the storage unit 13a can store a visitor 132a and a visit destination 133a in association with each other as a visit destination storage unit. The visitor 132a may include visitor identification information (for example, name, ID) and a face image of the visitor. The visit destination 133a may include the location of the visit destination (for example, the floor number, the conference room number, etc.), visitor information, and the like. Furthermore, the storage unit 13a may include a visitor list 134 and a monitoring target list 134a. The visitor list 134 may be, for example, a list of people who visited on a specific day. The monitoring target list is a list indicating visitors to be monitored among the visitor list.

[0044] 6 is a diagram illustrating an example of the arrangement of entrance cameras, gate devices, and surveillance cameras on floors in a building. Gate 460 of gate device 400 restricts the entry of visitors who arrive at the entrance of the building. Entrance camera 410 is positioned so that its angle of view includes visitors who have arrived at the entrance of the building. Meanwhile, surveillance camera 300a is positioned so that its angle of view includes visitors after they have entered.

[0045] The building is not limited to one story, but may have two or more floors. Although two conference rooms are illustrated in FIG. 6, the number of conference rooms is not limited to this. The number of surveillance cameras may be one or more per floor.

[0046] 7 is a block diagram showing the configuration of the authentication device 200. The authentication device 200 includes a face information DB 210, a face detection unit 220, a feature point extraction unit 230, a registration unit 240, and an authentication unit 250.

[0047] The face information DB 210 stores a visitor ID and the face feature information of the visitor in association with each other. The face information DB 210 is also called a storage unit. In response to a face authentication request received from the outside (for example, the stay management device 100a), the authentication device 200 compares the face image or face feature information included in the request with the face feature information of each visitor and returns the comparison result to the request source.

[0048] The face detection unit 220 detects a face area included in a registration image for registering face information, and outputs the face area to the feature point extraction unit 230. The feature point extraction unit 230 extracts feature points from the face area detected by the face detection unit 220, and outputs face feature information to the registration unit 240. Here, the face feature information is a collection of the extracted feature points. In addition, the feature point extraction unit 230 extracts feature points included in the face image received from the stay management device 100a, and outputs the face feature information to the authentication unit 250.

[0049] The registration unit 240 issues a new visitor ID when registering the facial feature information. The registration unit 240 associates the issued visitor ID with the facial feature information extracted from the registered image and registers them in the facial information DB 210. The authentication unit 250 compares the facial feature information extracted from the facial image with the facial feature information in the facial information DB 210. The authentication unit 250 returns a response to the stay management device 100a indicating whether or not there is a match in the facial feature information. The presence or absence of a match in the facial feature information corresponds to the success or failure of authentication.

[0050] FIG. 8 is a flowchart showing the flow of the face information registration process by the authentication device 200. First, the authentication device 200 acquires a registration image included in a face information registration request (step S201). For example, the authentication device 200 accepts a face information registration request from a visitor's mobile terminal or the stay management device 100a via the network 500. Next, the face detection unit 220 detects a face area included in the registration image (step S202). Next, the feature point extraction unit 230 extracts feature points from the face area detected in step S202, and outputs face feature information to the registration unit 240 (step S203). Finally, the registration unit 240 issues a visitor ID, associates the visitor ID with the face feature information, and registers it in the face information DB 210 (step S204). Note that the authentication device 200 may receive face feature information from a face authentication terminal or the like, and register it in the face information DB 210 in association with the visitor ID.

[0051] FIG. 9 is a flowchart showing the flow of face authentication processing by the authentication device 200. First, the feature point extraction unit 230 acquires face feature information from a face image (monitoring image) received from the stay management device 100a (step S301). For example, the authentication device 200 receives a face image from the stay management device 100a and extracts face feature information as in steps S201 to S203. Alternatively, the authentication device 200 may receive face feature information from the stay management device 100a. Next, the authentication unit 250 compares the acquired face feature information with the face information DB 210 (step S302). Note that, from the viewpoint of improving the matching accuracy, it is sufficient to compare the acquired face feature information with a registered image associated with a visitor ID in the visitor list or a visitor ID in the monitoring target list, rather than comparing with all image data in the face information DB 210. If the facial feature information matches (Yes in step S303), the authentication unit 250 identifies the visitor ID of the user whose facial feature information matches (step S304) and returns a message to the stay management device 100a indicating that face authentication was successful and the identified visitor ID (step S305).If there is no matching facial feature information (No in step S303), the authentication unit 250 returns a message to the stay management device 100a indicating that face authentication was unsuccessful (step S306).

[0052] Next, the overall operation of the stay management system according to the second embodiment will be described with reference to Figs. 10 to 13. Fig. 10 is a flowchart explaining the flow of reception of a visitor. Fig. 11 is a flowchart explaining the flow of a visitor passing through an entrance gate by face authentication. Fig. 12 is a flowchart explaining the flow of creating a monitoring target list. Fig. 13 is a flowchart explaining the flow of stay management.

[0053] The flow of visitor reception will be described with reference to FIG. When a visitor arrives at the entrance of the building, the gate device 400 accepts the visitor and the designation of the visitor's destination (step S401). For example, the visitor inputs the visitor information and the designation of the visitor's destination into the touch panel of the display unit 440 of the gate device 400, thereby performing such reception processing. Alternatively, a reception staff member of the company to be visited may perform the reception processing by operating a computer connected to the gate device 400.

[0054] The stay management device 100a acquires a facial image, associates it with the visitor's identification information (e.g., name, visitor ID, etc.), and registers it in the authentication device (step S402). The facial image may be acquired from a photo ID, or may be acquired by taking a picture of the visitor's face with a camera (e.g., an entrance camera). The visitor's identification information and facial image may also be acquired via the visitor's terminal (e.g., a computer, a smartphone, etc.) before the visit. Thereafter, the registration unit 101a of the stay management device 100a registers the visitor's facial image in the authentication device 200 in association with the visitor's identification information (e.g., name, visitor ID, etc.).

[0055] The registration unit 101a of the stay management device 100a associates the visitor with the visited destination and registers them in the storage unit 13a (visited destination storage unit) of the stay management device 100a (step S403).

[0056] Next, the flow of how a visitor passes through an entrance gate using face authentication will be described with reference to FIG. First, the entrance camera 410 captures a face image of the visitor and transmits it to the stay management device 100a. In this way, the stay management device 100a acquires a captured image including the face image of the visitor (step S501). The stay management device 100a requests face authentication of the captured image to the authentication device 200 (step S502). The stay management device 100a can request face authentication by specifying a visitor ID. The stay management device 100a receives a face authentication result (step S503). If the face authentication result is successful (Yes in step S504), the visitor ID whose face authentication has been successful is added to the visitor list 134 (step S505). The acquisition unit 120a acquires a visit destination associated with the visitor ID (step S506). The decision unit 130a decides the permitted stay time (step S507). The admission control unit 110a releases the restriction on the entrance gate (step S508). After that, the visitor can enter the building.

[0057] As a result, by registering the visitor's facial image in advance, the destination is automatically identified by facial recognition when the visitor arrives, so there is no need to input the destination and the visitor can enter with just facial recognition. In the example shown in Fig. 11, the entrance camera and gate device are used to determine the destination corresponding to the visitor ID and the permitted stay time. However, the above destination and stay time may also be determined by a stay management device that can be realized by a computer and camera at the reception desk at the entrance of the building.

[0058] Next, the flow of creating a monitoring list will be described with reference to FIG. The watch list will include visitors who have exceeded their permitted stay and have not yet left. First, the stay management device acquires, for example, a visitor list for a specific day (step S601). Next, if there is one or more visitors who have exceeded their permitted stay time (Yes in step S602), it further determines whether the one or more visitors have left the building (step S603). For example, a pass (e.g., an electronic card) may be issued to a visitor who has been permitted to enter, and the visitor's exit may be detected by holding the electronic card over an exit gate device when leaving. If one or more visitors have not left, a monitoring list is created (step S604).

[0059] This process of creating the monitoring list is repeated at a predetermined interval (for example, every few minutes or every few seconds), and the monitoring list is updated to the latest one. In this way, by narrowing down the monitoring list from the visitor list, the accuracy of face recognition can be improved and the processing time required for face recognition can be shortened.

[0060] Next, the flow of visitor stay management after entry will be described with reference to FIG. A plurality of monitoring cameras 300a to 300n arranged in the building capture images of visitors and transmit the images to the stay management device 100a via the network. In this way, the stay management device 100a acquires monitoring images from at least one of the plurality of monitoring cameras via the network (step S701). Next, the stay management device 100a requests face authentication from the authentication device by specifying the monitoring target list for the monitoring images (step S702). If the face authentication result received by the stay management device 100a is successful (Yes in step S703), the stay management device 100a identifies the visitor ID whose face authentication has been successful (step S704). The output unit 150a of the stay management device 100a outputs an alert to the management terminal 600 (step S705). The alert may include the identified visitor ID and location information of the monitoring camera among the plurality of monitoring cameras that captured the images.

[0061] The stay management system according to the second embodiment described above can properly manage visitor stays, detect visitors who stay longer than necessary, and output an alert. This makes it possible to discover suspicious people among multiple visitors, improving security. In addition, by narrowing down the visitor list to a monitoring list, it is possible to improve the accuracy of face recognition and shorten the processing time required for face recognition.

[0062] (Embodiment 3) Fig. 14 is a block diagram showing the configuration of a stay management device according to embodiment 3. In Fig. 14, the same components as those in embodiment 2 are given the same reference numerals as those in Fig. 5, and the description thereof will be omitted as appropriate. In the stay management device according to the present embodiment, an extension unit 160b in the control unit 10b is added. The extension unit 160b extends the visitor's permitted stay time when it is confirmed by face authentication that the visitor has been photographed by a specific surveillance camera (for example, a camera on the second floor or higher).

[0063] Fig. 15 is a diagram for explaining an example of layout on the first floor according to the embodiment 3. Fig. 16 is a diagram for explaining an example of layout on the second floor according to the embodiment 3. Fig. 17 is a flowchart for explaining stay management in the stay management system according to the embodiment 3. As described in the second embodiment, when a visitor passes through a gate, the acquisition unit 120a of the stay management device acquires visit destination information (e.g., conference room B on the second floor). Furthermore, the determination unit 130a of the stay management device determines the visitor's permitted stay time in the building (e.g., one hour). When the visitor then moves from the first floor to the second floor, the surveillance camera 300b captures the visitor. When it is confirmed by face authentication that the visitor has moved to the second floor, the extension unit 160b can extend the visitor's permitted stay time.

[0064] The flow of stay management according to the third embodiment will be described with reference to FIG. At least one of the multiple surveillance cameras 300a to 300n arranged in the building captures an image of the visitor and transmits the image to the stay management device 100a via the network. In this way, the stay management device 100a acquires a surveillance image from at least one of the multiple surveillance cameras via the network (step S801). Next, the stay management device 100a requests face authentication from the authentication device by specifying the surveillance target list for the surveillance image (step S802). If the face authentication result received by the stay management device 100a is successful (Yes in step S803), the stay management device 100a identifies the visitor ID whose face authentication has been successful (step S804). The stay location of the visitor is identified from the position of the surveillance camera that captured the image (step S805). It is determined whether the visitor's current location is a predetermined stay location (step S806). If the visitor is in the predetermined stay location (Yes in step S806), the extension unit 160b extends the visitor's permitted stay time (step S807). On the other hand, if the visitor is not at the predetermined stay position (No in step S806), the output unit 150a outputs an alert including the visitor's location information to the management terminal 600 (step S808).

[0065] In this way, in the stay management system according to the third embodiment, when the building to be visited is very large, the visitor's permitted stay time can be appropriately extended, thereby making it possible to perform more appropriate stay management.

[0066] (Embodiment 4) Fig. 18 is a block diagram showing a configuration of a stay management device according to embodiment 4. In Fig. 18, the same components as those in embodiment 2 or 3 are given the same reference numerals as those in Fig. 5 or 14, and the description thereof will be omitted as appropriate.

[0067] In the stay management device according to the present embodiment, an analysis unit 170c and an adjustment unit 180c are added to the control unit 10c. The analysis unit 170c and the adjustment unit 180c complement the function of the determination unit 130c that determines the permitted stay time based on visitor's destination information. That is, the analysis unit 170c acquires images captured by the entrance camera 410 or the surveillance camera 300, and analyzes the visitor's clothing type. The adjustment unit 180c determines an adjustment time for adjusting the permitted stay time based on the analyzed visitor's clothing type.

[0068] In addition, in the stay management device according to the present embodiment, a stay reference time 136c associated with a visit destination 135c and an adjustment time 138c associated with an outfit type 137c are added to the storage unit 13c. Examples of outfit types include suits, work clothes such as cleaners, and uniforms of delivery companies. The adjustment time can be arbitrarily set to, for example, 2 hours for suits, 1 hour for work clothes such as cleaners, and 0 hours for uniforms of delivery companies. That is, the adjustment time can be set differently depending on the purpose of visit associated with the outfit type. This makes it possible to adjust the stay permission time based on the outfit type analyzed from the photographed image of the visitor. In addition, when the visit destination information includes distance information or required time from the visitor's current location to the visit destination, the stay reference time may be set to be longer as the distance or required time becomes longer.

[0069] FIG. 19 is a flowchart illustrating a process of determining an allowed stay time according to the fourth embodiment. The determination unit 130c acquires a standard stay time associated with the visited destination information (step S901). The standard stay time is set to one hour. Next, the analysis unit 170c acquires a captured image from the entrance camera 410 or the monitoring camera 300, and identifies the visitor's clothing type (e.g., a suit) by image analysis (step S902). The adjustment unit 180c determines an adjustment time (e.g., two hours) associated with the identified clothing type (e.g., a suit) (step S903). Finally, the permitted stay time (three hours) is calculated from the standard stay time (one hour) and the adjustment time (two hours) (step S904). The standard stay time, adjustment time, and permitted stay time can be set arbitrarily.

[0070] In the stay management system according to the fourth embodiment described above, the permitted stay time can be adjusted by performing image analysis of the visitor's clothing, thereby enabling more flexible stay management.

[0071] In the above example, the program can be stored and provided to the computer using various types of non-transitory computer readable media. The non-transitory computer readable media includes various types of tangible storage media. Examples of the non-transitory computer readable media include magnetic recording media, magneto-optical recording media (e.g., magneto-optical disks), CD-ROM (Read Only Memory), CD-R, CD-R / W, and semiconductor memory. The magnetic recording media may be, for example, a flexible disk, a magnetic tape, or a hard disk drive. The semiconductor memory may be, for example, a mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, or RAM (Random Access Memory). The program may also be provided to the computer by various types of transitory computer readable media. Examples of the transitory computer readable media include electric signals, optical signals, and electromagnetic waves. The transitory computer readable media can provide the program to the computer via a wired communication path such as an electric wire and an optical fiber, or via a wireless communication path.

[0072] The present disclosure is not limited to the above-described embodiment, and may be modified as appropriate without departing from the spirit and scope of the present disclosure. In addition, the present disclosure may be implemented by appropriately combining the respective embodiments.

[0073] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. (Appendix 1) A registration means for acquiring a face image of a visitor and registering the face image in an authentication device; an entrance control means for authenticating the visitor based on authentication target information associated with the visitor's identification information and permitting the visitor to enter the building; An acquisition means for acquiring destination information within the building associated with the visitor's identification information; a determining means for determining an allowable stay time for the visitor in the building based on the acquired visiting destination information; a detection means for detecting the presence of the visitor by face recognition using the authentication device in surveillance images captured by one or more surveillance cameras in the building; an output means for outputting an alert when the presence of the visitor is detected by the face authentication after the permitted stay time has elapsed from the time of the permission of entry; A stay management device comprising: (Appendix 2) The stay management device described in Appendix 1, wherein the entry control means allows the visitor to enter a specified building if facial authentication using the authentication device is successful on an image of the visitor taken by a camera installed at the entrance of the building. (Appendix 3) The facility further includes an extension unit that extends the permitted stay time when the visitor's stay at a predetermined location is detected by the detection unit. 3. A stay management device according to claim 1 or 2. (Appendix 4) The stay management device according to any one of appendices 1 to 3, wherein the detection means causes the authentication device to perform face authentication based on a monitoring list associated with identification information of visitors who have passed the permitted stay time and have not left the building. (Appendix 5) a registration unit that, when receiving the visitor's identification information and the designation of the visit destination, registers the visitor's identification information and the visit destination information in a visit destination storage unit in association with each other, The acquisition means refers to the visit destination storage means and acquires the visit destination associated with the visitor who has succeeded in the face authentication by the entrance control means. 3. A stay management device as described in appendix 2. (Appendix 6) The stay management device according to any one of appendices 1 to 5, wherein, when the visited destination information includes information on distance or required time from the visitor's current location to the visited destination, the determination means determines the permitted stay time to be longer as the distance or required time becomes longer. (Appendix 7) 7. The stay management device according to any one of claims 1 to 6, wherein, when the visited destination information includes visit purpose information, the determining means determines different permitted stay times depending on the purpose. (Appendix 8) A stay time storage means is further provided for storing the visit destination information in association with a standard stay time and the clothing type in association with an adjustment time, The determining means is Identifying the reference stay time associated with the acquired visit destination information; Analyzing the captured image, identifying a type of clothing of the visitor, and identifying the adjustment time associated with the identified type of clothing; The stay allowance time is determined based on the specified stay reference time and adjustment time. 3. A stay management device as described in appendix 2. (Appendix 9) The output means outputs the alert to a predetermined management terminal. A stay management device according to any one of appendix 1 to 6. (Appendix 10) The output means includes: After the permitted stay time has elapsed, a location where the visitor's stay was detected is identified, and the identified location is output together with the alert. A stay management device according to any one of appendix 1 to 9. (Appendix 11) Acquire a facial image of the visitor and register the facial image in an authentication device; authenticating the visitor using authentication target information associated with the visitor's identification information and permitting the visitor to enter the building; Acquire destination information within the building associated with the visitor's identification information; determining an allowable stay time for the visitor in the building based on the acquired visit destination information; Detecting the presence of the visitor by face recognition using the authentication device in surveillance images captured by one or more surveillance cameras in the building; The visitor management method includes outputting an alert if the visitor's presence is detected by the facial recognition after the permitted stay time has elapsed from the time the entry was permitted. (Appendix 12) A process of acquiring a face image of a visitor and registering the face image in an authentication device; a process of authenticating the visitor based on authentication target information associated with the visitor's identification information and permitting the visitor to enter the building; acquiring information about a visitor in the building associated with the visitor's identification information; A process of determining an allowable stay time for the visitor in the building based on the acquired visit destination information; A process of detecting the presence of the visitor by face recognition using the authentication device for surveillance images captured by one or more surveillance cameras in the building; A non-transitory computer-readable medium having a program stored thereon, the non-transitory computer-readable medium causing a computer to execute a stay management process including a process of outputting an alert if the visitor's stay is detected by the facial recognition after the visitor's stay has elapsed from the time of the permission of entry. (Appendix 13) A gate device for controlling the entry and exit of visitors; Cameras installed inside the building; A stay management device according to any one of appendix 1 to 10, An authentication device including a storage means for storing face feature information of a plurality of persons and an authentication means for performing face authentication using the set of the face feature information; a management terminal that receives the output of the alert; A stay management system that includes: [Explanation of symbols]

[0074] 10a to 10c Control section 11a Memory 12a Communications Department 13a, 13c storage section 100 Stay Management Device 100a~100c Stay management device 101 Registration Department 101a Registration Department 103a Authentication control unit 110 Admission Control Unit 110a Admission Control Unit 120 Acquisition Department 120a Acquisition Department 130 Decision Section 130a Decision section 140 Detection unit 140a Detector 150 Output section 150a Output section 160b extension 170c Analysis Department 180c adjustment section 200 Authentication Device 300 Surveillance Camera 400 Gate device 410 Entrance Camera 420 Storage section 430 Communications Department 440 Display section 450 Control Unit 451 Shooting control section 452 Gate control section 460 Gates 500 Network 600 Management terminal

Claims

1. An entrance control means for permitting a visitor to enter a predetermined area by authentication based on a face image of the visitor photographed at the entrance of the predetermined area and a face image of the visitor registered in advance; A determination means for determining an allowable stay time of the visitor in the predetermined area based on visited destination information that indicates a place in the predetermined area and is associated with the preregistered visitor; A stay management device comprising:

2. a detection means for detecting the visitor by face recognition using an image captured within the predetermined area; an output means for outputting an alert including identification information of the detected visitor and location information of a surveillance camera among a plurality of surveillance cameras that captured the image when the visitor is detected by the face authentication after the lapse of the permitted stay time from the permission of entry; The stay management device according to claim 1 , further comprising:

3. The stay management device according to claim 1 , wherein the entry control means permits entry of a visitor into a specified area when face authentication is successful on an image of the visitor taken by a camera installed at an entrance to the specified area.

4. The facility further includes an extension unit that extends the permitted stay time when the visitor's stay at a predetermined location is detected by the detection unit. The stay management device according to claim 2 .

5. The stay management device according to claim 2 , wherein the detection means causes the authentication device to perform face authentication based on a monitoring list associated with identification information of visitors who have passed the permitted stay time and have not left the specified area.

6. An acquisition means for acquiring visited destination information within the predetermined area associated with the visitor's identification information; a registration unit that, when receiving the visitor's identification information and the designation of the visit destination, registers the visitor's identification information and the visit destination information in a visit destination storage unit in association with each other, The acquisition means refers to the visit destination storage means and acquires the visit destination associated with the visitor who has succeeded in the face authentication by the entrance control means. The stay management device according to claim 2 .

7. The stay management device according to any one of claims 1 to 5, wherein, when the visited destination information includes distance information from the visitor's current location to the visited destination, the determination means determines that the permitted stay time is to be longer as the distance becomes longer.

8. The stay management device according to claim 1 , wherein, when the visited destination information includes visit purpose information, the determination means determines different permitted stay times depending on the visit purpose.

9. 1. A computer-implemented visit management method, comprising: permitting the visitor to enter the specified area through authentication based on a facial image of the visitor photographed at the entrance to the specified area and a facial image of the visitor registered in advance; determining an allowable stay time for the visitor in the specified area based on visit destination information that is associated with the preregistered visitor and indicates a place in the specified area; How to manage your stay.

10. A process of permitting a visitor to enter a predetermined area by authentication based on a face image of the visitor photographed at an entrance to the predetermined area and a face image of the visitor registered in advance; A process of determining an allowable stay time for the visitor in the specified area based on visit destination information that indicates a place in the specified area and is associated with the pre-registered visitor; A program that causes a computer to execute the following.

Images