Facial recognition entrance / exit system and facial recognition entrance / exit method

Abstract

To provide a system and method for face-authentication entry / exit allowing for limiting the range or occasion of entering rooms and guaranteeing security by setting up permitted-to-stay time, the number of visit times and / or visit areas, when a resident of a housing complex gives entry permission to a deliverer, a checker of a gas appliance, etc. or the like.SOLUTION: A system for face-authentication entry / exit comprises a first terminal device 70 of a resident of a housing complex, a second terminal device 80 of a store or business office, a third terminal device 90 of a visitor who visits the resident of the housing complex at the request of the store or business office, an external system (order acceptance system 60) that accepts a visit request from the first terminal device and notifies the third terminal device of acceptance of the visit request, a camera installed in the housing complex, and an electric lock for opening and closing a gate installed on a way leading to a dwelling room of the resident in the housing complex. The electric lock of the gate is open-close controlled by comparing authentication information received from the second terminal device with authentication information obtained from image information of the visitor taken by the camera.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a face authentication entrance / exit system and a face authentication entrance / exit method. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there has been known a system that allows only authorized persons to enter a building, floor, or room in an apartment building or office, etc., with security in mind. Among such entrance / exit systems, entrance / exit systems that utilize personal authentication by facial recognition are being used as contactless entrance / exit systems that improve convenience and take into consideration the prevention of infectious diseases. Patent Document 1 describes an unlocking control device that, taking into consideration the entry of an unspecified number of people, allows passage to businesses that enter regularly only at predetermined times and dates. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6870802 Summary of the Invention [Problem to be solved by the invention]

[0004] The technology described in Patent Document 1 acquires biometric information of a person authorized to unlock and affiliation identification information that identifies the affiliation, and stores this in an unlocking permission database. Then, the biometric information of a person to be judged as to whether or not to permit unlocking is acquired, and is compared with the biometric information of the person authorized to unlock stored in the unlocking permission database to make an unlocking decision. Note that the biometric information used in the unlocking control device described in Patent Document 1 is said to include facial photo information.

[0005] The technology described in Patent Document 1 makes it possible to set the permitted time for each affiliation, such as day of the week or date, according to the affiliation and identification information of the worker, such as a cleaning worker, who is permitted to open the door, and allow the worker to enter temporarily. In other words, the technology described in Patent Document 1 is effective for subjects who enter at regular times, but Patent Document 1 does not mention permission for entry in cases where residents of an apartment building individually place orders and a delivery person leaves the package in front of the house.

[0006] In other words, Patent Document 1 does not disclose the conditions for entry permission in the case of parcel deliveries, such as the time limit or number of entries that are permitted, making it difficult to set conditions that meet the needs of residents wishing to have deliveries made.

[0007] In view of the above problems, the object of the present invention is to provide a facial recognition entrance / exit system and method which ensures security by allowing residents of an apartment building to set the permitted stay time, number of visits and / or visiting area when granting entry permission to delivery people, gas appliance inspectors, etc., thereby limiting the scope and opportunities of entry. [Means for solving the problem]

[0008] In order to solve the above problems, for example, the configurations described in the claims are adopted. The present application includes multiple means for solving the above problems, and as one example, the facial recognition entrance / exit system of the present invention is a facial recognition entrance / exit system that sets entry permission conditions for visitors to an apartment building, and includes a first terminal device of a resident of the apartment building, a second terminal device of a store or office, a third terminal device of a visitor who visits a resident of the apartment building at the request of the store or office, and an external system that accepts a visit request from the first terminal device and notifies the third terminal device. In addition, the facial recognition entry / exit system of the present invention comprises a camera installed in the apartment building, an electric lock for opening and closing a gate installed in the apartment building on the way to the resident's room, and an entry / exit control device that compares authentication information received from the second terminal device with authentication information obtained from image information of the visitor captured by the camera, and controls the opening and closing of the electric lock on the gate. Effect of the Invention

[0009] According to the present invention, residents of apartment buildings can set permitted stay times, number of visits, and visiting areas for delivery persons and the like, thereby limiting the scope and opportunities for entry and ensuring security. In addition, when a courier is delivering multiple packages, the permitted stay time and number of visits can be added up, allowing the courier to deliver to multiple residents during a single visit. Problems, configurations and effects other than those described above will become apparent from the following description of the embodiments. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram showing an example of the overall configuration of a face recognition entrance / exit system according to an embodiment of the present invention; [Diagram 2] 1 is a block diagram showing an example of the hardware configuration of an entrance / exit control device used in a face authentication entrance / exit system according to an embodiment of the present invention. [Diagram 3] 1 is a block diagram showing an example of the hardware configuration of an order reception system used in a face recognition entrance / exit system according to an embodiment of the present invention. FIG. [Figure 4] 1 is a block diagram showing an example of the hardware configuration of a terminal device used in a face authentication entrance / exit system according to an embodiment of the present invention. FIG. [Diagram 5] 1 is a diagram showing a data structure of a user information database in an entrance / exit control device used in a face authentication entrance / exit system according to an embodiment of the present invention. FIG. [Figure 6] 1 is a diagram showing a data structure of an entrance / exit permission setting database in an entrance / exit control device used in a face authentication entrance / exit system according to an embodiment of the present invention; [Figure 7] 1 is a diagram showing the data structure of a held token database in an entrance / exit control device used in a face authentication entrance / exit system according to an embodiment of the present invention. FIG. [Figure 8] 1 is a diagram showing a data structure of an entrance / exit permission information database in an entrance / exit control device used in a face authentication entrance / exit system according to an embodiment of the present invention. FIG. [Figure 9] FIG. 2 is a diagram showing the data structure of a partner information database in an entrance / exit control device according to one embodiment of the present invention, which is used in a face recognition entrance / exit system according to an embodiment of the present invention. [Figure 10] FIG. 11 is a diagram showing an example of a GUI for selecting a home delivery order destination, used in the face recognition entrance / exit system according to an embodiment of the present invention. [Figure 11] FIG. 11 is a sequence diagram showing an example of the flow of order reception in a face recognition entry / exit system specialized for delivery according to an embodiment of the present invention. [Figure 12] FIG. 11 is a sequence diagram showing an example of the unlocking flow in a face recognition entrance / exit system specialized for delivery according to an embodiment of the present invention. [Figure 13] FIG. 11 is a sequence diagram showing an example of the flow of order reception in a face recognition entrance / exit system specialized for inspectors such as gas inspectors according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of a face recognition entrance / exit system of the present invention (hereinafter, referred to as "this embodiment") will be described in detail with reference to the drawings. In this example, when necessary for convenience of explanation, the example will be divided into multiple sections for explanation. However, unless otherwise specified, these are not unrelated to each other, and one is a partial or complete variation, detailed explanation, supplementary explanation, etc. of the other.

[0012] In addition, in this example, when referring to the number of elements, including numbers, values, quantities, ranges, etc., unless specifically stated or clearly limited in principle to a specific number, the number is not limited to that specific number and may be more than or less than the specific number.

[0013] Furthermore, in this example, components including elements, procedures (steps), etc. are not necessarily essential unless specifically stated otherwise or considered to be clearly essential in principle.

[0014] <Overall configuration of the facial recognition entrance / exit system> FIG. 1 is a diagram showing an example of the configuration of a face recognition entrance / exit system in which an entrance / exit control device is arranged in an apartment building and entrance / exit is provided by face recognition. The facial recognition entrance / exit system in this example includes an entrance / exit control device 20 that controls entrance / exit within an apartment building 10, a camera 40 that displays the entrance / exit doors, an electric lock 41 that controls the unlocking of the doors, and an elevator 42 that is used for ascending and descending within the apartment building 10.

[0015] The face authentication entrance / exit system of this embodiment also uses an order reception system 60 and terminal devices 70, 80, and 90 each having different functions. The order receiving system 60 is a system that enables stores to receive home delivery requests from residents and provide home delivery services. Note that the order receiving system 60 can be managed and operated independently by each store that receives orders from residents, but the order receiving system 60 can also be managed and operated by an organization that aggregates multiple affiliated stores. Hereinafter, both individual stores and the aggregated organization to which the stores are affiliated will be referred to as "stores, etc."

[0016] The terminal device 70 is a terminal used by the resident to place an order for home delivery, gas inspection, etc. The terminal device 80 is a terminal through which a store or the like receives a home delivery order from the resident via the order receiving system 60. The terminal device 90 is a terminal with which the delivery person receives a delivery request from the order receiving system 60. The terminal device 90 includes terminals owned by inspection companies that are requested by residents to inspect indoor gas, such as gas inspection companies, as described below, in addition to the delivery person. Therefore, hereinafter, the term "delivery person, etc." will be used to include inspection workers other than the delivery person.

[0017] Although mobile terminals such as smartphones are usually used as the terminal devices 70, 80, and 90, they may also be fixed terminals installed in the homes of residents, stores, etc. Therefore, the term "terminal device" used here includes both mobile terminals and fixed terminals.

[0018] The entrance / exit control device 20 disposed in the apartment building 10 is composed of a communication processing unit 31 , an external input / output unit 32 , a processing unit 21 and a storage unit 33 . The communication processing unit 31 is connected to the above-mentioned order receiving system 60 and terminal devices 70 to 90 via a network line 50 such as the Internet. The external input / output unit 32 is an interface for transmitting and receiving information to and from a camera 40, an electric lock 41, and an elevator 42 installed within the apartment building 10.

[0019] The processing unit 21 of the entrance / exit control device 20 controls entrance / exit, including setting or changing the entrance / exit permission for delivery persons and the like, based on information received from the communication processing unit 31 and the external input / output unit 32. The storage unit 33 also includes various databases that store information received via the communication processing unit 31 and the external input / output unit 32 and information processed by the processing unit 21 of the entrance / exit control device 20.

[0020] The processing unit 21 of the entry / exit control device 20 is composed of a user authentication unit 22, a token management unit 23, an email sending unit 24, an entry / exit setting reception unit 25, a delivery request reception unit 26, a face authentication unit 27, a passage permission unit 28, a door control unit 29, and an elevator control unit 30.

[0021] The user authentication unit 22 accepts login processing from the resident's terminal device 70 and the order reception system 60 managed by the store or the like, and authenticates that the user is a user who is permitted to access (hereinafter referred to as an "authenticated user"). The token management unit 23 issues a temporary token to an authenticated user as authentication data for ensuring that a setting request has been accepted, and performs expiration management of the issued token.

[0022] The mail sending unit 24 notifies the terminal device 70 of the resident of the apartment building 10 of the processing result of the visit request from the order receiving system 60 . The entry / exit setting reception unit 25 receives an application for entry / exit permission from the resident's terminal device 70, and the delivery request reception unit 26 receives a temporary entry / exit permission setting from the order reception system 60.

[0023] The face authentication unit 27 receives the image from the camera 40 and authenticates the delivery person based on the degree of match with the face of the delivery person registered in advance. The passage permission unit 28 checks whether the person identified by the face authentication unit 27 is permitted to enter or exit. When the camera 40 is installed in front of the door, the door control unit 29 performs control to unlock the door based on the information from the camera 40. When the camera 40 is installed in front of the elevator 42, the elevator control unit 30 performs control to set the destination permitted floor of the elevator 42 based on the information from the camera 40.

[0024] The storage unit 33 includes a user information database (hereinafter abbreviated as "DB") 34, an entry / exit permission setting DB 35, a held token DB 36, an entry / exit permission information DB 37, and an affiliate information DB 38. The entry / exit permission information DB 37 includes a face photograph 37a (see FIG. 8).

[0025] The user information DB 34 stores user information that enables a resident to log in to the entry / exit control device 20. The entry / exit permission setting DB 35 stores entry / exit permitted persons such as delivery persons that are set by the resident's terminal device 70 and accepted via the entry / exit setting acceptance unit 25. As will be described later with reference to FIG. 7, the held token DB 36 stores tokens issued and managed by the token management unit 23, temporary permission IDs set by residents, expiration dates of tokens, and the like.

[0026] The entry / exit permission information DB 37 stores information on the delivery person or the like who is currently permitted to enter / exit. Specifically, the entry / exit setting reception unit 25 and the delivery request reception unit 26 store facial photographs 37a of the delivery person or the like received. Furthermore, the partner information DB 38 stores an access URL to the order reception system 60 provided in the store or the like.

[0027] The terminal device 70 used by the residents of the apartment building 10 to place an order for home delivery or the like is made up of a web browser 71, a communication processing unit 72, a storage unit 73, and an email receiving unit 74. The terminal device 70 accesses the order screen of the order receiving system 60 using a Web browser 71, and requests home delivery. The communication processing unit 72 provides a function for accessing each server including the order receiving system 60. The storage unit 73 stores an application for the Web browser 71. The mail receiving unit 74 receives a delivery notification from the order receiving system 60 and a face registration notification from the entrance / exit control device 20.

[0028] The order receiving system 60 is made up of an order receiving unit 61, a visit request unit 62, a communication processing unit 63, a mail sending unit 64, and a storage unit 65. The order receiving unit 61 receives orders from the terminal devices 70 of the residents via a network line 50 such as the Internet.

[0029] The visit request unit 62 notifies the entrance / exit control device 20 of the apartment building 10 of the time of visit and registers the face of the delivery person. The communication processing unit 63 is responsible for communication with the terminal devices 70-90. The email sending unit 64 sends a delivery notification to the resident's terminal device 70. The memory unit 65 stores various programs used in the order receiving system 60.

[0030] The terminal device 80 owned by the store is composed of a store delivery reception unit 81, a communication processing unit 82, and a memory unit 83. The store delivery reception unit 81 receives an order request from the order reception system 60. The communication processing unit 82 ensures communication with the terminal devices 70, 90 and the entrance / exit control device 20 of the apartment building 10. The memory unit 83 stores various programs used in the terminal device 80.

[0031] The terminal device 90 owned by a delivery person or the like is composed of a delivery person delivery reception unit 91, a communication processing unit 92, and a memory unit 93. The delivery person delivery reception unit 91 receives a delivery request from the order reception system 60. The communication processing unit 92 communicates with the terminal devices 70, 80 and the entrance / exit control device 20 of the apartment building 10. The storage unit 93 stores various programs used in the terminal device 90, and also stores facial photographs 94 of the delivery person, etc.

[0032] The facial photograph 94 of the delivery person or the like stored in the memory unit 93 is transmitted from the terminal device 90 to the order receiving system 60 when the delivery start registration of the delivery person or the like is performed in the order receiving system 60. The facial photograph 94 may be registered in advance in the memory unit 65 of the order receiving system 60 instead of being stored in the terminal device 90.

[0033] <Hardware configuration of the face recognition entrance / exit system> [Hardware configuration of the entrance / exit control device 20] Fig. 2 is a block diagram showing an example of a hardware configuration of the entrance / exit control device 20 shown in Fig. 1. The entrance / exit control device 20 includes a CPU (Central Processing Unit) 210, a ROM (Read Only Memory) 220, a RAM (Random Access Memory) 230, and a non-volatile storage 240, all connected to a system bus. It also includes a network interface (represented as "network IF" in the figure) 250 for communicating with external devices.

[0034] The CPU 210 reads out from the ROM 220 and executes the program code of the software that realizes the functions of each part of the entrance / exit control device 20. Variables and the like generated during the arithmetic processing performed in the entrance / exit control device 20 are temporarily written to the RAM 230. The CPU 210 executes the program code recorded in the ROM 220 to realize various functions of the entrance / exit control device 20.

[0035] As the network interface (abbreviated as "network I / F" in the figure) 250, for example, a NIC (Network Interface Card) or the like is used, and various data can be transmitted and received between devices via a LAN (Local Area Network), a dedicated line, or the like connected to a terminal of the NIC. The function of the communication processing unit 31 in FIG. 1 is realized by the network I / F 250.

[0036] The non-volatile storage 240 is configured with a non-volatile storage device such as a hard disk or an SSD (Solid State Drive), and semi-permanently stores and stores programs and data necessary for the operation of the CPU 210. The non-volatile storage 240 constitutes the storage unit 33 in FIG.

[0037] The entrance / exit control device 20 is provided with an input unit 260 and an output unit 270 as necessary. Images captured by each camera 40, sensor signals indicating the open / closed state of each electric lock 41, information on the operating state of the elevator 42, etc. are input to each of the input units 260. In addition, each of the output units 270 outputs control signals for each camera 40, each electric lock 41, and the elevator 42. The camera 40 may be configured to be connected to the network interface 250 via a LAN.

[0038] [Hardware configuration of order reception system 60] FIG. 3 is a block diagram showing an example of a hardware configuration of the order receiving system 60 shown in FIG. The order receiving system 60 also comprises a CPU 310, a ROM 320, a RAM 330, and a non-volatile storage 340 (corresponding to the storage unit 65 in FIG. 1) connected to a system bus. The order receiving system 60 also comprises a network I / F 350 for communicating with external devices. These configurations and functions are the same as the hardware configurations and functions of the entrance / exit control device 20 described in FIG. 2, so a description thereof will be omitted. However, the order receiving system 60 does not have configurations equivalent to the input unit 260 and output unit 270 shown in FIG. 2.

[0039] [Hardware configuration of terminal devices 70 to 90] FIG. 4 is a block diagram showing an example of the hardware configuration of the terminal device 70, the terminal device 80, and the terminal device 90 shown in FIG. The terminal device 70 also includes a CPU 410, a ROM 420, and a RAM 43 connected to the system bus. 0, and a non-volatile storage 460 (corresponding to the storage unit 73 in FIG. 1). By executing the program code of the Web browser 71 recorded in the ROM 420, various functions of the terminal device 70 are realized. The terminal device 70 also includes a network I / F 470 for communicating with external devices. These configurations and functions are the same as the hardware configurations and functions of the entrance / exit control device 20 described in FIG.

[0040] Furthermore, the terminal device 70, the terminal device 80, and the terminal device 90 are equipped with a display device 440 and an input device 450. The display device 440 is a display panel such as a liquid crystal display, and displays a GUI (Graphical User Interface) screen and the results of processing performed by the CPU 410. The input device 450 is a touch panel, a pointing device such as a mouse, or a keyboard, and the user can operate the input device 450 to input information and instructions. The input device 450 generates an input signal according to the user's operation and supplies it to the CPU 410. The entrance / exit control device 20 and the order reception system 60 may be equipped with the display device 440 and the input device 450.

[0041] <Data structures of various databases> [Data structure of user information DB34] FIG. 5 is a diagram showing the data structure of the user information DB 34 of the entrance / exit control device 20. As shown in FIG. As shown in FIG. 5, the user information DB 34 has fields for a room number 34a, a login ID 34b, a login password 34c, and a notification destination email address 34d.

[0042] The room number 34a stores the room number of the resident of the apartment building 10. The login ID 34b and the login password 34c store the login ID and login password for accessing the user authentication unit 22 of the entrance / exit control device 20. The notification destination email address 34d stores the notification destination email address for sending an email to the terminal device 70 of the resident.

[0043] When the order reception system 60 receives a request for entry or exit of a delivery person or the like from the entry / exit control device 20 of the apartment building 10 and the face of the delivery person or the like is registered or deleted, the email sending unit 24 of the entry / exit control device 20 sends an email to the terminal device 70 using the notification email address 34d.

[0044] [Data structure of entry / exit permission setting DB35] 6 is a diagram showing a data structure of the entry / exit permission setting DB 35 of the entry / exit control device 20. The residents of the apartment building 10 need to log in to the entry / exit control device 20 and register in advance, in the entry / exit permission setting DB 35, the entry / exit permission setting that restricts the entry / exit permission of delivery persons and the like.

[0045] The entry / exit permission setting DB 35 has fields for room number 35a, temporary permission ID 35b, target person 35c, permitted visit area 35d, permitted stay time 35e, number of authentications 35f, and token validity period 35g. The token validity period 35g is the expiration date from the setting of the token set by the order of a delivery person or the like.

[0046] Here, the room numbers of the residents of the apartment building 10 are stored in the room number 35a, as in the user information DB 34. A temporary identification signal that gives the delivery person or the like permission to enter or leave is stored in the temporary permission ID 35b. A target person such as a delivery person identified by the temporary permission ID 35b is stored in the target person 35c. In FIG. 6, delivery person A and the gas inspector correspond to the targets.

[0047] The permitted visit area 35d stores the areas that the resident has permitted the target person 35c to visit. For example, the resident of Room 102 indicates that the permitted visit areas for delivery persons and the like are limited to the entrance and the first floor, and the resident of Room 201 indicates that the permitted visit areas for delivery persons and the like are limited to the entrance and the second floor.

[0048] The permitted stay time 35e stores the permitted stay time of the person who the resident has given permission to visit. For example, the permitted stay time 35e shown in FIG. 6 is 5 minutes for a delivery person and 30 minutes for a gas inspector. This is determined based on the assumption that a delivery person can finish their work within 5 minutes, and that a gas inspector needs about 30 minutes for inspection. Note that the permitted stay time 35e is merely a guideline, and it is possible to set the permitted stay time arbitrarily depending on the relationship between the resident and the delivery person. It is also desirable to be able to change the initially set permitted stay time as necessary.

[0049] The authentication count 35f stores the number of times a delivery person or the like is authenticated. Here, the authentication count refers to the number of times a delivery person or the like is allowed to pass through a gate. In other words, a delivery person or the like who makes a delivery or the like at the request of a resident usually has to pass through several gates before reaching the resident's room in the apartment building 10. For example, in order for delivery person A to reach the resident in room 102, he or she must pass through two gates, the entrance gate and the gate on the first floor. Therefore, the authentication count 35f for delivery person A is set to "2 times."

[0050] On the other hand, for gas inspectors, the number of authentication attempts is set to "4 times" in 35f. This is to take into consideration the work of the gas inspectors, and assumes that the residents of Rooms 102 and 201 will pass through the same two gates at least twice. For example, there may be cases where the equipment and measuring devices required for inspection cannot be brought to the site in one go, so we believe that the residents set the number of authentication attempts to "4 times" in 34f to allow for some leeway.

[0051] The token validity period 35g is the validity period of the retained token managed by the token management unit 23 of the entrance / exit control device 20 and stored in the retained token DB 36. This retained token is a type of authentication data, and is necessary for registering a delivery person, etc. Here, the token validity period 35g is set to "1 day" for delivery company A, since one day is considered sufficient, and is set to "7 days" for gas inspectors, taking into consideration the time it takes to determine the person in charge. This token validity period 35g means that visitor registration must be completed within this period.

[0052] [Data structure of the retention token DB36] FIG. 7 is a diagram showing the data structure of the held token DB 36 of the entrance / exit control device 20. As shown in FIG. As shown in FIG. 7, the retained token DB 36 has fields for a token 36a, a temporary permission ID 36b, and a token expiration date 36c. As explained in the token validity period 34g of Fig. 6, the token 36a is authentication data that is issued and managed by the token management unit 23 of the entrance / exit control device 20 when a resident requests a delivery person or the like to deliver a package, etc. In other words, data for authenticating a delivery person or the like, such as "Oxaaaaaaaa", is stored in the field of the token 36a.

[0053] The temporary permission ID 36b stores an identification code of a person who is temporarily permitted to enter the room, set by the resident for each delivery person, etc., similar to the temporary permission ID 35b in the entry / exit permission setting DB 35. In Fig. 7, the temporary permission IDs 36a of "1" to "4" are stored for each token 36a. The token expiration date 36c stores the expiration date of the token stored in the token 36a.

[0054] The token validity period 35g in FIG. 6 is set to a validity period such as "1 day" or "7 days," whereas the token expiration date 36c in FIG. 7 is set to, for example, "22 / 3 / 26 11:30," indicating that the expiration date of this token 36a is until 11:30 on March 26, 2022.

[0055] [Data structure of entry / exit permission information DB37] FIG. 8 is a diagram showing a data structure of the entry / exit permission information DB 37 of the entry / exit control device 20. As shown in FIG. As shown in FIG. 8, the entry / exit permission information DB 37 has fields for a face photograph 37a, a permitted room 37b, a permitted visit area 37c, a permitted stay time 37d, and a possible authentication count 37e. In each field of the entry / exit permission information DB 37, data received when the delivery request receiving unit 26 of the entry / exit control device 20 receives a visitor registration request from the order receiving system 60 is stored.

[0056] That is, for example, face photographs of delivery persons permitted to visit, such as face photographs "001.Jpg" and "002.Jpg", are stored in face photograph 37a of entry / exit permission information DB 37. Also, "Room 102" or multiple rooms "Rooms 102-201" are stored in permitted room 37b, and "Entrance and 1st floor" and "Entrance and 1st and 2nd floors" are stored in permitted visit area 37c. Furthermore, the permitted stay time 37d stores a permitted stay time such as "5 minutes" to "60 minutes," and the permitted number of authentication attempts 37e stores a value from "2 times" to "8 times." Here, the possible authentication count 37e is the same as the possible authentication count 35f described in FIG. 6, and stores the possible authentication count for a delivery person or the like to be authenticated at two gates and reach a resident's room.

[0057] The visitor registration request from the order reception system 60 includes the token issued at the time of the order in addition to the facial photograph. Therefore, the token management unit 23 of the entrance / exit control device 20 searches the retained token DB 36 for the temporary permission ID corresponding to the token, which is the authentication data. The entrance / exit setting reception unit 25 of the entrance / exit control device 20 then generates the permitted room 37b, permitted visit area 37c, permitted stay time 37d, and possible authentication count 37e of the entrance / exit permission information DB 37 from the corresponding entrance / exit permission setting DB 35, and stores them in the entrance / exit permission information DB 37.

[0058] Furthermore, when the face authentication unit 27 of the entrance / exit control device 20 receives a visitor registration request from the order reception system 60, it performs matching between the face photo stored in the face photo 37a of the entrance / exit permission information DB 37 and the face photo of the person to be entered taken by the camera 40. At this time, if the face authentication unit 27 determines that it is the same delivery person, the entrance / exit setting reception unit 25 adds the contents of the new reception request to the permission information that has already been registered.

[0059] For example, the person with face photo 37a "001.Jpg" in FIG. 8 is assumed to be a delivery person, and the person with face photo 37a "002.Jpg" is assumed to be a gas inspector, and the following explanation will be given. The delivery person with face photo 37a "001.Jpg" is requested by the resident of room 102 through the order reception system 60, and the permitted room 37b is only room 102. In addition, the permitted visit area 37c is set to the entrance and the first floor, the permitted stay time is set to 5 minutes, and the number of times that authentication can be performed 37e is set to 2 times. As already explained, this means that the delivery person must pass through two gates before arriving at room 102, which is the resident's room, as described above. Since the delivery person only delivers goods, the permitted stay time 37d is set to a short time of 5 minutes.

[0060] On the other hand, it is assumed that the person with face photo 37a "002.Jpg" (here, a gas inspector) has been requested to inspect gas by the occupants of rooms 102 and 201. In other words, the permitted visit areas 37c for the person with face photo "002.Jpg" are the entrance, the first floor, and the second floor. For example, the occupant of room 102 sets the permitted stay time 37d for the person with face photo 37a "002.Jpg" who is a gas inspector to 40 minutes and the number of times authentication can be performed to four. The occupant of room 201 sets the permitted visit area 37c for the person with the same face photo "002.Jpg" to the entrance and the second floor, the permitted stay time to 20 minutes, and the number of times authentication can be performed to four.

[0061] In such a case, as shown in the second row of Fig. 8, the person who is the gas inspector and whose face photo 37a is "002.Jpg" is given permission to enter the building with the visit permitted areas 37c being the entrance, the first floor, and the second floor, with a total permitted stay time of 60 minutes and an additional number of possible authentication attempts of 8. Therefore, the person with the face photo "002.Jpg" can inspect gas for orders from multiple residents in rooms 102 and 201 across the first and second floors. In this way, when a delivery person, including a gas inspector, delivers multiple packages or performs gas inspections in multiple rooms, the delivery person can deliver to and inspect multiple residents during a single visit by adding up the permitted stay time and number of visits.

[0062] [Data structure of partner information DB38] 9 is a diagram showing a data structure of the partner information DB of the entrance / exit control device 20. The system administrator registers partner information in the partner information DB in advance. As shown in FIG. 9, the business partner information DB 38 has fields for business partner name 38a, access destination 38b, user name 38c, and password 38d.

[0063] The company name 38a stores the name of a company such as a delivery company or a gas inspector. The access destination 38b stores the URL for accessing the homepage of each business. In the user name 38c, the name of the occupant, such as "aaaaaa" or "cccccc", is stored. Password 38d stores a password, such as "Bbbbbb" or "Dddddd," for guiding delivery persons, gas inspectors, etc., to the resident's room.

[0064] FIG. 10 is a diagram showing a GUI used when a resident of the apartment building 10 accesses the delivery request receiving unit 26 of the entrance / exit control device 20 when placing an order for home delivery or the like. Hereinafter, the linking between the entrance / exit control device 20 and the order receiving system 60 will be described with reference to FIG.

[0065] For example, the occupant of room 102 selects, for example, delivery company A from the company name 38a in the partner information DB 38 on the GUI shown in FIG. Further, the occupant of Room 102 selects Deliveryman A·Room 102 from the target person 34c of the entry / exit permission setting DB 35, and presses the redirect button. Then, as shown in Figure 10, delivery company A is notified that the permitted visit area is the entrance / first floor, the permitted stay time is 5 minutes, the number of authentications is 2, and the token validity period is 1 day. As a result, delivery company A is required to deliver the product ordered by the resident in Room 102 to the resident within one day.

[0066] <Sequence showing the flow of order reception> FIG. 11 is a sequence diagram from when an order is placed on the terminal device 70 of a resident of the apartment building 10 to when the delivery person is registered (visitor registration) in the entrance / exit control device 20. In FIG. First, a resident accesses the entrance / exit control device 20 from the terminal device 70 and logs in (S10). The entrance / exit control device 20 then executes a login process (S11), and if the room number of the logged-in resident matches the content of the resident's room number 34a in the user information DB 34, it issues a token and executes a redirect process (S12).

[0067] The token information issued in step S12 is treated as authentication data approved by the resident. Then, by passing this token information to the order receiving system 60, the order receiving system 60 uses the token to give the delivery person permission for face authentication (permission to enter the room). That is, in the redirect process of step S12, the entrance / exit control device 20 transfers to the order receiving system 60 the login ID and password for the order receiving system 60, as well as the email address of the delivery person.

[0068] Next, the resident's terminal device 70 undergoes redirect processing by the entrance / exit control device 20 and performs screen transition processing to redirect the web browser of the terminal device 70 to the order reception system with the token in hand (S13). Note that this processing of the terminal device 70 is performed on a screen loaded by the web browser, for example, a screen written and processed in javascript. Then, the terminal device 70 transmits a notification of the screen transition to the order receiving system 60. In response to this, the order receiving system 60 performs a login process in response to the screen transition of the terminal device 70 (S14).

[0069] Furthermore, after the screen transition in step S13, the resident uses the terminal device 70 to select an order using the token (S15) and transmits the order information to the order receiving system 60. The order receiving system 60 then receives the order information from the terminal device 70 and stores the order information in the storage unit 65 (S16). The order receiving system 60 then notifies the terminal device 70 by email that the order has been accepted (S17).

[0070] Next, the order receiving system 60 makes a delivery request for the resident's order to the store terminal device 80 (S18), and the store terminal device 80 receives this and selects delivery acceptance (S19). Furthermore, the order receiving system 60 makes a delivery request to the delivery company's terminal device 90 (S20), and the delivery company's terminal device 90 receives this and selects delivery acceptance (S21). Note that the order receiving system 60 may perform either the process of step S18 or the process of step S20 first.

[0071] After the processes of steps S18 and S20 are completed and the product is handed over between the terminal device 90 of the delivery company and the terminal device 80 of the store, the terminal device 80 of the store registers the handover and transmits it to the order receiving system 60 (S22). In addition, the terminal device 90 of the delivery company registers the start of delivery and transmits it to the order receiving system 60 (S23).

[0072] The order reception system 60 receives the delivery registration from the terminal device 80 and the delivery start registration from the terminal device 90, performs visitor registration, and transmits the visitor registration to the entrance / exit control device 20 of the apartment building 10 (S24). In response to this, the entrance / exit control device 20 deletes the token issued in step S12 (S25), and then performs entrance / exit registration and face registration (S26). Then, the entrance / exit control device 20 updates the entrance / exit permission information (S27), and transmits the result of the information registration to the resident's terminal device 70 by email (S28). By carrying out the above steps S10 to S28, the processing sequence from the placement of an order from the resident of the apartment building 10 to the registration of the visitor (delivery person) by the entrance / exit control device 20 is completed.

[0073] In addition, the order reception sequence shown in Figure 11 is configured to log in to the order reception system 60 via the entry / exit control device 20, but it is also possible to register a login account from the order reception system 60 to the entry / exit control device 20 in advance, and have the order reception system 60 directly receive orders from resident(s), and after receiving the orders, register the visitor, including the visit destination, with the entry / exit control device 20.

[0074] <Sequence showing an example of unlocking flow using face recognition> 12 is a sequence diagram from when a delivery person or the like visits the apartment building 10, entry and exit is controlled by face authentication, and entry and exit permission information is deleted after the delivery person leaves. Note that the reason why the term "delivery person or the like" is used here is because it includes gas inspection companies and the like in addition to delivery people. When a delivery person or the like arrives at the apartment building 10 and stands in front of the camera 40 installed in the apartment building 10, the received camera image is supplied from the external input / output unit 32 of the entry / exit control device 20 to the face recognition unit 27 of the processing unit 21. The face authentication unit 27 then receives the face photo taken by the camera 40 and performs a matching process with the face photo 37a (see FIG. 1) stored in the face photo 37a (see FIG. 8) in the entry / exit permission information DB 37 (S31).

[0075] When a match is found in the face authentication process in step S31, the passage permission unit 28 of the entrance / exit control device 20 judges whether or not the entrance / exit permission of the delivery person, etc. is possible based on the facial photograph 37a in the entrance / exit permission information DB 37. Then, if it is judged that the entrance / exit permission of the delivery person, etc. is possible, the door control unit 29 of the entrance / exit control device 20 unlocks the door using the electric lock 41 (S32). Although not shown in Figure 12, if the camera 40 is installed in front of the elevator 42, the elevator control unit 30 of the entry / exit control device 20 can also control the available destination floors for the elevator 42.

[0076] If this is the first time that a delivery person or the like has been permitted to visit, the passage permission unit 28 of the entrance / exit control device 20 starts counting the permitted stay time 37d in the entrance / exit permission information DB 37 (S33). For example, in step S33, the time (e.g., 5 minutes) set when the delivery person or the like was registered is decremented. Furthermore, every time the delivery person or the like passes through a gate before reaching the resident's room, the passage permission unit 28 of the entrance / exit control device 20 decrements the value of the permitted authentication count 37e in the entrance / exit permission information DB 37 (S34).

[0077] Then, when the delivery person or the like completes the delivery or inspection, the delivery person or the like registers the completion of the delivery or inspection using the terminal device 90 (S35), and sends a notification to the order receiving system 60 that the delivery or inspection has been completed.

[0078] The order receiving system 60, upon receiving a notification of the completion of delivery or inspection from the terminal device 90 of the delivery person or the like, performs a completion registration of the delivery or inspection (S36) and transmits this to the entrance / exit control device 20. The entrance / exit control device 20 then deletes the entrance / exit permission information of the delivery person or the like for whom the completion of delivery or inspection has been registered from the entrance / exit permission information DB37 (S37). The order receiving system 60 also transmits the completion registration of the delivery or inspection to the terminal device 70 of the resident by email (S38). Finally, the entrance / exit control device 20 transmits an email to the terminal device 70 of the resident notifying that the information on the delivery person or the like for whom the completion registration of the delivery or inspection has been made has been deleted (S39). With the above processing, the sequence showing an example of the flow of unlocking a delivery person or the like using facial recognition is completed.

[0079] <Second embodiment> FIG. 13 is a sequence diagram explaining a face recognition entrance / exit system limited to gas inspectors as a second embodiment example in which the order receiving system 60 in FIG. 11 is replaced with a gas inspection reservation system 60'. Therefore, the terminal device 80 is a terminal device of the business office to which the gas inspector belongs, and the terminal device 90 is a terminal device owned by the gas inspector. In FIG. 13, the process from login (S40) on the resident's terminal device 70 to the login process (S44) of the gas inspection reservation system 60' is the same as the process from step S10 to step S14 in FIG. 11, so a duplicated description will be omitted.

[0080] When the login process of step S44 in the gas inspection reservation system 60' is completed, the resident uses the terminal device 70 to send an inspection request using the token from the entrance / exit control device 20 to the gas inspection reservation system 60' after the screen transition of step S43 (S45). Then, gas inspection reservation system 60' stores the gas inspection request from terminal device 70 in memory unit 65 (S46). Then, gas inspection reservation system 60' notifies resident's terminal device 70 by email that the request has been accepted (S47).

[0081] Next, the gas inspection reservation system 60' transmits the inspection request from the resident to the terminal device 80 of the sales office (S48). The terminal device 80 of the sales office receives this and selects to accept the inspection (S49). The gas inspection reservation system 60' then transmits an inspection request to the inspector's terminal device 90 (S50), and the inspector's terminal device 90, which receives this, selects to accept the inspection (S51).

[0082] Once the inspection request in step S50 and the inspection reception processing in step S51 have been completed and the assignment of responsibilities between the inspector's terminal device 90 and the sales office terminal device 80 has been completed, the sales office terminal device 80 registers the inspector and transmits the registration to the gas inspection reservation system 60' (S52). Then, gas inspection reservation system 60' receives the inspector registration from terminal device 80 of the business office and performs visitor registration (inspector registration) (S53).

[0083] The entrance / exit control device 20 receives the visitor registration from the gas inspection reservation system 60', deletes the token issued in step S42 (S54), and then performs entrance / exit registration and face registration (S55). The entrance / exit control device 20 then updates the entrance / exit permission information (S56), and sends the result of the information registration to the resident's terminal device 70 by email (S57). By carrying out the above steps S40 to SS57, the processing sequence from receiving a request for inspection of gas or the like from a resident of the apartment building 10 to registering a facial photograph of the inspector by the entrance / exit control device 20 is completed.

[0084] The processing procedure for facial recognition of inspectors can be applied as is to the procedure described in Figure 12, so as mentioned above, in the explanation of Figure 12, the term "delivery persons, etc." is used to include both delivery persons and gas inspectors, etc. As described above, in Fig. 13, the gas inspection reservation system 60' is used instead of the order receiving system 60 in Fig. 11. In the claims, the term "external system" is used as a common term that includes these different systems.

[0085] <Modification> The present invention is not limited to the above-described embodiment, but includes various application examples and modifications. The above-described embodiment has been described in detail to easily explain the present invention, and the present invention is not necessarily limited to those having all of the configurations described. Furthermore, in the above-described embodiment, the device or system configuration may be changed, and some processing steps may be omitted or replaced, without departing from the spirit of the present invention.

[0086] Furthermore, in the block diagram shown in Figure 1, only control lines and information lines that are considered necessary for explanation are shown, and not all control lines and information lines in the product are necessarily shown. In reality, it can be considered that almost all components are connected to each other. Also, in the sequence diagrams shown in Figures 11 and 12, it is possible to execute multiple processes simultaneously or change the processing order as long as it does not affect the processing results. [Explanation of symbols]

[0087] 10...Apartment building, 20...Entrance / exit control device, 21...Processing unit, 22...User authentication unit, 23...Token management unit, 24...Email transmission unit, 25...Entrance / exit setting reception unit, 26...Delivery request reception unit, 27...Facial authentication unit, 28...Passage permission unit, 29...Door control unit, 29...Elevator control unit, 31...Communication processing unit, 32...External input / output unit, 33...Memory unit, 34...User information database (DB), 35...Entrance / exit permission setting database (DB), 36...Retained token database (DB), 37...Entrance / exit permission information database (DB), 37a...Facial photo, 38...Partner information database (DB), 40...Camera, 41...Electric lock, 42...Elevator, 50…Internet, 60: order reception system, 61: order reception unit, 62: visit request unit, 63: communication processing unit, 64: mail transmission unit, 65: storage unit, 70: Resident's terminal device, 71: Web browser, 72: Communication processing unit, 73: Storage unit, 74: Email receiving unit, 80: store (or sales office) terminal device, 81: store delivery reception unit, 82: communication processing unit, 83: storage unit, 90: Terminal device of delivery person (or gas inspector), 91: Delivery reception section for delivery person, 92: Communication processing section, 93: Memory section, 94: Facial photograph 60'...Gas inspection reservation system

Claims

1. A face recognition entrance / exit system that sets entry permission conditions for visitors to an apartment complex, a first terminal device of a resident of the apartment building; a second terminal device at a store or office; a third terminal device of a visitor who visits a resident of the apartment complex upon request from the store or business office; an external system that receives a visit request from the first terminal device and notifies the third terminal device; A camera installed in the housing complex; an electric lock for opening and closing a gate installed on the path to the resident's room in the apartment building; an entrance / exit control device that compares the authentication information received from the second terminal device with authentication information obtained from image information of the visitor captured by the camera and controls the opening and closing of the electric lock of the gate. Facial recognition entrance / exit system.

2. The entrance / exit control device includes: When multiple residents of the apartment complex set the entry permission conditions for the same visitor individually, the visitor's permitted stay time and the number of times the electronic lock installed at the gate can be unlocked are added together. The face recognition entrance / exit system according to claim 1 .

3. The entrance / exit control device includes: a face authentication unit that authenticates the visitor based on a degree of match between authentication information obtained from the image captured by the camera and authentication information of the visitor that has been registered in advance; and a passage permission unit that determines whether or not the visitor identified by the face authentication unit is allowed to enter the facility. The face recognition entrance / exit system according to claim 1 .

4. The entrance / exit control device includes: a user authentication unit that receives access from the first terminal device in the external system and authenticates that the visitor is an authorized visitor; a token management unit that sends temporary authentication data to the visitor, which indicates that the visitor is the person whose visit request was accepted, and manages the expiration date of the sent authentication data. The face recognition entrance / exit system according to claim 1 .

5. The entrance / exit control device includes: a door control unit that unlocks an electronic lock of a gate through which a visitor authenticated by the user authentication unit passes based on information from the camera; and an elevator control unit that registers the destination floor of the elevator to which the visitor is heading. The face recognition entrance / exit system according to claim 4.

6. The entrance / exit control device includes: an entry / exit setting reception unit that receives a request for entry / exit permission for the visitor from the first terminal device; a delivery request receiving unit that receives a temporary entry / exit permission setting from the external system; The face recognition entrance / exit system according to claim 1 .

7. A face recognition entrance / exit method in which a resident of an apartment building sets entry permission conditions for a visitor individually, A step of accepting access to an entrance / exit control device in the apartment building from a first terminal device of a resident of the apartment building; a third terminal device of a visitor who visits a resident of the apartment complex upon request from a second terminal device of a store or business office, an external system receiving a visit request from the first terminal device and notifying the third terminal device of a visit to the resident; and a step of comparing the authentication information received from the second terminal device with authentication information obtained from image information of the visitor captured by a camera installed in the apartment complex, and opening an electric lock for opening and closing a gate of the apartment complex installed on the way to the resident's room by an entrance / exit control device. Facial recognition entry and exit method.

Images