Intercom system, entrance / exit management system, face authentication system, control method and program

Abstract

To improve security capability.SOLUTION: A control system 4 comprises a first acquisition unit 31, a second acquisition unit 32, and an entry control unit 331. The first acquisition unit 31 acquires first information D1 that pertains to the assessment result of face authentication that assesses using a face image whether or not a visitor is permitted to enter a prescribed area. The second acquisition unit 32 acquires second information D2 that pertains to the assessment result of impersonation assessment for assessing whether or not the subject of the face image used for face authentication is a genuine face. An entry control unit 331 exercises entry control relating to entry to the prescribed area, on the basis of the first information D1 acquired by the first acquisition unit 31 and the second information D2 acquired by the second acquisition unit 32. The entry control unit 331 performs the restriction process of restricting entry to the prescribed area by the visitor when the second information D2 indicates impersonation in entry control.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] This disclosure generally relates to Nii The present invention relates to an entrance / exit control system, a face authentication system, a control method, and a program, and more particularly to a system for controlling entrance to a specific area. Ui The present invention relates to an intercom system, an entrance / exit management system, a face authentication system, a control method, and a program. [Background technology]

[0002] Patent Document 1 describes a security system for an apartment building that is equipped with a face recognition device that recognizes, by facial shape, people who enter and leave a residential building of the apartment building, which is a controlled area. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2009-206784 A Summary of the Invention [Problem to be solved by the invention]

[0004] In a security system for an apartment building such as that described in Patent Document 1, it is desirable to improve crime prevention.

[0005] The present disclosure has been made in view of the above circumstances, and is capable of improving crime prevention. Rui The object of the present invention is to provide an intercom system, an entrance / exit management system, a face authentication system, a control method, and a program. [Means for solving the problem]

[0006] In order to solve the above problem, a face authentication system according to an embodiment of the present disclosure includes a face authentication unit, a first acquisition unit, an impersonation determination unit, a second acquisition unit, and an entrance control unit. The face authentication unit performs face authentication using a face image included in a first captured image captured by a first capture unit, and determines whether or not a visitor is a person permitted to enter a predetermined area. The first acquisition unit acquires first information on a determination result of the face authentication from the face authentication unit. The impersonation determination unit performs an impersonation determination for determining whether or not a subject of the face image used for the face authentication is a real face based on a second captured image captured by a second capture unit. The second acquisition unit acquires second information on a determination result of the impersonation determination from the impersonation determination unit. The entrance control unit performs an entrance control for an entrance to the predetermined area based on the first information acquired by the first acquisition unit and the second information acquired by the second acquisition unit. When the second information is information indicating impersonation, the entrance control unit performs a restriction process of restricting the visitor from entering the predetermined area during the entrance control. When the second information is information indicating impersonation during the admission control, the admission control unit stores the image captured by the first imaging unit in a storage unit. The admission control unit notifies the visitor that the captured image has been stored in the storage unit. A face authentication system according to an embodiment of the present disclosure includes a face authentication unit, a first acquisition unit, an impersonation determination unit, a second acquisition unit, and an entrance control unit. The face authentication unit performs face authentication using a face image included in a first captured image captured by a first capture unit, and determines whether or not a visitor is a person permitted to enter a predetermined area. The first acquisition unit acquires first information on a determination result of the face authentication from the face authentication unit. The impersonation determination unit performs an impersonation determination for determining whether or not a subject of the face image used for the face authentication is a real face based on a second captured image captured by a second capture unit. The second acquisition unit acquires second information on a determination result of the impersonation determination from the impersonation determination unit. The entrance control unit performs an entrance control for an entrance to the predetermined area based on the first information acquired by the first acquisition unit and the second information acquired by the second acquisition unit. In the entry control, when the second information is information indicating impersonation, the entry control unit performs a restriction process to restrict the visitor from entering the specified area. In the entry control, when the second information is information indicating impersonation, the entry control unit causes a photographing unit that photographs the visitor to store in a storage unit a photographed image taken after the impersonation determination. The entry control unit notifies the visitor that the photographed image has been stored in the storage unit.

[0007] An intercom system according to one aspect of the present disclosure includes: Face Recognition The information terminal includes: Face Recognition Able to communicate with the system.

[0008] The entrance / exit management system according to one embodiment of the present disclosure includes: Face Recognition The system includes an entrance / exit management device. Face Recognition In response to the entry control by the system, management is performed regarding the opening and closing of the door leading to the specified area.

[0010] A control method according to an embodiment of the present disclosure includes a face authentication step, a first information acquisition step, an impersonation determination step, a second information acquisition step, and an entrance control step. In the face authentication step, face authentication is performed to determine whether or not a visitor is a person permitted to enter a predetermined area based on a face image included in a first photographed image photographed by a first photographing unit. In the first information acquisition step, first information regarding a determination result of the face authentication is acquired. In the impersonation determination step, an impersonation determination is performed to determine whether or not a face used in the face authentication is a human face based on a second photographed image photographed by a second photographing unit. In the second information acquisition step, second information regarding a determination result of the impersonation determination is acquired. In the entrance control step, entrance control regarding entrance to the predetermined area is performed based on the first information acquired in the first information acquisition step and the second information acquired in the second information acquisition step. The entrance control step includes a restriction step. In the restricting step, when the second information is information indicating impersonation, the entrance control restricts the visitor from entering the predetermined area. In the entrance control step, when the second information is information indicating impersonation, the image captured by the first image capturing unit is stored in a storage unit. In the entrance control step, the visitor is notified that the captured image has been stored in the storage unit.

[0011] A program according to one embodiment of the present disclosure is a program for causing one or more processors to execute the control method. Effect of the Invention

[0012] According to the present disclosure, it is possible to improve crime prevention. Rui It is possible to provide an intercom system, an entrance / exit management system, a face authentication system, a control method, and a program. [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 is a schematic diagram showing the overall configuration of an intercom system according to the first embodiment. [Diagram 2] FIG. 2 is a conceptual diagram showing an example of installation of the lobby intercom according to the first embodiment. [Diagram 3]FIG. 3 is a block diagram showing the configuration of the face authentication system according to the first embodiment. [Figure 4] FIG. 4 is a flowchart showing the operation of the control system according to the first embodiment. [Diagram 5] FIG. 5 is a flowchart showing the operation of the control system. [Figure 6] FIG. 6 is a schematic diagram showing the overall configuration of the entrance / exit management system according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Preferred embodiments of the present disclosure will be described in detail below with reference to the drawings. In addition, common elements in each embodiment described below are given the same reference numerals, and duplicated descriptions of the common elements will be omitted. Each of the following embodiments is merely one of various embodiments of the present disclosure. Each embodiment can be modified in various ways depending on the design, etc., as long as the object of the present disclosure can be achieved. Each figure described in this disclosure is a schematic diagram, and the ratio of the size and thickness of each component in each figure does not necessarily reflect the actual dimensional ratio.

[0015] (Embodiment 1) (1) Overview First, an overview of an intercom system 2 according to the present embodiment will be described with reference to FIGS. 1 to 3. FIG.

[0016] As shown in Fig. 1, an intercom system 2 according to this embodiment is installed in a facility 1 (apartment building). When a visitor 9 (see Fig. 2) arrives at the facility 1, the intercom system 2 captures an image of the visitor 9 and generates a captured image D3 (see Fig. 3) including a facial image. Using the facial image included in the captured image D3, the intercom system 2 performs face authentication to determine whether or not the visitor 9 is a person permitted to enter the predetermined area A1 (see Fig. 2), and performs impersonation determination to determine whether or not the subject of the facial image is a real face.

[0017] Furthermore, the intercom system 2 of this embodiment performs entry control regarding entry to the predetermined area A1 based on first information D1 (see FIG. 3) regarding the result of the face authentication and second information D2 (see FIG. 3) regarding the result of the spoofing judgment. Here, when the second information D2 is information indicating spoofing, a restriction process is performed to restrict the visitor 9 from entering the predetermined area A1 in the facility 1.

[0018] When the second information D2 is information indicating impersonation, the intercom system 2 performs a restriction process, thereby making it possible to improve the security of the predetermined area A1 within the facility 1.

[0019] (2) Details Hereinafter, details of the configuration of the intercom system 2 according to this embodiment will be described with reference to FIGS.

[0020] (2.1) Premise The term "facility" in the present disclosure includes residential facilities used for residential purposes, as well as non-residential facilities such as stores (tenants), offices, welfare facilities, educational facilities, hospitals, and factories. Non-residential facilities also include restaurants, amusement parks, hotels, inns, kindergartens, nurseries, and community centers. In other words, the facility 1 may be a residential facility such as an apartment building, or a non-residential facility such as an office building. Furthermore, the facility 1 also includes facilities in which residential facilities and non-residential facilities are mixed, for example, with stores on the lower floors and residences on the upper floors. As shown in FIG. 1, in this embodiment, it is assumed that the facility 1 is an apartment building (such as an apartment) including multiple residences. In an apartment building, each of the multiple residences is a residence 22.

[0021] Furthermore, the "predetermined area" in the present disclosure is an area within the facility 1, for example, an area that only persons who have the right to enter may enter. Here, "persons who have the right to enter" refers to persons who have been permitted to enter by a person who has the authority to allow others to enter the predetermined area, and persons who have been registered in advance. As shown in FIG. 2, the predetermined area A1 in this embodiment is an area inside a door 20 installed in a lobby 21 within the facility 1 (apartment building). The predetermined area A1 in this embodiment includes the corridors, elevators, stairs, dwelling units 22, etc., inside the door 20.

[0022] In addition, the "visitor" in this disclosure includes not only guests of the facility 1 and construction workers, but also people approaching the door 20 leading to the predetermined area A1. In other words, the visitor 9 includes residents of the facility 1, managers and workers of the facility 1, and the like.

[0023] In the present disclosure, "capable of communication" means that information can be exchanged directly or indirectly via a network or a repeater, using an appropriate communication method such as wired communication or wireless communication.

[0024] (2.2) Intercom system configuration First, the configuration of the intercom system 2 will be described with reference to FIG.

[0025] As shown in FIG. 1, the intercom system 2 includes a control device 11, a lobby intercom 12 (intercom slave), a dwelling unit master unit 14, a dwelling unit slave unit 15 (intercom slave unit), and a management room unit 16. Here, the lobby intercom 12 includes a face authentication system 3 (see FIG. 3). Furthermore, the face authentication system 3 includes a control system 4 (see FIG. 3). In this embodiment, the intercom system 2 further includes a camera 13 (photographing unit), a monitoring server 17, and a door 20. Of these, the control device 11, the lobby intercom 12, the camera 13, and the door 20 are installed in a lobby 21. Note that the monitoring server 17 may be installed in another area within the facility 1, such as a management room 23, or may be installed in an area outside the facility 1, such as a management company 5. The dwelling unit master unit 14 and the dwelling unit slave unit 15 are installed in each dwelling unit 22. The management room unit 16 is installed in the management room 23.

[0026] The door 20 (or an electric lock provided on the door 20) in the lobby 21 leads to a predetermined area A1 (see FIG. 2). The door 20 is communicatively connected to the lobby intercom 12 and can be controlled by the lobby intercom 12, and is therefore included as a component of the intercom system 2. This makes it possible for the intercom system 2 to control the opening / closing or locking / unlocking of the door 20 in the lobby 21 by the lobby intercom 12. In other words, if the door 20 is an automatic door, the lobby intercom 12 can control the door 20 to open, which is closed by default.

[0027] The control device 11 is communicatively connected to the lobby intercom 12, each dwelling unit master unit 14, and the management room unit 16. The control device 11 relays communication between the lobby intercom 12, each dwelling unit master unit 14, and the management room unit 16.

[0028] The control device 11 is also connected to a network N1 external to the facility 1. Therefore, the intercom system 2 is capable of communicating with, for example, a registrant terminal 18 and a management company terminal 19 connected to the network N1.

[0029] The lobby interphone 12 is installed in the lobby 21 and is a terminal provided outside the predetermined area A1. The lobby interphone 12 is also connected to the control device 11 so as to be able to communicate with each other.

[0030] The lobby intercom 12 has an operation unit 121 and a photographing unit 122 (camera). The operation unit 121 includes a numeric keypad (including a touch panel) and a key cylinder for accepting operations by the visitor 9 (see FIG. 2). The photographing unit 122 is equipped with an image sensor such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge-Coupled Device) image sensor. The photographing unit 122 photographs a person who is about to operate the operation unit 121 or a person who is operating the operation unit 121 to generate a photographed image D3. The "photographed image" here refers to an image (image data) obtained by photographing the visitor 9, and includes moving images, still images, and frame-by-frame images.

[0031] When the visitor 9 performs a predetermined operation on the operation unit 121, the lobby intercom 12 transmits a call signal for calling the dwelling master unit 14 or the management room unit 16 to the dwelling master unit 14 or the management room unit 16. In addition, the lobby intercom 12 transmits the captured image D3 to the dwelling master unit 14 or the management room unit 16. As a result, the image of the visitor 9 captured by the capturing unit 122 of the lobby intercom 12 can be displayed on the dwelling master unit 14 or the management room unit 16.

[0032] Moreover, the lobby intercom 12 opens (unlocks) the door 20 when it accepts an entry operation on the operation unit 121. In other words, the visitor 9 can open the door 20 by performing an entry operation on the operation unit 121. Here, the "entry operation" refers to an operation performed on the operation unit 121 by the visitor 9 to enter the predetermined area A1 of the facility 1. The "entry operation" includes at least one of an operation of calling the terminal (the dwelling unit master unit 14) of the visitor's destination and an operation of requesting authentication for entry. The "entry operation" also includes, for example, an unlocking operation using a key inserted in a key cylinder and an operation of inputting a PIN number for opening the door 20. For example, when the visitor 9 calls the dwelling unit master unit 14 of the visitor's destination and the resident of the visitor's destination performs an operation to allow the dwelling unit master unit 14 to open after confirming the visitor 9, the door 20 is opened. Details of the lobby intercom 12 of this embodiment will be described in the section "(2.3) Configuration of the Lobby Intercom."

[0033] The dwelling unit master unit 14 is installed in the indoor space of each dwelling unit 22 (dwelling unit). The dwelling unit slave unit 15 is communicatively connected to the dwelling unit master unit 14, and is, for example, a front door slave unit installed outside the front door of each dwelling unit 22. In other words, the dwelling unit master unit 14 and the dwelling unit slave unit 15 are configured to be able to communicate (including make calls) with each other. Furthermore, in this embodiment, the dwelling unit slave unit 15 has a photographing unit (camera), and an image of the visitor 9 photographed by the photographing unit of the dwelling unit slave unit 15 can be displayed on the dwelling unit master unit 14. Moreover, the dwelling unit master unit 14 is communicatively connected to the control device 11.

[0034] The control room unit 16 is installed in the indoor space of the control room 23. Moreover, the control room unit 16 is connected to the control device 11 so as to be able to communicate with each other.

[0035] As described above, the lobby intercom 12, each dwelling unit master unit 14, and the management room unit 16 are all connected to the control device 11 so as to be able to communicate with each other. Therefore, the lobby intercom 12, each dwelling unit master unit 14, and the management room unit 16 can communicate with each other (including making calls) via the control device 11. In other words, the lobby intercom 12 and each dwelling unit master unit 14 can communicate with each other. Furthermore, the lobby intercom 12 and the management room unit 16 can communicate with each other, and each dwelling unit master unit 14 and the management room unit 16 can communicate with each other.

[0036] Camera 13 (imaging unit) includes an image sensor, such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge-Coupled Device) image sensor. Camera 13 in this embodiment is installed in lobby 21 and positioned so as to be able to capture an image of visitor 9 visiting lobby 21. Camera 13 generates captured image D4 (see FIG. 3 ) capturing an image of visitor 9. Camera 13 is configured to be able to communicate with surveillance server 17.

[0037] The monitoring server 17 is a device that stores (records) images D4 (see FIG. 3) captured by the camera 13 and controls the operation of the camera 13. As shown in FIG. 3, the monitoring server 17 includes a communication unit 171, a control unit 172, and a storage unit 173.

[0038] The communication unit 171 is connected to the camera 13 and the lobby intercom 12 directly or indirectly via another network or a repeater, etc. The communication unit 171 has a communication function with the camera 13 and the lobby intercom 12. Thus, the communication unit 171 is configured to be able to communicate with the camera 13 and the lobby intercom 12.

[0039] The storage unit 173 includes a non-transitory storage device such as a hard disk drive (HDD), a solid state drive (SSD), an optical disk drive, etc. The storage unit 173 stores (records) the captured image D4 by the camera 13.

[0040] The control unit 172 is realized by one or more processors executing an appropriate program. The control unit 172 controls the operation of the camera 13 and stores the image D4 captured by the camera 13 in the storage unit 173. For example, the control unit 172 can cause the camera 13 to start capturing images by sending an instruction to start capturing images to the camera 13 via the communication unit 171. Furthermore, the control unit 172 receives an instruction from the lobby intercom 12 and stores the image D4 captured by the camera 13 in the storage unit 173.

[0041] (2.3) Lobby intercom configuration Next, the configuration of the lobby intercom 12 will be described with reference to FIGS.

[0042] 3, the lobby intercom 12 has a face authentication system 3 in addition to the above-mentioned operation unit 121 and image capturing unit 122. The image capturing unit 122 outputs a captured image D3 of a visitor 9 (see FIG. 2) to the face authentication system 3.

[0043] (2.4) Configuration of face recognition system Next, the configuration of the face authentication system 3 will be described with reference to FIGS.

[0044] 3, the face authentication system 3 includes a control system 4, a face authentication unit 36, and an impersonation determination unit 37. The face authentication system 3 of this embodiment further includes a storage unit 34 and a communication unit 35.

[0045] The face authentication system 3 is mainly composed of a computer system having one or more processors and one or more memories. In the face authentication system 3, the one or more processors execute a program recorded in the memory, thereby realizing the functions of the face authentication unit 36, the spoofing determination unit 37, and the control system 4 of the face authentication system 3. The program may be pre-recorded in the memory, may be provided via a telecommunication line such as the Internet, or may be provided by recording it on a non-transitory recording medium such as a memory card.

[0046] The storage unit 34 includes a non-transitory storage device such as a hard disk drive (HDD), a solid state drive (SSD), an optical disk drive, etc. The storage unit 34 stores face image data of registrants such as residents and managers of the facility 1 (apartment building). Here, the face image data of the registrants is stored in the storage unit 34 in association with the identification information of the registrants. In addition, the identification information of the registrants is stored in association with the dwelling number of the registrants and information on the registrant terminal 18 such as a mobile phone or smartphone owned by the registrant.

[0047] The communication unit 35 is connected to the door 20, the monitoring server 17, and the control device 11 (see FIG. 1) directly or indirectly via another network or a repeater, etc. The communication unit 35 has a communication function with the door 20, the monitoring server 17, and the control device 11. As a result, the communication unit 35 is configured to be able to communicate with the door 20, the monitoring server 17, and the control device 11.

[0048] The face authentication unit 36 ​​performs face authentication to determine whether or not the visitor 9 (see FIG. 2) is a person permitted to enter the predetermined area A1 (see FIG. 2) by using a face image included in the photographed image D3 input from the photographing unit 122. In face authentication, the face authentication unit 36 ​​first performs face detection processing to detect a human face portion in the photographed image D3 and extracts a face image that is an image of the human face portion. Then, when a face image is extracted from the photographed image D3, the face authentication unit 36 ​​compares (matches) the extracted face image with face images (template data) of multiple registered persons registered in advance in the storage unit 34. After performing face authentication, the face authentication unit 36 ​​outputs (transmits) first information D1 related to the determination result of face authentication to the control system 4. Specifically, when there is an image among the face images of multiple registered persons that has a similarity to the extracted face image that is equal to or greater than a threshold value, the face authentication unit 36 ​​outputs the first information D1 indicating successful authentication to the control system 4. In this embodiment, the first information D1 indicating successful authentication includes identification information of the face image whose similarity is equal to or greater than the threshold. On the other hand, if there is no image whose similarity with the extracted face image is equal to or greater than the threshold among the face images of the multiple registrants, the face authentication unit 36 ​​outputs the first information D1 indicating unsuccessful authentication to the control system 4.

[0049] The spoofing determination unit 37 performs spoofing determination to determine whether or not the subject of a face image used for face authentication is a real face. When the photographed image D3 is input from the photographing unit 122, the spoofing determination unit 37 executes face detection processing to extract a face image. When the face image is extracted, the spoofing determination unit 37 determines whether or not the subject of the face image is a real face. For example, when the subject is a face in a photograph, a face image displayed on a tablet terminal or the like, or a headgear such as a mask or a face mask, the spoofing determination unit determines that the subject of the face image is not a real face and determines that the face image is an spoofed image.

[0050] The spoofing determination unit 37 performs spoofing determination based on, for example, the presence or absence of a change over time in a plurality of feature points in a face image. After performing spoofing determination, the spoofing determination unit 37 outputs (transmits) second information D2 relating to the result of the spoofing determination to the control system 4. Specifically, when at least one of the positions of the feature points and the positional relationship between the feature points does not change within a certain period of time, the spoofing determination unit 37 outputs the second information D2 indicating spoofing to the control system 4. On the other hand, when at least one of the positions of the feature points and the positional relationship between the feature points changes within a certain period of time, the spoofing determination unit 37 outputs the second information D2 indicating no spoofing to the control system 4.

[0051] (2.5) Control System Configuration Next, the configuration of the control system 4 will be described with reference to FIGS.

[0052] The control system 4 of this embodiment can communicate with information terminals such as the dwelling unit master unit 14 (see FIG. 1) and the management room unit 16 (see FIG. 1) via the communication unit 35 and the control device 11 (see FIG. 1). The "information terminal" in this disclosure further includes terminals such as personal computers (PCs), tablets, and smartphones. The control system 4 can also communicate with the registrant terminal 18 and the management company terminal 19 via the communication unit 35 and the control device 11.

[0053] As shown in Fig. 3, the control system 4 includes a first acquisition unit 31, a second acquisition unit 32, and a control unit 33. The control system 4 is mainly configured with a computer system having one or more processors and one or more memories. In the control system 4, the one or more processors execute a program recorded in the memory, thereby realizing the functions of the first acquisition unit 31, the second acquisition unit 32, and the control unit 33 (the admission control unit 331, the operation confirmation unit 332) of the control system 4. The program may be pre-recorded in the memory, may be provided through a telecommunication line such as the Internet, or may be recorded and provided on a non-transitory recording medium such as a memory card.

[0054] The first acquisition unit 31 acquires first information D1 related to the determination result of face authentication from the face authentication unit 36. When the first acquisition unit 31 acquires the first information D1, it outputs it to the admission control unit 331 of the control unit 33.

[0055] The second acquisition unit 32 acquires second information D2 relating to the result of the spoofing judgment from the spoofing judgment unit 37. Upon acquiring the second information D2, the second acquisition unit 32 outputs it to the admission control unit 331 of the control unit 33.

[0056] The control unit 33 includes an entrance control unit 331 and an operation confirmation unit 332. The control unit 33 of this embodiment is also capable of controlling the opening / closing or locking / unlocking of the door 20 of the lobby 21 (see FIG. 2).

[0057] The operation confirmation unit 332 confirms whether or not the operation unit 121 has accepted the admission operation. When the operation confirmation unit 332 confirms that the operation unit 121 has accepted the admission operation, it outputs a confirmation signal to the admission control unit 331.

[0058] The entrance control unit 331 performs entrance control regarding entrance to the predetermined area A1 (see FIG. 2) based on the first information D1 acquired by the first acquisition unit 31 and the second information D2 acquired by the second acquisition unit 32. In particular, when the second information D2 is information indicating impersonation during the entrance control, the entrance control unit 331 performs a restriction process to restrict the visitor 9 (see FIG. 2) from entering the predetermined area A1. The entrance control unit 331 does not open (unlock) the door 20 while performing the restriction process. Even if the first information D1 is information indicating successful authentication, the entrance control unit 331 does not open the door 20 when the second information D2 is information indicating impersonation. In this way, when it is determined that the visitor 9 is impersonated in the impersonation determination, the entrance control unit 331 performs a restriction process to restrict the visitor 9 from entering the predetermined area A1, thereby improving the crime prevention of the predetermined area A1.

[0059] Here, even if the second information D2 is information indicating spoofing, the entrance control unit 331 does not perform the restriction process when the operation unit 121 of the lobby intercom 12 accepts an entrance operation within a predetermined time after the entrance control unit 331 acquires the second information D2. Specifically, the entrance control unit 331 does not perform the restriction process when it accepts a confirmation signal input from the operation confirmation unit 332 within a predetermined time after the entrance control unit 331 acquires the second information D2. Even if the spoofing judgment determines that spoofing has occurred, the entrance control unit 331 does not perform the restriction process when the operation unit 121 of the lobby intercom 12 accepts an entrance operation within the predetermined time. Therefore, it is possible to reduce the number of times that the restriction process is performed when the result of the spoofing judgment is an erroneous judgment, for example.

[0060] The "entry operation" may be an operation by the visitor 9 to enter the predetermined area A1 of the facility 1, and may be an operation that opens the door 20 as a result of the operation. For example, even if the visitor 9 operates the operation unit 121 to call the dwelling unit master unit 14 of the visitor's residence, if the resident of the visitor's residence does not operate the dwelling unit master unit 14 to allow the door 20 to be opened, the visitor 9 does not perform the "entry operation." Also, for example, even if the visitor 9 operates the operation unit 121 to request authentication regarding entry, if the authentication fails, the visitor 9 does not perform the "entry operation." In this way, by limiting the entry operation to an operation that opens the door 20 as a result, the crime prevention of the predetermined area A1 can be further improved.

[0061] Furthermore, in the entrance control, when the first information D1 is information indicating successful authentication, the entrance control unit 331 of this embodiment performs processing according to the judgment result of the spoofing judgment unit 37. Even if the result of the face authentication is successful authentication, the entrance control unit 331 performs different control according to the result of the spoofing judgment, thereby further improving the crime prevention of the predetermined area A1.

[0062] In addition, in the admission control, when the second information D2 is information indicating impersonation, the admission control unit 331 of this embodiment notifies one or more terminals that there is a visitor 9 determined to be an impersonator. The one or more terminals include, for example, the dwelling unit master unit 14, the management room unit 16, the registrant terminal 18, and the management company terminal 19. As a method of notification, a text indicating that there is a visitor 9 determined to be an impersonator may be displayed (pop-up display) on the display unit of the terminal, or a sound indicating that there is a visitor 9 determined to be an impersonator may be output from the speaker of the terminal. In addition, when the second information D2 is information indicating impersonation, the admission control unit 331 may notify the police. The process in which the admission control unit 331 notifies one or more terminals that there is a visitor 9 determined to be an impersonator is called a first notification process. When the impersonation determination determines that an impersonation has occurred, the presence of a visitor determined to be an impersonator is notified to one or more terminals, thereby making it possible to further improve the crime prevention of the predetermined area A1.

[0063] In addition, in the admission control, when the second information D2 is information indicating impersonation and the first information D1 is information indicating successful authentication, the admission control unit 331 of this embodiment notifies the terminal of the impersonated person that there is a visitor 9 determined to be an impersonator. When the first information D1 is information indicating successful authentication, it is possible to identify the impersonated person based on the identification information of the face image whose similarity is equal to or greater than a threshold. When the first information D1 is information indicating successful authentication, the admission control unit 331 of this embodiment acquires information on the dwelling number of the impersonated person (registered person) and the registrant terminal 18 held by the registrant from the storage unit 34 based on the identification information included in the first information D1. Then, the admission control unit 331 notifies the dwelling unit master unit 14 and the registrant terminal 18 in the dwelling of the impersonated person that there is a visitor 9 determined to be an impersonator. The process in which the admission control unit 331 notifies the dwelling unit master unit 14 in the dwelling of the person who has been impersonated and the registrant terminal 18 of the person who has been impersonated that there is a visitor 9 who has been determined to be an impersonator is called the second notification process. The person who has been impersonated can learn from the notification that there is a visitor who has impersonated him or her, and the crime prevention of the predetermined area A1 can be further improved.

[0064] Furthermore, in the admission control, when the second information D2 is information indicating impersonation, the admission control unit 331 of this embodiment stores the captured image D3 captured by the photographing unit 122 in the storage unit 34. When the impersonation determination determines that impersonation has occurred, the captured image D3 used in the face authentication or impersonation determination can be stored in the storage unit 34, thereby saving an image of the face of the visitor 9 impersonated. Note that, instead of the captured image D3, a face image extracted in at least one of the face authentication and the impersonation determination may be stored in the storage unit 34. Furthermore, the captured image D3 captured by the photographing unit 122 may be stored in the storage unit 173 of the monitoring server 17.

[0065] Furthermore, in the admission control, when the second information D2 is information indicating impersonation, the admission control unit 331 of this embodiment stores the captured image D4 taken by the camera 13 (imaging unit) in the storage unit 173 of the surveillance server 17. When impersonation is determined in the impersonation determination, the captured image D4 of the visitor 9 taken by the camera 13 is stored in the storage unit 173 of the surveillance server 17, so that an image of the visitor 9 can be saved. The captured image D4 taken by the camera 13 may be stored in the storage unit 34 of the face authentication system 3.

[0066] Furthermore, in the admission control, when the second information D2 is information indicating spoofing, the admission control unit 331 of this embodiment stores the captured image D3 taken by the photographing unit 122 in the storage unit 34 after the spoofing determination. When the spoofing determination determines that the visitor 9 is a spoofed visitor, the admission control unit 331 stores the captured image D3 generated by the photographing unit 122 after the spoofing determination in the storage unit 34, thereby making it possible to preserve the image of the visitor 9 determined to be a spoofed visitor. The captured image D3 taken by the photographing unit 122 after the spoofing determination may be stored in the storage unit 173 of the monitoring server 17.

[0067] Furthermore, in the admission control, when the second information D2 is information indicating spoofing, the admission control unit 331 of this embodiment stores the captured image D4 taken by the camera 13 (image capture unit) in the storage unit 173 of the monitoring server 17 after the spoofing determination. When the spoofing determination determines that the visitor has been spoofed, the admission control unit 331 stores the captured image D4 generated by the camera 13 capturing an image of the visitor 9 after the spoofing determination in the storage unit 173, thereby making it possible to preserve the captured image D4 containing the visitor 9. Note that the captured image D4 taken by the camera 13 after the spoofing determination may be stored in the storage unit 34 of the face authentication system 3.

[0068] Furthermore, the entrance control unit 331 of this embodiment notifies the visitor 9 that at least one of the photographed image D3 and the photographed image D4 has been stored in the memory unit 34 or the memory unit 173 during the entrance control. The entrance control unit 331 notifies the visitor 9 that the photographed image D3 (photographed image D4) has been stored in the memory unit 34 (memory unit 173) by using, for example, the display unit or speaker of the lobby intercom 12. This notification can also be considered as a warning process for the visitor 9. By notifying the visitor 9 that an image of the face of the visitor 9 impersonated or the photographed image D3 (photographed image D4) in which the visitor 9 appears has been stored, the visitor 9 who intended to enter the building illegally can be deterred. Furthermore, the admission control unit 331 may notify the visitor 9 that the photographed image D3 (photographed image D4) has been stored in the memory unit 34 (memory unit 173) even if the photographed image D3 (photographed image D4) has not actually been stored in the memory unit 34 (memory unit 173). Even if the photographed image D3 (photographed image D4) has not actually been stored in the memory unit 34 (memory unit 173) due to a small capacity of the memory unit 34 (memory unit 173) or the like, by notifying the visitor 9 that the photographed image D3 (photographed image D4) has been stored in the memory unit 34 (memory unit 173), the visitor 9 who intended to enter the building illegally can be dissuaded.

[0069] (3) Operation of the control system Next, the operation of the control system 4 will be described with reference to Fig. 4 and Fig. 5. Fig. 4 is a flowchart showing an example of the admission control process (control method) performed by the control system 4 according to this embodiment.

[0070] First, the control system 4 acquires the first information D1 related to the judgment result of the face authentication by the first acquisition unit 31 (S1). In addition, the control system 4 acquires the second information D2 related to the judgment result of the impersonation judgment by the second acquisition unit 32 (S2). Next, the admission control unit 331 of the control system 4 checks whether the first information D1 is information indicating successful authentication (S3). If the first information D1 is information indicating successful authentication (YES in S3), the admission control unit 331 checks whether the second information D2 is information indicating impersonation (S4). If the second information D2 is not information indicating impersonation (NO in S4), the process proceeds to step S7. If the second information D2 is information indicating impersonation (YES in S4), the admission control unit 331 checks whether a predetermined time has passed since acquiring the second information D2 (S5). The predetermined time in the process of step S5 is the first predetermined time. If a predetermined time has passed since acquiring the second information D2 (YES in S5), the process proceeds to step S21 in FIG. 5, and the admission control unit 331 performs a restriction process to restrict the visitor 9 from entering the predetermined area A1.

[0071] If a predetermined time has not elapsed since acquiring the second information D2 (NO in S5), the entrance control unit 331 checks whether an entrance operation has been performed on the operation unit 121 of the lobby intercom 12 (S6). Specifically, the entrance control unit 331 checks whether a confirmation signal input from the operation confirmation unit 332 has been received. If an entrance operation has not been performed on the operation unit 121 (NO in S6), the process returns to step S5. If an entrance operation has been performed on the operation unit 121 (YES in S6), the entrance control unit 331 unlocks (opens) the door 20 (S7) and ends the entrance control process.

[0072] In step S3, if the first information D1 is information indicating authentication failure (NO in S3), the admission control unit 331 checks whether the second information D2 is information indicating impersonation (S8). If the second information D2 is information indicating impersonation (YES in S8), the admission control unit 331 checks whether a predetermined time has passed since the second information D2 was acquired (S9). The predetermined time in the process of step S9 is the second predetermined time. The second predetermined time may be the same as or different from the first predetermined time in step S5. In this embodiment, the first predetermined time and the second predetermined time are the same. If the predetermined time has passed since the second information D2 was acquired (YES in S9), the process proceeds to step S22 in FIG. 5, and the admission control unit 331 performs a restriction process to restrict the visitor 9 from entering the predetermined area A1.

[0073] If a predetermined time has not passed since acquiring the second information D2 (NO in S9), the entrance control unit 331 checks whether or not an entrance operation has been performed on the operation unit 121 of the lobby intercom 12 (S10). If an entrance operation has not been performed on the operation unit 121 (NO in S10), the process returns to step S9. If an entrance operation has been performed on the operation unit 121 (YES in S10), the entrance control unit 331 unlocks (opens) the door 20 (S7) and ends the entrance control process.

[0074] In step S8, if the second information is not information indicating spoofing (NO in S8), the entrance control unit 331 checks whether a predetermined time has passed since the second information D2 was acquired (S11). The predetermined time in the process of step S11 is a third predetermined time. The third predetermined time may be the same as the first predetermined time and the second predetermined time, or may be different. In this embodiment, the third predetermined time is the same as the first predetermined time and the second predetermined time. If the predetermined time has passed since the second information D2 was acquired (YES in S11), the entrance control unit 331 ends the entrance control process. On the other hand, if the predetermined time has not passed since the second information D2 was acquired (NO in S11), the entrance control unit 331 checks whether an entrance operation has been performed on the operation unit 121 of the lobby intercom 12 (S12). If an entrance operation has not been performed on the operation unit 121 (NO in S12), the process returns to step S11. On the other hand, if an entrance operation is being performed on the operation unit 121 (YES in S12), the entrance control unit 331 unlocks (opens) the door 20 (S7) and ends the entrance control process.

[0075] Next, an example of the restriction process performed by the control system 4 will be described with reference to FIG. 5. If the first information D1 is information indicating successful authentication (YES in S3 in FIG. 4), it is possible to know who the person (registered person) who has impersonated the visitor 9 is. Then, the entrance control unit 331 performs a second notification process to notify the terminal of the person who has been impersonated that there is a visitor 9 who has been determined to be an impersonator (S21). Here, the terminal of the person who has been impersonated is the dwelling unit master unit 14 in the dwelling unit 22 of the registrant or the registrant terminal 18. Next, the entrance control unit 331 performs a first notification process to notify the management terminal that there is a visitor 9 who has been determined to be an impersonator (S22). Here, the management terminal is the management room unit 16 in the management room 23 or the management company terminal 19 of the management company 5. Note that, when the entrance control unit 331 performs the second notification process, the entrance control unit 331 may not notify the terminal that has been notified in the second notification process again. Next, the admission control unit 331 stores the captured image D3 (captured image D4) captured by the camera 13 before and after the spoofing determination in the memory unit 34 (memory unit 173) (S23). Then, the admission control unit 331 performs a warning process (S24) to notify the visitor 9 that the captured image D3 (captured image D4) has been stored in the memory unit 34 (memory unit 173), and ends the admission control process.

[0076] 4 and 5 are merely examples, and the order of the processes may be changed as appropriate, and processes may be added or deleted as appropriate. For example, the first information acquisition step (S1) and the second information acquisition step (S2) may be in the reverse order. Also, the second notification process (S21) and the first notification process (S22) may be in the reverse order.

[0077] (Modification) The first embodiment is merely one of various embodiments of the present disclosure. The above embodiment can be modified in various ways depending on the design and the like as long as the object of the present disclosure can be achieved.

[0078] Furthermore, functions equivalent to the control system 4 according to the above embodiment may be embodied in a control method, a (computer) program, or a non-transitory recording medium on which a program is recorded. The control method according to one embodiment includes a first information acquisition step, a second information acquisition step, and an entrance control step. In the first information acquisition step, first information D1 is acquired regarding a judgment result of face authentication that judges whether or not the visitor 9 is a person permitted to enter the predetermined area A1 based on a face image. In the second information acquisition step, second information D2 is acquired regarding a judgment result of impersonation judgment that judges whether or not the face used in the face authentication is a human face. In the entrance control step, entrance control regarding entrance to the predetermined area A1 is performed based on the first information D1 acquired in the first information acquisition step and the second information D2 acquired in the second information acquisition step. The entrance control step includes a restriction step. In the restriction step, in the entrance control, when the second information D2 is information indicating impersonation, the entrance of the visitor 9 to the predetermined area A1 is restricted. A program according to one aspect is a program for causing one or more processors to execute the above control method.

[0079] The intercom system 2 in the present disclosure includes, for example, a computer system. The computer system is mainly composed of a processor and a memory as hardware. The function of the intercom system 2 in the present disclosure is realized by the processor executing a program recorded in the memory of the computer system. The program may be pre-recorded in the memory of the computer system, may be provided through an electric communication line, or may be provided by being recorded in a non-transitory recording medium such as a memory card, an optical disk, or a hard disk drive that can be read by the computer system. The processor of the computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large-scale integrated circuit (LSI). The integrated circuits such as IC or LSI referred to here are called by different names depending on the degree of integration, and include integrated circuits called system LSI, VLSI (Very Large Scale Integration), or ULSI (Ultra Large Scale Integration). Furthermore, a field-programmable gate array (FPGA) that is programmed after the manufacture of the LSI, or a logic device that can reconfigure the connection relationship inside the LSI or the circuit partition inside the LSI, can also be adopted as a processor. The electronic circuits may be integrated in one chip or distributed among multiple chips. The chips may be integrated in one device or distributed among multiple devices. The computer system referred to here includes a microcontroller having one or more processors and one or more memories. Thus, the microcontroller is also composed of one or more electronic circuits including a semiconductor integrated circuit or a large-scale integrated circuit.

[0080] Below, we will list some modified examples of the embodiment 1. The modified examples explained below can be applied in appropriate combinations.

[0081] It is not a required configuration for control system 4 that at least some of the functions of control system 4 are concentrated within a single device (lobby intercom 12), and the components of control system 4 may be distributed across multiple devices (housings).

[0082] For example, some functions of the control system 4 may be provided in a device (housing) separate from the lobby intercom 12, such as the control device 11. Furthermore, the control system 4 does not have to be provided within the facility 1 (apartment building). Furthermore, at least some functions of the control system 4 may be realized by, for example, a server or the cloud (cloud computing).

[0083] The control system 4 may include at least a first acquisition unit 31, a second acquisition unit 32, and an admission control unit 331. The functions of the control unit 33 and the admission control unit 331 may be separate.

[0084] It is not essential for the face authentication system 3 that the face authentication unit 36 ​​and the spoofing determination unit 37 of the face authentication system 3 are integrated into one device (lobby intercom 12). The face authentication unit 36 ​​and the spoofing determination unit 37 of the face authentication system 3 may be provided in a distributed manner in multiple devices (housings).

[0085] For example, some functions of the face authentication system 3 may be provided in a device (housing) separate from the lobby intercom 12, such as providing the face authentication unit 36 ​​or the spoofing determination unit 37 of the face authentication system 3 in the control device 11. The face authentication system 3 does not have to be provided in the facility 1 (apartment building). The face authentication unit 36 ​​or the spoofing determination unit 37 of the face authentication system 3 may be realized by, for example, a server or a cloud (cloud computing).

[0086] The face authentication unit 36 ​​may perform face authentication based on the captured image D4 captured by the camera 13. The spoofing determination unit 37 may perform spoofing determination based on the captured image D4 captured by the camera 13.

[0087] The face authentication unit 36 ​​and the masquerade determination unit 37 may perform face authentication or masquerade determination based on images captured by different imaging units (cameras).

[0088] For example, the lobby intercom 12 may include a plurality of image capturing units (a first image capturing unit and a second image capturing unit) as the image capturing unit 122. For example, a first image capturing unit of the plurality of image capturing units 122 captures an image for face authentication, and a second image capturing unit of the plurality of image capturing units 122 captures an image for spoofing determination. In this case, the face authentication unit 36 ​​performs face authentication based on the image captured by the first image capturing unit, and the spoofing determination unit 37 performs spoofing determination based on the image captured by the second image capturing unit.

[0089] As another example, the facial authentication unit 36 ​​may perform facial authentication based on a captured image D3 captured by the imaging unit 122 of the lobby intercom 12, and the impersonation determination unit 37 may perform impersonation determination based on a captured image D4 captured by the camera 13.

[0090] The spoofing determination unit 37 may perform spoofing determination based on a photographed image (distance image) taken by a depth camera capable of measuring the depth of a subject. A face in a photograph or a face image displayed on a tablet terminal or the like is flat and does not have depth like an actual face. Therefore, by measuring the depth of the subject (face) with a depth camera, the accuracy of spoofing determination by the spoofing determination unit 37 can be improved. The depth camera is, for example, a camera using a distance measurement technique such as a TOF (Time Of Flight) method that measures the distance to the subject by emitting infrared rays to the subject and measuring the time it takes to receive the infrared rays reflected by the subject. When a depth camera is used for spoofing determination, the photographing unit 122 of the lobby intercom 12 may be a depth camera, or the camera 13 may be a depth camera. The intercom system 2 may also be provided with a depth camera in addition to the photographing unit 122 and the camera 13. In this case, the lobby intercom 12 may be provided with a depth camera in addition to the photographing unit 122. The depth camera may be a stereo camera having two or more imaging units (cameras) and capable of measuring the depth of a subject based on parallax information of a plurality of images captured by each imaging unit. The imaging unit (camera) used for spoofing authentication may be an infrared camera capable of visualizing infrared radiation emitted from an object. The temperature of a face in a photograph or a face image displayed on a tablet terminal or the like is usually uniform and differs from the temperature of an actual face. Therefore, in the image captured by the infrared camera, it is easy to distinguish between a face in a photograph or a face image displayed on a tablet terminal or the like and an actual face. Therefore, by using an infrared camera, the accuracy of spoofing judgment by the spoofing judgment unit 37 can be improved. The infrared camera may be, for example, a near-infrared camera.

[0091] The face authentication system 3 may include at least the control system 4, a face authentication unit 36, and an impersonation determination unit 37.

[0092] In the first embodiment, the intercom system 2 is introduced into an apartment building, but the intercom system 2 can also be introduced into various facilities 1 such as detached houses and offices.

[0093] The intercom system 2 may include information terminals such as a registrant terminal 18 and a management company terminal 19.

[0094] The intercom system 2 may include a lobby intercom 12 and a control system separate from the lobby intercom 12 .

[0095] The intercom system 2 may include at least a control system 4 and an intercom device such as a lobby intercom 12.

[0096] The control system 4 may include, instead of the first acquisition unit 31 and the second acquisition unit 32, an acquisition unit having the functions of the first acquisition unit 31 and the second acquisition unit 32.

[0097] The intercom system 2 may be connected to a network N1 via a control device 11.

[0098] The computer system that is the main component of the face authentication system 3 and the computer system that is the main component of the control system 4 may be the same computer system or different computer systems. Furthermore, the program for causing one or more processors to function as the control system 4 may be a program separate from the program for causing one or more processors to function as the face authentication system 3 (face authentication unit 36, spoofing determination unit 37).

[0099] (Embodiment 2) (1) Overview 6, the control system 4 of this embodiment differs from the control system 4 of the first embodiment in that the control system 4 of this embodiment is provided in an entrance / exit management system 6 installed in a facility 1 (office). Hereinafter, the same components as those of the first embodiment will be denoted by the same reference numerals and the description thereof will be omitted as appropriate.

[0100] (2) Details As shown in FIG. 6, a facility 1 (office) is provided with a predetermined area A1, an area 21a, and a guard room 63.

[0101] The area 21a is an area adjacent to the predetermined area A1 via the door 20, and is, for example, a lobby, a corridor, etc. In the area 21a, a camera 13, the door 20, and a card reader 62 are provided.

[0102] The door 20 connects a predetermined area A1, such as a laboratory or a research room, to the area 21a.

[0103] The camera 13 is disposed in a position in the area 21a where it can capture an image of a visitor 9 approaching the door 20.

[0104] The card reader 62 reads identification information from an IC (Integrated Circuit) card held by a registrant, and outputs the read identification information to the entrance / exit management system 6. In other words, the card reader 62 is a terminal provided outside the predetermined area A1. The card reader 62 is also an operation unit that accepts an operation to request authentication regarding entry.

[0105] (2.1) Configuration of the entrance / exit control system Next, the configuration of the entrance / exit control system 6 will be described with reference to FIG.

[0106] 6, the entrance / exit management system 6 includes a monitoring server 17, a face authentication system 3, and an entrance / exit management device 61. The face authentication system 3 includes a control system 4.

[0107] The entrance / exit management device 61 is configured to be able to communicate with the control system 4, and manages the opening / closing (locking / unlocking) of the door 20 leading to the predetermined area A1 in accordance with the entrance control by the control system 4. The entrance / exit management device 61 includes a communication unit 611 and an opening / closing management unit 612.

[0108] The communication unit 611 is connected to the door 20, the card reader 62, and the face authentication system 3 directly or indirectly via another network or a repeater, etc. The communication unit 611 has a communication function with the door 20, the card reader 62, and the face authentication system 3. As a result, the communication unit 611 is configured to be able to communicate with the door 20, the card reader 62, and the face authentication system 3.

[0109] The opening / closing management unit 612 manages the opening / closing (locking / unlocking) of the door 20. Specifically, when the opening / closing management unit 612 receives an opening instruction (unlocking instruction) input from the control system 4 included in the face authentication system 3, it opens (unlocks) the door 20. Furthermore, when the opening / closing management unit 612 receives identification information read from an IC card held by the visitor 9 via the card reader 62, it outputs the identification information to the face authentication system 3.

[0110] The face authentication system 3 of this embodiment performs face authentication and impersonation determination based on a captured image D4 of a visitor 9 captured by a camera 13. The face authentication system 3 outputs to the control system 4 first information D1 (see FIG. 3) relating to the determination result of the face authentication and second information D2 (see FIG. 3) relating to the determination result of the impersonation determination.

[0111] The control system 4 performs entry control regarding entry to the predetermined area A1 based on the first information D1 and the second information D2 acquired from the face authentication system 3. Furthermore, in the entry control, when the second information D2 is information indicating impersonation, the control system 4 performs a restriction process to restrict entry of the visitor 9 into the predetermined area A1. The control system 4 does not open (unlock) the door 20 while the restriction process is being performed. In this way, when it is determined that the visitor 9 is impersonating in the impersonation judgment, the control system 4 performs the restriction process to restrict entry of the visitor 9 into the predetermined area A1, thereby improving the crime prevention of the predetermined area A1.

[0112] In the control system 4 of this embodiment, when the second information D2 is information indicating impersonation, and the card reader 62 (operation unit) accepts an entry operation to enter a specified area A1 within a specified time after acquiring the second information D2, the control system 4 does not perform restriction processing.

[0113] Here, the "entrance operation" in this embodiment refers to an operation that requests authentication for entry, and is an operation in which the visitor 9 has the card reader 62 read the identification information of the IC card he or she possesses. The control system 4 compares the identification information acquired through the entrance / exit management device 61 with the identification information previously stored in the storage unit 34 (see FIG. 3), and if there is matching identification information, it determines that an entrance operation has been performed on the operation unit. At this time, the control system 4 outputs an instruction to open the door 20 (an instruction to unlock) to the entrance / exit management device 61. It should be noted that the control system 4 compares the identification information acquired through the entrance / exit management device 61 with the identification information previously stored in the storage unit 34, and if there is no matching identification information, it does not determine that an entrance operation has been performed on the operation unit.

[0114] Furthermore, in the entrance control, when the second information D2 is information indicating impersonation, the control system 4 performs a first notification process to notify one or more terminals of the presence of a visitor 9 determined to be an impersonator. Here, the one or more terminals are the guard terminal 64 in the guard room 63, the management company terminal 19 (see FIG. 1) of the management company 5, etc.

[0115] Furthermore, in the entrance control, when the first information D1 is information indicating successful authentication, the control system 4 performs a second notification process of notifying the terminal of the person who has been impersonated that there is a visitor 9 who has been determined to be an impersonator. Here, the terminal of the person who has been impersonated is the registrant terminal 18 or the like in the predetermined area A1.

[0116] (Modification) The second embodiment is merely one of various embodiments of the present disclosure. The above embodiment can be modified in various ways depending on the design, etc., as long as the object of the present disclosure can be achieved.

[0117] Below, we will list some modified examples of the second embodiment. The modified examples explained below can be applied in appropriate combinations.

[0118] The entrance / exit management system 6 in the present disclosure includes, for example, a computer system. The computer system is mainly composed of a processor and a memory as hardware. The function of the entrance / exit management system 6 in the present disclosure is realized by the processor executing a program recorded in the memory of the computer system. The program may be pre-recorded in the memory of the computer system, may be provided through an electric communication line, or may be provided by being recorded in a non-transitory recording medium such as a memory card, an optical disk, or a hard disk drive that can be read by the computer system. The processor of the computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large-scale integrated circuit (LSI). The integrated circuits such as IC or LSI referred to here are called by different names depending on the degree of integration, and include integrated circuits called system LSI, VLSI (Very Large Scale Integration), or ULSI (Ultra Large Scale Integration). Furthermore, a field-programmable gate array (FPGA) that is programmed after the manufacture of the LSI, or a logic device that can reconfigure the connection relationship inside the LSI or reconfigure the circuit partition inside the LSI, can also be adopted as a processor. The electronic circuits may be integrated in one chip or distributed among multiple chips. The chips may be integrated in one device or distributed among multiple devices. The computer system referred to here includes a microcontroller having one or more processors and one or more memories. Thus, the microcontroller is also composed of one or more electronic circuits including a semiconductor integrated circuit or a large-scale integrated circuit.

[0119] The captured image used by the face authentication system 3 for face authentication and spoofing determination may be an image captured by an image capturing unit provided in the card reader 62, for example.

[0120] The card reader 62 may be a personal identification number input device or a biometric information acquisition device. The card reader 62 may be a key cylinder into which a key capable of opening (unlocking) the door 20 is inserted. The card reader 62 is not an essential component of the entrance / exit management device 61.

[0121] In the second embodiment, the entrance / exit control system 6 is introduced into an office, but the entrance / exit control system 6 can also be introduced into various facilities 1 such as apartment buildings and schools.

[0122] The entrance / exit management system 6 only needs to include at least the control system 4 and the entrance / exit management device 61.

[0123] The various configurations described in the second embodiment (including the modified examples) can be applied in appropriate combination with the various configurations described in the first embodiment (including the modified examples).

[0124] (summary) As described above, the control system (4) according to the first aspect includes a first acquisition unit (31), a second acquisition unit (32), and an entrance control unit (331). The first acquisition unit (31) acquires first information (D1) on the determination result of face authentication that uses a face image to determine whether or not the visitor (9) is a person permitted to enter the predetermined area (A1). The second acquisition unit (32) acquires second information (D2) on the determination result of impersonation determination that determines whether or not the subject of the face image used in the face authentication is a real face. The entrance control unit (331) performs entrance control regarding entrance to the predetermined area (A1) based on the first information (D1) acquired by the first acquisition unit (31) and the second information (D2) acquired by the second acquisition unit (32). In the entrance control, when the second information (D2) is information indicating impersonation, the entrance control unit (331) performs a restriction process for restricting the visitor (9) from entering the predetermined area (A1).

[0125] According to this embodiment, when the impersonation determination determines that an impersonation has occurred, the entrance control unit (331) performs a restriction process to restrict the visitor (9) from entering the specified area (A1), thereby improving the security of the specified area (A1).

[0126] In the control system (4) according to the second aspect, in the first aspect, when the second information (D2) is information indicating impersonation, the entry control unit (331) does not perform restriction processing when the operation unit (121; card reader 62) accepts an entry operation for entering a specified area (A1) within a specified time after the second acquisition unit (32) acquires the second information (D2).

[0127] According to this embodiment, even if the spoofing judgment judges that the user is spoofing, if the operation unit (121; card reader 62) accepts the entry operation within a predetermined time, the restriction process is not performed. Therefore, it is possible to reduce the number of times that the restriction process is performed when the spoofing judgment judges that the user is spoofing.

[0128] In the control system (4) according to the third aspect, in the second aspect, the operation unit (121; card reader 62) is provided in a terminal (lobby intercom 12) provided outside the predetermined area (A1). The entry operation includes at least one of an operation of calling the terminal (home master unit 14) of the visitor's (9) visit destination and an operation of requesting authentication for entry.

[0129] According to this embodiment, a visitor (9) who performs at least one of the operations of calling the terminal (home unit main unit 14) of the visitor's destination and the operation of requesting authentication for entry is highly likely not to be attempting unauthorized entry, and the result of the spoofing judgment is highly likely to be an incorrect judgment. Therefore, by not performing the restriction process when the visitor (9) performs the entry operation, it is possible to reduce the number of times that the restriction process is performed when the result of the spoofing judgment is an incorrect judgment.

[0130] In a control system (4) according to a fourth aspect, in any of the first to third aspects, an entrance control unit (331) performs processing according to the result of the impersonation determination when the first information (D1) is information indicating successful authentication during entrance control.

[0131] According to this embodiment, even if the result of the face authentication is a success, the entrance control unit (331) can perform different control depending on the result of the impersonation determination, thereby further improving the security of the specified area (A1).

[0132] In the control system (4) according to the fifth aspect, in any of the first to fourth aspects, when the second information (D2) is information indicating impersonation during entrance control, the entry control unit (331) notifies one or more terminals (the dwelling unit main unit 14; the management room unit 16; the registrant terminal 18; the management company terminal 19; the guard terminal 64) of the presence of a visitor (9) determined to be an impersonator.

[0133] According to this embodiment, when the impersonation assessment determines that an impersonation has occurred, the presence of a visitor (9) determined to be an impersonator is notified to one or more terminals (the residence master unit 14; the management room unit 16; the registrant terminal 18; the management company terminal 19; the security guard terminal 64), thereby further improving the security of the specified area (A1).

[0134] In the control system (4) according to the sixth aspect, in the fifth aspect, when the first information (D1) is information indicating successful authentication during entrance control, the entrance control unit (331) notifies the terminal of the person who has been impersonated (the dwelling unit base unit 14; the registrant terminal 18) that there is a visitor (9) who has been determined to be an impersonator.

[0135] According to this embodiment, when the impersonation judgment determines that an impersonation has occurred, the presence of a visitor (9) determined to be an impersonator is notified to the terminal of the person who has been impersonated (the dwelling unit main unit 14; the registrant terminal 18). The person who has been impersonated can learn from the notification that there is a visitor (9) who has impersonated him / her, and crime prevention in the specified area (A1) can be further improved.

[0136] In the control system (4) according to the seventh aspect, in any of the first to sixth aspects, in the entry control, when the second information (D2) is information indicating impersonation, the entry control unit (331) stores the captured images (D3; D4) captured by the photographing unit (122; camera 13) that photographs the visitor (9) in the memory unit (34; 173).

[0137] According to this embodiment, when the impersonation judgment determines that the visitor (9) has impersonated another person, the image of the visitor's (9) impersonated face can be saved by storing the captured image (D3; D4) taken by the photographing unit (122; camera 13) that photographs the visitor (9) in the memory unit (34; 173) during at least one of the face authentication and the impersonation judgment.

[0138] In the control system (4) according to the eighth aspect, in any one of the first to seventh aspects, In the admission control, when the second information (D2) is information indicating impersonation, the admission control unit (331) stores in the memory unit (34; 173) the captured image (D3; D4) captured by the photographing unit (122; camera 13) after the impersonation determination.

[0139] According to this embodiment, when the impersonation determination determines that an impersonation has occurred, the photographing unit (122; camera 13) photographs the visitor (9) after the impersonation determination, generates a photographed image (D3; D4), and stores the photographed image (D3; D4) containing the visitor (9) in the memory unit (34; 173).

[0140] In the control system (4) according to the ninth aspect, in the seventh or eighth aspect, the admission control unit (331) notifies the visitor (9) that the captured image (D3; D4) has been stored in the memory unit (34; 173).

[0141] According to this embodiment, by notifying the visitor (9) that a face impersonated by the visitor (9) or a photographed image (D3; D4) showing the visitor (9) has been stored, the visitor (9) who intended to illegally enter the building or the like can be deterred.

[0142] The configurations other than those of the first embodiment are not essential to the control system (4) and may be omitted as appropriate.

[0143] The intercom system (2) according to the tenth aspect includes the control system (4) according to any one of the first to ninth aspects and an information terminal (a dwelling master unit 14; a management room unit 16). The information terminal (the dwelling master unit 14; the management room unit 16) is capable of communicating with the control system (4).

[0144] According to this embodiment, when the impersonation determination determines that an impersonation has occurred, the control system (4) performs a restriction process to restrict the visitor (9) from entering the specified area (A1), thereby improving the security of the specified area (A1) of an apartment building or the like in which the intercom system (2) is installed.

[0145] An entrance / exit management system (6) according to an eleventh aspect includes the control system (4) according to any one of the first to ninth aspects and an entrance / exit management device (61). The entrance / exit management device (61) manages the opening and closing of a door (20) leading to a predetermined area (A1) in response to entrance control by the control system (4).

[0146] According to this embodiment, when the impersonation determination determines that an impersonation has occurred, the control system (4) performs a restriction process to restrict the visitor (9) from entering the specified area (A1), thereby improving the security of the specified area (A1) of an office or the like in which the entrance / exit control system (6) is installed.

[0147] A face authentication system (3) according to a twelfth aspect includes a control system (4) according to any one of the first to ninth aspects, a face authentication unit (36), and an impersonation determination unit (37). The face authentication unit (36) performs face authentication. The impersonation determination unit (37) performs impersonation determination.

[0148] According to this embodiment, when the impersonation determination unit (37) determines that an impersonation has occurred, the entrance control unit (331) performs a restriction process to restrict the visitor (9) from entering the specified area (A1), thereby improving the security of the specified area (A1).

[0149] The control method according to the thirteenth aspect includes a first information acquisition step, a second information acquisition step, and an entrance control step. In the first information acquisition step, first information (D1) is acquired on the basis of a face image (captured image D3) to determine whether or not the visitor (9) is a person permitted to enter the predetermined area (A1). In the second information acquisition step, second information (D2) is acquired on the basis of a result of impersonation determination to determine whether or not the face used in the face authentication is a human face. In the entrance control step, entrance control is performed on the basis of the first information (D1) acquired in the first information acquisition step and the second information (D2) acquired in the second information acquisition step. The entrance control step includes a restriction step. In the restriction step, in the entrance control, when the second information (D2) is information indicating impersonation, the entrance of the visitor (9) to the predetermined area (A1) is restricted.

[0150] According to this embodiment, when the impersonation determination determines that an impersonation has occurred, the visitor (9) is restricted from entering the specified area (A1), thereby improving the crime prevention of the specified area (A1).

[0151] A program according to a fourteenth aspect is a program for causing one or more processors to execute the control method according to the thirteenth aspect. [Explanation of symbols]

[0152] 12 Lobby intercom (external terminal) 121 Operation section 122 Photography Department 13 Camera (photography section) 14. Residential base station (terminal of the person who has been impersonated) (information terminal) 16 Control room machine (1 or more terminals) (information terminal) 17 Monitoring Server 173 Storage section 18 Registered User's Terminal (Device of the Person Impersonated) (Information Terminal) 19 Management company terminal (1 or more terminals) (information terminal) 2. Intercom System 3. Face Recognition System 31 First acquisition part 32 Second acquisition part 331 Admissions Control Department 34 Storage section 36 Face Recognition Unit 37 Spoofing Detection Unit 4. Control System 6. Entrance / Exit Control System 61 Entry / exit control device 62 Card Reader 64 Guard terminals (1 or more terminals) 9. Visitors A1 Specified area D1 First Information D2 2nd information D3 Captured images D4 Captured images

Claims

1. a face authentication unit that performs face authentication using a face image included in a first captured image captured by the first imaging unit and determines whether or not a visitor is a person authorized to enter a predetermined area; a first acquisition unit that acquires first information related to a determination result of face authentication from the face authentication unit; an imitation determination unit that performs imitation determination to determine whether or not a subject of the face image used for the face authentication is a real face based on a second captured image captured by a second imaging unit; a second acquisition unit that acquires second information related to a result of the spoofing determination from the spoofing determination unit; an admission control unit that performs admission control regarding admission to the predetermined area based on the first information acquired by the first acquisition unit and the second information acquired by the second acquisition unit; Equipped with The admission control unit: In the entrance control, when the second information is information indicating impersonation, a restriction process is performed to restrict the visitor from entering the predetermined area; In the admission control, when the second information is information indicating impersonation, an image captured by the first photographing unit is stored in a storage unit; notifying the visitor that the captured image has been stored in the storage unit; Facial recognition system.

2. A face recognition unit that performs face recognition using a face image included in a first photographed image captured by the first photographing unit and determines whether or not a visitor is a person authorized to enter a specified area; a first acquisition unit that acquires first information related to a determination result of face authentication from the face authentication unit; an imitation determination unit that performs imitation determination to determine whether or not a subject of the face image used for the face authentication is a real face based on a second captured image captured by a second imaging unit; a second acquisition unit that acquires second information related to a result of the spoofing determination from the spoofing determination unit; an admission control unit that performs admission control regarding admission to the predetermined area based on the first information acquired by the first acquisition unit and the second information acquired by the second acquisition unit; Equipped with The admission control unit: In the entrance control, when the second information is information indicating impersonation, a restriction process is performed to restrict the visitor from entering the predetermined area; In the entrance control, when the second information is information indicating impersonation, an image capturing unit that captures an image of the visitor is caused to store an image captured by the image capturing unit after the impersonation determination is made in a storage unit; notifying the visitor that the captured image has been stored in the storage unit; Facial recognition system.

3. When the second information is information indicating impersonation, and when an operation unit accepts an entry operation for entering the specified area within a specified time after the second acquisition unit acquires the second information, the entry control unit does not perform the restriction process. The face authentication system according to claim 1 or 2.

4. The operation unit is provided on a terminal provided outside the specified area, The entrance operation includes at least one of an operation of calling a terminal of the visitor's destination and an operation of requesting authentication for entrance. The face authentication system according to claim 3 .

5. The admission control unit, in the admission control, when the first information is information indicating successful authentication, performs processing according to the determination result of the impersonation determination. The face authentication system according to claim 1 .

6. When the second information indicates impersonation during the admission control, the admission control unit notifies one or more terminals of the presence of the visitor determined to be an impersonator. The face authentication system according to any one of claims 1 to 5.

7. When the first information indicates successful authentication during the admission control, the admission control unit notifies a terminal of the person who has been impersonated that there is a visitor who has been determined to be an impersonator. The face authentication system according to claim 6.

8. A face recognition system according to any one of claims 1 to 7, An information terminal capable of communicating with the face authentication system; Equipped with Intercom system.

9. A face recognition system according to any one of claims 1 to 7, an entrance / exit management device that manages opening and closing of a door leading to the predetermined area in response to the entrance control by the face authentication system; Equipped with Entrance / exit control system.

10. A face recognition step of performing face recognition to determine whether or not a visitor is a person authorized to enter a specified area based on a face image included in a first photographed image taken by a first photographing unit; a first information acquisition step of acquiring first information related to a determination result of the face authentication; an spoofing determination step of performing an spoofing determination for determining whether or not the face used in the face authentication is a human face based on a second captured image captured by a second imaging unit; a second information acquisition step of acquiring second information related to a result of the spoofing determination; an admission control step of performing admission control regarding admission to the predetermined area based on the first information acquired in the first information acquisition step and the second information acquired in the second information acquisition step; having The entrance control step includes a restriction step of restricting the visitor from entering the predetermined area when the second information is information indicating impersonation, In the admission control step, In the admission control, when the second information is information indicating impersonation, an image captured by the first photographing unit is stored in a storage unit; notifying the visitor that the captured image has been stored in the storage unit; Control methods.

11. A program for causing one or more processors to execute the control method described in claim 10.

Images