Intercom system, control method, and program

Abstract

To improve the security.SOLUTION: An intercom system 100 includes a control device 1 that is provided in a first area of a facility and is capable of communicating with a lobby intercom 9 that authenticates a visitor to the facility. The control device 1 includes a first acquisition unit, a second acquisition unit, a determination unit, and an output unit. The first acquisition unit acquires an authentication result brought by the lobby intercom 9. The second acquisition unit acquires an image of an intruder entering a second area that is located further inside the facility than the first area. The determination unit determines whether or not the intruder is the visitor authenticated by the lobby intercom 9 on the basis of the authentication result and the image brought by the lobby intercom 9. The output unit outputs information according to the determination result brought by the determination unit.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates generally to an intercom system, a control method and a program, and more particularly to an intercom system, a control method and a program capable of communicating with a lobby intercom that authenticates visitors to a facility. [Background technology]

[0002] Patent Document 1 describes an intercom system used in an apartment building. The intercom system described in Patent Document 1 includes a collective entrance unit installed at the collective entrance of the apartment building, a room master unit installed in each dwelling unit of the apartment building, and a control device that communicatively connects the collective entrance unit and each room master unit. The intercom system described in Patent Document 1 is configured to compare a visitor captured in an image captured by a camera of the collective entrance unit with a visitor captured in an image stored in a memory unit of the control device, and not to call the room master unit if the two match. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-108342 A Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, in an intercom system such as that described in Patent Document 1, further improvement in security is desired.

[0005] The present disclosure has been made in consideration of the above-mentioned problems, and aims to provide an intercom system, a control method, and a program that can improve security. [Means for solving the problem]

[0006] An intercom system according to one embodiment of the present disclosure is an intercom system including a control device provided in a first area of ​​a facility and capable of communicating with a lobby intercom that performs authentication processing for visitors to the facility. The control device includes a first acquisition unit, a second acquisition unit, a determination unit, and an output unit. The first acquisition unit acquires an authentication result by the lobby intercom. The second acquisition unit acquires an image of an intruder entering a second area that is located further inside the facility than the first area. The determination unit determines whether the intruder is a visitor who has been authenticated by the lobby intercom based on the authentication result and the image. The output unit outputs information according to the determination result by the determination unit.

[0007] An intercom system according to one embodiment of the present disclosure is an intercom system including a control device provided in a first area of ​​a facility and capable of communicating with a lobby intercom that performs authentication processing for visitors to the facility. The control device includes an acquisition unit, a determination unit, and an output unit. The acquisition unit acquires an image of an intruder entering a second area that is located further inside the facility than the first area. The determination unit determines, based on the image, whether the intruder is a visitor who has been authenticated by the lobby intercom. The output unit outputs information according to the determination result by the determination unit.

[0008] A control method according to one aspect of the present disclosure is a control method for an intercom system including a control device provided in a first area of ​​a facility and capable of communicating with a lobby intercom that performs authentication processing for visitors to the facility. The control method includes a first acquisition step, a second acquisition step, a determination step, and an output step. In the first acquisition step, an authentication result by the lobby intercom is acquired. In the second acquisition step, an image of an intruder entering a second area that is located further inside the facility than the first area is acquired. In the determination step, it is determined based on the authentication result and the image whether the intruder is a visitor who has been authenticated by the lobby intercom. In the output step, information according to the determination result in the determination step is output.

[0009] A program according to one embodiment of the present disclosure is a program for causing one or more processors to execute the control method. Effect of the Invention

[0010] According to the present disclosure, security can be improved. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a block diagram showing a configuration of an intercom system according to an embodiment of the present disclosure. [Diagram 2] FIG. 2 is a block diagram showing a configuration of a first control device provided in the intercom system. [Diagram 3] FIG. 3 is a diagram showing a first image acquired by the intercom system. [Figure 4] FIG. 4 is a diagram showing a second image acquired by the intercom system. [Diagram 5] FIG. 5 is a sequence diagram for explaining the operation of the intercom system. [Figure 6] FIG. 6 is an explanatory diagram for explaining the operation of the intercom system. [Figure 7] FIG. 7 is an explanatory diagram for explaining the operation of the intercom system. [Figure 8] FIG. 8 is an explanatory diagram for explaining the operation of the intercom system. [Figure 9] FIG. 9 is a front view of a first display device included in the intercom system. [Figure 10] FIG. 10 is a block diagram showing a configuration of an intercom system according to the second modification. [Figure 11] FIG. 11 is a diagram showing a second image acquired by the intercom system. [Figure 12] FIG. 12 is a block diagram showing a configuration of a first control device provided in the intercom system of the third modification. [Figure 13] FIG. 13 is a sequence diagram for explaining the operation of the intercom system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] An intercom system 100 according to an embodiment of the present disclosure will be described in detail with reference to the drawings. Note that the embodiment and modified examples described below are merely examples of the present disclosure, and the present disclosure is not limited to the embodiment and modified examples. Other than the embodiment and modified examples, various modifications are possible according to the design, etc., as long as they do not deviate from the technical idea of ​​the present disclosure. In addition, the following embodiments (including modified examples) may be realized in appropriate combination.

[0013] (1) Overview The intercom system 100 according to this embodiment is an intercom system applied to a facility F1 (see Figs. 6 to 8). In this embodiment, it is assumed that the facility F1 is an apartment building (hereinafter referred to as apartment building F10). However, the facility F1 to which the intercom system 100 is applied may be a detached house other than the apartment building F10. Alternatively, the facility F1 may be a non-residential facility such as an office, a store, a school, or a care facility.

[0014] 1, the intercom system 100 is an intercom system including a control device (first control device) 1 capable of communicating with a lobby intercom 9. The lobby intercom 9 is provided in a first area AR1 of a facility F1, and performs authentication processing of a visitor C0 to the facility F1. Here, when the facility F1 is an apartment building F10 as in this embodiment, the first area AR1 is a common entrance.

[0015] As shown in FIG. 2, the first control device 1 includes a first acquisition unit 174, a second acquisition unit 175, a determination unit 170, and an output unit 176.

[0016] The first acquisition unit 174 acquires the authentication result of the visitor C0 via the lobby intercom 9.

[0017] The second acquisition unit 175 acquires an image Im2 (see FIG. 4) of an entrant E0 entering a second area AR2 of the facility F1. The second area AR2 of the facility F1 is an area that is located further inside the facility F1 than the first area AR1.

[0018] The determination unit 170 determines whether the trespasser E0 is a visitor C0 authenticated by the lobby intercom 9, based on the authentication result by the lobby intercom 9 and the image Im2.

[0019] The output unit 176 outputs information according to the result of the determination by the determination unit 170 .

[0020] Here, in the authentication process by the lobby intercom 9 of the present disclosure, "authenticating the visitor C0" refers to determining that the visitor C0 is qualified to enter the second area AR2 of the facility F1. In the following description, the visitor C0 who has been authenticated by the lobby intercom 9 may be referred to as an "authenticated person," and the visitor C0 who has not been authenticated by the lobby intercom 9 may be referred to as an "unauthenticated person."

[0021] Furthermore, in the present disclosure, "an entrant E0 entering the second area AR2" includes a person who has entered the second area AR2, and a person who is moving in the first area AR1 toward the second area AR2.

[0022] According to the above configuration, security can be improved by using the information output by the output unit 176. As an example, when an unauthenticated person enters the second area AR2 together with an authenticated person, a warning can be given to the unauthenticated person based on the information output by the output unit 176, for example, to prompt the unauthenticated person to exit the second area AR2, thereby improving security.

[0023] (2) Details The lobby intercom 9 and the intercom system 100 capable of communicating with the lobby intercom 9 will be described in detail below with reference to FIGS. 1 to 9. FIG.

[0024] (2.1) Overall Structure In this embodiment, the intercom system 100 is applied to an apartment building F10.

[0025] As shown in FIG. 1, the intercom system 100 includes a first control device 1, a second control device 2, an imaging device 3, a first display device 4, a second display device 5, an audio output device 6, multiple (two in FIG. 1) dwelling terminals 7, and multiple (two in FIG. 1) door phones 8.

[0026] A first control device 1 and a second control device 2 included in the intercom system 100 communicate with a lobby intercom 9 provided in a first area AR1 of the apartment building F10.

[0027] Here, the first area AR1 is provided, for example, on the first floor of the apartment building F10. A second area AR2 is provided on the first floor, which is located further inside the apartment building F10 than the first area AR1. The first area AR1 and the second area AR2 are separated by a gate GT1. The gate GT1 is an automatic door provided between the first area AR1 and the second area AR2. The gate GT1 is configured to be unlocked by an unlocking signal from the lobby intercom 9 and to open automatically. The gate GT1 includes a transparent member, for example, a glass plate, and is configured to allow the first area AR1 to be viewed from the second area AR2 even when the gate GT1 is closed.

[0028] The second area AR2 is, for example, an area in which elevators, stairs, and the like are installed to access from the first floor to floors where the dwelling units of the apartment building F10 are provided.

[0029] Each of the multiple dwelling terminals 7 is installed in each dwelling unit of the apartment building F10. Each dwelling terminal 7 is configured to communicate (for example, make calls and receive image signals) with the lobby intercom 9 via the second control device 2.

[0030] Each of the multiple door phones 8 is installed, for example, at the outer entrance of each dwelling unit of the apartment building F10. The multiple door phones 8 correspond one-to-one to the multiple dwelling unit terminals 7. Each door phone 8 is configured to communicate (for example, make calls and transmit image signals, etc.) with the corresponding dwelling unit terminal 7.

[0031] The imaging device 3, the first display device 4, the second display device 5 and the audio output device 6 will be described later.

[0032] (2.2) Lobby intercom 1, the lobby intercom 9 includes a first communication unit 91, a second communication unit 92, an imaging unit 93, a storage unit 94, an operation unit 95, a display unit 96, a call unit 97, and a control unit 98. The lobby intercom 9 also has a housing that houses or holds the above-mentioned components.

[0033] The imaging unit 93 is a camera having an imaging element for capturing an image of a subject. Here, the subject of the imaging unit 93 is a visitor C0 (see FIG. 3) to the apartment house F10. The imaging area (field of view) of the imaging unit 93 is set in front of the lobby intercom 9 so that at least the face of the visitor C0 can be captured when the visitor C0 is authenticated by the lobby intercom 9. That is, the imaging unit 93 captures an image (first image Im1) of the face of the visitor C0, as shown in FIG. 3. In this embodiment, the imaging unit 93 is a camera that captures a video. Furthermore, in this embodiment, the imaging unit 93 is a camera that captures a color image. Note that the imaging unit 93 may be a camera that captures a still image. The imaging unit 93 may be a camera that captures a monochrome image. The imaging unit 93 is not limited to a camera that captures a visible light image, and may be a near-infrared camera, a stereo camera, a depth camera, or the like.

[0034] The imaging element is, for example, a two-dimensional image sensor such as a CCD (Charge Coupled Devices) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor. The imaging unit 93 forms an image of light from a subject on an imaging surface (light receiving surface) of the imaging element by an optical system such as a lens, and converts the light from the subject into an electrical signal by the imaging element. The imaging unit 93 then outputs an output signal of the imaging element to the control unit 98 as an image signal.

[0035] The first communication unit 91 is a communication module configured to be able to communicate with the first control device 1 included in the intercom system 100.

[0036] The second communication unit 92 is a communication module configured to be able to communicate with the second control device 2 included in the intercom system 100.

[0037] The storage unit 94 is configured with a device selected from a ROM (Read Only Memory), a RAM (Random Access Memory), an EEPROM (Electrically Erasable Programmable Read Only Memory), or the like.

[0038] The storage unit 94 prestores facial images (reference images) of a plurality of persons who are qualified to enter the second area AR2 from the first area AR1. The storage unit 94 may store facial feature amounts of a plurality of persons who are qualified to enter the second area AR2 from the first area AR1. The reference images, etc. may be stored in an external storage device (server, cloud server, etc.) that can communicate with the lobby intercom 9.

[0039] The operation unit 95 is configured to accept operations by a visitor C0 to the apartment complex F10. The operation unit 95 is, for example, an input interface having a plurality of push button switches, a touch panel, and the like.

[0040] The display unit 96 is, for example, a liquid crystal display. The display unit 96 is configured to display, for example, the first image Im1 captured by the imaging unit 93. If the lobby intercom 9 is equipped with a touch panel display, the touch panel display may function as both the display unit 96 and the operation unit 95.

[0041] The communication unit 97 includes a speaker and a microphone, and is configured to be able to communicate with the dwelling terminal 7.

[0042] The control unit 98 is configured by a computer system mainly composed of a processor such as a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit) and a memory. The processor executes a program stored in the memory, causing the computer system to function as the control unit 98. The program executed by the processor is pre-recorded in the memory of the computer system here, but may be provided by being recorded on a recording medium such as a memory card, or may be provided via an electric communication line such as the Internet.

[0043] 1, the control unit 98 has an acquisition unit 981, a face detection unit 982, an authentication unit 983, a processing unit 984, and an output unit 985. Note that the acquisition unit 981, the face detection unit 982, the authentication unit 983, the processing unit 984, and the output unit 985 merely indicate functions realized by the control unit 98, and do not necessarily indicate actual configurations.

[0044] The acquisition unit 981 acquires a first image Im1 which is a facial image of the visitor C0 captured by the imaging unit 93.

[0045] The face detection unit 982 extracts data on the facial features of the visitor C0 based on the first image Im1.

[0046] The authentication unit 983 determines whether or not there is a reference image that matches the first image Im1 among the multiple reference images stored in the memory unit 94. More specifically, the authentication unit 983 determines whether or not there is a reference image that includes a face whose degree of match with the facial feature amount data of the visitor C0 extracted from the first image Im1 by the face detection unit 982 is equal to or higher than a predetermined threshold (e.g., 80% or higher).

[0047] If the authentication unit 983 determines that there is a reference image that matches the first image Im1, it authenticates the visitor C0. In other words, the authentication unit 983 determines that the visitor C0 is an authenticated person who is qualified to enter the second area AR2 from the first area AR1.

[0048] Furthermore, if the authentication unit 983 determines that there is no reference image that matches the first image Im1, it does not authenticate the visitor C0. In other words, the authentication unit 983 determines that the visitor C0 is an unauthenticated person who is not qualified to enter the second area AR2 from the first area AR1.

[0049] When the authentication unit 983 authenticates the visitor C0, it generates information on the authentication result (authentication result information). The authentication result information includes authentication information indicating that the visitor C0 has been authenticated and data on the facial feature amount of the visitor C0 extracted from the first image Im1 by the face detection unit 982.

[0050] The output unit 985 outputs the authentication result information to the first control device 1 via the first communication unit 91.

[0051] The processing unit 984 opens the gate GT1 when the authentication unit 983 authenticates the visitor C0. On the other hand, when the authentication unit 983 does not authenticate the visitor C0, the processing unit 984 outputs a sound (voice) indicating that the authentication has failed from, for example, a speaker included in the communication unit 97 without opening the gate GT1.

[0052] Furthermore, as described above, the lobby intercom 9 is configured to communicate with each of the multiple dwelling unit terminals 7. As a result, the lobby intercom 9 is configured so that the visitor C0 can operate the operation unit 95 to call a resident of a desired dwelling unit (a resident of the apartment building F10) by the visitor C0.

[0053] Specifically, when the operation unit 95 of the lobby intercom 9 accepts a call operation, it transmits a control signal related to the call to the dwelling terminal 7 installed in the dwelling unit to be called. If the dwelling terminal 7 accepts a predetermined operation from the resident (such as pressing a call button provided on the dwelling terminal 7) while the dwelling terminal 7 is receiving the control signal, communication becomes possible between the dwelling terminal 7 and the lobby intercom 9. This enables a call between the resident of the dwelling who is the operator of the dwelling terminal 7 and the visitor C0 who is the operator of the lobby intercom 9.

[0054] In addition, when the dwelling terminal 7 is receiving a control signal, if the dwelling terminal 7 accepts a specified operation from the resident (such as pressing an unlock button provided on the dwelling terminal 7), the dwelling terminal 7 transmits an unlock signal to the lobby intercom 9 via the second control device 2, which will be described later.

[0055] When the second communication unit 92 of the lobby intercom 9 receives the unlocking signal, the authentication unit 983 authenticates the visitor C0 and outputs authentication result information including authentication information indicating that the visitor C0 has been authenticated and the first image Im1 of the visitor C0 authenticated by the authentication unit 983 to the first control device 1 via the first communication unit 91.

[0056] Furthermore, when the second communication unit 92 receives an unlock signal, the processing unit 984 opens the gate GT1. That is, the visitor C0 authenticated by the lobby intercom 9 (authentication unit 983) includes a person who is permitted by the resident of the apartment building F10 to enter the second area AR2. Note that the person who is permitted by the resident of the apartment building F10 to enter the second area AR2 includes, for example, a family member of the resident of the apartment building F10, a friend of the resident of the apartment building F10, a delivery person, and the like.

[0057] (2.3) First control device As shown in FIG. 2, the first control device 1 includes a first communication unit 11, a second communication unit 12, a third communication unit 13, a fourth communication unit 14, a fifth communication unit 15, a memory unit 16, and a control unit 17.

[0058] The first communication unit 11 is a communication module configured to be able to communicate with the lobby interphone 9 .

[0059] The second communication unit 12 is a communication module configured to be able to communicate with the imaging device 3. Here, the imaging device 3 is a camera having an imaging element for capturing an image of a subject. As shown in Figs. 6 to 8, the imaging device 3 is installed, for example, on the ceiling of the second area AR2. As shown in Fig. 4, the imaging device 3 captures an image (second image) Im2 of an intruder E0 entering the second area AR2 from the first area AR1. The imaging area of ​​the imaging device 3 is set so that at least the face of the intruder E0 can be captured when the intruder E0 enters the second area AR2 from the first area AR1. In this embodiment, the imaging device 3 is a camera that captures a moving image. Furthermore, in this embodiment, the imaging device 3 is a camera that captures a color image. Note that the imaging device 3 may be a camera that captures a still image. Also, the imaging device 3 may be a camera that captures a monochrome image. Also, the imaging device 3 is not limited to a camera that captures a visible light image, and may be a near-infrared camera, a stereo camera, a depth camera, or the like.

[0060] The third communication unit 13 is a communication module configured to be able to communicate with the first display device 4. Here, the first display device 4 is, for example, a digital signage as shown in FIG. 6 to FIG. 9. The first display device 4 is installed, for example, on the floor surface of the second area AR2. The first display device 4 displays an image output from a first output unit 177, which will be described later. Note that the first display device 4 is not limited to a digital signage as long as it is a device capable of displaying the image output from the first output unit 177. Also, the first display device 4 may be a projector or the like capable of projecting the image output from the first output unit 177 onto a screen or the like.

[0061] The fourth communication unit 14 is a communication module configured to be able to communicate with the second display device 5. Here, the second display device 5 is a projector, for example. The second display device 5 is installed on, for example, the ceiling of the second area AR2. The second display device 5 projects an image output from a second output unit 178, which will be described later, onto, for example, the floor surface of the second area AR2. Note that the second display device 5 is not limited to a projector, and may be a spotlight or the like. In this case, the second display device 5 irradiates light onto the second area AR2 based on a control signal output from the second output unit 178.

[0062] The fifth communication unit 15 is a communication module configured to be able to communicate with the audio output device 6. Here, the audio output device 6 is, for example, a speaker. The audio output device 6 is installed, for example, on the ceiling of the second area AR2. The audio output device 6 outputs audio based on audio data output from a third output unit 179 described later.

[0063] The control unit 17 is configured by a computer system mainly composed of a processor such as a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit) and a memory. The processor executes a program stored in the memory, so that the computer system functions as the control unit 17. The program executed by the processor is pre-recorded in the memory of the computer system here, but may be provided by being recorded on a recording medium such as a memory card, or may be provided via an electric communication line such as the Internet.

[0064] 2, the control unit 17 has a determination unit 170, a first acquisition unit 174, a second acquisition unit 175, and three output units 176 (a first output unit 177, a second output unit 178, and a third output unit 179). The determination unit 170 has a face detection unit 171, a motion detection unit 172, and a determination processing unit 173. Note that the determination unit 170 (the face detection unit 171, the motion detection unit 172, and the determination processing unit 173), the first acquisition unit 174, the second acquisition unit 175, the first output unit 177, the second output unit 178, and the third output unit 179 merely indicate functions realized by the control unit 17, and do not necessarily indicate actual configurations.

[0065] The first acquisition unit 174 acquires the authentication result information output from the lobby intercom 9.

[0066] The second acquisition unit 175 acquires the second image Im2 captured by the imaging device 3.

[0067] The face detection section 171 detects the face of the intruder E0 based on the second image Im2. Specifically, the face detection section 171 extracts a feature amount of the face of the intruder E0 based on the second image Im2.

[0068] The motion detection unit 172 detects the motion of the intruder E0 based on the second image Im2. The "motion of the intruder E0" here refers to information including a change in the position of the intruder E0. The motion detection unit 172 also calculates the movement path of the intruder E0 from the change in the position of the intruder E0. The motion detection unit 172 also calculates the movement speed of the intruder E0 from the change in the position of the intruder E0 and time information. The motion detection unit 172 stores the movement path of the intruder E0 and the movement speed of the intruder E0 in the storage unit 16 as part of the behavior information of the intruder E0. In other words, the behavior information of the intruder E0 includes the movement path and movement speed of the intruder E0 obtained based on the second image Im2. The time information is acquired, for example, by a clock function of the control unit 17.

[0069] The determination processing unit 173 determines whether the intruder E0 is a visitor C0 (authenticated person) authenticated by the lobby intercom 9, based on the authentication result information acquired by the first acquisition unit 174 and the face detection result by the face detection unit 171. Specifically, the determination processing unit 173 determines that the intruder E0 is an authenticated person when the degree of agreement between the facial feature amount data of the visitor C0 included in the authentication result information and the facial feature amount data of the intruder E0 included in the face detection result by the face detection unit 171 is equal to or higher than a predetermined threshold (e.g., 80% or more). In addition, the determination processing unit 173 determines that the intruder E0 is not an authenticated person (a non-authenticated person) when the degree of agreement between the facial feature amount data of the visitor C0 included in the authentication result information and the facial feature amount data of the intruder E0 included in the face detection result by the face detection unit 171 is less than a predetermined threshold (e.g., less than 80%).

[0070] The first output unit 177 outputs information according to the determination result by the determination processing unit 173 to the first display device 4. Here, as described above, in this embodiment, the first display device 4 is a digital signage, and the information output by the first output unit 177 includes data of an image to be displayed by the first display device 4, which is a digital signage.

[0071] The second output unit 178 outputs information according to the determination result by the determination processing unit 173 to the second display device 5. Here, as described above, in this embodiment, the second display device 5 is a projector, and the information output by the second output unit 178 includes data of an image projected by the second display device 5 which is a projector.

[0072] The third output unit 179 outputs information according to the result of the determination by the determination processing unit 173 to the audio output device 6. The information output by the third output unit 179 includes data of the audio output by the audio output device 6, which is a speaker.

[0073] The storage unit 16 is configured with a device selected from a ROM (Read Only Memory), a RAM (Random Access Memory), an EEPROM (Electrically Erasable Programmable Read Only Memory), etc. The storage unit 16 stores various data acquired by the first acquisition unit 174 and the second acquisition unit 175. The storage unit 16 also stores various data output by the first output unit 177, the second output unit 178, and the third output unit 179.

[0074] (2.4) Second control device As shown in FIG. 1, the second control device 2 includes a communication unit 21 and a control unit 22.

[0075] The communication unit 21 is a communication module configured to be able to communicate with the lobby intercom 9 and each dwelling terminal 7. The communication unit 21 is configured to relay communication between each dwelling terminal 7 and the lobby intercom 9.

[0076] The control unit 22 is configured by a computer system mainly composed of a processor such as a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit) and a memory. The processor executes a program stored in the memory, causing the computer system to function as the control unit 22. The program executed by the processor is pre-recorded in the memory of the computer system here, but may be provided by being recorded on a recording medium such as a memory card, or may be provided via an electric communication line such as the Internet.

[0077] The control unit 22 is configured to control the communication unit 21. Specifically, the control unit 22 controls the communication unit 21 to transmit a communication signal transmitted from the lobby intercom 9 to each of the multiple dwelling terminals 7, and to transmit a communication signal transmitted from each of the dwelling terminals 7 to the lobby intercom 9.

[0078] (2.5) Dwelling Unit Terminal The dwelling terminal 7 has, for example, a microcomputer having a processor and a memory. The processor executes a program stored in the memory, causing the microcomputer to realize the functions of the dwelling terminal 7. The program executed by the processor is pre-recorded in the memory of the microcomputer here, but may also be provided by being recorded on a non-transitory recording medium such as a memory card, or may be provided via a telecommunications line such as the Internet.

[0079] The dwelling terminal 7 is configured to be able to communicate with the lobby intercom 9 via the second control device 2. When the dwelling terminal 7 receives a control signal (call signal) for calling a resident from the lobby intercom 9 and accepts a predetermined operation by an operator of the dwelling terminal 7 (for example, a resident of a dwelling unit in the apartment building F10), the dwelling terminal 7 and the lobby intercom 9 are able to communicate with each other via the second control device 2. This allows a call between the operator of the dwelling terminal 7 and the operator of the lobby intercom 9. Furthermore, when the dwelling terminal 7 accepts a predetermined operation by the operator of the dwelling terminal 7 while receiving a call signal from the lobby intercom 9 or being able to communicate with the lobby intercom 9, an unlocking signal is transmitted to the lobby intercom 9. When the lobby intercom 9 receives the unlocking signal, it opens the gate GT1.

[0080] Furthermore, when the dwelling terminal 7 receives a predetermined operation while receiving a control signal (call signal) for calling a resident from the door phone 8, the dwelling terminal 7 becomes capable of communicating with the door phone 8. This allows a call to be made between the operator of the dwelling terminal 7 and the operator of the door phone 8.

[0081] (3) Operation The operations of the lobby intercom 9 and the intercom system 100 will be described below with reference to FIG. 5 which is a sequence diagram.

[0082] First, as shown in FIG. 6, assume a situation in which two visitors C0 (a first visitor C1 and a second visitor C2) are present in a first area AR1 of an apartment building F10. Here, the first visitor C1 is, for example, a resident of an apartment building F10 who has returned home from an outside trip. The first visitor C1 stands in front of the lobby intercom 9 and is about to be authenticated by the lobby intercom 9 in order to enter the second area AR2 from the first area AR1. The second visitor C2 waits at a position away from the lobby intercom 9 and intends to enter the second area AR2 from the first area AR1 together with the first visitor C1, that is, to enter the first area AR1 together with the first visitor C1 without being authenticated by the lobby intercom 9.

[0083] When, for example, a human presence sensor (not shown) included in the lobby intercom 9 detects the first visitor C1, the imaging unit 93 of the lobby intercom 9 captures a first image Im1 of the first visitor C1. When the imaging unit 93 captures the first image Im1, the acquisition unit 981 acquires the first image Im1 (step 1).

[0084] The authentication unit 983 performs authentication processing for the first visitor C1 based on the first image Im1 of the first visitor C1 (Step S2).

[0085] Here, the visitor C0 authenticated by the authentication unit 983 includes a person pre-registered in the memory unit 94. In other words, the authentication unit 983 authenticates the visitor C0 when the visitor C0 is a person pre-registered in the memory unit 94. The people pre-registered in the memory unit 94 include residents of the apartment building F10, family members of the residents of the apartment building F10, delivery persons, etc.

[0086] The authentication unit 983 determines whether or not there is a reference image among the multiple reference images stored in the storage unit 94 that matches the first image Im1.

[0087] In this operation example, since the first visitor C1 is a resident of a dwelling unit in the apartment building F10, an image of the first visitor C1 is included in the multiple reference images stored in the memory unit 94. Therefore, the authentication unit 983 authenticates the first visitor C1.

[0088] When the authentication unit 983 authenticates the first visitor C1, the output unit 985 outputs authentication result information including authentication information indicating that the first visitor C1 has been authenticated and data on the facial features of the first visitor C1 to the first control device 1 (step S3).

[0089] The authentication result information output from the output unit 985 is acquired by the first acquisition unit 174 of the first control device 1 (step S4).

[0090] Furthermore, when the authentication unit 983 authenticates the first visitor C1, the processing unit 984 opens the gate GT1 as shown in FIG.

[0091] When the gate GT1 is opened, the first visitor C1 starts entering the second area AR2 from the first area AR1. Here, "starting entering the second area AR2 from the first area AR1" means starting to move in the direction of the second area AR2 in the first area AR1. In other words, in this embodiment, the first visitor C1 becomes a person entering the second area AR2 from the first area AR1 (first visitor E1) at the point in time when the first visitor C1 starts to move in the first area AR1 toward the second area AR2.

[0092] At this time, the second visitor C2 starts entering from the first area AR1 to the second area AR2 in order to enter from the first area AR1 to the second area AR2 together with the first visitor C1. That is, in this embodiment, the second visitor C2 becomes a person entering from the first area AR1 to the second area AR2 (a second visitor E2) at the point in time when the second visitor C2 starts moving from the first area AR1 toward the second area AR2.

[0093] Here, the imaging device 3 constantly captures images of the imaging area at a predetermined imaging interval. That is, as shown in Fig. 4, the imaging device 3 captures the second image Im2 of the first and second enterers E1 and E2 from the stage when the first and second enterers E1 and E2 are present in the first area AR1.

[0094] The second acquisition unit 175 acquires the second image Im2 from the imaging device 3 at a predetermined time interval. Note that the predetermined time interval at which the second acquisition unit 175 acquires the second image Im2 is set to a time equal to or longer than the imaging interval at which the imaging device 3 captures the second image Im2.

[0095] The motion detection unit 172 of the first control device 1 identifies the first and second entrants E1 and E2 based on the second image Im2. The motion detection unit 172 detects the movements of the first and second entrants E1 and E2 by tracking the positions of the identified first and second entrants E1 and E2. That is, the motion detection unit 172 detects the movements of the first and second entrants E1 and E2 entering the second area AR2 from the first area AR1.

[0096] Furthermore, the face detection unit 171 of the first control device 1 performs face detection of the first and second intruders E1 and E2 based on the second image Im2. More specifically, the face detection unit 171 performs face detection of the first and second intruders E1 and E2 identified by the motion detection unit 172 based on the second image Im2.

[0097] The frequency with which the face detection section 171 detects the faces of the first and second persons E1 and E2 is lower than the frequency with which the motion detection section 172 detects the movements of the first and second persons E1 and E2. By detecting the movements of the first and second persons E1 and E2 more frequently than the face detection of the first and second persons E1 and E2 by the motion detection section 172, the movements of the first and second persons E1 and E2 can be tracked more reliably.

[0098] The face detection unit 171 extracts facial features of the first and second entrants E1 and E2 based on the second image Im2. The second image Im2 from which the face detection unit 171 extracts facial features of the first and second entrants E1 and E2 is the second image Im2 captured immediately after the first acquisition unit 174 acquires the authentication result information and acquired by the second acquisition unit 175 (step S5). In other words, the second image Im2 acquired by the second acquisition unit 175 immediately after the first acquisition unit 174 acquires the authentication result information is the second image Im2 at the stage when the first and second entrants E1 and E2 are present in the first area AR1.

[0099] The determination processing unit 173 included in the first control device 1 determines whether the first entrant E1 and the second entrant E2 are authenticated persons or not based on the authentication result information received from the lobby intercom 9 and the face detection result by the face detection unit 171 (step S6). Here, the authentication result information includes the data of the facial feature amount of the first visitor C1 as described above. Therefore, the determination processing unit 173 determines that the first entrant E1 is an authenticated person because the degree of coincidence between the facial feature amount of the first entrant E1 and the facial feature amount of the first visitor C1 is equal to or greater than a predetermined threshold. In addition, the determination processing unit 173 determines that the second entrant E2 is not an authenticated person (a non-authenticated person) because the degree of coincidence between the facial feature amount of the second entrant E2 and the facial feature amount of the first visitor C1 is less than the predetermined threshold.

[0100] The first output unit 177 to the third output unit 179 output information according to the determination result of the determination processing unit 173 to the first display device 4, the second display device 5, and the audio output device 6, respectively (step S7).

[0101] Below, the operation of outputting information by the first output unit 177 to the third output unit 179 according to the judgment result of the judgment processing unit 173, and the operation of the first display device 4, the second display device 5, and the audio output device 6 when receiving information output from the first output unit 177 to the third output unit 179 are illustrated as examples.

[0102] When the determination processing unit 173 determines that the second intruder E2 is not an authenticated person, the first output unit 177 outputs first notification information to the first display device 4. The first notification information is information including at least one of a preset content corresponding to not being authenticated by the lobby intercom 9 and a content notifying the second intruder E2 that he / she has not been authenticated by the lobby intercom 9. When the motion detection unit 172 detects that the second intruder E2 has entered a predetermined area (the second area AR2 in this operation example) in the apartment building F10, the first output unit 177 outputs the first notification information to the first display device 4.

[0103] The first alarm information includes data of an alarm image A1. For example, as shown in Fig. 9, the alarm image A1 includes an enlarged image Im21 of the second intruder E2 extracted from the second image Im2 captured by the imaging device 3, and a marker M1, such as an exclamation mark, that is preset in correspondence with the fact that the second intruder E2 has not been authenticated by the lobby intercom 9. The alarm image A1 also includes a character string image W1 including a character string ("not authenticated") that notifies the second intruder E2 that the second intruder E2 has not been authenticated by the lobby intercom 9. Note that the alarm image A1 may be configured to include an image that notifies that the second intruder E2 is a suspicious person when the degree of coincidence between the facial features of the second intruder E2 and the facial features of a suspicious person previously stored in the storage unit 16 is equal to or greater than a predetermined threshold.

[0104] The first display device 4 displays the notification image A1 based on the first notification information. By visually checking the notification image A1 displayed on the first display device 4, the second intruder E2 recognizes that the intercom system 100 has grasped that he / she has not been authenticated by the lobby intercom 9. Therefore, the display of the notification image A1 has an intimidating effect on the second intruder E2, and can urge the second intruder E2 to exit the second area AR2. Also, by visually checking the notification image A1 displayed on the first display device 4, the first intruder E1 can be alert to the surroundings.

[0105] When the determination processing unit 173 determines that the first entrant E1 is an authenticated person, the second output unit 178 outputs second notification information to the second display device 5 at predetermined intervals. The second notification information is information including at least one of preset content corresponding to being authenticated by the lobby intercom 9 and content notifying the first entrant E1 that he / she has been authenticated by the lobby intercom 9. More specifically, when the motion detection unit 172 detects that the first entrant E1 has entered the second area AR2, the second output unit 178 outputs the second notification information to the second display device 5.

[0106] The second notification information includes data of a notification image A2. The notification image A2 includes a marker M2 that is set in advance in response to being authenticated by the lobby intercom 9. The marker M2 is, for example, an image of a blue ring that generally has a positive meaning. Furthermore, the notification image A2 includes a character string image W2 that includes a character string ("Authenticated") that notifies the first entrant E1 that he or she has been authenticated by the lobby intercom 9.

[0107] The second notification information also includes information on the current position of the first entering person E1 in the second area AR2. Here, the information on the current position of the first entering person E1 included in the second notification information is calculated by converting three-dimensional coordinate data centered on the installation position of the imaging device 3, which is calculated from the second image Im2 captured by the imaging device 3, into three-dimensional coordinate data centered on the installation position of the second display device 5.

[0108] The second display device 5 projects the notification image A2 toward the current position of the first intruder E1 in the second area AR2 based on information on the current position of the first intruder E1 included in the second notification information output at a predetermined interval from the second output unit 178. More specifically, the second display device 5 projects the notification image A2 onto the floor surface of the second area AR2 so that a marker M2, which is a ring image, surrounds the first intruder E1, as shown in Fig. 8. By visually recognizing the notification image A2, the first intruder E1 can confirm that the security of the apartment building F10 is being maintained by the intercom system 100.

[0109] When the determination processing unit 173 determines that the second entrant E2 is not an authenticated person, the second output unit 178 outputs third notification information to the second display device 5. The third notification information is information including at least one of a preset content corresponding to not being authenticated by the lobby intercom 9 and a content notifying the second entrant E2 that he / she has not been authenticated by the lobby intercom 9. More specifically, when the motion detection unit 172 detects that the second entrant E2 has entered the second area AR2, the second output unit 178 outputs the third notification information to the second display device 5 at a predetermined interval.

[0110] The third notification information includes data of a notification image A3 that is different from the notification image A2. The notification image A3 includes a marker M3 that is preset in correspondence with not being authenticated by the lobby intercom 9. The marker M3 is, for example, an image of a red ring that generally has a negative meaning. Furthermore, the notification image A3 includes a character string image W3 that includes a character string ("Not Authenticated") that notifies the second entrant E2 that he or she has not been authenticated by the lobby intercom 9.

[0111] The third notification information also includes information on the current location of the second trespasser E2 in the second area AR2.

[0112] The second display device 5 projects the notification image A3 toward the current position of the second entrant E2 in the second area AR2 based on the information on the current position of the second entrant E2 included in the third notification information output from the second output unit 178 at a predetermined interval. More specifically, the second display device 5 projects the notification image A3 onto the floor surface of the second area AR2 so that the marker M3, which is a ring image, surrounds the second entrant E2, as shown in FIG. 8. By visually recognizing the notification image A3, the second entrant E2 recognizes that the intercom system 100 has grasped that he / she has not been authenticated by the lobby intercom 9. Therefore, the display of the notification image A3 has an effect of threatening the second entrant E2, and can urge the second entrant E2 to exit the second area AR2.

[0113] 8, when the first entrant E1 and the second entrant E2 are both present in the second area AR2, the second output unit 178 outputs the second and third alert information to the second display device 5 at the same time. In this case, the second display device 5 projects the alert image A2 and the alert image A3 on the floor surface of the second area AR2 at the same time based on the second and third alert information. This makes it possible to simultaneously notify the first entrant E1 and the second entrant E2 of different contents.

[0114] When the determination processing unit 173 determines that the first intruder E1 is an authenticated person, the third output unit 179 outputs the fourth notification information to the audio output device 6. The fourth notification information is information including at least one of a preset content corresponding to being authenticated by the lobby intercom 9 and a content notifying the first intruder E1 that he / she has been authenticated by the lobby intercom 9. More specifically, when the motion detection unit 172 detects that the first intruder E1 has entered the second area AR2, the third output unit 179 outputs the fourth notification information to the audio output device 6.

[0115] The fourth notification information includes data of a first voice. The first voice includes a voice (e.g., "You have been authenticated") that notifies the first entrant E1 that he / she has been authenticated by the lobby intercom 9. The first voice also includes a voice that is set in advance in correspondence with being authenticated by the lobby intercom 9. The first voice may differ depending on the attributes of the first entrant E1. For example, if the first entrant E1 is a resident of the apartment complex F10, the first voice data includes a voice such as "Welcome back." Also, if the first entrant E1 is a person permitted to enter the second area AR2 by a resident of the apartment complex F10, the first voice data includes a voice such as "Welcome."

[0116] The audio output device 6 outputs (plays) the first audio based on the fourth notification information. By hearing the first audio, the first intruder E1 can confirm that the security of the apartment building F10 is being maintained by the intercom system 100.

[0117] When the determination processing unit 173 determines that the second intruder E2 is not an authenticated person, the third output unit 179 outputs the fifth notification information to the audio output device 6. The fifth notification information is information including at least one of a preset content corresponding to not being authenticated by the lobby intercom 9 and a content notifying the second intruder E2 that he / she has not been authenticated by the lobby intercom 9. More specifically, when the motion detection unit 172 detects that the second intruder E2 has entered the second area AR2, the third output unit 179 outputs the fifth notification information to the audio output device 6.

[0118] The fifth notification information includes data of a second voice. The second voice includes a voice (e.g., "not authenticated") notifying the second trespasser E2 that he / she has not been authenticated by the lobby intercom 9. The second voice also includes a voice (e.g., "please leave") that is preset in response to not being authenticated by the lobby intercom 9.

[0119] The audio output device 6 reproduces the second audio based on the fifth notification information. By hearing the second audio, the second intruder E2 recognizes that the intercom system 100 has grasped that he / she has not been authenticated by the lobby intercom 9. Therefore, the reproduction of the second audio has an intimidating effect on the second intruder E2, and can urge the second intruder E2 to exit the second area AR2.

[0120] (4) Variations The above embodiment is merely one of various embodiments of the present disclosure. The above embodiment can be modified in various ways depending on the design, etc., as long as the object of the present disclosure can be achieved. In addition, a function similar to that of the intercom system 100 according to the above embodiment may be embodied in a control method for the intercom system 100, a computer program, or a non-transitory recording medium on which a computer program is recorded, etc.

[0121] A control method according to one embodiment is a control method for an intercom system 100 including a first control device 1 that is provided in a first area AR1 of a facility F1 and is capable of communicating with a lobby intercom 9 that authenticates a visitor C0 to the facility F1. The control method includes a first acquisition step, a second acquisition step, a determination step, and an output step. In the first acquisition step, an authentication result by the lobby intercom 9 is acquired. In the second acquisition step, a second image Im2 of an intruder E0 who enters a second area AR2 located inside the facility F1 rather than the first area AR1 is acquired. In the determination step, it is determined whether or not the intruder E0 is a visitor C0 authenticated by the lobby intercom 9 based on the authentication result by the lobby intercom 9 and the second image Im2. In the output step, information according to the determination result in the determination step is output.

[0122] A program according to one aspect is a program for causing one or more processors to execute the above-described control method.

[0123] Modifications of the embodiment are listed below. Hereinafter, the above embodiment may be referred to as a "basic example." The basic example and the modifications described below may be combined as appropriate and applied.

[0124] (4.1) Variation 1 In the basic example, the determination processing unit 173 is configured to determine whether or not the trespasser E0 is an authenticated person based on the authentication result information acquired by the first acquisition unit 174 and the face detection result by the face detection unit 171, but is not limited to this configuration. The determination processing unit 173 may determine whether or not the trespasser E0 is an authenticated person based on the authentication result information, the face detection result by the face detection unit 171, and the detection result by the motion detection unit 172.

[0125] The following describes an example of the operation of the intercom system 100 according to the modified example 1. In the following description, the same components as those in the basic example are given the same reference numerals, and the description thereof will be omitted as appropriate.

[0126] The imaging unit 93 of the lobby intercom 9 captures a first image Im1 of the first visitor C1. When the imaging unit 93 captures the first image Im1, the acquisition unit 981 acquires the first image Im1.

[0127] The authentication unit 983 performs authentication processing for the first visitor C1 based on the first image Im1 of the first visitor C1.

[0128] When the authentication unit 983 authenticates the first visitor C1, the output unit 985 outputs authentication result information including authentication information indicating that the first visitor C1 has been authenticated and facial feature data of the first visitor C1 to the first control device 1. The authentication result information output from the output unit 985 is acquired by the first acquisition unit 174 of the first control device 1.

[0129] When the authentication unit 983 authenticates the first visitor C1, the processing unit 984 opens the gate GT1. When the gate GT1 is opened, the first visitor C1 and the second visitor C2 start entering the second area AR2 from the first area AR1. Hereinafter, the first visitor C1 will be referred to as the first visitor E1, and the second visitor C2 will be referred to as the second visitor E2.

[0130] In the present first modification, it is assumed that the second entrant E2 prevents the image of his / her face from being captured by the imaging device 3, for example, by pulling his / her hat down low when entering the second area AR2 from the first area AR1.

[0131] The face detection unit 171 extracts facial features of the first and second entering individuals E1 and E2, based on the second image Im2 acquired by the second acquisition unit 175 immediately after the first acquisition unit 174 acquires the authentication result information.

[0132] Determination processing unit 173 calculates the degree of match between the facial feature amounts of first visitor C1 included in the authentication result information and the facial feature amounts of first visitor E1 extracted by face detection unit 171. Determination processing unit 173 determines that first visitor E1 is an authenticated person.

[0133] Furthermore, the determination processor 173 calculates the degree of match between the facial features of the first visitor C1 included in the authentication result information and the facial features of the second visitor E2 extracted by the face detector 171. Here, because the second visitor E2 prevents his / her face from being captured by the imaging device 3, the face detector 171 is unable to extract the facial features of the second visitor E2 and outputs invalid data as the facial features of the second visitor E2. When the invalid data is output as the facial features of the second visitor E2, the determination processor 173 outputs the invalid data as a calculation result of the degree of match between the facial features of the first visitor C1 and the facial features of the second visitor E2.

[0134] When invalid data is output as a calculation result of the degree of coincidence between the facial features of the first visitor C1 and the facial features of the second visitor E2, the determination processing unit 173 determines whether or not the second visitor E2 is an authenticated person based on the detection result by the motion detection unit 172. That is, the invalid data output as a calculation result of the degree of coincidence between the facial features of the first visitor C1 and the facial features of the second visitor E2 triggers the determination processing unit 173 to determine whether or not the second visitor E2 is an authenticated person based on the detection result by the motion detection unit 172. Therefore, the determination processing unit 173 determines whether or not the second visitor E2 is an authenticated person based on the authentication result information, the face detection result by the face detection unit 171, and the detection result by the motion detection unit 172.

[0135] More specifically, when invalid data is output as a calculation result of the degree of coincidence between the facial features of the first visitor C1 and the facial features of the second visitor E2, the determination processing unit 173 determines whether or not the second visitor E2 is an authenticated person based on behavioral information related to the behavior of the second visitor E2 obtained from the detection result of the motion detection unit 172. The behavioral information related to the behavior of the second visitor E2 is information including the movement route T2 and movement speed of the second visitor E2 calculated by the motion detection unit 172, as described above.

[0136] Specifically, if the second intruder E2 does not stop within a specified range AR3 (see Figures 6 to 8) around the lobby intercom 9 for a specified period of time or longer, the judgment processing unit 173 determines that the second intruder E2 is not an authenticated person, since it is unlikely that the second intruder E2 has been authenticated by the lobby intercom 9.

[0137] Here, whether the second intruder E2 has stopped within the predetermined range AR3 for a predetermined time or more is determined from the movement route T2 (see FIG. 7) and movement speed of the second intruder E2 included in the behavior information of the second intruder E2. The predetermined time is set, for example, to be less than the time required for authentication by the lobby intercom 9.

[0138] In this operation example, the determination processing unit 173 determines from the behavior information of the second entrant E2 that the movement route T2 of the second entrant E2 does not pass through the predetermined range AR3 and has not stopped within the predetermined range AR3 for a predetermined time or more, as shown in Fig. 4. That is, the determination processing unit 173 determines that the second entrant E2 is not an authenticated person. Note that even if the movement route T2 passes through the predetermined range AR3, if the movement speed within the predetermined range AR3 is not 0 for a predetermined time or more, the determination processing unit 173 determines that the second entrant E2 has not stopped within the predetermined range AR3 for a predetermined time or more.

[0139] (4.2) Variation 2 In the basic example, the determination processing unit 173 is configured to determine whether or not the trespasser E0 is an authenticated person based on the authentication result information acquired by the first acquisition unit 174 and the face detection result by the face detection unit 171, but is not limited to this configuration. The determination processing unit 173 may determine whether or not the trespasser E0 is an authenticated person based on a second image Im2 (Im2A) (see FIG. 11) of the trespasser E0 captured by a second imaging unit 932 (described later) provided in the lobby intercom 9 (9A).

[0140] As shown in FIG. 10, the lobby intercom 9A that communicates with the intercom system 100 according to the second modification further includes a second imaging unit 932 in addition to a first imaging unit 931 corresponding to the imaging unit 93 in the above embodiment. The second imaging unit 932 is a camera having an imaging element for imaging a subject. The second imaging unit 932 is, for example, a camera capable of imaging a wider range than the first imaging unit 931. Here, the subject of the second imaging unit 932 is an intruder E0 entering the second area AR2. That is, the second imaging unit 932 captures a second image Im2A of the intruder E0. The imaging area (field of view) of the second imaging unit 932 is set in front of the lobby intercom 9 so that at least the face of the intruder E0 can be imaged when the intruder E0 starts moving toward the second area AR2.

[0141] The following describes an example of the operation of the intercom system 100 according to the modified example 2. In the following description, the same components as those in the basic example are given the same reference numerals, and the description thereof will be omitted as appropriate.

[0142] The first imaging section 931 of the lobby intercom 9A captures a first image Im1 of the first visitor C1. When the first imaging section 931 captures the first image Im1, the acquisition section 981 acquires the first image Im1.

[0143] The authentication unit 983 performs authentication processing for the first visitor C1 based on the first image Im1 of the first visitor C1.

[0144] When the authentication unit 983 authenticates the first visitor C1, the output unit 985 outputs authentication result information to the first control device 1. The authentication result information output from the output unit 985 is acquired by the first acquisition unit 174 of the first control device 1.

[0145] When the authentication unit 983 authenticates the first visitor C1, the processing unit 984 opens the gate GT1. Hereinafter, the first visitor C1 will be referred to as a first visitor E1, and the second visitor C2 will be referred to as a second visitor E2.

[0146] Here, when the processing unit 984 opens the gate GT1, the second imaging unit 932 captures a second image Im2A including the first entering person E1 and the second entering person E2, as shown in Fig. 11. When the second imaging unit 932 captures the second image Im2A, the acquisition unit 981 acquires the second image Im2A.

[0147] The output unit 985 outputs the second image Im2A to the first control device 1. The second image Im2A output from the output unit 985 is acquired by the second acquisition unit 175 of the first control device 1.

[0148] The motion detection section 172 of the first control device 1 distinguishes between the first entering individual E1 and the second entering individual E2 based on the second image Im2A acquired by the second acquisition section 175.

[0149] The face detection section 171 of the first control device 1 detects the sizes of the faces of the first and second entering individuals E1 and E2 based on the second image Im2A.

[0150] The determination processing unit 173 of the first control device 1 determines whether the intruder E0 is an authenticated person based on the size of the face of the intruder E0 detected by the face detection unit 171. In other words, the determination processing unit 173 determines whether the intruder E0 is an authenticated person based on the size of the face of the intruder E0 included in the second image Im2A captured by the second imaging unit 932. As an example, the determination processing unit 173 compares the size of the face of the intruder E0 with a reference size (reference size S1), and determines that the intruder E0 is an authenticated person if the face of the intruder E0 is larger than the reference size S1 in the second image Im2A. Furthermore, the determination processing unit 173 determines that the intruder E0 is not an authenticated person if the face of the intruder E0 is captured at a size equal to or smaller than the reference size S1 in the second image Im2A.

[0151] 11, the face of the first entrant E1 appears larger than the reference size S1 in the second image Im2A. Therefore, the determination processor 173 determines that the first entrant E1 is an authenticated person. Also, the face of the second entrant E2 appears smaller than the reference size S1. Therefore, the determination processor 173 determines that the first entrant E1 is an authenticated person authenticated by the lobby intercom 9, and that the second entrant E2 is not an authenticated person.

[0152] (4.3) Variation 3 As shown in FIG. 12, the intercom system 100 according to the third modification differs from the above embodiment in that the determination unit 170 further includes an authentication unit 180.

[0153] An example of the operation of the intercom system 100 will be described below with reference to the sequence diagram of Fig. 13. In the following description, the same components as those in the basic example are given the same reference numerals, and the description thereof will be omitted as appropriate.

[0154] The imaging unit 93 of the lobby intercom 9 captures a first image Im1 of the first visitor C1. When the imaging unit 93 captures the first image Im1, the acquisition unit 981 acquires the first image Im1 (Step S11).

[0155] The authentication unit 983 performs a first authentication process for the first visitor C1 based on the first image Im1 of the first visitor C1 (S12).

[0156] When the authentication unit 983 authenticates the first visitor C1, the output unit 985 outputs first authentication result information including authentication information indicating that the first visitor C1 has been authenticated and facial feature data of the first visitor C1 to the first control device 1 (S13). The first authentication result information output from the output unit 985 is acquired by the first acquisition unit 174 of the first control device 1 (S14).

[0157] When the authentication unit 983 authenticates the first visitor C1, the processing unit 984 opens the gate GT1. When the gate GT1 is opened, the first visitor C1 and the second visitor C2 start entering the second area AR2 from the first area AR1. Hereinafter, the first visitor C1 will be referred to as the first visitor E1, and the second visitor C2 will be referred to as the second visitor E2.

[0158] The face detection unit 171 extracts facial features of the first entrant E1 and the second entrant E2, respectively, based on the second image Im2 (step S15) acquired by the second acquisition unit 175 immediately after the first acquisition unit 174 acquires the first authentication result information.

[0159] The judgment processing unit 173 performs a provisional judgment process to provisionally judge whether the first intruder E1 and the second intruder E2 are authenticated persons or not based on the first authentication result information received from the lobby intercom 9 and the face detection result by the face detection unit 171 (step S16).

[0160] The determination processor 173 determines that the degree of match between the facial features of the first entrant E1 and the facial features of the first visitor C1 is equal to or greater than a predetermined threshold, and provisionally determines that the first entrant E1 is an authenticated person. The determination processor 173 also determines that the degree of match between the facial features of the second entrant E2 and the facial features of the first visitor C1 is less than a predetermined threshold, and provisionally determines that the second entrant E2 is not an authenticated person.

[0161] When the provisional judgment process is completed, the judgment processing unit 173 generates provisional judgment information including the provisional judgment result.

[0162] Next, the authentication unit 180 of the first control device 1 performs a second authentication process for the first intruder E1 and the second intruder E2 based on the second image Im2 (step S17). Specifically, the authentication unit 180 determines whether or not there is a reference image that matches the face of the first intruder E1 and the face of the second intruder E2 among the multiple reference images stored in the storage unit 16 based on the face detection result by the face detection unit 171. In this operation example, since the first intruder E1 is a resident of a dwelling unit of the apartment building F10, the image of the first intruder E1 is included in the multiple reference images stored in the storage unit 16. Therefore, the authentication unit 180 authenticates the first intruder E1. Moreover, since the image of the second intruder E2 is not included in the multiple reference images stored in the storage unit 16, the authentication unit 180 does not authenticate the second intruder E2.

[0163] Upon completion of the second authentication process, the authentication unit 180 generates second authentication result information including the authentication result of the second authentication process.

[0164] The determination processing unit 173 makes a final determination as to whether the trespasser E0 is an authenticated person based on the provisional determination information and the second authentication result information by the authentication unit 180 of the first control device 1 (step S18). Here, the provisional determination information is generated based on the first authentication result information and the face detection result based on the second image Im2 by the face detection unit 171. Therefore, the determination processing unit 173 makes a final determination as to whether the trespasser E0 is an authenticated person based on the first authentication result information by the lobby intercom 9, the second image Im2, and the second authentication result information by the authentication unit 180. More specifically, when the trespasser E0 is determined to be an authenticated person in the provisional determination process and is authenticated by the authentication unit 180 in the second authentication process, the determination processing unit 173 makes a final determination that the trespasser E0 is an authenticated person. Furthermore, when the intruder E0 is determined not to be an authenticated person in the provisional determination process and is not authenticated by the authentication unit 180 in the second authentication process, the determination processing unit 173 makes a final determination that the intruder E0 is not an authenticated person.

[0165] When the determination processing unit 173 determines that the entrant E0 is an authenticated person in the provisional determination processing but is not authenticated by the authentication unit 180 in the second authentication processing, the determination processing unit 173 determines that the entrant E0 is not a person registered in advance in the storage unit 16 but is a person permitted to enter the second area AR2 by a resident of the apartment building F10. When the determination processing unit 173 determines that the entrant E0 is not an authenticated person in the provisional determination processing but is authenticated by the authentication unit 180 in the second authentication processing, the determination processing unit 173 determines that the entrant E0 is a person who accompanied someone but is a person registered in advance in the storage unit 16.

[0166] The first output unit 177 to the third output unit 179 output information according to the main determination result of the determination processing unit 173 to the first display device 4, the second display device 5, and the audio output device 6, respectively (step S19).

[0167] Note that when the determination processing unit 173 fails to acquire the first authentication result information, the determination processing unit 173 may not perform the provisional determination process, and may instead determine whether or not the trespasser E0 is an authenticated person based on the second authentication result information by the authentication unit 180. Here, the second authentication process is performed by the authentication unit 180 based on the second image Im2. That is, the determination processing unit 173 may determine whether or not the trespasser E0 is an authenticated person based on the second image Im2.

[0168] (4.4) Other Modifications The intercom system 100 in the present disclosure includes a computer system, for example, in the control unit 17 of the first control device 1. The computer system is mainly composed of a processor and a memory as hardware. The function of the control unit 17 in the present disclosure is realized by the processor executing a program recorded in the memory of the computer system. The program may be pre-recorded in the memory of the computer system, provided through an electric communication line, or provided by recording it in a non-transitory recording medium such as a memory card, an optical disk, or a hard disk drive that can be read by the computer system. The processor of the computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large-scale integrated circuit (LSI). The integrated circuits such as IC or LSI referred to here are called by different names depending on the degree of integration, and include integrated circuits called system LSI, VLSI (Very Large Scale Integration), or ULSI (Ultra Large Scale Integration). Furthermore, a field-programmable gate array (FPGA) that is programmed after the manufacture of the LSI, or a logic device that can reconfigure the connection relationship inside the LSI or reconfigure the circuit partition inside the LSI, can also be adopted as a processor. The electronic circuits may be integrated in one chip or distributed among multiple chips. The chips may be integrated in one device or distributed among multiple devices. The computer system referred to here includes a microcontroller having one or more processors and one or more memories. Thus, the microcontroller is also composed of one or more electronic circuits including a semiconductor integrated circuit or a large-scale integrated circuit.

[0169] Furthermore, it is not essential for the first control device 1 that multiple functions are concentrated in one housing, and the components of the first control device 1 may be distributed across multiple housings. Furthermore, at least some of the functions of the first control device 1, such as the control unit 17, may be realized by, for example, cloud (cloud computing) or the like.

[0170] Furthermore, the functions of the first control device 1 and the second control device 2 may be integrated into one housing.

[0171] (5) Summary As described above, the intercom system (100) according to the first aspect is an intercom system provided in the first area (AR1) of the facility (F1) and including a control device (1) capable of communicating with a lobby intercom (9) that performs authentication processing of a visitor (C0) to the facility (F1). The control device (1) includes a first acquisition unit (174), a second acquisition unit (175), a determination unit (170), and an output unit (176). The first acquisition unit (174) acquires an authentication result by the lobby intercom (9). The second acquisition unit (175) acquires an image (Im2) of an entrant (E0) who enters a second area (AR2) that is located inside the facility (F1) rather than the first area (AR1). The determination unit (170) determines whether or not the entrant (E0) is a visitor (C0) authenticated by the lobby intercom (9) based on the authentication result by the lobby intercom (9) and the image (Im2). The output unit (176) outputs information according to the determination result by the determination unit (170).

[0172] According to this embodiment, security can be improved by using the information output by the output unit 176. For example, when a visitor (C0) who is not authenticated by the lobby intercom 9 enters the second area AR2 together with a visitor (C0) who is authenticated by the lobby intercom 9, a warning can be given to the unauthenticated person based on the information output by the output unit 176, for example, to prompt the unauthenticated person to exit the second area AR2, thereby improving security.

[0173] In the intercom system (100) according to the second embodiment, in the first embodiment, the image (Im2) is captured by the imaging device (3) installed in the second area (AR2).

[0174] According to this embodiment, it is possible to more reliably capture an image (Im2) of an entrant (E0) entering the second area (AR2) from the first area (AR1).

[0175] In the intercom system (100) according to the third aspect, the lobby intercom (9) in the first aspect includes an imaging unit (93) that captures an image (Im2).

[0176] According to this embodiment, it is possible to more reliably capture an image (Im2) of the entrant (E0) immediately after the entrant starts entering the second area (AR2) from the first area (AR1).

[0177] In the intercom system (100) according to the fourth aspect, in any of the first to third aspects, when the determination unit (170) determines that the intruder (E0) is a visitor (C0) who has been authenticated by the lobby intercom (9), the output unit (176) outputs information including at least one of preset content corresponding to being authenticated by the lobby intercom (9) and content informing the intruder (E0) that he or she has been authenticated by the lobby intercom (9).

[0178] According to this embodiment, an intruder (E0), who is a visitor (C0) who has been authenticated by the lobby intercom (9), can be assured that the security of the facility (F1) is being maintained by the intercom system (100).

[0179] In the intercom system (100) according to the fifth aspect, in any one of the first to fourth aspects, the visitor (C0) authenticated by the lobby intercom (9) includes a person who has been registered in advance.

[0180] According to this embodiment, the efficiency of authentication processing by the lobby intercom (9) can be improved.

[0181] In the intercom system (100) according to the sixth aspect, in any one of the first to fifth aspects, the facility (F1) is an apartment building (F10). The visitors (C0) authenticated by the lobby intercom (9) include people who are permitted by the residents of the apartment building (F10) to enter the second area (AR2).

[0182] According to this embodiment, the efficiency of authentication processing by the lobby intercom (9) can be improved.

[0183] In the intercom system (100) according to the seventh aspect, in any of the first to sixth aspects, when the judgment unit (170) judges that the intruder (E0) is a visitor (C0) who has not been authenticated by the lobby intercom (9), the output unit (176) outputs information including at least one of a preset content corresponding to not being authenticated by the lobby intercom (9) and a content informing the intruder (E0) that he or she has not been authenticated by the lobby intercom (9).

[0184] According to this embodiment, it is possible to intimidate an intruder (E0), who is a visitor (C0) who has not been authenticated by the lobby intercom (9).

[0185] In the intercom system (100) according to the eighth aspect, in any of the first to seventh aspects, the determination unit (170) has a face detection unit (171) that detects the face of the intruder (E0) based on the image (Im2). The determination unit (170) determines whether the intruder (E0) is a visitor (C0) authenticated by the lobby intercom (9) based on the authentication result by the lobby intercom (9) and the face detection result by the face detection unit (171).

[0186] According to this embodiment, the accuracy of the determination by the determining section (170) can be improved.

[0187] In the intercom system (100) according to the ninth aspect, in any one of the first to eighth aspects, the determination unit (170) has a face detection unit (171) that performs face detection of the intruder (E0) based on the image (Im2), and a motion detection unit (172) that detects the movement of the intruder (E0) based on the image (Im2). The determination unit (170) determines whether the intruder (E0) is a visitor (C0) authenticated by the lobby intercom (9) based on the authentication result by the lobby intercom (9), the face detection result by the face detection unit (171), and the detection result by the motion detection unit (172). The frequency with which the face detection unit (171) detects the face of the intruder (E0) is lower than the frequency with which the motion detection unit (172) detects the movement of the intruder (E0).

[0188] According to this embodiment, it is possible to improve the accuracy of the determination by the determining section 170. Also, it is possible to more reliably track the movements of the first entering person E1 and the second entering person E2.

[0189] In the intercom system (100) according to the tenth aspect, in any of the first to ninth aspects, the output section (176) outputs information according to the determination result by the determination section (170) when an intruder (E0) enters a predetermined area in the facility (F1).

[0190] According to this aspect, it is possible to output information according to the result of the determination made by the determining unit (170) depending on the area in which the trespasser (E0) is present.

[0191] In the intercom system (100) according to the eleventh aspect, in the second aspect, the control device (1) further includes an authentication unit (180) that authenticates the intruder (E0) based on an image (Im2) captured by the imaging device (3). The determination unit (170) determines whether the intruder (E0) is a visitor (C0) authenticated by the lobby intercom (9) based on a first authentication result that is an authentication result by the lobby intercom (9), a second authentication result by the authentication unit (180), and the image (Im2).

[0192] According to this embodiment, the accuracy of the determination by the determining unit (170) can be further improved.

[0193] In the intercom system (100) according to the twelfth aspect, in any of the first to eleventh aspects, the determination unit (170) determines whether the intruder (E0) is a visitor (C0) authenticated by the lobby intercom (9) based on behavior information related to the behavior of the intruder (E0). The behavior information related to the behavior of the intruder (E0) includes a movement route and a movement speed of the intruder (E0) obtained based on the image (Im2).

[0194] According to this embodiment, even if face authentication of the intruder (E0) is not performed, it is possible to determine whether the intruder (E0) is a visitor (C0) authenticated by the lobby intercom (9).

[0195] In the intercom system (100) of the 13th aspect, in the 12th aspect, the judgment unit (170) judges that the intruder (E0) is not a visitor (C0) authenticated by the lobby intercom (9) if the intruder (E0) does not stop within a specified range (AR3) around the lobby intercom (9) for a specified period of time or more.

[0196] According to this embodiment, even if face authentication of the intruder (E0) is not performed, it is possible to determine whether the intruder (E0) is a visitor (C0) authenticated by the lobby intercom (9).

[0197] In the intercom system (100) according to the fourteenth aspect, in the third aspect, the determination unit (170) determines whether or not the intruder (E0) is a visitor (C0) authenticated by the lobby intercom (9) based on the size of the intruder's face included in the image (Im2) captured by the imaging unit (93).

[0198] According to this embodiment, the determination process by the determining unit (170) can be simplified.

[0199] The intercom system (100) according to the fifteenth aspect is an intercom system provided in a first area (AR1) of a facility (F1) and including a control device (1) capable of communicating with a lobby intercom (9) that performs authentication processing of a visitor (C0) to the facility (F1). The control device (1) includes an acquisition unit (175), a determination unit (170), and an output unit (176). The acquisition unit (175) acquires an image (Im2) of an intruder (E0) entering a second area (AR2) that is located inside the facility (F1) rather than the first area (AR1). The determination unit (170) determines, based on the image (Im2), whether or not the intruder (E0) is a visitor (C0) authenticated by the lobby intercom (9). The output unit (176) outputs information according to the determination result by the determination unit (170).

[0200] According to this embodiment, security can be improved by using the information output by the output unit 176. For example, when a visitor (C0) who is not authenticated by the lobby intercom 9 enters the second area AR2 together with a visitor (C0) who is authenticated by the lobby intercom 9, a warning can be given to the unauthenticated person based on the information output by the output unit 176, for example, to prompt the unauthenticated person to exit the second area AR2, thereby improving security.

[0201] A control method according to a sixteenth aspect is a control method for an intercom system (100) including a control device (1) that is provided in a first area (AR1) of a facility (F1) and can communicate with a lobby intercom (9) that performs an authentication process for a visitor (C0) to the facility (F1). The control method includes a first acquisition step, a second acquisition step, a determination step, and an output step. In the first acquisition step, an authentication result by the lobby intercom (9) is acquired. In the second acquisition step, an image (Im2) of an intruder (E0) who enters a second area (AR2) located inside the facility (F1) rather than the first area (AR1) is acquired. In the determination step, it is determined whether or not the intruder (E0) is a visitor (C0) authenticated by the lobby intercom (9) based on the authentication result by the lobby intercom (9) and the image (Im2). In the output step, information according to the determination result in the determination step is output.

[0202] According to this aspect, security can be improved.

[0203] A program according to a seventeenth aspect is a program for causing one or more processors to execute the control method of the sixteenth aspect. [Explanation of symbols]

[0204] 1 Control device 3. Imaging device 9. Lobby Intercom 93 Imaging section 100 Intercom System 170 Judgment section 171 Face detection unit 172 Motion detection unit 174 First acquisition part 175 Second Acquisition Department 176 Output section 180 Authentication Department AR1 1st area AR2 2nd area AR3 Predetermined range C0 Visitor E0 intruder F1 Facilities F10 apartment complex Im2 Screenshots

Claims

1. An intercom system including a control device provided in a first area of ​​a facility and capable of communicating with a lobby intercom that performs authentication processing for visitors to the facility, The control device includes: a first acquisition unit that acquires an authentication result by the lobby intercom; a second acquisition unit that acquires an image of an entrant entering a second area that is located inside the facility beyond the first area; a determination unit that determines whether the trespasser is a visitor authenticated by the lobby intercom based on the authentication result and the image; An output unit that outputs information according to a result of the determination by the determination unit. Intercom system.

2. The image is captured by an imaging device installed in the second area.

2. The intercom system according to claim 1.

3. The lobby intercom includes an imaging unit that captures the image.

2. The intercom system according to claim 1.

4. When the determination unit determines that the intruder is the visitor authenticated by the lobby intercom, the output unit outputs the information including at least one of a preset content corresponding to the authentication by the lobby intercom and a content notifying the intruder that the intruder has been authenticated by the lobby intercom. The intercom system according to any one of claims 1 to 3.

5. The visitors authenticated by the lobby intercom include people who have been registered in advance. The intercom system according to any one of claims 1 to 3.

6. The facility is an apartment building, the visitors authenticated by the lobby intercom include persons authorized by residents of the apartment complex to enter the second area; The intercom system according to any one of claims 1 to 3.

7. When the determination unit determines that the intruder is the visitor who has not been authenticated by the lobby intercom, the output unit outputs the information including at least one of a preset content corresponding to the intruder not being authenticated by the lobby intercom and a content notifying the intruder that the intruder has not been authenticated by the lobby intercom. The intercom system according to any one of claims 1 to 3.

8. the determination unit has a face detection unit that detects a face of the trespasser based on the image, the determination unit determines whether the trespasser is a visitor authenticated by the lobby intercom based on the authentication result and the face detection result by the face detection unit. The intercom system according to any one of claims 1 to 3.

9. the determination unit includes a face detection unit that detects a face of the intruder based on the image, and a movement detection unit that detects a movement of the intruder based on the image, the determination unit determines whether the trespasser is a visitor authenticated by the lobby intercom based on the authentication result, the face detection result by the face detection unit, and the detection result by the motion detection unit; The frequency with which the face detection unit detects the face of the intruder is lower than the frequency with which the motion detection unit detects the motion of the intruder. The intercom system according to any one of claims 1 to 3.

10. The output unit outputs the information when the trespasser enters a predetermined area in the facility. The intercom system according to any one of claims 1 to 3.

11. The control device further includes an authentication unit that authenticates the trespasser based on the image captured by the imaging device, the determination unit determines whether the trespasser is the visitor authenticated by the lobby intercom based on a first authentication result which is the authentication result by the lobby intercom, a second authentication result by the authentication unit, and the image.

3. The intercom system according to claim 2.

12. The determination unit determines whether the intruder is a visitor authenticated by the lobby intercom based on behavior information related to the intruder's behavior, The behavior information includes a movement path and a movement speed of the trespasser obtained based on the image. The intercom system according to any one of claims 1 to 3.

13. the determination unit determines that the trespasser is not the visitor authenticated by the lobby intercom when the trespasser does not stop within a predetermined range around the lobby intercom for a predetermined period of time or more.

13. The intercom system according to claim 12.

14. The determination unit determines whether the intruder is a visitor authenticated by the lobby intercom based on a size of the intruder's face included in the image captured by the imaging unit.

4. The intercom system according to claim 3.

15. An intercom system including a control device provided in a first area of ​​a facility and capable of communicating with a lobby intercom that performs authentication processing for visitors to the facility, The control device includes: an acquisition unit that acquires an image of an individual who enters a second area located inside the facility from the first area; a determination unit that determines whether the trespasser is a visitor authenticated by the lobby intercom based on the image; An output unit that outputs information according to a result of the determination by the determination unit. Intercom system.

16. A method for controlling an intercom system including a control device that is provided in a first area of ​​a facility and is capable of communicating with a lobby intercom that performs authentication processing for visitors to the facility, comprising: a first acquisition step of acquiring an authentication result by the lobby intercom; a second acquisition step of acquiring an image of an entrant entering a second area located inside the facility from the first area; a determining step of determining whether the trespasser is a visitor authenticated by the lobby intercom based on the authentication result and the image; An output step of outputting information according to the determination result in the determination step. Control methods.

17. A program for causing one or more processors to execute the control method according to claim 16.

Images