Intercom system, control method, and program

Abstract

To improve convenience of an intercom system.SOLUTION: An intercom system 10 comprises a slave unit 1 and a master unit 2. The slave unit 1 is installed at a main entrance of a facility and includes an imaging section 12 for acquiring an image on a visitor of the facility. The master unit 2 is installed inside the facility and can perform two-way conversation with the slave unit 1. The intercom system 10 has a business confirmation mode. The business confirmation mode is a mode for notification of business inquiry for the visitor from the slave unit 1 in response to a call for the master unit 2 from the slave unit 1 based on operation to the slave unit 1 by the visitor of the facility. The intercom system 10 further comprises a control section 19. The control section 19 controls validation and invalidation of the business confirmation mode on the basis of a result of authentication processing on the visitor based on the image acquired by the imaging section 12.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure generally relates to an intercom system, a control method, and a program. More specifically, the present disclosure relates to an intercom system that notifies a visitor of an inquiry about a matter in response to a call from the visitor, a control method for the intercom system, and a program.

Background Art

[0002] Patent Document 1 describes an intercom system. This intercom system is composed of a slave unit (first terminal) installed at the common entrance of an apartment building and a master unit (second terminal) installed in each household of the apartment building for making calls with the slave unit.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In an intercom system such as that of Patent Document 1, when a visitor comes to the facility, the visitor calls the destination household from the slave unit at the common entrance of the facility to convey the matter. Then, the resident of the called household confirms the matter from the visitor and determines whether to respond to the visitor.

[0005] However, even when the visitor is, for example, a person related to the facility (such as a resident) or a person whose visit is scheduled (such as a delivery person), the visitor still needs to call the destination household from the slave unit at the common entrance of the facility to convey the matter as described above, which has the problem of poor convenience

[0006] This disclosure is made in view of the above-mentioned reasons and aims to provide an intercom system, control method, and program that can improve convenience. [Means for solving the problem]

[0007] An intercom system according to one aspect of the present disclosure comprises a first terminal and a second terminal. The first terminal is installed at the entrance of a facility and has an acquisition unit that acquires at least one of images and sounds relating to visitors of the facility. The second terminal is installed inside the facility and is capable of two-way communication with the first terminal. The intercom system is in message confirmation mode. And, delivery mode, The above-mentioned request confirmation mode is a mode in which, in response to a call from the first terminal to the second terminal based on an operation performed on the first terminal by a visitor to the facility, the first terminal notifies the visitor of the request. The aforementioned delivery mode is a mode in which the delivery person of the visiting delivery company enters a message for the resident to be called to the first terminal. The intercom system further comprises a control unit. The control unit controls the enabling and disabling of the request confirmation mode based on the result of the authentication process for the visitor, which is based on at least one of the image and sound acquired by the acquisition unit. If the control unit is authenticated in the authentication process to be a delivery person of the delivery company, it controls the request confirmation mode to be disabled and the delivery mode to be enabled. An intercom system according to one aspect of the present disclosure comprises a first terminal and a second terminal. The first terminal is installed at the entrance of a facility and has an acquisition unit that acquires at least one of images and sounds relating to visitors of the facility. The second terminal is installed inside the facility and is capable of two-way communication with the first terminal. The intercom system has a message confirmation mode. The message confirmation mode is a mode in which, in response to a call from the first terminal to the second terminal based on an operation of the first terminal by a visitor of the facility to the first terminal, the first terminal notifies the visitor of a message inquiry. The intercom system further comprises a control unit. The control unit controls the enabling and disabling of the message confirmation mode based on the result of an authentication process for the visitor based on at least one of the images and sounds acquired by the acquisition unit. In the authentication process, if the control unit is authenticated that the visitor is a person who will be refused by the resident to whom the call was made, the control unit enables the request confirmation mode and operates the first terminal so as not to make a call from the first terminal to the second terminal based on the visitor's operation on the first terminal.

[0008] A control method according to one aspect of this disclosure is a control method for controlling an intercom system. The intercom system comprises a first terminal and a second terminal. The first terminal is installed at the entrance of a facility and has an acquisition unit that acquires at least one of images and sounds related to visitors of the facility. The second terminal is installed inside the facility and is capable of two-way communication with the first terminal. The intercom system is in message confirmation mode. And, delivery mode, The above-mentioned request confirmation mode is a mode in which, in response to a call from the first terminal to the second terminal based on an operation performed on the first terminal by a visitor to the facility, the first terminal notifies the visitor of the request. The aforementioned delivery mode is a mode in which the delivery person of the visiting delivery company enters a message for the resident to be called to the first terminal.The control method includes a control process. In the control process, the enabled and disabled status of the requirement confirmation mode is controlled based on the result of an authentication process for the visitor based on at least one of the image and sound acquired by the acquisition unit. In the control process, if the visitor is authenticated as a delivery person of the delivery company in the authentication process, the request confirmation mode is disabled and the delivery mode is enabled. A control method according to one aspect of the present disclosure is a control method for controlling an intercom system. The intercom system comprises a first terminal and a second terminal. The first terminal is installed at the entrance of a facility and has an acquisition unit that acquires at least one of images and sounds related to visitors of the facility. The second terminal is installed inside the facility and is capable of two-way communication with the first terminal. The intercom system has a message confirmation mode. The message confirmation mode is a mode in which, in response to a call from the first terminal to the second terminal based on an operation of the first terminal by a visitor of the facility to the first terminal, the first terminal notifies the visitor of a message inquiry. The control method includes a control process. In the control process, the enablement and disablement of the message confirmation mode is controlled based on the result of an authentication process for the visitor based on at least one of the images and sounds acquired by the acquisition unit. In the control process, if the visitor is authenticated in the authentication process as a person who will be refused by the resident to whom the call was made, the request confirmation mode is enabled and the first terminal is operated so as not to make a call from the first terminal to the second terminal based on the visitor's operation on the first terminal.

[0009] A program relating to one aspect of this disclosure causes a computer system to execute the control method described above. [Effects of the Invention]

[0010] According to this disclosure, there is an advantage in that it can improve the convenience of the intercom system. [Brief explanation of the drawing]

[0011] [Figure 1] Figure 1 is a block diagram showing the configuration of an intercom system according to an embodiment. [Figure 2] Figure 2 is a block diagram showing the configuration of the sub-unit control unit in the same intercom system. [Figure 3] Figure 3 is a sequence diagram illustrating the operation of the same intercom system when the visitor is not a designated person. [Figure 4] Figure 4 is a sequence diagram illustrating the operation of the same intercom system when the visitor is someone associated with the apartment building. [Figure 5] Figure 5 is a sequence diagram illustrating the operation of the same intercom system when the visitor is a person authorized to unlock the main entrance. [Figure 6] Figure 6 is a sequence diagram illustrating the operation of the same intercom system when the visitor is a delivery person. [Figure 7] Figure 7 is a sequence diagram illustrating the operation of the same intercom system when a visitor is a person who should be rejected. [Modes for carrying out the invention]

[0012] (1) Summary The intercom system 10 according to this embodiment is an intercom system for apartment houses, which is applied to apartment houses such as condominiums, for example. However, the intercom system 10 may be applied to single-family houses in addition to apartment houses. Alternatively, the intercom system 10 may be applied to non-residential facilities such as offices, stores, schools, or nursing facilities.

[0013] As shown in FIG. 1, the intercom system 10 includes a sub-unit 1 (first terminal) and a master unit 2 (second terminal). The sub-unit 1 is provided at the entrance (e.g., a shared entrance) of a facility (e.g., an apartment house), and has an acquisition unit (e.g., imaging unit 12) that acquires at least one of sound (e.g., voice) and images (e.g., face images) related to visitors to the facility. The master unit 2 is provided inside the facility and can perform two-way communication with the sub-unit 1.

[0014] The intercom system 10 has a matter confirmation mode. The matter confirmation mode is a mode in which, in response to a call from the sub-unit 1 to the master unit 2 based on an operation on the sub-unit 1 by a visitor to the facility, an inquiry about the matter is notified to the visitor from the sub-unit 1.

[0015] Further, the intercom system 10 includes a sub-unit side control unit 19. In this embodiment, the sub-unit side control unit 19 is provided in the sub-unit 1. The sub-unit side control unit 19 controls the validity and invalidity of the matter confirmation mode based on the result of the authentication process for the visitor based on at least one of the image and sound acquired by the acquisition unit.

[0016] According to this configuration, it is possible to automatically control whether to notify a visitor of an inquiry about the matter based on the result of the authentication process for the visitor. When notifying a visitor of an inquiry about the matter, the visitor does not need to convey the matter to the called party. Therefore, by pre-registering and authenticating visitors who do not need to convey the matter to the called party, it is possible to automatically omit conveying the matter to the called party for visitors who do not need to convey the matter to the called party. As a result, the convenience of the intercom system 10 can be improved.

[0017] (2) Details Next, the intercom system 10 according to this embodiment will be described in more detail.

[0018] (2.1) Overall Configuration As shown in FIG. 1, the intercom system 10 according to this embodiment includes a slave unit 1, a plurality of master units 2, a control device 3, and an authentication server 4.

[0019] The slave unit 1 is, for example, an information terminal installed at the common entrance of an apartment house (facility). The slave unit 1 is configured to perform two-way communication (including two-way calling) with each master unit 2 via the control device 3. The slave unit 1 is also configured to communicate with the authentication server 4.

[0020] The slave unit 1 acquires at least one of an image and sound related to a visitor to the apartment house. The image related to the visitor is, for example, a face image of the visitor or an image of the iris of the visitor's eye. The sound related to the visitor is, for example, the voice of the visitor or a specific sequence of sounds output from a mobile terminal carried by the visitor. In this embodiment, it is assumed that the slave unit 1 acquires a face image of the visitor as at least one of the image and sound related to the visitor.

[0021] The image (face image of the visitor) acquired by the slave unit 1 is used in the authentication process for the visitor in the authentication server 4. By this authentication process, it is determined (authenticated) whether the visitor is a person related to the apartment house, whether the visitor has the unlocking authority for the electric lock device 20a of the common entrance, whether the visitor is a delivery person of a delivery company, and whether the visitor is a person to be rejected. A person to be rejected is a person against whom the resident refuses to respond.

[0022] The slave unit 1 changes its response to visitors according to the result of the authentication process at the authentication server 4. More specifically, the slave unit 1 has a request confirmation mode that can be switched on and off. The request confirmation mode is a mode in which the slave unit 1 notifies the master unit 2 of the request from the slave unit 1 in response to a call from the slave unit 1 to the master unit 2 based on an operation by the visitor to the slave unit 1. The slave unit 1 controls whether the request confirmation mode is enabled or disabled based on the result of the authentication process for the visitor.

[0023] For example, if the authentication process for a visitor determines that the visitor is, for instance, a person associated with the apartment building, a person authorized to unlock the electric lock device 20a of the common entrance, or a delivery person from a delivery company, the sub-unit 1 disables the purpose confirmation mode and omits asking the visitor about their purpose. As a result, such visitors do not need to communicate their purpose to the person they are calling. This improves the convenience of the intercom system 10.

[0024] Furthermore, the "person related to the apartment building" mentioned above refers to, for example, a resident of the apartment building. Also, the "person authorized to unlock the electric lock device 20a of the common entrance" mentioned above refers to, for example, a delivery person from a delivery company who has been issued a one-time password (a password that can only be used once) to unlock the electric lock device 20a of the common entrance. The "delivery person from the delivery company" mentioned above refers to, for example, a delivery person from a delivery company who has not been issued a one-time password to unlock the electric lock device 20a.

[0025] Each of the multiple master units 2 is, for example, a dwelling terminal installed in each dwelling unit of an apartment building. Each master unit 2 is configured to perform two-way communication (including two-way voice calls) with the slave unit 1. The resident of each dwelling unit can check the request entered by the visitor who has come to visit them on the slave unit 1 using the master unit 2 in that resident's dwelling unit, and decide whether or not to respond to the visitor (for example, by voice call) depending on the content of the request.

[0026] The control device 3 is configured to relay communication between the slave unit 1 and each master unit 2. The control device 3 is installed, for example, in a control room. For example, when a visitor uses the slave unit 1 to call the master unit 2, the control device 3 relays the signals transmitted and received between the slave unit 1 and the master unit 2.

[0027] As described above, the authentication server 4 performs authentication processing on visitors based on the image of the visitor acquired by the slave unit 1. Through this authentication process, the authentication server 4 determines (authenticates) whether the visitor is a person associated with the apartment building, whether they have the authority to unlock the electric lock device 20a of the common entrance, whether they are a delivery person from a delivery company, and whether they are a person subject to denial.

[0028] The authentication server 4 has registered at least one of the authentication reference images and authentication reference sounds. The authentication reference images include authentication reference images related to people associated with the apartment building, authentication reference images related to people authorized to unlock the electric lock device 20a of the common entrance, authentication reference images related to delivery personnel of a delivery company, and authentication reference images related to persons to be denied. The authentication reference sounds include authentication reference sounds related to people associated with the apartment building, authentication reference sounds related to people authorized to unlock the electric lock device 20a of the common entrance, authentication reference sounds related to delivery personnel of a delivery company, and authentication reference sounds related to persons to be denied. In this embodiment, the authentication reference images are registered as at least one of the authentication reference images and authentication reference sounds.

[0029] For example, a person with registration authority (e.g., a resident) registers the facial image of person A, a resident of the apartment building, as a reference image for authentication related to people associated with the apartment building on the authentication server 4. As a result, when person A arrives at the installation location of the sub-unit 1, they are authenticated as a person associated with the apartment building. Alternatively, if person B, a delivery person for a courier service, has the authority to unlock the electric lock device 20a, a person with registration authority registers person B's facial image as a reference image for authentication related to people with the authority to unlock the electric lock device 20a at the common entrance on the authentication server 4. As a result, when person B arrives at the installation location of the sub-unit 1, they are authenticated as a person with the authority to unlock the electric lock device 20a at the common entrance. Or, if person B does not have the authority to unlock the electric lock device 20a, a person with registration authority registers person B's facial image as a reference image for authentication related to delivery personnel for a courier service on the authentication server 4. As a result, when person B arrives at the installation location of the sub-unit 1, they are authenticated as a delivery person for a courier service.

[0030] Slave unit 1 is connected to control device 3 via communication line 61. Slave unit 1 is also connected to authentication server 4 via communication line 65. Each of the multiple master units 2 is connected to control device 3 via communication line 62. Communication line 62 has a main line 63 and multiple branch lines 64. One end of the main line 63 is connected to control device 3. The multiple branch lines 64 branch off from the main line 63. Multiple master units 2 are connected to the multiple branch lines 64.

[0031] Communication lines 61 and 62 are, for example, communication lines that constitute a LAN (Local Area Network). Communication line 65 is, for example, a communication line that constitutes a WAN (Wide Area Network). Note that communication line 65 may be composed of the same LAN communication lines as communication lines 61 and 62. Also, communication lines 61 and 62 may be composed of the same WAN communication lines as communication line 65.

[0032] (2.2) Configuration of the handset Next, the configuration of the sub-unit 1 will be described. As shown in Figure 1, the sub-unit 1 includes a sensor 11, an imaging unit 12 (acquisition unit), a storage unit 13, a sub-unit side operation unit 14, a call unit 15, a notification unit 16, a sub-unit side transmission unit 17, a sub-unit side communication unit 18, and a sub-unit side control unit 19.

[0033] Sensor 11 is, for example, a pyroelectric infrared sensor, and detects a visitor by detecting the amount of change in infrared radiation emitted from the visitor who has come to the common entrance of the apartment building.

[0034] The imaging unit 12 is a camera for capturing images of visitors standing in front of the sub-unit 1. The imaging unit 12 has a two-dimensional image sensor, such as a CCD (Charge Coupled Devices) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor. In this embodiment, the imaging area of ​​the imaging unit 12 is set in front of the sub-unit 1 so that at least the visitor's face can be captured when the visitor operates the sub-unit 1. In this embodiment, the imaging unit 12 is a camera that captures video. Furthermore, in this embodiment, the imaging unit 12 is a camera that captures color images. The imaging unit 12 outputs the captured video as a video signal to the sub-unit side control unit 19. The imaging unit 12 is an example of an acquisition unit that acquires at least one of images and sounds related to the visitor.

[0035] The memory unit 13 is composed of read-write non-volatile memory. For example, the memory unit 13 is flash memory. For example, the memory unit 13 stores (records) the video captured by the imaging unit 12. In addition to the video captured by the imaging unit 12, the memory unit 13 also stores various other data, which will be described later.

[0036] The sub-unit control panel 14 is configured to accept operations from visitors. The sub-unit control panel 14 accepts from visitors the input of the room number to be called (also called the input of the call operation), and the input of the PIN code for the electric lock device 20a of the shared entrance door 20. The sub-unit control panel 14 is an input interface having, for example, multiple push buttons and a touch panel. The multiple push buttons include, for example, a numeric keypad with numbers 0 to 9, an asterisk (*) button, an erase button, and a call button. For example, if a visitor wants to call the resident of room number (dwelling unit number) "Room 1024" using the sub-unit 1, they input the room number by operating the numeric keypad buttons. Finally, when the operator presses the call button, the input of the room number is confirmed, and a call is made to the master unit 2 of the dwelling unit with room number "1024".

[0037] The communication unit 15 is a device for enabling communication with the base unit 2. The communication unit 15 includes, for example, a microphone and a speaker. The microphone is configured to collect the voice of a visitor standing in front of the sub-unit 1. The microphone outputs the collected voice as an audio signal to the sub-unit control unit 19. The speaker is configured to output the voice of a resident collected by the communication unit 25 of the base unit 2 (described later). The speaker converts the audio signal output from the sub-unit control unit 19 into audio and outputs it.

[0038] The notification unit 16 is a device that provides various notifications to visitors. The notification unit 16 is, for example, a speaker and outputs various notification messages (messages) as audio. For example, when the sub-unit 1 asks a visitor about their purpose, under the control of the mode control unit 192, the notification unit 16 outputs a message such as "What can I do for you?" or "Please speak your purpose into the microphone on the sub-unit." This allows the notification unit 16 to obtain information about the visitor's purpose (purpose information).

[0039] The slave unit transmission unit 17 is a communication interface for communicating with the master unit 2. The slave unit transmission unit 17 is connected to the control device 3 via a communication line 61. The slave unit transmission unit 17 is configured to perform bidirectional communication with the master unit 2 via the control device 3. The slave unit transmission unit 17 is configured to transmit communication signals to the master unit 2. The communication signals include voice signals output from the call unit 15 and video signals output from the imaging unit 12, etc. The slave unit transmission unit 17 also receives communication signals transmitted from the master unit 2 via the control device 3 (for example, voice signals output from the call unit 25 of the master unit 2), and acquires voice signals etc. output from the call unit 25 of the master unit 2 by demodulating the received communication signals. The acquired voice signals are output to the call unit 15 of the slave unit 1 via the slave unit control unit 19.

[0040] The slave-side communication unit 18 is a communication interface for communicating with the authentication server 4. The slave-side communication unit 18 is connected to the control device 3 via a communication line 65. The slave-side communication unit 18 is configured to perform bidirectional communication with the authentication server 4. The slave-side communication unit 18 is configured to transmit communication signals to the authentication server 4. The communication signals include video signals, which are output signals from the imaging unit 12. The slave-side communication unit 18 also receives communication signals transmitted from the authentication server 4 (for example, authentication result signals indicating the result of the authentication process) and obtains the authentication result (i.e., the result of the authentication process of the authentication server 4) by demodulating the received communication signals.

[0041] The slave unit control 19 is composed of, for example, a microcomputer mainly consisting of a CPU (Central Processing Unit) and memory. The microcomputer functions as the slave unit control 19 by executing a program stored in memory, which is performed by the CPU. The program executed by the CPU is pre-recorded in the microcomputer's memory, but it may also be provided on a recording medium such as a memory card, or provided via a telecommunications line such as the Internet.

[0042] The sub-unit control unit 19 is configured to control the other components of the sub-unit 1 (sensor 11, imaging unit 12, storage unit 13, sub-unit operation unit 14, call unit 15, notification unit 16, sub-unit transmission unit 17, and sub-unit communication unit 18).

[0043] As shown in Figure 2, the slave unit control unit 19 includes an acquisition control unit 191, a mode control unit 192, a notification control unit 193, and a door control unit 194.

[0044] The acquisition control unit 191 is configured to control the imaging unit 12 to cause it to capture images and to acquire the images captured by the imaging unit 12 from the imaging unit 12. For example, when the acquisition control unit 191 detects a person such as a visitor with the sensor 11, it activates the imaging unit 12 and starts capturing images of that person. The acquisition control unit 191 acquires the output signal (video signal) of the imaging unit 12 and transmits the acquired video signal as authentication video to the authentication server 4 via the slave-side communication unit 18. The authentication server 4 receives still images from the authentication video sent from the acquisition control unit 191. certification It is used as a reference image for [purpose].

[0045] As will be described later, when the authentication server 4 receives the video signal from the acquisition control unit 191, it demodulates the received video signal and acquires the video. The authentication server 4 then determines (authenticates) whether the visitor shown in the acquired video is a person associated with the apartment building (e.g., a resident), whether the person has the authority to unlock the electric lock device 20a of the common entrance, whether the person is a delivery person from a delivery company, and whether the person is subject to refusal. The authentication server 4 then transmits the result of this determination (i.e., the authentication result) to the slave unit 1.

[0046] Furthermore, the acquisition control unit 191 transmits the output signal (video signal) from the imaging unit 12 to the master unit 2 via the slave unit transmission unit 17. The master unit 2 demodulates the video signal from the acquisition control unit 191 and displays it on the display unit 24 of the master unit 2. This allows the visitor to be identified by the video (video showing the visitor) displayed on the display unit 24 of the master unit 2.

[0047] The mode control unit 192 switches the processing (operating mode) for dealing with the visitor based on the authentication result from the authentication server 4, and deals with the visitor in the switched processing mode. More specifically, the mode control unit 192 determines, based on the authentication result from the authentication server 4, whether the visitor is a person associated with the apartment building, whether the visitor has the authority to unlock the electric lock device 20a of the common entrance, whether the visitor is a delivery person from a delivery company, and whether the visitor is a person subject to refusal, and switches the processing for dealing with the visitor according to the determination result.

[0048] The mode control unit 192 has multiple operating modes (for example, a request confirmation mode, an unlocking information input mode, and a delivery mode). The request confirmation mode is a mode in which, in response to a call from the sub-unit 1 to the main unit 2 at the destination of the call based on a call operation by a visitor to the sub-unit 1, the sub-unit 1 notifies the visitor of the request. The unlocking information input mode is a mode in which the sub-unit 1 accepts input of information (for example, a PIN code) for unlocking the electric lock device 20a of the common entrance door 20 of the apartment building. The delivery mode is a mode in which the sub-unit 1 accepts input of at least one (in this embodiment, both) of the following: providing information to the delivery person of a visiting delivery company (for example, a message from the resident at the destination to the delivery person), and receiving input of information from the delivery person to the sub-unit 1 (for example, a message from the delivery person to the resident at the destination). The mode control unit 192 controls the enabling and disabling of the above multiple operating modes based on the authentication result of the authentication server 4. Details of the processing of the mode control unit 192 will be described later in the operation description of the intercom system 10.

[0049] The notification control unit 193 is configured to control the notification unit 16 to broadcast various notification messages (messages) to visitors from the notification unit 16. For example, if the notification control unit 193 wants to inquire about the visitor's purpose, it will output a voice message from the notification unit 16 such as "What can I do for you?" or "Please tell me what you want into the microphone on the sub-unit 1."

[0050] The door control unit 194 is configured to control the locking and unlocking of the electric lock device 20a of the shared entrance door 20. More specifically, when a PIN for the electric lock device 20a is entered into the slave unit operation unit 14, the door control unit 194 unlocks the electric lock device 20a for a certain period of time if the entered PIN matches a PIN that has been pre-registered in the door control unit 194. On the other hand, the door control unit 194 does not unlock the electric lock device 20a if the entered PIN does not match a PIN that has been pre-registered. Furthermore, the door control unit 194 unlocks the electric lock device 20a for a certain period of time when it receives an unlock command from the master unit 2 or the mode control unit 192.

[0051] (2.3) Configuration of the main unit Next, the configuration of the master unit 2 will be described. As shown in Figure 1, the master unit 2 has a master unit side transmission unit 21, a master unit side operation unit 22, a notification unit 23, a display unit 24, a call unit 25, a storage unit 26, and a master unit side control unit 27.

[0052] The master unit transmission unit 21 is a communication interface for communicating with the slave unit 1. The master unit transmission unit 21 is connected to the control device 3 via a communication line 62. The master unit transmission unit 21 is configured to perform bidirectional communication (including bidirectional voice calls) with the slave unit 1 via the control device 3. The master unit transmission unit 21 is configured to transmit communication signals to the slave unit 1. The communication signals include voice signals output from the voice unit 25 of the master unit 2, and various control signals output from the master unit operation unit 22. The master unit transmission unit 21 also receives communication signals transmitted from the slave unit 1 via the control device 3 (for example, voice signals output from the voice unit 15 of the slave unit 1, or video signals output from the imaging unit 12). The master unit transmission unit 21 then demodulates the received communication signals to acquire the voice acquired by the voice unit 15 of the slave unit 1, or the video captured by the imaging unit 12. The acquired voice is output to the voice unit 25 via the master unit control unit 27. Furthermore, the acquired video is output to the display unit 24 via the master unit control unit 27.

[0053] The master unit's control panel 22 is configured to accept input from a person (e.g., a resident). When the master unit's transmission unit 21 receives a call signal from the slave unit 1 to call the resident, and a predetermined operation (e.g., a push operation) is performed on the master unit's control panel 22, voice communication becomes possible between the slave unit 1 and the master unit 2.

[0054] The notification unit 23 is configured to output, for example, a ringtone. The notification unit 23 is, for example, a speaker. When a call is received from the slave unit 1, the notification unit 23 outputs a ringtone at a predetermined timing under the control of the master unit control unit 27. In other words, when a call is received from the slave unit 1, the notification unit 23 performs a notification operation to notify that a call has been received from the slave unit 1. Furthermore, the notification unit 23 is configured to output not only the ringtone but also the visitor's request acquired by the slave unit 1 as audio.

[0055] The display unit 24 is configured to display video from the master unit transmission unit 21 (i.e., video captured by the imaging unit 12 of the slave unit 1). The display unit 24 is, for example, a liquid crystal display. If the master unit 2 is equipped with a touch panel display, the touch panel display may serve as both the display unit 24 and the master unit operation unit 22.

[0056] The communication unit 25 is a device for enabling communication with the sub-unit 1. The communication unit 25 includes, for example, a microphone and a speaker. The microphone collects the voice of the resident standing in front of the base unit 2 and outputs the collected voice as an audio signal to the base unit-side control unit 27. The speaker converts the audio signal from the base unit-side control unit 27 (for example, the audio signal related to the visitor's voice collected by the communication unit 15 of the sub-unit 1) into audio and outputs it.

[0057] The memory unit 26 is composed of read-write non-volatile memory. The memory unit 26 is, for example, flash memory. The memory unit 26 stores various types of information (for example, video sent from the slave unit 1 and the visitor's request (for example, audio signal)).

[0058] The master unit control unit 27 is composed of, for example, a microcomputer mainly consisting of a CPU and memory. The microcomputer functions as the master unit control unit 27 by executing a program stored in memory, which is the CPU's way of doing so. In this case, the program executed by the CPU is pre-recorded in the microcomputer's memory, but it may also be provided on a recording medium such as a memory card, or provided via a telecommunications line such as the Internet.

[0059] The master unit control unit 27 is configured to control the other components of the master unit 2 (master unit transmission unit 21, display unit 24, master unit operation unit 22, storage unit 26, notification unit 23, and call unit 25).

[0060] The master unit control unit 27 controls the master unit transmission unit 21 to cause the master unit transmission unit 21 to transmit a communication signal to the slave unit 1 and to receive a communication signal from the slave unit 1. The communication signal from the master unit 2 to the slave unit 1 includes an audio signal output from the master unit 2's call unit 25 and various control signals output from the master unit operation unit 22. The communication signal from the slave unit 1 to the master unit 2 includes an audio signal output from the slave unit 15 and video signals output from the imaging unit 12. The master unit control unit 27 also controls the display unit 24 to display the video sent from the slave unit 1 on the display unit 24.

[0061] (2.4) Authentication Server Configuration Next, the configuration of the authentication server 4 will be described. As shown in Figure 1, the authentication server 4 has a communication unit 41, an authentication unit 42, and a storage unit 43.

[0062] The communication unit 41 is a communication interface for communicating with the slave unit 1. The communication unit 41 is connected to the slave-side communication unit 18 of the slave unit 1 via a communication line 65. The communication unit 41 is configured to perform bidirectional communication with the slave-side communication unit 18. The communication unit 41 receives a communication signal transmitted from the slave unit 1 (for example, a video signal from the imaging unit 12) and acquires the video captured by the imaging unit 12 by demodulating the received communication signal. The communication unit 41 is also configured to transmit a communication signal (for example, an authentication result signal) to the slave unit 1. The authentication result signal is a signal indicating the result of the authentication process of the authentication unit 42.

[0063] The storage unit 43 is composed of read-write non-volatile memory. The storage unit 43 is, for example, flash memory. The storage unit 43 stores (records) images acquired by the communication unit 41 (images captured by the imaging unit 12). The storage unit 43 has reference images for authentication that are used in the authentication process of the authentication unit 42 stored (registered) in advance. The above-mentioned reference images for authentication include reference images for authentication related to people associated with the apartment building, reference images for authentication related to people who have the authority to unlock the electric lock device 20a of the common entrance door 20, reference images for authentication related to delivery personnel of a delivery company, and reference images for authentication related to persons to be denied.

[0064] The authentication unit 42 is configured to perform authentication processing for visitors. The authentication unit 42 extracts still images from the video acquired by the communication unit 41 from the slave unit 1 (i.e., the video captured by the imaging unit 12 of the slave unit 1), and the extracted still images and the information registered in the storage unit 43 certification The system compares the image with a reference image. This allows the authentication unit 42 to determine (authenticate) whether the person in the image (i.e., the visitor) is a person associated with the apartment building, whether they have the authority to unlock the electric lock device 20a of the common entrance door 20, whether they are a delivery person from a delivery company, and whether they are a person subject to refusal. The authentication unit 42 transmits an authentication result signal indicating the authentication result to the slave unit 1's slave unit communication unit 18 via the communication unit 41.

[0065] (2.5) Operation of the intercom system Next, with reference to Figure 3, the operation of the intercom system 10 will be explained. First, the operation when the visitor is not a person who falls under any of the above categories will be explained. A "person who falls under any of the above categories" is a person who is not associated with the apartment building, a person who has the authority to unlock the electric lock device 20a of the common entrance door 20, a delivery person from a delivery company, or a person who is not subject to refusal.

[0066] When a visitor makes a call to the sub-unit 1, the sub-unit 1 initiates a call to the calling master unit 2 (step S1). The acquisition control unit 191 of the sub-unit 1 causes the imaging unit 12 of the sub-unit 1 to capture an image of the visitor (step S2), and transmits the captured image to the authentication server 4 from the sub-unit communication unit 18 (step S3). The acquisition control unit 191 of the sub-unit 1 also transmits the image captured by the imaging unit 12 to the calling master unit 2 from the sub-unit transmission unit 17 (step S4). Upon receiving the image from the sub-unit 1, the calling master unit 2 can display the image transmitted from the sub-unit 1 on the display unit 24 of the master unit 2 in accordance with operations performed on the master unit operation unit 22.

[0067] The authentication unit 42 of the authentication server 4 determines (authenticates) based on the video from the slave unit 1 whether the person shown in the video (i.e., the visitor) is a person associated with the apartment building, whether the person has the authority to unlock the electric lock device 20a of the common entrance door 20, whether the person is a delivery person from a delivery company, and whether the person is subject to refusal (step S5). Then, the communication unit 41 of the authentication server 4 transmits the result of the authentication process of the authentication unit 42 to the slave unit 1 (step S6).

[0068] Then, the mode control unit 192 of the slave unit 1 determines, based on the result of the authentication process of the authentication server 4, whether the visitor is a person associated with the apartment building, whether the visitor has the authority to unlock the electric lock device 20a of the common entrance door 20, whether the visitor is a delivery person from a delivery company, and whether the visitor is a person subject to refusal (step S7). Then, the mode control unit 192 switches the processing to deal with the visitor based on the determination result (i.e., the authentication result). Then, the mode control unit 192 deals with the visitor with the switched processing.

[0069] If the mode control unit 192 determines, based on the authentication process of the authentication server 4, that the visitor is not a person associated with the apartment building, a person authorized to unlock the electric lock device 20a of the shared entrance, a delivery person from a delivery company, or a person subject to refusal (step S8), the mode control unit 192 activates the purpose confirmation mode and performs the normal process of dealing with the visitor (step S9).

[0070] When the request confirmation mode is enabled as described above, the mode control unit 192 controls the notification unit 16 of the sub-unit 1 to output a request inquiry message (e.g., voice output) from the notification unit 16 (step S10). The request inquiry message is a message to ask the visitor about the purpose of their visit, and is a pre-set standard message such as "Please tell us what you need." In response to this request for information, the visitor responds with their request by voice. In response to this response, the mode control unit 192 controls the microphone of the call unit 15 to obtain information about the visitor's request (request information) by voice, for example (step S11). Then, the mode control unit 192 transmits the obtained request information as a voice signal from the sub-unit side transmission unit 17 to the calling base unit 2 (step S12).

[0071] Furthermore, if the mode control unit 192 determines that the visitor does not fall under any of the above categories (step S8), it transmits a control signal to the calling master unit 2 via the slave unit side transmission unit 17 in response to the visitor's call operation to the slave unit 1 (step S13). Then, the mode control unit 192 causes the calling master unit 2 to make a call from the notification unit 23 (step S14).

[0072] The master unit control unit 27 of the calling master unit 2 receives message information (voice signal) from the slave unit 1 via the master unit transmission unit 21. In response to the acquisition of this information, or in response to an operation by the resident on the master unit operation unit 22, the master unit control unit 27 automatically outputs the acquired message information from the notification unit 23 (for example, as voice output) (step S15). This informs the calling resident of the visitor's purpose. The calling resident checks the content of this message and decides whether or not to respond to the visitor (for example, to make a call) (step S16).

[0073] Then, if the resident who received the call wants to answer the visitor (for example, make a call) (Yes in step S16), they operate the base unit's control panel 22 to make a call with the sub-unit 1 (step S17). On the other hand, if the resident who received the call does not want to answer the visitor (for example, make a call) (No in step S16), they operate the base unit's control panel 22 to control the notification control unit 193 of the sub-unit 1. As a result, the notification unit 16 of the sub-unit 1 outputs a message indicating that they will not answer the call (for example, a message such as "We cannot transfer your call") (for example, an audio output) (step S18).

[0074] In this manner, if the visitor is not a designated person, when the visitor makes a call to sub-unit 1, sub-unit 1 will inquire about the visitor's purpose, and that purpose will be output from the notification unit 23 of base unit 2. The resident of base unit 2, who made the call, will then check the purpose and decide whether or not to respond to the visitor.

[0075] Next, referring to Figure 4, we will explain the operation when the authentication process of the authentication server 4 results in the visitor being a person associated with the apartment building. Note that steps S1 to S7 in Figure 4 are the same as steps S1 to S7 in Figure 3. The following explanation will start from step S20 in Figure 4.

[0076] Based on the result of the determination in step S7 (step S7), if the mode control unit 192 determines that the visitor is a person associated with the apartment complex (step S20), it disables the request confirmation mode (step S21), thereby omitting the output of a request inquiry message from the notification unit 16 of the slave unit 1. Also, if the mode control unit 192 determines that the visitor is a person associated with the apartment complex (step S20), in response to the visitor's call operation to the slave unit 1, it transmits a control signal to the calling master unit 2 via the slave unit-side transmission unit 17 (step S22), causing the calling master unit 2 to make a call from its notification unit 23 (step S23). Therefore, in this case, the calling master unit 2 only receives a call from the slave unit 1 to the calling master unit 2, and the visitor's request is not output from the notification unit 23 of the master unit 2. In this case, the resident being called operates, for example, the base unit's control panel 22 to display the video from the imaging unit 12 (video showing the visitor) on the display panel 24 of the base unit 2 (step S24). The resident being called then looks at the video displayed on the display panel 24, determines that the visitor is someone associated with the apartment building, and operates the base unit's control panel 22 to make a call with the sub-unit 1 (step S25).

[0077] Furthermore, in the above operation, if the visitor is a person related to the apartment building (for example, a resident of the apartment building), it is assumed that the visitor will call their own apartment and not call someone else's apartment. Assuming this, if the visitor is a person related to the apartment building, the visitor is a family member or cohabitant of the resident they called, and therefore does not need to explain their purpose to the resident. For this reason, if the visitor is a person related to the apartment building, the purpose confirmation mode is omitted, and the inquiry to the visitor about their purpose is also omitted. This improves the convenience of the intercom system 10.

[0078] Furthermore, if the visitor is someone associated with the apartment building, it is possible to change how the sub-unit 1 handles the visitor depending on whether the visitor is calling to their own apartment or someone else's. This will be explained in Modification 3.

[0079] Next, referring to Figure 5, we will explain the operation when, as a result of the authentication process of the authentication server 4, the visitor is a person authorized to unlock the electric lock device 20a of the apartment building door 20 (for example, a delivery person from a delivery company who has been issued a one-time password (a PIN valid only once)). Note that steps S1 to S7 in Figure 5 are the same as steps S1 to S7 in Figure 3. The following explanation will start from step S30 in Figure 5.

[0080] As a result of the determination in step S7 (step S7), if the mode control unit 192 of the slave unit 1 determines that the visitor is a person authorized to unlock the electric lock device 20a of the apartment building (step S30), the mode control unit 192 disables the request confirmation mode (step S31) and enables the unlock information input mode (step S32).

[0081] As described above, when the request confirmation mode is disabled, the mode control unit 192 omits the notification of the request inquiry message from the notification unit 16 of the slave unit 1 and the output of the visitor's request from the notification unit 23 of the master unit 2.

[0082] Furthermore, when the unlocking information input mode is effectively controlled as described above, the mode control unit 192 controls the slave unit side operation unit 14 to allow the slave unit side operation unit 14 to accept input of information (e.g., a PIN code) for unlocking the electric lock device 20a (step S33). When a visitor enters a PIN code to unlock the electric lock device 20a into the slave unit side operation unit 14, the door control unit 194 of the slave unit 1 determines whether the PIN code entered into the slave unit side operation unit 14 matches a pre-registered PIN code (step S34). If the PIN codes match (Yes in step S34), the electric lock device 20a is unlocked for a certain period of time (step S35), and if the PIN codes do not match (No in step S34), the electric lock device 20a is not unlocked (step S36).

[0083] Furthermore, if the mode control unit 192 determines that the visitor is authorized to unlock the electric lock device 20a (step S30), it transmits a control signal to the calling master unit 2 via the slave unit side transmission unit 17 in response to the visitor's call operation to the slave unit 1 (step S37), causing the calling master unit 2 to make a call from the notification unit 23 (step S38). However, if the mode control unit 192 determines that the visitor is authorized to unlock the electric lock device 20a (step S30), it may omit causing the calling master unit 2 to make a call from the notification unit 23.

[0084] Thus, if the visitor is authorized to unlock the electric lock device 20a, the purpose confirmation mode is disabled and the unlocking information input mode is enabled. As a result, if the visitor is authorized to unlock the electric lock device 20a, the output of the purpose inquiry message from the notification unit 16 of the sub-unit 1 is omitted, and the visitor is automatically allowed to unlock the electric lock device 20a and enter the common entrance. This improves the convenience of the intercom system 10, for example, if the visitor is a delivery person to whom a one-time password has been issued, and the delivery person has been instructed to leave the package at a designated location inside the common entrance, the resident who was called does not need to answer the door to the delivery person.

[0085] Next, referring to Figure 6, we will explain the operation when the authentication process of the authentication server 4 results in the visitor being a delivery person from a delivery company (more specifically, a delivery person who has not been issued a one-time password). Note that steps S1 to S7 in Figure 6 are the same as steps S1 to S7 in Figure 3. The following explanation will start from step S40 in Figure 6.

[0086] As a result of the determination in step S7 (step S7), if the mode control unit 192 determines that the visitor is a delivery person from a delivery company (step S40), the mode control unit 192 disables the request confirmation mode (step S41) and enables the delivery mode (step S42).

[0087] As described above, if the visitor is determined to be a delivery person (step S40), the mode control unit 192 transmits a control signal to the calling master unit 2 via the sub-unit side transmission unit 17 in response to the visitor's call operation to the sub-unit 1 (step S43), causing the calling master unit 2's notification unit 23 to make a call (step S44). However, if the mode control unit 192 determines that the visitor is a delivery person, it may omit causing the calling master unit 2's notification unit 23 to make a call.

[0088] Furthermore, when the request confirmation mode is disabled as described above, the mode control unit 192 omits the notification of the request inquiry message from the notification unit 16 of the slave unit 1 and the output of the visitor's request from the notification unit 23 of the master unit 2.

[0089] Furthermore, once the delivery mode is effectively controlled as described above, the mode control unit 192 controls, for example, the notification unit 16 of the sub-unit 1 to output (for example, via voice output) a pre-set message (for example, "Please put the package in the delivery box in front of the main entrance") from the notification unit 16 of the sub-unit 1 as information to be presented from the sub-unit 1 to the delivery person (step S45). As a result, the delivery person places the package in the designated delivery box.

[0090] Furthermore, the mode control unit 192 controls, for example, the notification unit 16 of the sub-unit 1 to cause the notification unit 16 to broadcast, for example, by voice output, a message indicating that it is accepting information input from the delivery person to the sub-unit 1 (for example, a message such as "If you have a message for the resident you called, please enter it by voice"). (Step S46) As a result, the delivery person voice-inputs a message to the telephone unit 15 of the sub-unit 1 as information input from the delivery person to the sub-unit 1, for example, a message such as "I have placed the delivery item in the delivery box in front of the main entrance" (Step S47). At this time, the mode control unit 192 controls the telephone unit 15 of the sub-unit 1 to acquire the message voice-input by the delivery person using the microphone of the telephone unit 15.

[0091] The mode control unit 192 then transmits the message acquired by the call unit 15 to the base unit 2 via the sub-unit transmission unit 17 (step S48), and stores it in the memory unit 26 of the base unit 2 that made the call (step S49). This allows the resident at the call destination to hear the delivery person's message from the base unit 2 at their home by having the notification unit 23 of the base unit 2 output the message as audio. This allows at least one of the following (both in the above explanation) to be conveyed: a message from the delivery person to the resident, and a message from the resident to the delivery person, even if the resident has specified contactless delivery to the delivery company. This improves the convenience of the intercom system 10.

[0092] Next, referring to Figure 7, we will explain the operation when the authentication process of the authentication server 4 reveals that the visitor is a person who should be rejected. Note that steps S1 to S7 in Figure 7 are the same as steps S1 to S7 in Figure 3. The following explanation will start from step S50 in Figure 7.

[0093] Based on the result of the determination in step S7 (step S7), if the mode control unit 192 determines that the visitor is a person to be rejected (step S50), it stops the call from the sub-unit 1 to the calling base unit 2 based on the visitor's operation on the sub-unit 1 (step S51), and enables the request confirmation mode (step S52).

[0094] As described above, when calls from slave unit 1 to master unit 2 are stopped, calls will no longer be made from the notification unit 23 of master unit 2.

[0095] Furthermore, when the request confirmation mode is effectively controlled as described above, the mode control unit 192 notifies the request inquiry message from the notification unit 16 of the slave unit 1 (step S53). The mode control unit 192 then controls the microphone of the call unit 15 to acquire the request (request information) from the visitor in response to the above request (step S54). The mode control unit 192 then transmits the acquired request information from the slave unit side transmission unit 17 to the calling master unit 2 (step S55). At the calling master unit 2, when the master unit side control unit 27 receives the request information from the slave unit 1, it stores the received request information in the storage unit 26 of the master unit 2 (step S56). When a request to play back the request is input to the master unit side operation unit 22 of the calling master unit 2 (step S57), the master unit side control unit 27 of the calling master unit 2 outputs the request information stored in the storage unit 26 from the notification unit 23. This allows the resident who received the call to confirm that the person who was supposed to refuse the visitor has come by replaying the message (Step S58).

[0096] In this way, if a visitor is a person who should be refused entry, the system does not make a call from the sub-unit 1 to the main unit 2, thus eliminating the need for the resident to answer the door and improving the convenience of the intercom system 10. Furthermore, the resident who made the call can find out that a person who should be refused entry (visitor) has come through the history of inquiries stored in the memory unit 26 of the main unit 2. This improves the security of the intercom system 10.

[0097] (3) Other embodiments The above embodiments are merely one of many embodiments of this disclosure. The above embodiments can be modified in various ways depending on the design, etc., as long as the objectives of this disclosure are achieved. Furthermore, functions similar to those of the intercom system 10 according to the above embodiments may be embodied in a control method for the intercom system 10, a computer program, or a non-temporary recording medium on which the computer program is stored.

[0098] One aspect of the control method is a control method for controlling an intercom system comprising a first terminal and a second terminal. The first terminal is installed at the entrance of a facility and has an acquisition unit that acquires at least one of images and sounds related to visitors to the facility. The second terminal is installed inside the facility and is capable of two-way communication with the first terminal. The intercom system has a message confirmation mode that, in response to a call from the first terminal to the second terminal based on an operation of the first terminal by a visitor to the facility, notifies the first terminal of an inquiry regarding the visitor's request. The control method also includes a mode control process that controls the enabling and disabling of the message confirmation mode based on the result of an authentication process for the visitor based on at least one of the sounds and images acquired by the acquisition unit.

[0099] A program according to one embodiment causes a computer system to execute the control method according to the above embodiment.

[0100] (4) Variations The following lists some modifications of the above embodiment. The modifications described below can be combined and applied as appropriate.

[0101] (4.1) Variation 1 In the above embodiment, an imaging unit 12 that acquires images (video) of a visitor is given as an example of an acquisition unit that acquires at least one of images and sounds related to a visitor. However, the acquisition unit may be a microphone that acquires sounds related to the visitor (for example, voice, a specific sequence of sounds output from a mobile device carried by the visitor) instead of the imaging unit 12, or it may be both the imaging unit 12 and the microphone.

[0102] (4.2) Modification 2 In the above embodiment, the functions of the control unit 19 are installed in the slave unit 1. However, the functions of the control unit 19 are not limited to being installed in the slave unit 1. For example, it may be installed in the control device 3, in any of the master units 2, or in an external terminal capable of communicating with both the slave unit 1 and the master units 2.

[0103] In the above embodiment, the functions of the mode control unit 192 are implemented in the slave unit control unit 19. However, the functions of the mode control unit 192 are not limited to being implemented in the slave unit control unit 19. For example, it may be implemented in the control device 3, in either of the master units 2, or in an external terminal capable of communicating with the slave unit 1 and the master units 2.

[0104] (4.3) Modification example 3 In the above embodiment, if the authentication process of the authentication server 4 reveals that the visitor is a resident of the apartment building, and the visitor calls another person's apartment as the destination, the notification unit 23 or display unit 24 of the destination master unit 2 may output information indicating that the call is being made by a resident of apartment OX. In this case, when the authentication server 4 registers a reference image for authentication related to a person associated with the apartment building, it associates and registers the room number of that person associated with the apartment building. Then, when the slave unit 1 transmits the video captured by the imaging unit 12 to the authentication server 4, it associates the video with the room number of the destination entered by the visitor in the slave unit 1 and transmits it to the authentication server 4.

[0105] Then, when the authentication server 4 determines (authenticates) whether or not the visitor is a person associated with the apartment building, if the person in the video matches the person in the reference image used for authentication, and the room number of the destination linked to the video matches the room number linked to the reference image, then the authentication server 4 determines that the visitor is making a call to their own apartment. In this case, the authentication server 4 sends the authentication result that the visitor is a person associated with the apartment building to the slave unit 1, as in the operation description above.

[0106] Furthermore, the authentication server 4 determines that the visitor is calling someone else's apartment if the person in the video matches the person in the reference image used for authentication, and the room number of the destination linked to the video does not match the room number linked to the reference image. In this case, the authentication server 4 sends the visitor's room number information (i.e., the room number information linked to the reference image) and information indicating that the visitor is calling someone else's apartment, along with the authentication result that the visitor is a person associated with the apartment building. The slave unit 1 then outputs information to the notification unit 23 or display unit 24 of the calling master unit 2 indicating that it is being called by the resident (visitor) of the room number linked to the reference image.

[0107] (4.4) Modification 4 In the above embodiment, when it is determined that the visitor is a delivery person (S40 in Figure 6), an example is given where the delivery person inputs a message to the resident who called them as part of the information input from the delivery person to the sub-unit 1 (step S47). However, the delivery person may also input the package number assigned to the delivery by the delivery company into the sub-unit's operation unit 14 as part of the information input from the delivery person to the sub-unit 1. In this case, when the authentication server 4 registers (stores) the image of the delivery person as a reference image for authentication related to the delivery person of the delivery company in the storage unit 43 of the authentication server 4, it registers it linked to the package number of the delivery person.

[0108] The acquisition control unit 191 of the slave unit 1 associates the video captured by the imaging unit 12 with the package number entered into the slave unit's operation unit 14, and transmits it to the authentication server 4 via the slave unit's communication unit 18.

[0109] Then, when the authentication server 4 determines (authenticates) whether or not a visitor is a delivery person from a delivery company, if the person in the video matches the person in the reference image used for authentication, and the package number associated with the video matches the package number associated with the reference image, then the server determines that the visitor is a delivery person from a delivery company and the package number is correct. In this case, the authentication server 4 sends the authentication result that the visitor is a delivery person from a delivery company and the package number is correct to the slave device 1.

[0110] Furthermore, if the person in the video matches the person in the reference image used for authentication, and the package number associated with the video does not match the package number associated with the reference image, the authentication server 4 determines that the visitor is a delivery person from a delivery company and that the package number is incorrect. In this case, the authentication server 4 transmits the determination that the visitor is a delivery person from a delivery company and that the package number is incorrect to the slave device 1.

[0111] Furthermore, if the person in the video does not match the person in the reference image used for authentication, the authentication server 4 determines that the visitor is not a delivery person from the courier company, regardless of whether the package number matches or not. In this case, the authentication server 4 transmits the determination that the visitor is not a delivery person from the courier company to the slave unit 1.

[0112] Then, the mode control unit 192 of the sub-unit 1 unlocks the electric lock device 20a for a certain period of time by controlling the door control unit 194 only if the authentication result from the authentication server 4 is that the visitor is a delivery person from a delivery company and the package number is correct. This allows residents to receive packages from delivery personnel without having to answer the door, even if they have specified contactless delivery to the delivery company. This improves the convenience of the intercom system 10.

[0113] (4.5) Modification 5 In the above embodiment, an information terminal with dedicated application software installed that enables wireless communication with the master unit 2 may be included. The information terminal may be, for example, a smartphone carried by a user such as a resident. In this case, the master unit 2 transmits video from the slave unit 1 (video captured by the imaging unit 12) to the information terminal, and the information terminal can play back and view the video. The master unit 2 also transmits message information stored in the storage unit 26 to the information terminal, and the information terminal can play back and confirm the content of the message information. Furthermore, when the master unit 2 outputs a ringtone in response to a call from the slave unit 1, it is possible to control the information terminal to output a ringtone.

[0114] (4.6) Variation 6 In the above embodiment, if it is determined that the visitor is authorized to unlock the door, the control unit disables the purpose confirmation mode and enables the lock information input mode. However, if it is determined that the visitor is authorized to unlock the door, the control unit may disable the purpose confirmation mode and release the electric lock device 20a (electric lock). This allows the electric lock device 20a to be automatically unlocked without inquiring about the visitor's purpose, thus allowing the visitor to enter the entrance.

[0115] (4.7) Other variations The intercom system 10 in this disclosure includes a computer system, for example, in the slave unit-side control unit 19 of the slave unit 1. The computer system mainly consists of a processor and memory as hardware. The function of the slave unit-side control unit 19 in this disclosure is realized by the processor executing a program recorded in the memory of the computer system. The program may be pre-recorded in the memory of the computer system, provided via a telecommunications line, or recorded and provided on a non-temporary recording medium such as a memory card, optical disk, or hard disk drive that can be read by the computer system. The processor of the computer system consists of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large-scale integrated circuit (LSI). The multiple electronic circuits may be aggregated on a single chip or distributed across multiple chips. The multiple chips may be aggregated on a single device or distributed across multiple devices.

[0116] Furthermore, it is not essential for the slave unit 1 to have multiple functions integrated into a single housing; the components of the slave unit 1 may be distributed across multiple housings. In addition, at least some of the functions of the slave unit 1, such as the slave unit control unit 19, may be implemented by, for example, the cloud (cloud computing). Conversely, as in the above embodiment, all the functions of the slave unit 1 may be integrated into a single housing.

[0117] (5) Aspect Based on the embodiments and modifications described above, this disclosure includes the following aspects.

[0118] The intercom system (10) according to the first embodiment comprises a first terminal (1) and a second terminal (2). The first terminal (1) is installed at the entrance of the facility and has an acquisition unit (12) that acquires at least one of images and sounds related to visitors of the facility. The second terminal (2) is installed inside the facility and is capable of two-way communication with the first terminal (1). The intercom system (10) has a message confirmation mode. The message confirmation mode is a mode in which, in response to a call from the first terminal (1) to the second terminal (2) based on an operation of the first terminal (1) by a visitor of the facility, the first terminal (1) notifies the visitor of the message. The intercom system (10) further comprises a control unit (19). The control unit (19) controls the enabling and disabling of the message confirmation mode based on the result of an authentication process for the visitor based on at least one of the images and sounds acquired by the acquisition unit (12).

[0119] This configuration allows for automatic control over whether or not to notify visitors of their purpose based on the results of the authentication process. If visitors are not notified of their purpose, they do not need to communicate their purpose to the designated contact person. Therefore, by pre-registering visitors who do not need to communicate their purpose to the designated contact person, it is possible to omit this process for those visitors. As a result, the convenience of the intercom system (10) can be improved.

[0120] In the second embodiment of the intercom system (10), in the first embodiment, the control unit (19) controls the purpose confirmation mode to be disabled in the authentication process if the visitor is authenticated as a person associated with the facility.

[0121] With this configuration, if the visitor is a person associated with the facility, the purpose confirmation mode can be automatically disabled. This allows visitors who are associated with the facility to omit the task of communicating their purpose to the designated party, thereby improving the convenience of the intercom system (10).

[0122] In the third embodiment of the intercom system (10), in the second embodiment, the control unit (19) enables the purpose confirmation mode in the authentication process if the visitor is not authenticated as a person associated with the facility.

[0123] With this configuration, if a visitor is not a person associated with the facility, the purpose confirmation mode can be automatically enabled. This allows the resident who received the call to decide whether or not to answer the visitor's call after confirming the visitor's purpose, thereby improving the convenience of the intercom system (10).

[0124] In the intercom system (10) according to the fourth embodiment, in the first embodiment, when the request confirmation mode is enabled, the first terminal (1) outputs information regarding the request obtained from the visitor to the second terminal (2).

[0125] With this configuration, the visitor's purpose can be confirmed on the second terminal (2).

[0126] The intercom system (10) according to the fifth embodiment has an unlocking information input mode in the first embodiment. The unlocking information input mode is a mode in which the first terminal (1) accepts input of information for unlocking the electric lock on the entrance of the facility. In the authentication process, if the control unit (19) is authenticated as a person authorized to unlock the electric lock (electric lock device 20a), it controls the request confirmation mode to be disabled and the unlocking information input mode to be enabled.

[0127] With this configuration, if a visitor is authorized to unlock the electric lock on the front door, the system can automatically allow the visitor to unlock the electric lock and enter the house without having to ask them about their purpose. This improves the convenience of the intercom system (10), for example, if the visitor is a delivery person and the resident has instructed the delivery person to leave the package in a designated location inside the front door.

[0128] In the intercom system (10) according to the sixth embodiment, in the first embodiment, the control unit (19) disables the request confirmation mode and unlocks the electric lock (electric lock device 20a) at the entrance of the facility when it is authenticated in the authentication process that the visitor is a person authorized to unlock the electric lock (electric lock device 20a) at the entrance of the facility.

[0129] With this configuration, if a visitor is authorized to unlock the electric lock on the front door, the system can automatically unlock the electric lock on the front door, allowing the visitor to enter without having to ask them about their purpose.

[0130] In the intercom system (10) according to the seventh embodiment, in the fifth or sixth embodiment, the person authorized to unlock the electric lock on the front door (electric lock device 20a) includes a delivery person of a delivery company.

[0131] With this configuration, if the resident at the receiving end has specified "leave at door" to the delivery company, the resident at the receiving end does not need to answer the door to the delivery person, thereby improving the convenience of the intercom system (10).

[0132] The intercom system (10) according to the eighth aspect has a delivery mode in the first aspect. The delivery mode is a mode that performs at least one of the following: presenting information from the first terminal (1) to a delivery person of a delivery company that has come to the home, and receiving information input from the delivery person to the first terminal (1). In the authentication process, if the control unit (19) is authenticated to be a delivery person of a delivery company, it controls the message confirmation mode to be disabled and controls the delivery mode to be enabled.

[0133] With this configuration, if the resident who made the call has specified to leave the package at the delivery company, at least one of the following can be communicated: information from the delivery person to the resident (e.g., a message), and information from the resident to the delivery person (e.g., a message). This improves the convenience of the intercom system (10).

[0134] In the intercom system (10) according to the ninth embodiment, in the first embodiment, the control unit (19) controls the request confirmation mode to be effective when the visitor is authenticated in the authentication process as a person who will refuse to answer the call from the resident to whom the call was made, and operates the first terminal (1) so as not to make a call from the first terminal (1) to the second terminal (2) based on the visitor's operation on the first terminal (1).

[0135] With this configuration, if a visitor is someone who should be refused, the sub-unit does not make a call to the main unit, thus eliminating the need for the resident to answer the visitor and improving the convenience of the intercom system (10).

[0136] The intercom system (10) according to the tenth embodiment further comprises a storage unit (26) in the ninth embodiment. The storage unit (26) stores information about the visitor's request obtained by the first terminal (1) from the visitor when the visitor is authenticated as a person subject to rejection.

[0137] With this configuration, it is possible to confirm that a person subject to rejection (visitor) has arrived based on the request stored in the memory unit (26). This improves the security of the intercom system (10).

[0138] In the intercom system (10) according to the eleventh embodiment, the storage unit (26) is provided in the second terminal (2) as in the tenth embodiment.

[0139] With this configuration, the second terminal (2) can store the request from the person to be rejected (visitor).

[0140] The control method relating to the twelfth aspect is a control method for controlling an intercom system (10). The intercom system (10) comprises a first terminal (1) and a second terminal (2). The first terminal (1) is installed at the entrance of the facility and has an acquisition unit (12) that acquires at least one of images and sounds related to visitors of the facility. The second terminal (2) is installed inside the facility and is capable of two-way communication with the first terminal (1). The intercom system (10) has a message confirmation mode. The message confirmation mode is a mode in which, in response to a call from the first terminal (1) to the second terminal (2) based on an operation of the first terminal (1) by a visitor of the facility, the first terminal (1) notifies the visitor of the message. The control method includes control processing. In the control processing, the enablement and disablement of the message confirmation mode are controlled based on the result of authentication processing for the visitor based on at least one of the images and sounds acquired by the acquisition unit (12).

[0141] This configuration allows for automatic control over whether or not to notify visitors of their purpose based on the results of the authentication process. If visitors are not notified of their purpose, they do not need to communicate their purpose to the designated contact person. Therefore, by pre-registering visitors who do not need to communicate their purpose to the designated contact person, it is possible to omit this process for those visitors. As a result, the convenience of the intercom system (10) can be improved.

[0142] The program according to the 13th embodiment causes the computer system to execute the control method according to the 12th embodiment.

[0143] This configuration makes it possible to provide a program that executes a control method according to a twelfth embodiment. [Explanation of Symbols]

[0144] 1. Sub-unit (first terminal) 2. Master unit (second terminal) 10 Intercom System 12. Imaging Unit (Acquisition Unit) 19. Slave Unit Control Unit (Control Unit) 20a Electric locking device (electric lock) 26 Memory section

Claims

1. A first terminal is installed at the entrance of the facility and has an acquisition unit that acquires at least one of images and sounds related to visitors of the facility. The facility includes a second terminal located inside the aforementioned facility, which is capable of two-way communication with the first terminal, A request confirmation mode is provided in which, in response to a call from the first terminal to the second terminal based on an operation performed on the first terminal by a visitor to the facility, the first terminal notifies the visitor of the request, It has a delivery mode that accepts messages from a delivery person of a visiting delivery company to the first terminal for the resident to whom the message was sent, The system further comprises a control unit that controls the enabling and disabling of the request confirmation mode based on the result of the authentication process for the visitor based on at least one of the image and sound acquired by the acquisition unit, In the authentication process, if the visitor is authenticated as a delivery person of the delivery company, the control unit controls the request confirmation mode to be disabled and the delivery mode to be enabled. Intercom system.

2. A first terminal is installed at the entrance of the facility and has an acquisition unit that acquires at least one of images and sounds related to visitors of the facility. The facility includes a second terminal located inside the aforementioned facility, which is capable of two-way communication with the first terminal, In response to a call from the first terminal to the second terminal based on an operation performed on the first terminal by a visitor to the facility, the first terminal has a request confirmation mode that notifies the visitor of the request. The system further comprises a control unit that controls the enabling and disabling of the request confirmation mode based on the result of the authentication process for the visitor based on at least one of the image and sound acquired by the acquisition unit, In the authentication process, the control unit, when authenticated that the visitor is a person who will be refused by the resident to whom the call was made, enables the request confirmation mode and operates the first terminal so as not to make a call from the first terminal to the second terminal based on the visitor's operation on the first terminal. Intercom system.

3. The system has a delivery mode that allows a delivery person from a visiting delivery company to input a message to the resident being called to the first terminal, In the authentication process, if the visitor is authenticated as a delivery person of the delivery company, the control unit controls the request confirmation mode to be disabled and the delivery mode to be enabled. The intercom system according to claim 2.

4. The control unit, in the authentication process, controls the request confirmation mode to be disabled if the visitor is authenticated as a person associated with the facility. The intercom system according to claim 1 or 2.

5. The control unit, in the authentication process, if the visitor is not authenticated as a person associated with the facility, enables the request confirmation mode. The intercom system according to claim 4.

6. When the aforementioned request confirmation mode is enabled, the first terminal outputs the information regarding the request obtained from the visitor to the second terminal. The intercom system according to claim 1 or 2.

7. The first terminal has an unlocking information input mode that accepts input of information for unlocking the electric lock on the entrance of the facility, In the authentication process, if the control unit is authenticated as having the authority to unlock the electric lock, it disables the request confirmation mode and enables the unlocking information input mode. The intercom system according to claim 1 or 2.

8. If the control unit is authenticated in the authentication process that the visitor is authorized to unlock the electric lock on the entrance of the facility, it disables the request confirmation mode and unlocks the electric lock. The intercom system according to claim 1 or 2.

9. The person who has the authority to unlock the electric lock on the aforementioned entrance is a delivery person of a delivery company, The intercom system according to claim 7.

10. The person who has the authority to unlock the electric lock on the front door includes a delivery person of a delivery company, The intercom system according to claim 8.

11. The first terminal further comprises a storage unit that stores information regarding the visitor's request obtained from the visitor when the visitor is authenticated as a person subject to rejection. The intercom system according to claim 2.

12. The storage unit is provided in the second terminal, The intercom system according to claim 11.

13. A first terminal provided at the entrance of a facility and having an acquisition unit that acquires at least one of images and sounds related to visitors of the facility, A control method for controlling an intercom system comprising a second terminal installed inside the facility and capable of two-way communication with the first terminal, The aforementioned intercom system is A request confirmation mode is provided in which, in response to a call from the first terminal to the second terminal based on an operation performed on the first terminal by a visitor to the facility, the first terminal notifies the visitor of the request, It has a delivery mode that accepts messages from a delivery person of a visiting delivery company to the first terminal for the resident to whom the message was sent, The control method includes a control process that controls the enabling and disabling of the requirement confirmation mode based on the result of an authentication process for the visitor based on at least one of the image and sound acquired by the acquisition unit. In the control process, if the visitor is authenticated as a delivery person of the delivery company in the authentication process, the request confirmation mode is disabled and the delivery mode is enabled. Control method.

14. A first terminal provided at the entrance of a facility and having an acquisition unit that acquires at least one of images and sounds related to visitors of the facility, A control method for controlling an intercom system comprising a second terminal installed inside the facility and capable of two-way communication with the first terminal, The intercom system has a message confirmation mode that, in response to a call from the first terminal to the second terminal based on an operation of the first terminal by a visitor to the facility, notifies the first terminal of the visitor of the request. The control method includes a control process that controls the enabling and disabling of the requirement confirmation mode based on the result of an authentication process for the visitor based on at least one of the image and sound acquired by the acquisition unit. In the control process, if the visitor is authenticated in the authentication process as a person who will be refused by the resident to whom the call was made, the request confirmation mode is enabled and the first terminal is operated so as not to make a call from the first terminal to the second terminal based on the visitor's operation on the first terminal. Control method.

15. Causes a computer system to execute the control method described in claim 13 or 14. program.

Images