Intercom device and control method for the intercom device

Abstract

To provide an intercom device capable of prompting a visitor to make an appropriate response, and a control method of the intercom.SOLUTION: An intercom device which communicates with a cloud server that collects an IP (Internet Protocol) address of a mobile terminal of a user includes a slave device and a master device. The slave device including a call bell and a speaker is installed outdoor. The master device connected to the slave device is installed indoor. The master device includes a first communication unit and a first control unit. The first communication unit communicates, in response to operation of the call bell, with the cloud server via a router outside the master device, to acquire the IP address of the mobile terminal or terminal position information generated based on the IP address. The first control unit transmits a control signal to the slave device, the control signal causing the speaker to output a message according to the IP address or the terminal position information acquired by the first communication unit.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an intercom device and a control method for the intercom device.

Background Art

[0002] Japanese Patent Application Laid-Open No. 2020-078036 (Patent Document 1) discloses an intercom system. In this intercom system, for example, when an operation for calling is performed by a visitor, a call is sent to the user's public network information terminal. Therefore, according to this intercom system, even when the user is absent, the user can respond to the call via the public network information terminal (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the intercom system disclosed in Patent Document 1 above, when an operation for calling is performed by a visitor, for example, a call is sent to a non-public network information terminal in the house using short-range wireless communication. If the call is not responded to, a call is sent to the public network information terminal using the public network. Thus, in this intercom system, a two-stage call is made when the user is absent. However, since the two-stage call takes time, it is conceivable that the visitor may leave while the two-stage call is being made if the response from the resident is slow.

[0005] The present invention has been made to solve such problems, and an object thereof is to provide an intercom device capable of promptly reacting while a visitor is waiting and prompting an appropriate response to the visitor, and a control method for the intercom device.

Means for Solving the Problems

[0006] An intercom device according to an aspect of the present invention is configured to communicate with a cloud server that collects the IP (Internet Protocol) address of a user's mobile terminal. This intercom device includes a sub-unit and a main unit. The sub-unit includes a calling bell and a speaker and is installed outdoors. The main unit is connected to the sub-unit and is installed indoors. The main unit includes a first communication unit and a first control unit. The first communication unit obtains the IP address of the mobile terminal or the terminal position information generated based on the IP address by communicating with the cloud server via a router outside the main unit in response to the operation of the calling bell. The first control unit transmits a control signal to the sub-unit that causes the speaker to output a message corresponding to the IP address or the terminal position information obtained by the first communication unit.

[0007] In this intercom device, in response to the calling bell being operated by a visitor, a message corresponding to the IP address of the user's mobile terminal or the terminal position information is output from the speaker. Therefore, according to this intercom device, since a message corresponding to the current position of the user is output from the speaker, it is possible to prompt the visitor to take an appropriate response according to the current position of the user.

[0008] In the above intercom device, when the IP address is a private IP address or when the terminal position information indicates that the mobile terminal exists indoors, the first control unit transmits a control signal to the sub-unit that causes the speaker to output a first message, while when the IP address is a global IP address or when the terminal position information indicates that the mobile terminal exists outdoors, the first control unit may transmit a control signal to the sub-unit that causes the speaker to output a second message.

[0009] In this intercom device, different messages (the first message or the second message) are output from the speaker depending on whether the user is presumed to be present outdoors or indoors. Therefore, according to this intercom device, it is possible to prompt a visitor to take an appropriate action according to the current location of the user (outdoors or indoors).

[0010] In the above intercom device, the slave unit further includes a camera that photographs the outside and generates image data, and a second communication unit that wirelessly communicates with the first communication unit of the master unit. The master unit is connected to the slave unit via a two-wire transmission line. Between the master unit and the slave unit, power and control signals may be transmitted and received via the transmission line, and image data may be transmitted and received via wireless communication between the first and second communication units.

[0011] In this intercom device, the transmission and reception of image data between the master unit and the slave unit are not performed via a two-wire transmission line, but are performed via wireless communication between the first and second communication units. Therefore, according to this intercom device, since the transmission and reception of image data are performed by a communication means (wireless communication) with a relatively sufficient communication bandwidth, the transmission and reception of image data between the master unit and the slave unit can be performed smoothly.

[0012] In the above intercom device, the second communication unit can wirelessly communicate with a mobile terminal. The slave unit further includes a second control unit that controls the second communication unit. In the master unit, when the IP address is a private IP address, or when the terminal location information indicates that the mobile terminal is present indoors, it is possible to set whether to transmit the image data from the slave unit to the master unit or from the slave unit to the mobile terminal. The second control unit may control the second communication unit to transmit the image data to the transmission destination according to the content of the setting.

[0013] In this intercom device, when the IP address is a private IP address or when the terminal location information indicates that the mobile terminal is present indoors (when it is estimated that the user is present indoors), it is possible to set whether to transmit the image data from the slave unit to the master unit or from the slave unit to the mobile terminal. Therefore, according to this intercom device, by setting so that the image data is transmitted from the slave unit to the mobile terminal when it is estimated that the user is present indoors, even if the user is not near the master unit indoors, the user can easily confirm the visitor via the mobile terminal.

[0014] In the above intercom device, when a permission signal or a non - permission signal is received from the mobile terminal via the first communication unit in response to the transmission of the image data to the mobile terminal, the first control unit may transmit a control signal to the slave unit to output a message indicating an instruction to the delivery person to the speaker according to the received signal.

[0015] In this intercom device, a message indicating an instruction to the delivery person is output from the speaker according to the signal received from the mobile terminal. Therefore, according to this intercom device, for example, by appropriately operating the mobile terminal by referring to the image displayed on the mobile terminal, the user can appropriately instruct the delivery person.

[0016] A control method for an intercom device according to another aspect of the present invention is a control method for an intercom device configured to communicate with a cloud server that collects the IP (Internet Protocol) address of a user's mobile terminal. The intercom device has a calling bell and a speaker, and includes a slave unit installed outdoors and a master unit connected to the slave unit and installed indoors. The control method for the intercom device includes, in response to the calling bell being operated, causing the master unit to obtain the IP address or terminal location information generated based on the IP address by communicating with the cloud server via a router outside the master unit, and transmitting, from the master unit to the slave unit, a control signal for causing the speaker to output a message corresponding to the obtained IP address or terminal location information.

[0017] In this control method for the intercom device, in response to the calling bell being operated by a visitor, a message corresponding to the IP address or terminal location information of the user's mobile terminal is output from the speaker. Therefore, according to this control method for the intercom device, since a message corresponding to the user's current location is output from the speaker, it is possible to prompt the visitor to take an appropriate action according to the user's current location.

Effects of the Invention

[0018] According to the present invention, it is possible to provide an intercom device and a control method for the intercom device that can prompt a visitor to take an appropriate action by making the visitor feel that a response is immediately made from a resident (user).

Brief Description of the Drawings

[0019]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

[0020] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the drawings, the same or corresponding parts are denoted by the same reference numerals and their descriptions will not be repeated.

[0021] [1. Configuration] <1-1. Configuration of Intercom System> FIG. 1 is a block diagram schematically showing the configuration of an intercom system 10 including an intercom device 50 according to the present embodiment. As shown in FIG. 1, the intercom system 10 includes an intercom device 50, a cloud server 300, and a mobile terminal 400. In the intercom system 10, the intercom device 50, the cloud server 300, and the mobile terminal 400 can communicate with each other via a network (for example, the Internet) N1.

[0022] The intercom device 50 includes a master unit 100 and a slave unit 200. The master unit 100 and the slave unit 200 can perform two-way communication, and a call can be made between the master unit 100 and the slave unit 200. For example, the master unit 100 is installed inside (defined as indoors) the user's living space or work area such as a workplace, and the slave unit 200 is installed outside (defined as outdoors) the user's living space or work area such as a workplace. The master unit 100 is operated by the user, for example, and the slave unit 200 is operated by a visitor who comes to the user's home or workplace, for example. When a visitor comes to the user's home, the user and the visitor can talk to each other through the master unit 100 and the slave unit 200 respectively.

[0023] The master unit 100 is connected to the network N1 via a router 500, for example. Also, each of the cloud server 300 and the mobile terminal 400 is connected to the network N1. The cloud server 300 is constituted by a general-purpose computer, for example, and the mobile terminal 400 is constituted by a smartphone, a tablet, or a mobile PC (Personal Computer), for example.

[0024] The owner of the mobile terminal 400 is the user of the intercom device 50. The mobile terminal 400 is set to be connected to the network N1 via the router 500 when the user is indoors. In this case, the IP address of the mobile terminal 400 becomes the private IP address of the router 500. On the other hand, when the user is outdoors, the mobile terminal 400 is connected to the network N1 via a mobile phone network (for example, 3G, 4G, 5G), for example. In this case, the IP address of the mobile terminal 400 becomes a global IP address.

[0025] In the intercom system 10, the IP address information of the mobile terminal 400 is periodically transmitted to the cloud server 300. In the cloud server 300, based on the acquired IP address information, it is determined whether the user is present indoors or outdoors, and terminal location information indicating the determination result is generated. Specifically, when the acquired IP address information indicates the private IP address of the router 500, it is determined that the user is present indoors, and when the acquired IP address information indicates a global IP address, it is determined that the user is present outdoors. Then, terminal location information indicating the determination result is generated.

[0026] In the intercom device 50, when a visitor makes a call through the sub - machine 200, the main machine 100 acquires the terminal location information from the cloud server 300. In the main machine 100, control corresponding to the acquired terminal location information is performed. According to this intercom device 50, it is possible to prompt an appropriate response to the visitor according to the current location of the user. The specific control content in the intercom device 50 will be described in detail later.

[0027] <1 - 2. Configuration of Intercom Device> FIG. 2 is a block diagram schematically showing the configuration of the intercom device 50. As shown in FIG. 2, the intercom device 50 includes a main machine 100 and a sub - machine 200. The main machine 100 and the sub - machine 200 are connected via a two - wire transmission line L1. The transmission line L1 is composed of, for example, a twisted pair wire.

[0028] The main machine 100 includes a first control unit 110, a storage unit 120, a microphone 130, a speaker 140, a display 150, an operation unit 160, a first communication unit 180, and a third communication unit 170.

[0029] The first control unit 110 includes a CPU (Central Processing Unit) and memory etc. (not shown), and is configured to control each component of the master unit 100. For example, various functions in the master unit 100 are realized by the control program of the master unit 100 stored in the memory being executed by the CPU.

[0030] The storage unit 120 is configured to store various data. The storage unit 120 stores, for example, image data indicating a UI (User Interface) displayed on the display 150, and audio data indicating a calling sound output from the speaker 140. The storage unit 120 is constituted by, for example, at least a part of a ROM (Read Only Memory), a RAM (Random Access Memory), an EEPROM (Electrically Erasable Programmable Read Only Memory), a hard disk drive, and a solid state drive.

[0031] The microphone 130 is configured to convert the input voice into an analog voice signal. This analog voice signal is converted into a digital voice signal (voice data) by, for example, a voice processing circuit (not shown), and is transmitted to the slave unit 200.

[0032] The speaker 140 is configured to convert an analog voice signal into voice and output it. For example, the digital voice signal (voice data) received from the slave unit 200 is converted into an analog voice signal by a voice processing circuit (not shown), and the speaker 140 converts the analog voice signal into voice and outputs it. Also, the speaker 140 outputs a calling sound indicated by the voice data stored in the storage unit 120, for example, in a state where the master unit 100 has received a calling signal from the slave unit 200.

[0033] The display 150 is configured to display images. The display 150 is composed of, for example, a monitor such as a liquid crystal monitor or an organic EL (Electro Luminescence) monitor. An image captured by the slave unit 200, for example, is displayed on the display 150.

[0034] The operation unit 160 is configured to receive operations from the user. The operation unit 160 is composed of, for example, a touch panel or physical buttons. For example, when the master unit 100 is receiving a call signal from the slave unit 200, if a predetermined operation (e.g., pressing a physical button) is performed via the operation unit 160, a call between the master unit 100 and the slave unit 200 becomes possible. When the operation unit 160 is composed of a touch panel, for example, an operation area for receiving a predetermined operation is displayed on the display 150, and a call between the master unit 100 and the slave unit 200 becomes possible in the same manner as the operation of the previous physical button in response to a touch operation from the user.

[0035] The first communication unit 180 is configured to communicate with the cloud server 300 and the mobile terminal 400 via the network N1 (FIG. 1). The first communication unit 180 is composed of, for example, a wired LAN (Local Area Network) module or a wireless LAN module.

[0036] The third communication unit 170 is configured to transmit and receive control signals to and from the slave unit 200 via the transmission line L1. That is, two-way communication via the transmission line L1 is possible between the master unit 100 and the slave unit 200. In addition, the third communication unit 170 is configured to send power to the slave unit 200 via the transmission line L1. This power is supplied from a power source (not shown) connected to the master unit 100.

[0037] The slave unit 200 includes a second control unit 210, a storage unit 220, a calling bell 230, a microphone 240, a speaker 250, a camera 260, a second communication unit 280, and a fourth communication unit 270.

[0038] The second control unit 210 includes a CPU, a memory, etc. (not shown), and is configured to control each component of the slave unit 200. For example, by executing the control program of the slave unit 200 stored in the memory by the CPU, various functions in the slave unit 200 are realized.

[0039] The storage unit 220 is configured to store various data. The storage unit 220 stores, for example, the audio data output from the speaker 250. The storage unit 220 is constituted by, for example, at least a part of a ROM, a RAM, an EEPROM, a hard disk drive, and a solid state drive.

[0040] The calling bell 230 is, for example, a button pressed by a visitor. When the calling bell 230 is pressed by a visitor, a calling signal is transmitted from the slave unit 200 to the master unit 100 via the transmission line L1.

[0041] The microphone 240 is configured to convert the input voice into an analog voice signal. This analog voice signal is converted into a digital voice signal (voice data) by, for example, a voice processing circuit (not shown), and transmitted to the master unit 100.

[0042] The speaker 250 is configured to convert an analog voice signal into voice and output it. For example, the digital voice signal (voice data) received from the master unit 100 is converted into an analog voice signal by a voice processing circuit (not shown), and the speaker 250 converts the analog voice signal into voice and outputs it.

[0043] The camera 260 is configured to capture a moving image and generate image data. When the calling bell 230 is pressed, the image data generated by the camera 260 is transmitted from the slave unit 200 to the master unit 100. The transmitted image is displayed on the display 150 of the master unit 100. In the intercom device 50, the camera 260 constantly captures, for example, an outdoor image. By storing the image data generated through constant capture in the storage unit 220, the intercom device 50 can be provided with the function of a surveillance camera. The camera 260 is composed of, for example, a camera module including an image sensor.

[0044] The second communication unit 280 is configured to communicate with the cloud server 300 and the mobile terminal 400 via the network N1 (Fig. 1). The second communication unit 280 is composed of, for example, a wireless LAN module. The fourth communication unit 270 is configured to transmit and receive control signals to and from the master unit 100 via the transmission line L1. Also, the fourth communication unit 270 is configured to receive power supply from the master unit 100 via the transmission line L1.

[0045] <1-3. Configuration of Cloud Server> Fig. 3 is a block diagram schematically showing the configuration of the cloud server 300. As described above, the cloud server 300 is realized by, for example, a general-purpose computer. As shown in Fig. 3, the cloud server 300 includes a control unit 310, a communication I / F (interface) 330, and a storage unit 320.

[0046] The control unit 310 includes a CPU, a RAM, a ROM, etc. (not shown) and is configured to control each component. The communication I / F 330 is configured to communicate with each of the intercom device 50 and the mobile terminal 400 via the network N1. The communication I / F 330 is composed of, for example, a wired LAN module or a wireless LAN module.

[0047] The storage unit 320 is an auxiliary storage device such as a hard disk drive or a solid state drive, for example. The storage unit 320 stores, for example, a control program. By executing the control program by the CPU of the control unit 310, various functions in the cloud server 300 are realized.

[0048] <1-4. Configuration of Mobile Terminal> FIG. 4 is a block diagram schematically showing the configuration of the mobile terminal 400. As described above, the mobile terminal 400 is constituted by, for example, a smartphone, a tablet, or a mobile PC. As shown in FIG. 4, the mobile terminal 400 includes a control unit 410, a communication I / F 430, a display 450, an operation unit 440, and a storage unit 420.

[0049] The control unit 410 includes a CPU, a RAM, a ROM, etc. (not shown), and is configured to control each component. The communication I / F 430 is configured to communicate with, for example, each of the cloud server 300 and the intercom device 50 via the network N1. The communication I / F 430 is constituted by, for example, a wired LAN module or a wireless LAN module.

[0050] The display 450 is configured to display an image. The display 450 is constituted by, for example, a monitor such as a liquid crystal monitor or an organic EL monitor. The operation unit 440 is configured to receive an operation from the user. The operation unit 440 is constituted by, for example, a part or all of a touch panel, a keyboard, a mouse, and a microphone.

[0051] The storage unit 420 is an auxiliary storage device such as a solid state drive or a hard disk drive, for example. The storage unit 420 is configured to store, for example, a control program. By executing the control program by the CPU of the control unit 410, various functions in the mobile terminal 400 are realized.

[0052] [2. Operations] <2-1. First Voice Output Operation of the Sub-Machine Speaker> In the intercom device 50, in order to prompt an appropriate response to the visitor, a message according to the situation is output from the speaker 250 of the sub-machine 200.

[0053] FIG. 5 is a flowchart showing the operation procedure in the intercom system 10 until the first voice output is performed by the speaker 250. Referring to FIG. 5, the process shown in the left flowchart is executed by the second control unit 210 of the sub-machine 200. The process shown in the central flowchart is executed by the first control unit 110 of the master unit 100. The process shown in the right flowchart is executed by the control unit 310 of the cloud server 300.

[0054] Referring to the left flowchart of FIG. 5, the second control unit 210 of the sub-machine 200 determines whether the call bell 230 installed outdoors (for example, at the entrance) by the visitor has been pressed (step S100). If it is determined that the call bell 230 has not been pressed (NO in step S100), the second control unit 210 waits until the call bell 230 is pressed by the visitor.

[0055] On the other hand, if it is determined that the call bell 230 has been pressed (YES in step S100), the second control unit 210 controls the fourth communication unit 270 to transmit a call signal to the master unit 100 via the transmission line L1 (step S110).

[0056] After that, the second control unit 210 determines whether it has received a control signal for the speaker 250 (hereinafter also referred to as the "speaker control signal") from the master unit 100 via the transmission line L1 (step S120). As types of the speaker control signal, for example, there are a control signal for causing the speaker 250 to output a first message and a control signal for causing the speaker 250 to output a second message. The first message is, for example, a message to be output when the user's mobile terminal 400 is present indoors (when it is highly likely that the user is at home), and the second message is, for example, a message to be output when the mobile terminal 400 is present outdoors (when it is highly likely that the user is not at home).

[0057] As an example of the first message, a message such as "Please wait a moment" can be cited. When the user is at home, the user can often respond immediately to a call from a visitor, so the content of the first message may be concise. On the other hand, as an example of the second message, a message such as "I am out, but I am calling from my mobile phone. Please wait a moment" can be cited. The second message is devised to keep the visitor staying on the spot even if there is no response from the user for a while. Also, in a case where it is not good for crime prevention to know that there is no one indoors, an expression such as "I am calling the user's personal mobile phone. Please wait until it connects" may be used.

[0058] In step S120, if it is determined that the speaker control signal has not been received from the master unit 100 (NO in step S120), the second control unit 210 waits until the speaker control signal is received from the master unit 100. On the other hand, if it is determined that the speaker control signal has been received from the master unit 100 (YES in step S120), the second control unit 210 controls the speaker 250 to output a message corresponding to the received speaker control signal (step S130). That is, the second control unit 210 reads out voice data indicating a message corresponding to the received speaker control signal from the storage unit 220, and controls the speaker 250 to output the message (voice) indicated by the read voice data.

[0059] Next, referring to the flowchart in the center of FIG. 5, the first control unit 110 of the master unit 100 determines whether a call signal has been received from the slave unit 200 via the transmission path L1 (step S200). If it is determined that the call signal has not been received (NO in step S200), the first control unit 110 waits until the call signal is received from the slave unit 200.

[0060] On the other hand, if it is determined that the call signal has been received from the slave unit 200 (YES in step S200), the first control unit 110 controls the first communication unit 180 to transmit a signal for confirming the current position of the user's mobile terminal 400 (hereinafter also referred to as the "confirmation signal") to the cloud server 300 (step S210). The transmission of the confirmation signal to the cloud server 300 is performed via the router 500 and the network N1. Also, information that can identify the user's mobile terminal 400 (hereinafter also referred to as the "terminal identification information") is, for example, registered in the master unit 100 in advance. For example, the terminal identification information is included in the confirmation signal.

[0061] Thereafter, the first control unit 110 determines whether information indicating the current position of the user's mobile terminal 400 (terminal position information) has been received from the cloud server 300 via the first communication unit 180 (step S220). If it is determined that the terminal position information has not been received (NO in step S220), the first control unit 110 waits until the terminal position information is received.

[0062] On the other hand, when it is determined that the terminal position information has been received (YES in step S220), the first control unit 110 controls the third communication unit 170 to transmit a speaker control signal corresponding to the terminal position information to the slave unit 200 (step S230). That is, when the terminal position information indicates that the user's mobile terminal 400 is present indoors, the first control unit 110 transmits a speaker control signal to cause the slave unit 200 to output the first message to the speaker 250 of the slave unit 200. Further, when the terminal position information indicates that the user's mobile terminal 400 is present outdoors, the first control unit 110 transmits a speaker control signal to cause the slave unit 200 to output the second message to the speaker 250 of the slave unit 200.

[0063] Next, referring to the flowchart on the right side of FIG. 5, the control unit 310 of the cloud server 300 determines whether a confirmation signal has been received from the master unit 100 via the network N1 (step S300). When it is determined that the confirmation signal has not been received (NO in step S300), the control unit 310 waits until the confirmation signal is received.

[0064] On the other hand, when it is determined that the confirmation signal has been received (YES in step S300), the control unit 310 controls the communication I / F 330 to transmit the terminal position information regarding the user's mobile terminal 400 to the master unit 100 (step S310). As described above, in the cloud server 300, the IP address information of the user's mobile terminal 400 is periodically collected. In the cloud server 300, the terminal position information may be periodically generated in response to the collection of the IP address information, or may be generated based on the latest IP address information in response to the reception of the confirmation signal from the master unit 100.

[0065] In this way, in the master unit 100, in response to the calling bell 230 being operated by a visitor, communication with the cloud server 300 via the router 500 outside the master unit 100 is performed, and the terminal position information of the user's mobile terminal 400 is acquired from the cloud server 300. Then, in the slave unit 200, a message corresponding to the terminal position information is output from the speaker 250. Therefore, according to the intercom device 50, since a message corresponding to the user's current position is output from the speaker 250, it is possible to prompt the visitor to take an appropriate action according to the user's current position.

[0066] Further, the intercom device 50 outputs different messages (the first message or the second message) from the speaker 250 depending on whether the user is presumed to be present outdoors or indoors. Therefore, according to the intercom device 50, by making the visitor feel that a response will be made immediately from the resident (user), it is possible to prompt the visitor to take an appropriate action according to the user's current position (outdoors or indoors).

[0067] <2-2. Call operation between slave unit and master unit> In the intercom device 50, when the mobile terminal 400 is present indoors (when there is a high possibility that the user is at home), it is possible to set whether to send a call from the slave unit 200 to either the master unit 100 or the mobile terminal 400. When it is set that a call from the slave unit 200 is sent to the master unit 100 when the mobile terminal 400 is present indoors, when the calling bell 230 of the slave unit 200 is pressed by a visitor, the call from the slave unit 200 is sent to the master unit 100.

[0068] FIG. 6 is a flowchart showing the operation procedure in the intercom device 50 until a call operation between the slave unit 200 and the master unit 100 is performed. The processes shown in this flowchart are executed after the master unit 100 receives the terminal position information from the cloud server 300 in step S220 of FIG. 5, when (1) the terminal position information indicates that the user's mobile terminal 400 exists indoors, and (2) the intercom device 50 is set to send a call from the slave unit 200 to the master unit 100 when the mobile terminal 400 exists indoors. For example, after the master unit 100 receives the terminal position information from the cloud server 300, if the first control unit 110 of the master unit 100 determines that the above (1) and (2) are satisfied, and the determination result is transmitted from the master unit 100 to the slave unit 200, the processes shown in this flowchart are executed.

[0069] Referring to FIG. 6, the processes shown in the flowchart on the left side are executed by the second control unit 210 of the slave unit 200, and the processes shown in the flowchart on the right side are executed by the first control unit 110 of the master unit 100.

[0070] Referring to the flowchart on the left side of FIG. 6, the second control unit 210 of the slave unit 200 controls the second communication unit 280 to transmit the image data generated by the camera 260 to the master unit 100 via wireless communication (step S400). For example, the image data is transmitted from the slave unit 200 to the master unit 100 via the router 500 and the network N1. Thereby, the image data generated by photographing the visitor who pressed the call bell 230 is transmitted from the slave unit 200 to the master unit 100 via wireless communication.

[0071] Thereafter, the second control unit 210 determines whether it has received a call start signal from the master unit 100 via the transmission line L1 (step S410). As will be described later, the call start signal is transmitted from the master unit 100 to the slave unit 200 via the transmission line L1 when a predetermined operation (for example, pressing a physical button) is performed by the user via the operation unit 160 of the master unit 100.

[0072] When it is determined that the call start signal has not been received (NO in step S410), the second control unit 210 waits until the call start signal is received. On the other hand, when it is determined that the call start signal has been received (YES in step S410), the second control unit 210 executes processing for starting a call via wireless communication (step S460). In the call in step S460, both transmission and reception of voice data and image data are performed via wireless communication. Note that the transmission and reception of voice data may be performed via the transmission path L1, and only the transmission and reception of image data may be performed via wireless communication.

[0073] Next, referring to the flowchart on the right side of FIG. 6, the first control unit 110 of the master unit 100 determines whether image data has been received from the slave unit 200 via wireless communication (step S420). When it is determined that the image data has not been received from the slave unit 200 (NO in step S420), the first control unit 110 waits until the image data is received from the slave unit 200.

[0074] On the other hand, when it is determined that the image data has been received from the slave unit 200 (YES in step S420), the first control unit 110 controls the display 150 to start outputting the moving image indicated by the received image data (step S430).

[0075] The first control unit 110 determines whether a call start instruction from the user has been received (step S440). For example, it is determined whether a predetermined operation (for example, pressing a physical button) has been performed by the user via the operation unit 160. When it is determined that a call start instruction from the user has not been received (NO in step S440), the first control unit 110 waits until a call start instruction from the user is received.

[0076] On the one hand, when it is determined that a call start instruction from the user is received (YES in step S440), the first control unit 110 controls the third communication unit 170 to transmit a call start signal to the slave unit 200 via the transmission line L1 (step S450). Thereafter, the first control unit 110 executes processing for starting a call via wireless communication (step S460).

[0077] FIG. 7 is a diagram showing how transmission and reception between the slave unit 200 and the master unit 100 are performed. As shown in FIG. 7, transmission and reception of various control signals between the slave unit 200 and the master unit 100 are performed via the transmission line L1. Also, power supply from the master unit 100 to the slave unit 200 is performed via the transmission line L1. The master unit 100 receives power supply from a power source (not shown) and supplies a part of the supplied power to the slave unit 200 via the transmission line L1. Further, transmission and reception of each of image data and audio data between the slave unit 200 and the master unit 100 are performed via wireless communication.

[0078] Thus, in the intercom device 50, transmission and reception of image data between the master unit 100 and the slave unit 200 are not performed via the two-wire transmission line L1, but are performed via wireless communication between the first communication unit 180 and the second communication unit 280. Therefore, according to the intercom device 50, since transmission and reception of image data are performed by a communication means (wireless communication) having a relatively large communication bandwidth, transmission and reception of image data between the master unit 100 and the slave unit 200 can be performed smoothly.

[0079] <2-3. Call operation between slave unit and mobile terminal> As described above, in the intercom device 50, it is possible to set whether to send a call from the slave unit 200 to either the master unit 100 or the mobile terminal 400 when the mobile terminal 400 is present indoors. When it is set that a call from the slave unit 200 is sent to the mobile terminal 400 in a state where the mobile terminal 400 is present indoors, or when the mobile terminal 400 is present outdoors, when the call bell 230 of the slave unit 200 is pressed by a visitor, the call from the slave unit 200 is sent to the mobile terminal 400.

[0080] FIG. 8 is a flowchart showing an operation procedure in the intercom system 10 until a call operation between the slave unit 200 and the mobile terminal 400 is performed. The processes shown in this flowchart are as follows: after the master unit 100 receives terminal position information from the cloud server 300 in step S220 of FIG. 5, (A) the terminal position information indicates that the user's mobile terminal 400 exists indoors, and (B) when the mobile terminal 400 exists indoors and the setting to send a call from the slave unit 200 to the mobile terminal 400 is made in the intercom device 50, or (C) when the terminal position information indicates that the user's mobile terminal 400 exists outdoors.

[0081] For example, after the master unit 100 receives terminal position information from the cloud server 300, it is determined by the first control unit 110 of the master unit 100 that (A) and (B) are satisfied, or (C) is satisfied. After the determination result is transmitted from the master unit 100 to the slave unit 200, the processes shown in this flowchart are executed.

[0082] Referring to FIG. 8, the processes shown in the left flowchart are executed by the second control unit 210 of the slave unit 200, and the processes shown in the right flowchart are executed by the control unit 410 of the mobile terminal 400.

[0083] Referring to the left flowchart of FIG. 8, the second control unit 210 of the slave unit 200 controls the second communication unit 280 to transmit the image data generated by the camera 260 to the mobile terminal 400 via wireless communication (step S500). For example, the image data is transmitted from the slave unit 200 to the mobile terminal 400 via the router 500 and the network N1. Thereby, the image data generated by photographing the visitor who pressed the call bell 230 is transmitted from the slave unit 200 to the mobile terminal 400 via wireless communication.

[0084] After that, the second control unit 210 determines whether a call start signal has been received from the master unit 100 via the transmission line L1 (step S510). As will be described later, the call start signal is transmitted from the mobile terminal 400 to the master unit 100 via wireless communication when a predetermined operation (for example, touching a predetermined area of the display 450) is performed by the user via the operation unit 440 of the mobile terminal 400, and then transmitted from the master unit 100 to the slave unit 200 via the transmission line L1. Note that the call start signal does not necessarily need to be transmitted from the mobile terminal 400 to the slave unit 200 via the master unit 100. For example, it may be directly transmitted from the mobile terminal 400 to the slave unit 200 via wireless communication.

[0085] When it is determined that the call start signal has not been received (NO in step S510), the second control unit 210 waits until the call start signal is received. On the other hand, when it is determined that the call start signal has been received (YES in step S510), the second control unit 210 executes processing for starting a call via wireless communication (step S560). In the call in step S560, both transmission and reception of audio data and image data are performed via wireless communication.

[0086] Next, referring to the flowchart on the right side of FIG. 8, the control unit 410 of the mobile terminal 400 determines whether image data has been received from the slave unit 200 via wireless communication (step S520). When it is determined that the image data has not been received from the slave unit 200 (NO in step S520), the control unit 410 waits until the image data is received from the slave unit 200.

[0087] On the other hand, when it is determined that the image data has been received from the slave unit 200 (YES in step S520), the control unit 410 starts an application (hereinafter also referred to as a "dedicated application") for realizing the mobile terminal operations required in the intercom system 10, and controls the display 450 to start outputting the moving image indicated by the received image data (step S530).

[0088] The control unit 410 determines whether or not it has received a call start instruction from the user (step S540). For example, it is determined whether or not a predetermined operation (e.g., touching a predetermined area of the display 450) has been performed by the user via the operation unit 440. If it is determined that the call start instruction from the user has not been received (NO in step S540), the control unit 410 waits until it receives the call start instruction from the user.

[0089] On the other hand, if it is determined that the call start instruction from the user has been received (YES in step S540), the control unit 410 controls the communication I / F 430 to transmit a call start signal to the slave unit 200 via the transmission path L1 via the master unit 100 (step S550). Thereafter, the control unit 410 executes processing for starting a call via wireless communication (step S560).

[0090] As described above, in the intercom device 50, when it is shown by the terminal position information that the mobile terminal 400 exists indoors (when it is estimated that the user exists indoors), it is possible to set whether to transmit the image data from the slave unit 200 to the master unit 100 or from the slave unit 200 to the mobile terminal 400. Therefore, according to the intercom device 50, by setting so that the image data is transmitted from the slave unit 200 to the mobile terminal 400 when it is estimated that the user exists indoors, even if the user is not near the master unit 100 indoors (for example, when the master unit is installed on the first floor indoors and the user is on the second floor), the user can easily communicate with the visitor via the mobile terminal 400.

[0091] <2-4. Second voice output operation in the speaker of the slave unit> As described above, in the intercom device 50, in order to prompt an appropriate response to the visitor, a message according to the situation is output from the speaker 250 of the slave unit 200. The second voice output operation is an operation that is particularly effective when the visitor is a delivery company.

[0092] FIG. 9 is a flowchart showing the operation procedure in the intercom system 10 until the second voice output is performed in the speaker 250. Referring to FIG. 9, the process shown in the left flowchart is executed by the second control unit 210 of the slave unit 200. The process shown in the right flowchart is executed by the control unit 410 of the mobile terminal 400. As described above, the camera 260 constantly captures an outdoor image, for example.

[0093] Referring to the left flowchart of FIG. 9, the second control unit 210 of the slave unit 200 determines whether a visitor (for example, a delivery person) has been photographed by the camera 260 (step S600). The second control unit 210 determines whether a visitor has been photographed by the camera 260, for example, based on whether a moving subject of a predetermined area or more has been photographed by the camera 260. When it is determined that the visitor has not been photographed by the camera 260 (NO in step S600), the second control unit 210 waits until it is determined that the visitor has been photographed by the camera 260.

[0094] On the other hand, when it is determined that the visitor has been photographed by the camera 260 (YES in step S600), the second control unit 210 starts recording the image photographed by the camera 260 in the storage unit 220 (step S610). Further, the second control unit 210 controls the second communication unit 280 to transmit the image data generated by the camera 260 to the mobile terminal 400 via wireless communication (step S620).

[0095] Thereafter, the second control unit 210 determines whether it has received a speaker control signal from the master unit 100 via the transmission line L1 (step S630). As will be described later, the speaker control signal is transmitted from the mobile terminal 400 to the master unit 100 via wireless communication when a predetermined operation (for example, touching a predetermined area of the display 450) is performed by the user via the operation unit 440 of the mobile terminal 400, and then transmitted from the master unit 100 to the slave unit 200 via the transmission line L1. Note that the speaker control signal does not necessarily have to be transmitted from the mobile terminal 400 to the slave unit 200 via the master unit 100. For example, it may be directly transmitted from the mobile terminal 400 to the slave unit 200 via wireless communication.

[0096] Examples of the types of the speaker control signal include a control signal for causing the speaker 250 to output a third message and a control signal for causing the speaker 250 to output a fourth message. The third message is, for example, a message to be output when the visitor is a delivery company, and the fourth message is, for example, a message to be output when the visitor is not a delivery company. Note that when the visitor is not a delivery company, no message may be output from the speaker 250.

[0097] An example of the third message is a message such as "Please put the package in the delivery box placed outdoors". On the other hand, an example of the fourth message is a message such as "You may have the wrong destination. Please check the destination again". These messages are, for example, messages that prompt appropriate actions for the delivery company.

[0098] In step S630, if it is determined that the speaker control signal has not been received from the master unit 100 (NO in step S630), the second control unit 210 waits until the speaker control signal is received from the master unit 100. On the other hand, if it is determined that the speaker control signal has been received from the master unit 100 (YES in step S630), the second control unit 210 controls the speaker 250 to output a message according to the received speaker control signal (step S640). That is, the second control unit 210 reads out audio data indicating the message according to the received speaker control signal from the storage unit 220, and controls the speaker 250 to output the message (voice) indicated by the read audio data.

[0099] Next, referring to the flowchart on the right side of FIG. 9, the control unit 410 of the mobile terminal 400 determines whether image data has been received from the slave unit 200 via wireless communication (step S700). If it is determined that the image data has not been received from the slave unit 200 (NO in step S700), the control unit 410 waits until the image data is received from the slave unit 200.

[0100] On the other hand, if it is determined that the image data has been received from the slave unit 200 (YES in step S700), the control unit 410 starts a dedicated application and controls the display 450 to start outputting the moving image indicated by the received image data (step S710).

[0101] FIG. 10 is a diagram showing an example of an image displayed in step S710 of FIG. 9. As shown in FIG. 10, on the display 450, the captured image of the camera 260 is displayed in the area T1, and the icons U1 and U2 are displayed at the lower part of the area T2 surrounding the area T1. The icon U1 is an icon that the user should touch when the subject shown in the captured image is a delivery company. That is, the icon U1 is an icon for the user to confirm that the subject is a delivery company and indicate that the user permits the loading of the package into the delivery box. On the other hand, the icon U2 is an icon that the user should touch when the subject shown in the captured image is not a delivery company. That is, the icon U2 is an icon for the user to confirm that the subject is not a delivery company and indicate that the user does not permit the loading of the package into the delivery box.

[0102] Referring again to the flowchart on the right side of FIG. 9, the control unit 410 determines whether it has received a selection (touch) of an icon (icon U1 or icon U2) by the user via the operation unit 440 (step S720). If it is determined that the selection of the icon by the user has not been received (NO in step S720), the control unit 410 waits until it receives the selection of the icon by the user.

[0103] On the other hand, when it is determined that the user has selected an icon (YES in step S720), the control unit 410 controls the communication I / F 430 to transmit a speaker control signal to the slave unit 200 via the transmission path L1 through the master unit 100 (step S730). For example, when the icon U1 is selected by the user, the control unit 410 performs control to transmit a speaker control signal (permission signal) for causing the speaker 250 to output the third message to the master unit 100. Also, when the icon U2 is selected by the user, the control unit 410 performs control to transmit a speaker control signal (non - permission signal) for causing the speaker 250 to output the fourth message to the master unit 100. Each speaker control signal transmitted to the master unit 100 is transmitted to the slave unit 200 via the transmission path L1. That is, the first control unit 110 of the master unit 100 controls the third communication unit 170 to transmit the received speaker control signal (permission signal or non - permission signal) to the slave unit 200 via the transmission path L1.

[0104] In this way, in the intercom device 50, according to the signal (permission signal or non - permission signal) received from the mobile terminal 400, a message indicating an instruction to the delivery company is output from the speaker 250. Therefore, according to the intercom device 50, for example, by appropriately operating the mobile terminal 400 with reference to the image displayed on the mobile terminal 400 (for example, the image shown in FIG. 10), the delivery company can be appropriately instructed.

[0105] [3. Features] As described above, in the intercom device 50 according to the present embodiment, in response to the call bell 230 being operated by the visitor, a message corresponding to the terminal position information of the user's mobile terminal 400 is output from the speaker 250. Therefore, according to the intercom device 50, since a message corresponding to the user's current position is output from the speaker 250, it is possible to prompt the visitor to take an appropriate action according to the user's current position.

[0106] [4. Modification Example] Although the embodiments have been described above, the present invention is not limited to the above embodiments, and various modifications are possible without departing from the spirit thereof. Hereinafter, modified examples will be described.

[0107] <4-1> In the intercom system 10 according to the above embodiment, generation of terminal position information based on the IP address information of the mobile terminal 400 was performed in the cloud server 300. However, generation of the terminal position information does not necessarily have to be performed in the cloud server 300. For example, in response to the call bell 230 being operated by a visitor, the IP address information of the user's mobile terminal 400 may be transmitted from the cloud server 300 to the master unit 100, and the terminal position information may be generated in the master unit 100 based on the IP address information. Also, in the master unit 100, the content of the speaker control signal may be determined based on the IP address information transmitted from the cloud server 300 without generating the terminal position information.

[0108] <4-2> Also, in the intercom device 50 according to the above embodiment, the audio data output from the speaker 250 of the slave unit 200 was stored in the storage unit 220. However, the audio data output from the speaker 250 does not necessarily have to be stored in the storage unit 220. For example, the audio data output from the speaker 250 may be stored in the storage unit 120 of the master unit 100. In this case, the speaker control signal transmitted from the master unit 100 to the slave unit 200 will include an audio signal.

[0109] <4-3> Also, in the intercom device 50 according to the above embodiment, the wireless communication between the first communication unit 180 of the master unit 100 and the second communication unit 280 of the slave unit 200 is performed via the router 500 and the network N1. However, the wireless communication between the first communication unit 180 of the master unit 100 and the second communication unit 280 of the slave unit 200 does not necessarily have to be performed via the router 500 and the network N1. For example, the master unit 100 and the slave unit 200 may be paired in advance, and wireless communication between the first communication unit 180 and the second communication unit 280 may be realized by a communication method that does not use the network N1 such as Bluetooth (registered trademark).

Explanation of Signs

[0110] 10 Intercom system, 50 Intercom device, 100 Master unit, 110 First control unit, 120, 220, 320, 420 Storage unit, 130, 240 Microphone, 140, 250 Speaker, 150, 450 Display, 160, 440 Operation unit, 170 Third communication unit, 180 First communication unit, 200 Slave unit, 210 Second control unit, 230 Call bell, 260 Camera, 270 Fourth communication unit, 280 Second communication unit, 300 Cloud server, 310, 410 Control unit, 330, 430 Communication I / F, 400 Mobile terminal, 500 Router, L1 Transmission path, N1 Network, T1, T2 Area, U1, U2 Icon.

Claims

1. An intercom device configured to communicate with a cloud server that collects the IP (Internet Protocol) address of a user's mobile terminal, including a calling bell and a speaker, and a slave unit installed outdoors, comprising a master unit connected to the slave unit and installed indoors, wherein the master unit, in response to the operation of the calling bell, communicates with the cloud server via a router outside the master unit to obtain the IP address or terminal location information generated based on the IP address, a first communication unit; a first control unit that transmits a control signal to the slave unit to cause the speaker to output a message corresponding to the IP address or the terminal location information obtained by the first communication unit, wherein the first control unit, when the IP address is a private IP address, or when the terminal location information indicates that the mobile terminal is present indoors, transmits a control signal to the slave unit to cause the speaker to output a first message, while when the IP address is a global IP address, or when the terminal location information indicates that the mobile terminal is present outdoors, transmits a control signal to the slave unit to cause the speaker to output a second message, an intercom device.

2. The slave unit, further includes a camera that photographs the outdoors and generates image data, and a second communication unit that wirelessly communicates with the first communication unit of the master unit, wherein the master unit is connected to the slave unit via a two-wire transmission line, and between the master unit and the slave unit, power and control signals are transmitted and received via the transmission line, and the image data is transmitted and received via the wireless communication between the first and second communication units. The intercom device according to claim 1.

3. The second communication unit is capable of wireless communication with the mobile terminal, the slave unit further includes a second control unit that controls the second communication unit, in the master unit, when the IP address is a private IP address, or when the terminal location information indicates that the mobile terminal is present indoors, it is possible to set whether to transmit the image data from the slave unit to the master unit or from the slave unit to the mobile terminal. The intercom device according to claim 2, wherein the second control unit controls the second communication unit to transmit the image data to a transmission destination according to the content of the setting.

4. When a permission signal or a non - permission signal is received from the mobile terminal via the first communication unit in response to the transmission of the image data to the mobile terminal, the first control unit transmits a control signal for causing the slave unit to output a message indicating an instruction to the delivery service provider to the speaker according to the received signal. The intercom device according to claim 3.

5. A control method for an intercom device configured to communicate with a cloud server that collects the IP (Internet Protocol) address of a user's mobile terminal, wherein the intercom device has a calling bell and a speaker, and a slave unit installed outdoors, and a master unit connected to the slave unit and installed indoors, and the control method of the intercom device includes a step of causing the master unit to acquire the IP address or terminal position information generated based on the IP address by communicating with the cloud server via a router outside the master unit in response to the operation of the calling bell; a step of transmitting a control signal for causing the slave unit to output a first message to the speaker when the acquired IP address is a private IP address or when the acquired terminal position information indicates that the mobile terminal is present indoors; a step of transmitting a control signal for causing the slave unit to output a second message to the speaker when the acquired IP address is a global IP address or when the acquired terminal position information indicates that the mobile terminal is present outdoors. A control method for an intercom device.

Images