Communication System

Abstract

To provide a high value-added communication system by integrating an IP call system and a monitoring camera system.SOLUTION: A communication system 1 includes: an IP call system 10 comprising a plurality of call terminals and transmitting / receiving voice data and video data using a call protocol between the call terminals over an IP network; a system manager which controls transmitting / receiving the voice data and the video data; and a monitoring camera system 40 including a monitoring camera 41. A video captured by the monitoring camera can be displayed on a display of a call terminal. When another call terminal or an IP speaker is selected and called from one call terminal belonging to the IP call system, the IP speaker being able to receive voice data using the call protocol, the system manager specifies one monitoring camera disposed near the other call terminal or the IP speaker and displays a video captured by the specified monitoring camera on the display of the one call terminal.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a communication system that can integrate and operate in-house calls using intercoms and IP speakers, loudspeakers, video monitoring using a surveillance camera system, video recording, and the like. [Background technology]

[0002] An intercom system (IP call system) is a system primarily used for internal calls. Typically, an intercom system includes one or more call terminals and one or more public address devices such as speakers. Each call terminal is equipped with a microphone and a speaker and is interconnected via a network. Each call terminal transmits input audio to another call terminal in accordance with a predetermined protocol such as the SIP protocol to perform internal calls. Each call terminal also transmits input audio to the public address device, amplifying the audio from the public address device.

[0003] Surveillance camera systems are systems primarily used for crime prevention. Typically, a surveillance camera system includes one or more surveillance cameras and a recorder to which each surveillance camera is connected. Each surveillance camera may be installed in a predetermined location, such as on a ceiling or wall, or may be mounted on a mobile object, such as a drone or automobile. The recorder receives footage captured by the surveillance camera and stores it on an internal or external recording medium, allowing for live viewing by outputting the footage to an external display in real time.

[0004] An example of an intercom system is disclosed in Patent Document 1. An example of a surveillance camera system is disclosed in Patent Document 2. [Patent Document 1] JP 2006-114951 [Patent Document 2] Patent Publication No. 2009-296207 Summary of the Invention [Problem to be solved by the invention]

[0005] The present disclosure aims to provide a communication system with higher added value by combining an IP call system and a surveillance camera system. [Means for solving the problem]

[0006] A communication system according to a first aspect of the present disclosure includes an IP call system including a plurality of call terminals, each connected to an IP network and each having a microphone, a speaker, and a display, and performing transmission and reception processing of audio data and video data using a call protocol between the call terminals via the IP network; a system manager that is connected to the IP network separately from the call terminals and that controls transmission and reception of audio data and video data between the call terminals using the call protocol; a surveillance camera system including a surveillance camera connected to an IP network; Equipped with The video captured by the surveillance camera can be displayed on the display of the call terminal, When one call terminal belonging to the IP call system selects and calls another call terminal or an IP speaker capable of receiving audio data using the call protocol, the system manager identifies one surveillance camera located near the other call terminal or the IP speaker, and displays the image captured by the identified surveillance camera on the display of the one call terminal.

[0007] A communication system according to a second aspect of the present disclosure includes: an IP call system including a plurality of call terminals each connected to an IP network and each having a microphone, a speaker, and a display, and performing transmission and reception processing of audio data and video data using a call protocol between the call terminals via the IP network; a system manager that is connected to the IP network separately from the call terminals and that controls transmission and reception of audio data and video data between the call terminals using the call protocol; a surveillance camera system including a surveillance camera connected to an IP network; Equipped with The video captured by the surveillance camera can be displayed on the display of the call terminal, When a call or broadcast is selected on one of the call terminals belonging to the IP call system while the video being captured by a surveillance camera is displayed on the display of the call terminal, the system manager identifies other call terminals belonging to the IP call system that are located in the vicinity of the surveillance camera and that are capable of receiving audio data using the call protocol, and places a call to the identified call terminal or IP speaker. [Effects of the Invention]

[0008] The communication system of the present disclosure allows users to use surveillance camera images on their call terminals, allowing them to use the IP call system more conveniently and efficiently. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of a communication system 1 according to the first embodiment. [Figure 2] FIG. 2 is a schematic diagram of a network N including a LAN and a WAN. [Figure 3] FIG. 3 is a diagram showing an example of the configuration of the call terminal 11. As shown in FIG. [Figure 4] FIG. 4 is a diagram showing the appearance of the call terminal 11. As shown in FIG. [Figure 5A] FIG. 5A is an example of a management information table for each terminal managed by the system manager 20 of the first embodiment. [Figure 5B] FIG. 5B is another example of a management information table for each terminal managed by the system manager 20 of the first embodiment. [Figure 6] FIG. 6 is an example of a management information table for each terminal managed by the system manager 20 of the second embodiment. [Figure 7] FIG. 7 is a flowchart showing a basic call flow using the IP call system 10. [Figure 8] FIG. 8 is a diagram showing an example of a display on the display 113 of the call terminal 11. As shown in FIG. [Figure 9A] FIG. 9A is a flowchart showing an example of a method for using camera images from a monitoring camera 41a located around the second call terminal 11b when making a call from the first call terminal 11a to the second call terminal 11b in the first embodiment. [Figure 9B] FIG. 9B is a flowchart showing an example of a method for using camera footage from a monitoring camera 41a located around the second calling terminal 11b when making a call from the first calling terminal 11a to the second calling terminal 11b in modified embodiment 1A. [Figure 10] FIG. 10 is a diagram showing an example of a display on the display 113 of the call terminal 11. As shown in FIG. [Figure 11] FIG. 11 is a diagram showing an example of a display on the display 113 of the call terminal 11. As shown in FIG. [Figure 12A] FIG. 12A is a diagram showing an example of a display on the display 113 of the call terminal 11. As shown in FIG. [Figure 12B] FIG. 12B is a diagram showing an example of a display on the display 113 of the call terminal 11. As shown in FIG. [Figure 13] FIG. 13 is a diagram showing a schematic configuration of a communication system 1a according to the second embodiment. [Figure 14] FIG. 14 is a flowchart showing an example of a method for using camera images from a monitoring camera 41a positioned around an IP speaker 51a when loudspeaker broadcasting is performed from the first call terminal 11a to the IP speaker 51 in the second embodiment. [Figure 15]FIG. 15 is a flowchart showing an example of a method for using camera images from a monitoring camera 41a positioned around an IP speaker 51a when loudspeaker broadcasting is performed from the first call terminal 11a to the IP speaker 51a in the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] 1. First embodiment (1) Configuration of the communication system 1 of the first embodiment 1, the communication system 1 of this embodiment includes an IP call system 10, a system manager 20, and a surveillance camera system 40. The IP call system 10, the system manager 20, and the surveillance camera system 40 are interconnected via a network N.

[0011] The IP call system 10 includes a plurality of call terminals 11. Each call terminal 11 is a terminal that performs voice calls, and has the function of performing voice calls by transmitting and receiving voice data to and from other call terminals 11 via a network N. Each call terminal 11 is assigned an identifier (e.g., an IP address) that uniquely identifies it on the network N. During a voice call, the call terminal 11 transmits and receives audio data and video data in accordance with a protocol for IP calls. One example of a protocol for IP calls is the Session Initiation Protocol (SIP), which is standardized by the Internet Engineering Task Force (IETF) and specified in RFC3261.

[0012] The system manager 20 is a control device that allows the call terminal 11 to perform transmission and reception processing of audio data and video data in accordance with an IP call protocol. The transmission and reception processing includes call control such as making calls. For example, the system manager 20 is a SIP server that performs call control in accordance with SIP. The system manager 20 is assigned an identifier (for example, an IP address) that uniquely identifies itself on the network.

[0013] The surveillance camera system 40 is a system for monitoring a predetermined area (monitoring area) for security purposes, etc., and includes one or more surveillance cameras 41 and a recorder 42. Each surveillance camera 41 generates video data from a video signal acquired by an image sensor such as a CCD or CMOS, and transmits the video data to an external device. The surveillance camera 41 transmits video streaming in accordance with a transmission protocol for the surveillance camera system. An example of a transmission protocol for the surveillance camera system is a protocol conforming to the ONVIF (Open Network Video Interface Forum) standard. Each surveillance camera 41 is assigned an identifier (e.g., an IP address) that uniquely identifies it on the network. The surveillance camera 41 and the recorder 42 are recording devices equipped with a recording medium such as an HDD or SSD, and have the function of recording video data transmitted from the connected surveillance camera 41. The recorder 42 receives and records video data in accordance with the transmission protocol for the surveillance camera system, just like the surveillance camera 41. The recorder 42 is assigned a unique identification information (e.g., an IP address) on the network. The recorder 42 has a function for receiving audio input via a microphone, generating audio data from the audio input from the microphone, and transmitting the audio data to an external device. The recorder 42 transmits the audio data in accordance with a transmission protocol for a surveillance camera system. The surveillance camera system 40 may be managed in an integrated manner by a VMS (Video Management System). When managed in an integrated manner by a VMS, the surveillance camera 41 and the recorder 42 are controlled and managed by VMS software installed on a PC (Personal Computer). When managed in an integrated manner by a VMS, the recorder 42 may be a PC on which VMS software is installed and which is equipped with a recording medium such as an HDD or SSD, and in this case, the audio data of the audio input from the microphone equipped on the PC is transmitted to an external device.

[0014] The surveillance camera 41 comprises a processing unit including a CPU, an MPU, etc., and a memory that stores computer programs that can be executed by the processing unit. The processing unit executes the computer programs stored in the memory to realize various functions of the surveillance camera 41. The computer programs stored in the memory include program instructions that execute various functions, such as an event detection function.

[0015] The recorder 42 includes a processing unit including a CPU, an MPU, etc., and a memory that stores computer programs that can be executed by the processing unit. The processing unit executes the computer programs stored in the memory to realize various functions of the recorder 42. The computer programs stored in the memory include program instructions that execute various functions, such as a recording function and an event detection function.

[0016] As shown in FIG. 2, the network N may be configured via multiple local area networks (LANs) and a wide area network (WAN) such as the Internet that interconnects these networks. The IP call system 10, the system manager 20, and the surveillance camera system 40 are each configured on a LAN and interconnected. In this configuration, various communications can be performed across multiple LANs, such as voice calls between communication terminals 11 in different IP call systems 10. When the IP call system 10 is configured on a LAN, the communication terminals 11 may be connected to a router constituting the LAN via an Ethernet cable, transmit audio data via the Ethernet cable, and be supplied with power via PoE (Power over Ethernet) via the Ethernet cable. When the surveillance camera system 40 is configured on a LAN, the surveillance cameras 41 and recorders 42 may be connected to a router constituting the LAN via an Ethernet cable, transmit video data via the Ethernet cable, and be supplied with power via PoE via the Ethernet cable.

[0017] The following description will be given using an example in which SIP is used as the IP call protocol and the ONVIF protocol is used as the transmission protocol for the surveillance camera system.

[0018] As shown in Fig. 3, the communication terminal 11 includes a microphone 110, a speaker 111, a camera 112, a display 113, an input unit 114, a processing unit 116, and a memory 117. The microphone 110 is an electro-acoustic transducer whose sound collection direction faces outward from the housing of the communication terminal 11, and collects the voice of a speaker speaking to the communication terminal 11 and outputs an audio signal. The speaker 111 is an electro-acoustic transducer whose sound emission direction faces outward from the housing of the communication terminal 11, and outputs audio obtained by playing back audio data. The camera 112 is an imaging device including an imaging element such as a CCD image sensor or a CMOS image sensor, and its imaging direction faces outward from the housing of the communication terminal 11 in a direction that captures the figure of the speaker speaking to the communication terminal 11. The camera 112 generates and outputs video data of still images or videos from the video signal obtained by capturing an image. The display 113 is a display including a display element such as an LCD or an organic EL, and displays images captured by the camera 112 of the call terminal 11 or other call terminals 11, as well as other images related to GUIs and the like. The input unit 114 is an input device that accepts user operations, such as buttons or switches. The input unit 114 and the display 113 may be integrated to form a touch panel. The call terminal 11 can take various forms, such as a desk-top type, a wall-mounted type, or a wall-embedded type. The call terminal 11 is a call device that can be called a speakerphone, an interphone, or an intercom.

[0019] Fig. 4 is an external view showing one configuration of communication terminal 11. Communication terminal 11 has camera 12, display 113, input unit 114, and handset 115. Handset 115 includes microphone 110 and speaker 111. Communication terminal 11 in Fig. 4 includes microphone 110 and speaker 111 in addition to handset 115, and is capable of collecting and emitting sound even when handset 115 is placed on the main body, and is used, for example, for hands-free communication without using handset 115.

[0020] In the call terminal 11, the processing unit 116 includes a CPU (Central Processing Unit), an MPU (Micro Processing Unit), etc. The memory 117 stores computer programs that can be executed by the processing unit 116. The various functions of the call terminal 11 are realized by the processing unit 116 executing the computer programs stored in the memory 117. The computer programs stored in the memory 117 include program instructions that execute the various functions described above, such as a call function, a recording function, an event detection function, an AI-based determination function, a loudspeaker function, a real-time broadcast function, a recorded broadcast function, a download broadcast function, and a simultaneous broadcast function.

[0021] (2) Basic calling method using IP calling system 10 The basic method of SIP calling will be explained using the flowchart in FIG.

[0022] The system manager 20 has a SIP server function and performs call control. As shown in Figures 5A and 5B, the system manager 20 manages information about each terminal (such as the call terminal 11 and the monitoring camera 41) in the communication system 1 in a table. Here, the information about each terminal is the "IP address" and the "name" of the location where each terminal is located.

[0023] The name of each terminal may be arbitrarily input by the user from the input unit 114 of each call terminal 11.

[0024] The names of the respective terminals may be the same for the call terminal 11 and the camera 41 as shown in FIG. 5A, or may be different for the call terminal 11 and the camera 41 as shown in FIG. 5B.

[0025] Hereinafter, an example will be described in which a call originates from a call terminal (first call terminal 11a) named "2nd Floor North" and a call destination is a call terminal (second call terminal 11b) named "1st Floor Lobby."

[0026] The user first attempts to make a call from the first call terminal 11a located on the "second floor north" to the second call terminal 11b located in the "first floor lobby," and selects "first floor lobby" on the display screen (see FIG. 8) of the display 113 of the first call terminal 11a. In response to the user's selection, the first call terminal 11a places a call to the system manager 20 (S101). In response to the call to the first call terminal 11a, the system manager 20 relays the call to the second call terminal 11b located in the "first floor lobby" (S102). When the second call terminal 11b answers the call, a call session is initiated between the first call terminal 11a and the second call terminal 11b (S103). A call session refers to a state of the IP call system 10 that enables a call between the user of the first call terminal 11a and the user of the second call terminal 11b.

[0027] (3) Communication method using the IP communication system 10 and the surveillance camera system 40 in cooperation with each other A communication method using the IP call system 10 and the monitoring camera system 40 in cooperation with each other in the communication system 1 of this embodiment will be described with reference to the flowchart of FIG. 9A.

[0028] The communication terminals 11 or cameras 41 of the communication system 1 are installed in multiple locations in the building. Here, it is assumed that the locations where the communication terminals 11 or cameras 41 are installed are the first floor lobby and the second floor north. This communication method is for the case where, when a call is made from a first communication terminal 11a installed on the "second floor north" to a second communication terminal 11b installed on the "first floor lobby," camera images from surveillance cameras located around the communication terminal in the "first floor lobby" are used.

[0029] The user first attempts to call the second call terminal 11b in the "first floor lobby" from the first call terminal 11a in the "second floor north" (the call origin), and selects "first floor lobby" on the display screen of the display 113 of the first call terminal 11a (see FIG. 8). In response to the user's input, the first call terminal 11a makes an inquiry to the system manager 20 (S201). The system manager 20, upon receiving the notification, identifies a surveillance camera likely to be located around the second call terminal 11b in the selected "first floor lobby" and notifies the first call terminal 11a of the address of the camera 41a (S202). The first call terminal 11a, upon receiving the notification, sends a video request to the camera 41a in the "first floor lobby" (S203). The camera 41a, upon receiving the video request from the first call terminal 11a, sends the camera video it is currently capturing to the first call terminal 11a using the ONVIF protocol (S204). The transmitted live image from the camera 41a is displayed on the display 113 of the first call terminal 11a (FIG. 10).

[0030] A user on the "second floor north" makes a call to a user in the "1st floor lobby" using the first and second call terminals 11a and 11b while viewing the camera image of the "1st floor lobby." Specifically, the user selects a call to the "1st floor lobby" on the first call terminal 11a. In response to the user's input, the first call terminal 11a makes a call to the system manager 20 (S205). In response to the call to the first call terminal 11a, the system manager 20 relays the call to the second call terminal 11b in the "1st floor lobby" (S206). When the second call terminal 11b answers the call, a call session is initiated between the first call terminal 11a and the second call terminal 11b (S207).

[0031] 5A, there may be a case where there are multiple cameras 41 with the name "1st Floor Lobby" in the table that manages information about each terminal. In this case, the system manager 20 may select one or multiple cameras from the multiple cameras 41 in the "1st Floor Lobby." When multiple cameras are selected, the image displayed on the display 113 of the first call terminal 11a may be divided into multiple images.

[0032] In the above description, when the user selects the second call terminal 11b in the "1st floor lobby," in step S202, the system manager 20 identifies the camera 41a with the name "1st floor lobby." This is done when the table managing the information of each terminal is as shown in FIG. 5A. On the other hand, when the table managing the information of each terminal is as shown in FIG. 5B, there is no camera 41 with a name that exactly matches "1st floor lobby," so the system manager 20 may select a camera 41 to be registered with a similar name, such as the camera 41 in the "1st floor lobby reception" and / or the camera 41 in the "1st floor lobby west" position.

[0033] 5B, the system manager 20 may select multiple cameras 41, i.e., the camera 41 at the "first floor lobby reception" and the camera 41 at the "first floor lobby west" In this case, the image displayed on the display 113 of the first call terminal 11a may be a divided image of the display 113.

[0034] As described above, in the communication system 1 of this embodiment, the user can check the state of the other party on the camera image before making a call. Therefore, the user can decide how to make a call based on the image of the other party. For example, if the camera image shows that there is no one at the other party, the user can decide to try calling again later. Alternatively, if there are many people at the other party, the user can decide to speak louder.

[0035] When the call session starts in step S207, the display 113 of the first call terminal 11a displays live video captured by the camera 112 of the second call terminal 111b, as shown in Fig. 11. In addition to the video, icons for operation or for indicating the status of operation may be simultaneously displayed in part of the display screen of the display 113, as shown in Fig. 11. The top three icons shown in Fig. 11 indicate, in order, turning on / off or switching the video image, turning on / off the call, and switching to a communication location selection screen.

[0036] 12A, in step S207, not only the image from the camera 112 of the second call terminal 11b but also the image captured by the camera 112 of the first call terminal 11a may be displayed on the display 113 of the first call terminal 11a during the call session. In this case, as shown in FIG. 12A, the image from the first call terminal 11a is displayed smaller than the image from the second call terminal 11b.

[0037] 12B, the display 113 of the first call terminal 11a during the call session in step S207 may simultaneously display the image captured by the camera 41a in the "first floor lobby" together with the image captured by the camera 112 of the second call terminal 11b. In this case, as shown in FIG. 12B, the image captured by the camera 41a in the "first floor lobby" may be displayed smaller than the image of the second call terminal 11b.

[0038] Furthermore, after the call session (S207) is started, the video from the monitoring camera 41a may be displayed on the display 113 of the first call terminal 11a at the user's option. During a call, if the camera icon in the upper right corner of the display of the first call terminal 11a in FIG. 11 is selected, live video captured by the monitoring camera 41a in the "first floor lobby" may be displayed instead of the video from the camera 112 of the second call terminal 11b, as shown in FIG. 10. Alternatively, as shown in FIG. 12B, live video captured by the monitoring camera 41a in the "first floor lobby" may be displayed together with the video from the camera 112 of the second call terminal 11b. With this configuration, a user on the "second floor north" can make a call while watching the situation in the "first floor lobby."

[0039] (4) Modified embodiment 1A In the above-mentioned (3) method of linking the IP call system 10 and the surveillance camera system 40, in step S201, the first call terminal 11a makes an inquiry to the system manager 20, and the system manager 20, upon receiving the notification, identifies the surveillance camera 41 and notifies the first call terminal 11a (S202), and sends a video request from the first call terminal 11a to the surveillance camera 41a (S203).

[0040] As shown in Fig. 9B, steps S201 to S203 may be replaced by steps S211 to S212. That is, in step S211, the first call terminal 11a makes an inquiry to the system manager 20, and the system manager 20, upon receiving the inquiry, identifies the monitoring camera 41a and sends a video request to the monitoring camera 41a (S212). The subsequent steps from step S204 onwards are exactly the same as those in Fig. 9A.

[0041] (5) Modified embodiment 1B In the communication method of Figure 9A or 9B above, when a call is made between the first call terminal 11a and the second call terminal 11b, the system manager 20 searches for a surveillance camera 41a in the vicinity of the second call terminal 11b and displays the image from the surveillance camera 41a on the display 113 of the first call terminal 11a.

[0042] In modified embodiment 1B, the user selects and executes a call with the area around the monitoring camera 41a while the first call terminal 11a is displaying live video from the monitoring camera 41a. The communication method in modified embodiment 1B is similar to that in Fig. 9A or 9B in terms of the flowchart, and will be described here using Fig. 9B.

[0043] While in "2nd Floor North," the user displays the video from the surveillance camera 41a in the "1st Floor Lobby," which is located away from "2nd Floor North," on the display 113 of the first call terminal 11a (S211, S212, S204). While watching the video from the surveillance camera 41a, the user presses the "Call" button on the first call terminal 11a according to the situation. This causes the first call terminal 11a to call the system manager 20 (S205). The system manager 20 identifies a call terminal 11 in the vicinity of the surveillance camera 41a and calls the identified call terminal 11, the second call terminal 11b (S206). When another user in the vicinity of the second call terminal 11b answers the call, a call session begins between the first call terminal 11a and the second call terminal 11b (S207).

[0044] In the modified embodiment 1B, when a user who has seen the video from the monitoring camera 41 calls, the second call terminal 11b in the vicinity of the monitoring camera 41a is identified and a call can be made. For example, the user can check from the video whether the person he or she is looking for is in the vicinity of the monitoring camera 41a, and then can make a call with that person.

[0045] (6) Modified embodiment 1C In the explanation of (3) above, when the user selects the second call terminal 11b in the "1st floor lobby," in step S202, the system manager 20 identifies the camera 41a with the name "1st floor lobby." If the table managing the information of each terminal is as shown in FIG. 5A, it is possible to search for a terminal using the "name" in the table managing the information of each terminal. Also, even if a search is performed by "name," there may be cases where a nearby camera cannot be identified. The system manager 20 may use an identifier other than the "name" to identify the target camera.

[0046] An example of an identifier other than a "name" that can be used to identify a device is an IP address. The IP address may be used to identify cameras that share a common network or are connected to the same router.

[0047] As another example, the system manager 20 may use a combination of multiple identifiers to identify a target camera. For example, a "name" and an "IP address" may be used in combination. By doing so, for example, if two cameras are registered with the same name, "first floor lobby," but refer to different lobbies in different buildings, the system manager 20 can more appropriately identify the camera 41 by using the IP address in combination.

[0048] 2. Second embodiment (1) Configuration of the communication system 1a of the second embodiment As shown in Fig. 13, a communication system 1a of this embodiment includes a loudspeaker system 50 in addition to the communication system 1 of the first embodiment. The IP call system 10, system manager 20, surveillance camera system 40, and network N are the same as those of the first embodiment, so detailed description will be omitted. In the communication system 1a, the IP call system 10, system manager 20, surveillance camera system 40, and loudspeaker system 50 are interconnected via the network N.

[0049] The public address system 50 is a system installed in a predetermined area (public address area) for purposes such as evacuation guidance during a disaster and playing music such as background music, and includes one or more IP speakers 51. Each IP speaker 51 is assigned unique identification information (e.g., an IP address) on the network. The IP speaker 51 has the function of receiving, playing, and amplifying audio data in accordance with the same IP call protocol as the call terminal 11 and the same surveillance camera system transmission protocol as the recorder 42. The public address system 50 also includes a paging gateway 52 connected to the same network as the IP speaker 51. The paging gateway 52 is assigned unique identification information (e.g., an IP address) on the network. The paging gateway 52 has the function of receiving audio data via the network and transferring the audio data to the IP speaker 51 in accordance with the same IP call protocol as the call terminal 11 and the same surveillance camera system transmission protocol as the recorder 42. In other words, the paging gateway 52 can receive audio data intended for the IP speaker 51 and then transfer the audio data to the IP speaker 51, thereby broadcasting the audio data simultaneously. The paging gateway 52 transfers the audio data to the IP speaker 51 by multicast or broadcast. The IP speaker 51 receives and plays back the digitized audio data via a wireless communication medium such as an Ethernet cable or cellular communication.

[0050] In this way, in the communication system 1a, the IP call system 10, the system manager 20, the surveillance camera system 40, and the loudspeaker system 50 are interconnected via a network, and it is possible to make voice calls between the call terminals 11 of the IP call system 10, to make voice broadcasts from the call terminals 11 of the IP call system 10 to the IP speakers 51 of the loudspeaker system 50, and to make voice broadcasts from the recorder 42 of the surveillance camera system 40 to the IP speakers 51 of the loudspeaker system.

[0051] As shown in FIG. 2, the network N may be configured via multiple local area networks (LANs) and a wide area network (WAN) such as the Internet that interconnects these networks. The IP call system 10, system manager 20, and surveillance camera system 40 are each configured on a LAN and interconnected. In this configuration, various communications are possible across the multiple LANs, such as voice calls between call terminals 11 in different IP call systems 10, audio broadcasts from a call terminal 11 in an IP call system 10 in one LAN to an IP speaker in a public address system 50 in another LAN, and audio broadcasts from a recorder 42 in a surveillance camera system 40 in one LAN to an IP speaker 51 in a public address system 50 in another LAN. When the IP call system 10 is configured on a LAN, the call terminal 11 is preferably connected to a router constituting the LAN via an Ethernet cable, and may transmit audio data via the Ethernet cable and receive power via Power over Ethernet (PoE) via the Ethernet cable. When the surveillance camera system 40 is configured on a LAN, the surveillance camera 41 and recorder 42 are preferably connected to a router that makes up the LAN with an Ethernet cable, and send and receive video data via the Ethernet cable, and are also supplied with PoE power via the Ethernet cable.When the public address system 50 is configured on a LAN, the IP speaker 51 and paging gateway 52 are preferably connected to a router that makes up the LAN with an Ethernet cable, and are also preferably connected to and receive audio data via the Ethernet cable, and are also supplied with PoE power via the Ethernet cable.

[0052] Also in the second embodiment, as in the first embodiment, the system manager 20 has a SIP server function and performs call control. As shown in Fig. 6, the system manager 20 manages information on each terminal (such as the call terminal 11, IP speaker 51, and surveillance camera 41) in the communication system 1 in a table. Here, the information on each terminal is the "IP address" and the "name" of the location where each terminal is located.

[0053] Furthermore, in the communication system 1a of the second embodiment, the communication method that does not use the loudspeaker system 50 is the same as that of the communication system 1 of the first embodiment. In other words, since it is the same as "(2) Basic call method using the IP call system 10," "(3) Communication method using the IP call system 10 and the surveillance camera system 40 in cooperation with each other," "(4) Modified embodiment 1A," "(5) Modified embodiment 1B," and "(6) Modified embodiment 1C" in "1. First embodiment" above, a description thereof will be omitted.

[0054] (2) A communication method using the IP communication system 10, the public address system 50, and the surveillance camera system 40 in cooperation with each other A communication method using the IP call system 10, the loudspeaker system 50, and the surveillance camera system 40 in cooperation with each other in the communication system 1a of this embodiment will be described with reference to the flowchart of FIG.

[0055] In the communication system 1a, a first telephone terminal 11a is placed on the "second floor north" where the user is located, and an IP speaker 51a and a surveillance camera 41a are placed in the "first floor lobby." This communication method is for acquiring camera images from the surveillance camera 41a located around the IP speaker 51a in the "first floor lobby" when a loudspeaker broadcast is made from the first telephone terminal 11a placed on the "second floor north" to the IP speaker 51b placed in the "first floor lobby."

[0056] The user first selects "1st Floor Lobby" on the display screen (see FIG. 8) of the display 113 of the first communication terminal 11a, which is the call originator, to broadcast a message to the IP speaker 51a in the "1st Floor Lobby." In response to the user's input, the first communication terminal 11a queries the system manager 20 (S301). Upon receiving the notification, the system manager 20 identifies a surveillance camera 41a ("1st Floor Lobby" camera) likely to be located around the selected "1st Floor Lobby" IP speaker 51a, and notifies the first communication terminal 11a in the "2nd Floor North" of the address of the "1st Floor Lobby" camera 41a (S302). This causes the first communication terminal 11a in the "2nd Floor North" to send a video request to the "1st Floor Lobby" camera (S303). The camera 41a requested by the first call terminal 11a sends the camera image being captured to the first call terminal 11a using the ONVIF protocol (S204). The sent image from the camera 41a is displayed on the display 113 of the first call terminal 11a.

[0057] The users on the "second floor north" will receive a loudspeaker broadcast while watching the camera image on the "first floor lobby" (S307).

[0058] As described above, in the communication system of this embodiment, the user can check the state of the call destination using the camera image and then decide how to make a loudspeaker broadcast. For example, if the camera image shows that there is no call destination, the user can decide not to make a loudspeaker broadcast. Alternatively, if there are many people at the call destination, the user can decide to make a loudspeaker broadcast at a high volume.

[0059] (3) Modified embodiment 2A In the above-mentioned (2) method of linking the IP call system 10, the loudspeaker system 50, and the surveillance camera system 40, in step S301, the first call terminal 11a makes an inquiry to the system manager 20, and the system manager 20, upon receiving the notification, identifies the surveillance camera 41 and notifies the first call terminal 11a (S302), and sends a video request from the first call terminal 11a to the surveillance camera 41a (S203).

[0060] In the communication method of modified embodiment 2A, as shown in Fig. 15, in step S311, the first call terminal 11a makes an inquiry to the system manager 20, and the system manager 20, upon receiving the inquiry, identifies the monitoring camera 41 and sends a video request to the monitoring camera 41a (S312). The subsequent steps from step S304 onwards are exactly the same as the communication method of Fig. 14.

[0061] (4) Modified embodiment 2B In the communication method of Figure 14 or Figure 15 above, when a loudspeaker broadcast is made from the first call terminal 11a to the IP speaker 51a, the system manager 20 searches for a surveillance camera 41a around the IP speaker 51a and displays the image from the surveillance camera 41a on the display 113 of the first call terminal 11a.

[0062] In modified embodiment 2B, while the first communication terminal 11a is displaying live video from the monitoring camera 41a, the user selects and executes loudspeaker broadcasting to the vicinity of the monitoring camera 41a. The communication method of modified embodiment 2B is similar to that of Fig. 14 or Fig. 15 in terms of the flowchart, and therefore will be described here using Fig. 15.

[0063] While in the "second floor north" area, the user displays the video from the surveillance camera 41a in the "first floor lobby," which is located away from the "second floor north," on the display 113 of the first call terminal 11a (S311, S312, S304). While watching the video from the surveillance camera 41a on the first call terminal 11a, the user presses the "broadcast" button according to the situation. This causes the first call terminal 11a to call the system manager 20 (S305). The system manager 20 identifies the IP speaker 51a near the surveillance camera 41a and calls the identified IP speaker 51a (S306). In this way, loudspeaker broadcasting to the IP speaker 51a from the first call terminal 11a becomes possible.

[0064] In modified embodiment 2B, the IP speaker 51a near the surveillance camera 41a is identified and loudspeaker broadcasting is possible by specification of the user who has viewed the video from the surveillance camera 41. For example, the user can check from the video whether people he is looking for are in the vicinity of the surveillance camera 41a, and then loudspeaker broadcasting can be made to those people.

[0065] In the above, we have described a case where, when a user presses the "broadcast" button, the system manager 20 designates the IP speaker 51a to perform the broadcast. The system manager 20 may designate multiple IP speakers 51 in the "first floor lobby" to perform the broadcast. Alternatively, instead of the IP speaker 51a, the system manager 20 may designate the second call terminal 11b in the "first floor lobby" to perform the broadcast. This is effective, for example, when there is no IP speaker 51 in the "first floor lobby." Alternatively, the system manager 20 may designate one or more IP speakers 51 and one or more call terminals 11 in the "first floor lobby" to perform the broadcast.

[0066] 3. Features of the first and second embodiments (1) The communication system 1 comprises an IP call system 10, a system manager 20, and a surveillance camera system 40. The IP call system 10 includes a plurality of call terminals 11. The call terminals 11 are connected to an IP network N. The call terminals 11 have a microphone 110, a speaker 111, and a display 113. The system manager 20 is independently connected to the IP network N. The system manager 20 controls the transmission and reception of audio data and video data using a call protocol between the plurality of call terminals 11. The surveillance camera system 40 includes a surveillance camera 41 connected to the IP network N.

[0067] The call terminal 11 can display the video captured by the monitoring camera 41 on the display 113 of the call terminal 11.

[0068] The call protocol of the communication system 1 may be the SIP protocol.

[0069] When the first call terminal 11a selects and calls the second call terminal 11b located in another location (S201), the system manager 20 identifies one monitoring camera 41a that is located in the vicinity of the second call terminal 11b and that belongs to the monitoring camera system 40 (S202), and displays the video captured by the identified monitoring camera 41a on the display of the first call terminal 11a (S203, S204). After this, the user of the first call terminal 11a can make a call with the second call terminal 11b while viewing the video captured by the monitoring camera 41a in the vicinity of the second call terminal 11b (S205 to S207).

[0070] In the communication system 1, the user can check the state of the other party on the surveillance camera image and then decide how to make a call. For example, if the camera image shows that there is no one at the other party, the user can decide to call back later. Alternatively, if there are many people at the other party, the user can decide to speak louder.

[0071] (2) When the communication system 1 receives a call from the first call terminal 11a while the display 113 of the first call terminal 11a is displaying the video currently being captured by the surveillance camera 41a, the system manager 20 may identify other call terminals located in the vicinity of the surveillance camera 41a and enable a call between the identified call terminal (second call terminal 11b) and the first call terminal.

[0072] By utilizing the communication system 1 in this way, when a user who has seen the video from the surveillance camera 41a calls, the second call terminal 11b near the surveillance camera 41a is identified and a call can be made. For example, the user can check from the video whether the person they are looking for is near the surveillance camera 41a, and then talk to that person.

[0073] (3) The communication system 1a includes an IP call system 10, a loudspeaker system 50, a system manager 20, and a surveillance camera system 40. The IP call system 10 includes multiple call terminals 11. The call terminals 11 are connected to an IP network N. The call terminals 11 have a microphone 110, a speaker 111, and a display 113. The system manager 20 is independently connected to the IP network N. The loudspeaker system 50 includes an IP speaker 51. The IP speaker 51 is connected to the network N and is capable of receiving audio data using a call protocol. The system manager 20 controls the transmission and reception of audio data and video data using a call protocol between the multiple call terminals 11. The surveillance camera system 40 includes a surveillance camera 41 connected to the IP network N.

[0074] The call terminal 11 can display the video captured by the monitoring camera 41 on the display 113 of the call terminal 11.

[0075] The call protocol of the communication system 1a may be the SIP protocol.

[0076] When an IP speaker 51a located elsewhere is selected and called from the first call terminal 11a (S301), the system manager 20 identifies one monitoring camera 41a that is located near the IP speaker 51a and that belongs to the monitoring camera system 40 (S302), and displays the video captured by the identified monitoring camera 41a on the display of the first call terminal 11a (S203, S204). After this, the user of the first call terminal 11a can broadcast the video to the IP speaker 51a while watching the video captured by the monitoring camera 41a near the second call terminal 11b (S205-S207).

[0077] The communication system 1a can check the state of the call destination from the surveillance camera image and then decide how to make a loudspeaker broadcast. For example, if the camera image shows that there is no one at the call destination who is the target of the loudspeaker broadcast, it can decide to make the loudspeaker broadcast again later. Alternatively, if there are many people at the call destination, it can decide to speak louder.

[0078] (4) When the communication system 1a is displaying the video currently being captured by the surveillance camera 41a on the display 113 of the first call terminal 11a, if the user selects broadcasting on the first call terminal 11a, the first call terminal 11a may call the system manager 20, and the system manager 20 may identify an IP speaker 51a located in the vicinity of the surveillance camera 41a and broadcast the video to the identified IP speaker 51a.

[0079] By utilizing the communication system 1a in this way, when a user who has seen the video from the surveillance camera 41a calls, the IP speaker 51a near the surveillance camera 41a is identified and a loudspeaker broadcast is possible. For example, after checking the video to see if the person the user is looking for is near the surveillance camera 41a, the user can broadcast a loudspeaker broadcast to that person.

[0080] 4. Other embodiments The above description is of the case where the name of the camera specified by the user is completely identical to the name of the camera in the table held by the system manager 20. The two may not completely match, but may only partially match.

[0081] In the above, an example has been shown in which the system manager 20 specifies one camera in response to a user selection, but the system manager 20 may specify multiple cameras.

[0082] In the above example, the system manager 20 identified cameras that appear to match the name entered by the user via the input unit. The system manager 20 may identify cameras using identifiers other than the name. An IP address may be used as the identifier. When multiple LANs are separated by multiple routers or when multiple LANs are virtually separated by switches (L2 switches, L3 switches), cameras connected to the same LAN as the call terminal (i.e., cameras that appear to be close) may be identified based on the degree of commonality between the device identifiers of the call terminal and the camera. For example, if the identifier of each device is an IP address, the installation location of each device can be estimated by looking at the network portion of each device's IP address. In other words, devices with the same network portion can be determined to belong to the same network N1. For example, IP addresses 192.168.1.1 and 192.168.1.8 can be determined to be in the same network, and 192.168.2.2 and 192.168.2.4 can be determined to be in the same network.

[0083] Furthermore, identification based on the degree of agreement between the name entered and set by the user via the input unit and the camera name in the table held by the system manager 20, and identification based on the degree of commonality of the device identifiers may be used in combination. [Explanation of symbols]

[0084] 1, 1a Communication System 10 IP Call System 11 Call terminal 11a First call terminal 11b Second call terminal 113 (Call terminal) display 20 System Manager 40 Surveillance Camera System 41 Surveillance Camera 42 Recorder 50 Public address system 51 IP Speaker

Claims

1. an IP call system including a plurality of call terminals each connected to an IP network and each having a microphone, a speaker, and a display, and performing transmission and reception processing of audio data and video data using a call protocol between the call terminals via the IP network; a system manager that is connected to the IP network separately from the call terminals and that controls transmission and reception of audio data and video data using the call protocol between the call terminals; a surveillance camera system including a surveillance camera connected to an IP network; Equipped with The video captured by the surveillance camera can be displayed on the display of the call terminal, When one call terminal belonging to the IP call system selects and calls another call terminal or an IP speaker capable of receiving voice data using the call protocol, the system manager identifies one monitoring camera located near the other call terminal or the IP speaker, and displays an image captured by the identified monitoring camera on a display of the one call terminal; When the system manager identifies one surveillance camera, the system manager identifies a surveillance camera having a name that completely or partially matches the name of another communication terminal or IP speaker input at the one communication terminal. Communication system.

2. The communication system described in claim 1, wherein when the system manager identifies one surveillance camera, the system manager identifies a surveillance camera having an IP address whose network portion is the same as the IP address of another call terminal or IP speaker entered in the one call terminal.

3. an IP call system including a plurality of call terminals each connected to an IP network and each having a microphone, a speaker, and a display, and performing transmission and reception processing of audio data and video data using a call protocol between the call terminals via the IP network; a system manager that is connected to the IP network separately from the call terminals and that controls transmission and reception of audio data and video data using the call protocol between the call terminals; a surveillance camera system including a surveillance camera connected to an IP network; Equipped with The video captured by the surveillance camera can be displayed on the display of the call terminal, Identifying a surveillance camera having a name that completely or partially matches a name inputted into one of the call terminals belonging to the IP call system; A communication system in which, when a call or broadcast is selected on the first call terminal while the video being captured by the identified surveillance camera is being displayed on the display of the first call terminal, the system manager identifies other call terminals located in the vicinity of the surveillance camera and belonging to the IP call system, or IP speakers capable of receiving audio data using the call protocol, and places a call to the identified call terminal or IP speaker.

4. 4. The communication system according to claim 1, further comprising a loudspeaker system including a plurality of IP speakers that receive the audio data transmitted from the communication terminals and loudspeaker-broadcast the received audio data.

5. 4. The communication system according to claim 1, wherein the call protocol is a SIP protocol.

Images