Device collaboration platform

Abstract

This system provides a highly flexible and free-flowing collaborative operation between multiple different IP devices. [Solution] A device collaboration platform comprising a cloud server, the cloud server being connected to a plurality of IP devices, the plurality of IP devices comprising a plurality of input devices and a plurality of output devices, the platform generating and maintaining collaboration rules that associate a first input device among the plurality of input devices with a first output device among the plurality of output devices, and the device collaboration platform that, by referring to the collaboration rules, causes the first output device associated with the first input device to perform a predetermined output action based on information input from the first input device.

Description

Technical Field

[0001] The present invention relates to a device cooperation platform for cooperating a plurality of various IP devices on the cloud.

Background Art

[0002] There are various IP systems. An example of an IP system is a surveillance camera system that monitors abnormalities in a predetermined surveillance area for security purposes or the like. The surveillance camera system includes a plurality of surveillance cameras (IP cameras) connected to the Internet. Another example of an IP system is an IP audio system used for public address broadcasts and calls. The IP audio system includes a plurality of IP speakers and IP call terminals connected to the Internet. The IP audio system is, for example, mainly an IP intercom system for in-building calls.

[0003] Each of these IP systems has conventionally existed as an individual system, and the plurality of IP devices within each IP system operate and communicate using their own protocols. Although multiple IP devices within one IP system may perform cooperative operations, it has been difficult to cooperate devices between different IP systems. The system disclosed in Patent Document 1 attempts to operate in cooperation with a surveillance camera system and an IP intercom system. In the system disclosed in Patent Document 1, a system manager realizes the cooperative operation between the surveillance camera system and the IP intercom system. The system manager acquires and manages the location information of each IP camera belonging to the surveillance camera system and the location information of each call terminal belonging to the IP intercom system. When making a call from a calling call terminal to a called call terminal on the IP intercom system, the system manager identifies an IP camera near the called call terminal and provides the captured video of this IP camera to the calling call terminal. Thereby, it is possible to display the captured video of the IP camera belonging to the surveillance camera system on the display of the calling call terminal belonging to the intercom system.

Prior Art Documents

[0004] [Patent Document 1] Japanese Patent Publication No. 2023-154227 [Overview of the project] [Problems that the invention aims to solve]

[0005] The cooperative operation between different IP devices disclosed in Patent Document 1 is limited. The present invention aims to provide a system that enables free and highly flexible cooperative operation between multiple different IP devices. [Means for solving the problem]

[0006] The device collaboration platform according to the present invention includes a cloud server, the cloud server is connected to a plurality of IP devices, the plurality of IP devices include a plurality of input devices and a plurality of output devices, the device collaboration platform generates and maintains collaboration rules that associate a first input device among the plurality of input devices with a first output device among the plurality of output devices, and, by referring to the collaboration rules, causes the first output device associated with the first input device to perform a predetermined output action based on information input from the first input device. [Effects of the Invention]

[0007] The present invention is a device linkage platform configured to create and maintain linkage rules for linking multiple input devices and multiple output devices, and to refer to these linkage rules, which include the mapping of which output device to perform an output action for each input device, to cause a predetermined action to be performed on a first output device associated with the first input device, along with the information input from the first input device. The present invention enables the free and highly flexible linking of multiple input devices and multiple output devices. [Brief explanation of the drawing]

[0008] [Figure 1] This figure shows an overview of a device collaboration platform according to an embodiment of the present invention. [Figure 2] This figure shows a specific example of an IP system according to an embodiment of the present invention. [Figure 3] This figure shows specific examples of an external server and an external sensor according to an embodiment of the present invention. [Figure 4] This figure shows a specific example of the cooperation rule according to an embodiment of the present invention. [Figure 5A] This figure shows an example of the cooperation between an IP surveillance camera system and an IP audio system according to an embodiment of the present invention. [Figure 5B] This figure shows an example of a user interface displayed on a user terminal according to an embodiment of the present invention. [Figure 6] This figure shows an example of the cooperation between an IP surveillance camera system, an IP audio system, and an IP warning light system according to an embodiment of the present invention. [Figure 7] This figure shows an example of the cooperation between an IP surveillance camera system, an IP audio system, and a smart lock system according to an embodiment of the present invention. [Figure 8A] This figure shows an example of the cooperation between an IP surveillance camera system, an IP audio system, an IP warning light system, and a smart lock system according to an embodiment of the present invention. [Figure 8B] This figure shows an example of a user interface displayed on a user terminal according to an embodiment of the present invention. [Figure 9] This figure shows an example of the cooperation between an IP surveillance camera system and an IP audio system according to an embodiment of the present invention. [Figure 10A] This figure shows an example of interaction between an IP audio system and an external sensor according to an embodiment of the present invention. [Figure 10B] This figure shows an example of a user interface displayed on a user terminal according to an embodiment of the present invention. [Figure 11A]This figure shows an example of cooperation between an IP audio system and an external server 30 according to an embodiment of the present invention. [Figure 11B] This figure shows an example of a user interface displayed on a user terminal according to an embodiment of the present invention. [Modes for carrying out the invention]

[0009] The following describes the device collaboration platform according to this embodiment.

[0010] The present invention relates to a device collaboration platform. According to the present invention, a device collaboration platform including a cloud server is provided. This device collaboration platform is connected to a plurality of input devices, a plurality of output devices, and a user terminal. It creates and maintains collaboration rules for collaborative operations between the input devices and output devices. These collaboration rules include routing that determines which output device should perform an output action for each input device. By referring to these collaboration rules, the system causes a first output device, which is routed to the first input device, to perform an output action along with the information input from that first input device.

[0011] FIG. 1 shows an example of a device cooperation platform. The device cooperation platform 10 includes a cloud server accessible via the Internet. The device cooperation platform 10 is connected to a plurality of IP systems 20 via the Internet. Each IP system 20 includes a plurality of input devices and / or a plurality of output devices. The device cooperation platform 10 is connected to a plurality of external servers 30 via the Internet. Each external server 30 is, for example, operated by a different business entity. The device cooperation platform 10 is connected to one or more user terminals 40 via the Internet. The user terminal 40 is an information terminal such as a PC, a smartphone, or a tablet that is owned and used by the user. Here, the user is, for example, a user who uses the IP system 20 within the facility where the IP system 20 is installed. The device cooperation platform 10 is connected to a plurality of external sensors 50 via the Internet. Each external sensor 50 is a sensor device as an IoT device that detects a specific event and transmits the detection result to the outside.

[0012] The device cooperation platform 10 holds a cooperation rule R for performing a cooperation operation between different input devices and output devices. Specifically, the cooperation rule R includes a cooperation rule for performing a cooperation operation between an input device and an output device. The cooperation rule R includes, for example, a routing for determining which output device is to perform an output action when there is an information input from which input device. Each input device and each output device may be individually identified by identification information such as an IP address and routed using the individual identification information. The cooperation rule R includes, for example, information that serves as an opportunity (trigger) for causing the input device and the output device to perform a cooperation operation.

[0013] The device collaboration platform 10 holds one or more web applications A. Web applications A perform processing to coordinate the operation of input devices and output devices according to collaboration rules R. A specific example of the collaboration operation processing includes, when information is input from a first input device, referring to collaboration rules R, sending a link to the user terminal to execute an output action to a first output device routed to the first input device, along with the input information. A specific example of the collaboration operation processing includes, in response to the user terminal's selection of a link, sending a request to the first output device to execute a predetermined output action. Web applications A run on an OS installed on a cloud server.

[0014] As shown in Figure 2, an example of the IP system 20 is a surveillance camera system 20A. The surveillance camera system 20A is an IP surveillance camera system and includes multiple IP cameras (surveillance cameras) 21. Each surveillance camera 21 is installed in an area (surveillance area) where security or other abnormalities should be monitored, connected to a local area network provided within the surveillance area, and configured to be able to connect to the internet via a router. The surveillance camera 21 is equipped with an image sensor and a video encoder, and is configured to encode the video signal acquired by the image sensor into video data using the video encoder and transmit the video data. The surveillance camera 21 may be equipped with an anomaly detection function that performs image sensing on the captured video and detects abnormalities in the captured video. An example of an anomaly detection function may include event detection that detects moving objects with predetermined movements, or predetermined events such as fire outbreaks or water level rises, in the captured video using image sensing. Image sensing may be edge sensing performed by a processor within the camera 21a, or it may be performed by an external computer connected to the camera 21a. When an anomaly is detected by the anomaly detection function, the camera 21 may be equipped with an anomaly detection notification function that notifies the camera that an anomaly has been detected. Furthermore, the camera 21 may be equipped with a contact input that is connected to an external device such as a sensor, and the contact is turned ON according to the state of the external device, and the camera starts taking pictures in response, and transmits information indicating that the contact has been turned ON to an external device via the network.

[0015] As shown in FIG. 2, an example of the IP system 20 is the IP audio system 20B. The IP audio system 20B includes a plurality of IP speakers 22 and a plurality of IP microphone terminals 23. Each IP speaker 22 and each IP microphone terminal 23 are installed in an area for performing public address, sound collection, and communication, connected to a local area network provided within the area, and configured to be connected to the Internet via a router. The IP speaker 22 is equipped with an audio decoder and is configured to reproduce audio data and output sound. The IP speaker 22 has a built-in memory for holding one or more sound sources (audio data), and can reproduce a selected sound source in the built-in memory. The IP speaker 22 can reproduce audio data received from the outside via the network. The IP microphone terminal 23 includes a microphone and an audio encoder, and is configured to encode the audio input via the microphone into audio data by the audio encoder and transmit the audio data.

[0016] As shown in FIG. 2, an example of the IP system 20 is the warning light system 20C. The warning light system 20C includes a plurality of warning lights 24. Each warning light 24 is installed in a warning area for detecting abnormalities and warning people around, connected to a local area network provided within the warning area, and configured to be connected to the Internet via a router. The warning light 24 includes a light-emitting element composed of an LED or the like. Further, the warning light 24 has a contact input, is connected to an external device such as a sensor, the contact becomes ON according to the state of the external device, in response to this, the light-emitting element is driven, and information indicating that the contact has become ON is transmitted to the outside via the network. Also, the warning light 24 is configured to drive the light-emitting element according to a command received from the outside via the network.

[0017] As shown in Figure 2, an example of the IP system 20 is a smart lock system 20D. The smart lock system 20D is a system for locking and unlocking locks installed on doors, etc. The smart lock system 20D includes a plurality of smart lock terminals 25. Each smart lock terminal 25 is installed on a door for entering and exiting an access-controlled area, is connected to a local area network provided in that area, and is configured to be able to connect to the internet via a router. The smart lock terminal 25 is equipped with, for example, an actuator and is configured to lock or unlock by driving the actuator in response to a command received from the outside via the network.

[0018] As shown in Figure 3, the external server 30 includes a group of information source servers 30A. The group of information source servers 30A includes multiple information source servers. Each information source server is a server that transmits and distributes information that triggers the coordinated operation of input devices and output devices. In the example shown in Figure 3, the group of information source servers 30A includes a weather information server 30A1 that distributes weather information, an event notification server 30A2, and the weather information server 30A1, event notification server 30A2, and sensing server 30A3 may each be operated by separate entities.

[0019] As shown in Figure 3, the external server 30 includes a messaging server group 30B. The messaging server group 30B includes multiple messaging servers. Each messaging server is a server that notifies and transmits messages as a means of communication using natural language. In the example shown in Figure 3, the messaging server group 30B includes a mail server 30B1 that sends emails as messages. The messaging server group 30B also includes a chat server 30B2 that allows users to send text messages to each other in a chat format. Examples of chat servers 30B2 include, for example, the Teams server provided by Microsoft, the Slack server provided by Salesforce, etc. The mail server 30B1 and the chat server 30B2 may be operated by separate entities.

[0020] An example of an external sensor 50 is a water level sensor 50A, as shown in Figure 3, which detects the water level of a water source such as a river or dam and transmits a detection signal to the outside when the water level reaches a predetermined level or higher. An example of an external sensor 50 is a temperature sensor 50B, as shown in Figure 3, which measures the temperature of the outside air and transmits a detection signal to the outside when the temperature reaches a predetermined level or higher.

[0021] Figure 4 shows an example of a cooperation rule R. Cooperation rule R includes a routing table RT. Routing table RT is a database that holds the correspondence between input devices and output devices to be operated in cooperation. Input devices are selected from one of the IP systems 20, and output devices are selected from a different IP system 20 than the system to which the information input device belongs. Cooperation rule R includes a trigger table TT. Trigger table TT is a database that holds the conditions that trigger the coordinated operation of the input devices and output devices associated in routing table RT. Different conditions can be set for each input device shown in routing table RT. Cooperation rule R includes a notification means table MT. Notification means table MT is a database that holds notification means for notifying the user terminal 40 when the coordinated operation of the input devices and output devices associated in routing table RT is performed due to the activation of the conditions shown in trigger table TT. Different notification means can be set for each input device shown in routing table RT.

[0022] The processing of web application A includes the processing of setting the linkage rule R. When the user terminal 40 accesses the device linkage platform 10, the device linkage platform 10 executes web application A and includes the processing of receiving input for setting the linkage rule R from the user terminal 40. The input for setting the linkage rule R includes input to select input devices and output devices to be operated in a coordinated manner within the IP system 20. For each input device, input is accepted to select and associate one or more output devices to be operated in a coordinated manner. The result of this association input is reflected in the routing table RT. The input for setting the linkage rule R includes input to select a trigger that will cause the input device and output device to operate in a coordinated manner. The trigger includes input that identifies conditions related to the operation of the input device, conditions for information distributed from information source servers belonging to the information source server group 30B, and conditions for information transmitted from the external sensor 50. The result of this condition input is reflected in the trigger table TT. The input for setting the linkage rule R includes an input for setting a notification means to notify the user terminal 40 when the input device and output device are operated in a coordinated manner, and an input for selecting a messaging server belonging to the messaging server group 30B. The result of this selection input is reflected in the notification means table MT.

[0023] In the example shown in Figure 4, input device a in the IP system 20 is associated with two output devices A and C, input device b is associated with one output device B, input device c is associated with three output devices E, F, and G, and input device d is associated with one output device C. In the example shown in Figure 4, for example, if condition A associated with input device a is met, the coordinated operation by input device a is initiated. The routing table RT is referenced, and the coordinated operation is performed with output devices A and C associated with input device a. At this time, the notification means table MT is referenced, and a message is notified to the user terminal 40 by chat A associated with input device a.

[0024] An example of a condition set in the trigger table TT is a condition related to the operation of an input device. For example, if the input device is a surveillance camera 21 belonging to the surveillance camera system 20A, the condition is that an abnormality has been detected in the video footage captured by the surveillance camera 21. For example, the condition could be that an abnormality has been notified by the abnormality detection notification function of the surveillance camera 21. For example, the condition could be that a contact input has been notified by the contact input notification function of the surveillance camera 21. For example, if the input device is an IP microphone terminal 23 belonging to the IP audio system 20B, the condition is that there has been audio input via the microphone of the IP microphone terminal 23. That is, the condition is that a predetermined sound has been input from the microphone of the IP microphone terminal 23. A predetermined sound could be, for example, a sound with a predetermined timbre or a sound above a predetermined volume. For example, if the input device is a warning light 24 belonging to the warning light system 20C, the condition is that the warning light has been driven by a contact input.

[0025] An example of a condition set in the trigger table TT is a condition related to information distributed from information source servers belonging to the information source server group 30A. For example, if the condition is weather information distributed from weather information server 30A1, the condition would be information indicating a specific weather in a specific area. For example, the condition could be that a specific warning or alert has been issued in the location (area) where the IP system 20 to which the corresponding information input device belongs is installed. For example, if the condition is information distributed from event notification server 30A2, the condition would be information indicating the occurrence of a specific event in a specific area. For example, the condition could be that information about an earthquake has been distributed in the location (area) where the IP system 20 to which the corresponding information input device belongs is installed.

[0026] An example of a condition set in the trigger table TT is a condition related to information transmitted from the external sensor 50. For example, the condition could be that a detection signal indicating a water level above a predetermined level is received from the water level sensor 50A. For example, the condition could be that a detection signal indicating a temperature above a predetermined level is received from the temperature sensor 50B.

[0027] Next, with reference to Figure 5A, a specific example of a device collaboration system using a surveillance camera system 20A and an IP audio system 20B as the IP system 20 will be described. As shown in Figure 5A, the device collaboration platform 10 is connected to the surveillance camera system 20A and IP audio system 20B configured at site A, and to the IP audio system 20B configured at site B. Sites A and B are physically different locations. In the example shown in Figure 5A, the routing table RT associates camera 21a, an input device (camera) belonging to the surveillance camera system 20A at site A, with IP speakers 22A and 22B, output devices (IP speakers) belonging to the IP audio system 20B at site A, and IP speaker 22E, an output device (IP speaker) belonging to the IP audio system 20B at site B. In other words, camera 21a and IP speakers 22A, 22B, and 22E are configured to work in cooperation with each other. The trigger table TT associates conditions related to motion detection with camera 21a. In the messaging table MT, chat A is associated with camera 21a. In the example shown in Figure 5A, the processing of web application A includes the following: When the camera 21a receives a notification from the camera 21a indicating that it has detected motion in the captured video due to the camera 21a's anomaly detection notification function, the system responds by acquiring (receiving) still image data of the captured video at the time the motion was detected (step S10). The above still image, text data indicating that camera 21a has detected motion, and link information regarding the link to activate the coordinated operation with IP speakers 22A, 22B, and 22E associated with camera 21a are notified (sent) to the user terminal 40 (step S11). This notification is made by sending the image data, text data, and link information to the chat server 30B that provides Chat A. As a result, the user terminal 40, which is accessing the chat server 30B, is notified of the image data, text data, and link information sent from the device coordination platform 10 via Chat A. Figure 5B shows an example of the Chat A screen 41 displayed on the user terminal 40. As shown in Figure 5B, on the user terminal 40, a message 41 indicating that motion has been detected in the video captured by camera 21a is displayed on the Chat A screen 41 based on the text data, the video captured by camera 21a at the time of motion detection 41b is displayed based on the image data, and a link 41c is displayed based on the link information. The link 41c is displayed in a user-selectable format via the input section of the user terminal 40. When link 41c is selected, the user terminal 40 sends a message to the device collaboration platform 10 indicating that the link has been selected. When link 41c is selected from the user terminal 40, web application A refers to the routing table RT and sends commands and data to IP speakers 22A, 22B, and 22E associated with camera 21a (step S12). This enables the IP speakers 22A, 22B, and 22E to activate and sound in response to the detection of anomalies in the video feed from camera 21a.

[0028] An example of step S12 includes sending a command to the IP speakers 22A, 22B, and 22E instructing them to play the built-in sound source stored in the internal memory. This enables coordinated operation in which the IP speakers 22A, 22B, and 22E play the built-in sound source and produce sound.

[0029] One example of step S12 is sending a command to the IP speakers 22A, 22B, and 22E instructing them to play the audio data received from the user terminal 40. The audio data sent from the user terminal 40 is, for example, audio data that is encoded from the microphone on the user terminal 40 and sent in streaming format. For example, the user terminal 40 may be configured to turn on the microphone after link 41c is selected and to send the audio data relating to the audio input from the microphone to the device collaboration platform 10 in real time in streaming format. Another example is that the audio data sent from the user terminal 40 is, for example, an audio file in which the audio input from the microphone on the user terminal 40 is encoded and saved in a predetermined file format, and is audio data that is sent in a non-streaming format. For example, the user terminal 40 may be configured to turn on the microphone after link 41c is selected, save the audio data relating to the audio input from the microphone in file format, and send it to the device collaboration platform 10. This allows the IP speakers 22A, 22B, and 22E to perform coordinated operations, such as playing the user's voice spoken through the microphone of the user terminal 40.

[0030] In step S12, different coordination commands may be sent to each of the IP speakers 22A, 22B, and 22E. For example, a command to play the built-in sound source described above may be sent to some of the IP speakers 22A, 22B, and 22E, while a command to play the audio data transmitted from the user terminal 40 described above may be sent to the remaining IP speakers 22A, 22B, and 22E. For example, a command to play the built-in sound source described above may be sent to IP speaker 22A, a command to play the audio data transmitted from the user terminal 40 in streaming format described above may be sent to IP speaker 22B, and a command to play the audio data transmitted from the user terminal 40 in non-streaming format described above may be sent to IP speaker 22E.

[0031] Figure 6 shows a modified version of the system example shown in Figure 5A. In the example shown in Figure 6, the device collaboration platform 10 is connected to the warning light system 20C installed at site B, instead of the IP audio system 20B installed at site B. In the routing table RT, camera 21a is associated with IP speakers 22A and 22B and warning light 24A, which is an output device (warning light) belonging to the warning light system 20C, as collaboration partners. In the example shown in Figure 6, step S12 includes sending a command to the warning light 24A to drive (illuminate) the warning light. As a result, in conjunction with the detection of an anomaly in the video captured by camera 21a, a public address broadcast is made by the IP system 20 at site A, and a warning is issued by the warning light system 20C at site B.

[0032] Figure 7 shows a modified version of the system example shown in Figure 5A. In the example shown in Figure 7, the device collaboration platform 10 is connected to a smart lock system 20D installed at site B, instead of the IP audio system 20B installed at site B. In the routing table RT, camera 21a is associated with IP speakers 22A and 22B and a smart lock terminal 25A, which is an output device belonging to the smart lock system 20D, as collaboration partners. In the example shown in Figure 7, step S12 includes sending a command to the smart lock terminal 25A instructing it to lock or unlock. As a result, in conjunction with the detection of an anomaly in the video captured by camera 21a, a public address broadcast is made by the IP system 20 at site A, and the smart lock terminal 25A locks or unlocks at site B.

[0033] The processing in steps S10 to S12 above triggers a notification to the user terminal 40 when motion is detected by the camera 21a. By selecting a link included in this notification, public address broadcasting can be immediately initiated from the IP speakers 22A, 22B, and 22E associated with the camera 21a.

[0034] Another example of a specific device linkage system using a surveillance camera system 20A, an IP audio system 20B, a warning light system 20C, and a smart lock system 20D will be described. As shown in Figure 8A, the device linkage platform 10 is connected to the surveillance camera system 20A, IP audio system 20B, warning light system 20C, and smart lock system 20D, which are set up at site A. In the example shown in Figure 8A, the routing table RT associates camera 21a, which belongs to the surveillance camera system 20A, with IP speaker 22A, which belongs to the IP audio system 20B, warning light 24A, which belongs to the warning light system 20C, and smart lock terminal 25A, which belongs to the smart lock system 20D. That is, camera 21a, IP speaker 22A, warning light 24A, and smart lock terminal 25A are configured to operate in cooperation with each other. In the trigger table TT, camera 21a is associated with the reception of a detection signal from water level sensor 50A as a condition related to external sensor 50. In the messaging table MT, chat A is associated with camera 21a. In the example shown in Figure 8A, the processing of web application A includes the following: When a detection signal is received from the water level sensor 50A, in response, the system notifies the user terminal 40 of still image data captured from the video at the time of detection, text data of a message regarding the detection, and link information regarding the link to activate the coordinated operation with the IP speaker 22A, warning light 24A, and smart lock terminal 25A associated with the camera 21a (step S20). This notification is made by sending the image data, text data, and link information to the chat server 30B that provides Chat A. As a result, the user terminal 40, which is accessing the chat server 30B, is notified of the image data, text data, and link information sent from the device coordination platform 10 via Chat A. An example of the Chat A screen 41 displayed on the user terminal 40 is shown in Figure 5B. When link 41c is selected from user terminal 40, web application A refers to routing table RT and displays a user interface (UI) on user terminal 40 for coordinating operation with the IP speaker 22A, warning light 24A, and smart lock terminal 25A associated with camera 21a (step S21). Figure 8B shows an example of the UI. The UI includes a camera video display 42a. The camera video display 42a displays the video captured by camera 21a. That is, web application A receives the video captured by camera 21a and transmits it to the user terminal 40 (step S22). The UI includes the display of an icon 42b, which is a selectable UI element. Icon 42b is an icon used to instruct the user to make a call to the IP speaker 22A. When icon 42b is selected, web application A converts the audio input through the microphone of the user terminal 40 into audio data and sends it to the IP speaker 22A in streaming format (step S23). Here, for example, the RTSP protocol is used. The UI includes the display of icon 42c, which is a selectable UI element. Icon 42c is an icon used to instruct the IP speaker 22A to transmit audio. When icon 42c is selected, web application A records the audio input through the microphone of the user terminal 40 to generate an audio file and sends this audio file to the IP speaker 22A in a non-streaming format (step S24). The UI includes the display of icon 42d, which is a selectable UI element. Icon 42d is an icon for instructing the IP speaker 22A to play a built-in warning sound. When icon 42d is selected, web application A sends a command to the IP speaker 22A to play an audio file of the warning sound stored in its internal memory (step S25). The UI includes the display of icon 42e, which is a selectable UI element. Icon 42e is an icon for instructing the IP smart lock terminal 25A to lock. When icon 42e is selected, web application A sends a command to the smart lock terminal 25A to lock (step S26). The UI includes the display of icon 42f, which is a selectable UI element. Icon 42f is an icon used to instruct the warning light 24A to activate the warning light. When icon 42f is selected, web application A sends a command to the warning light 24A to activate the warning light (step S27).

[0035] Through the processing in steps S20 to S27 described above, the water level sensor 50A detects the water level and triggers a notification to the user terminal 40. By selecting a link included in this notification, the user can view the video feed from the camera 21a associated with the water level sensor 50A, and also broadcast an announcement from the IP speaker 22A associated with the camera 21a, thereby activating the warning light 24A and the smart lock terminal 25A. These operations on the IP speaker 22A, warning light 24A, and smart lock terminal 25A associated with the camera 21a can be performed immediately through the UI of the web application A.

[0036] (modified version) As a modification of the embodiment described above, the cooperation rule R does not need to include a notification means table MT for identifying a notification means for notifying the user terminal 40 during the cooperation operation. In other words, the web application A does not need to notify the user terminal 40 during the cooperation operation. In this case, Figure 9 is an example of a modification of the embodiment shown in Figure 5A that does not include the notification means table MT. In this case, the processing of the web application A includes the following. When the camera 21a receives a notification from camera 21a indicating that it has detected motion in the captured video due to its anomaly detection notification function, the system responds by referring to the routing table to identify the IP speakers 22A, 22B, and 22E associated with camera 21a (step S30). - Commands and data are sent to IP speakers 22A, 22B, and 22E (step S31). This enables the IP speakers 22A, 22B, and 22E to activate and sound in response to the detection of anomalies in the video feed from camera 21a. An example of the commands and data sent in step S31 is as described in step S12 above. In this modified version, the coordinated operation does not include notification to the user terminal 40, and when a trigger indicated by the trigger table TT is activated, a public address broadcast can be immediately made from the output devices (IP speakers 22A, 22B, 22E) associated with the input device (camera 21a).

[0037] (modified version) In the embodiment described above, the input device to be operated in cooperation was selected from the IP system 20 in the cooperation rule R, but it may be selected from the external sensor 50. In the example shown in Figure 10A, as a modification of the embodiment shown in Figure 5A, the water level sensor 50A is selected as the input device, and in the routing table RT, the water level sensor 50A is associated with the IP speakers 22A, 22B, and 22C. Since the external sensor 50 also serves as the information source that triggers the cooperation operation, the trigger table TT is not required, as shown in Figure 10A. In this modification, the processing of the web application A includes the following. When a detection signal is received from the water level sensor 50A, the system responds by notifying the user terminal 40 of the text data of a message regarding the detection and link information regarding a link to activate coordinated operation with the IP speakers 22A, 22B, and 22E associated with the water level sensor 50A (step S40). This notification is performed by referring to the message table MT and sending the text data and link information to the chat server 30B that provides chat A associated with the water level sensor 50A. As a result, the user terminal 40, which is accessing the chat server 30B, is notified of the text data and link information sent from the device coordination platform 10 via chat A. Figure 10B shows an example of the chat A screen (screen 43) displayed on the user terminal 40. As shown in Figure 10B, on the user terminal 40, a message 43a indicating that a dangerous water level has been detected by the water level sensor 50A based on the text data is displayed on the chat A screen 43, and a link 43b is displayed based on the link information. When link 43b is selected, the user terminal 40 sends a message to the device collaboration platform 10 indicating that the link has been selected. When link 43b is selected from the user terminal 40, the web application A refers to the routing table RT and sends commands and data to the IP speakers 22A, 22B, and 22E associated with the water level sensor 50A (step S41). This enables the IP speakers 22A, 22B, and 22E to activate and operate in conjunction with the detection of water level by the water level sensor 50A.

[0038] (modified version) In the embodiment described above, the input device to be operated in cooperation was selected from the IP system 20 in the cooperation rule R, but it may be selected from the information source server group 30A. In the example shown in Figure 11A, as a modification of the embodiment shown in Figure 5A, the event notification server 30A2 is selected as the input device, and in the routing table RT, the event notification server 30A2 is associated with the IP speakers 22A, 22B, and 22C. Since the information source server group 30A also serves as the information source that triggers the cooperation operation, the trigger table TT is not required, as shown in Figure 11A. In this modification, the processing of web application A includes the following. ·When information is received from the event notification server 30A2, in response, the user terminal 40 is notified of the text data of the message regarding the distributed information and link information regarding the link to activate cooperative operation with the IP speakers 22A, 22B, and 22E associated with the event notification server 30A2 (step S50). This notification is performed by referring to the message table MT and sending the text data and link information to the chat server 30B that provides chat A associated with the event notification server 30A2. As a result, the user terminal 40, which is accessing the chat server 30B, is notified of the text data and link information sent from the device cooperation platform 10 via chat A. Figure 11B shows an example of the chat A screen (screen 44) displayed on the user terminal 40. As shown in Figure 11B, on the user terminal 40, a message 44a indicating that emergency information has been distributed by the event notification server 30A2 based on the text data is displayed on the chat A screen 44, and a link 44b is displayed based on the link information. When link 44b is selected, the user terminal 40 sends a message to the device collaboration platform 10 indicating that the link has been selected. When link 44b is selected from the user terminal 40, web application A refers to the routing table RT and sends commands and data to IP speakers 22A, 22B, and 22E associated with the event notification server 30A2 (step S51). This enables the IP speakers 22A, 22B, and 22E to ring in response to detection by the event notification server 30A2.

[0039] (supplement) In the embodiment described above, the user terminal 40 has an application program installed that communicates with the web application A on the device collaboration platform (cloud server) 10 and displays the user interface shown in Figures 5B, 8B, 10B, and 11B. One example of an application program is a browser. Another example of an application program is a dedicated application (native application) that communicates with the cloud server.

[0040] Although the present invention has been described above based on embodiments, the present invention is not limited to the embodiments described. Modifications to the embodiments are possible without departing from the spirit of the invention as described in the claims.

Claims

1. A device collaboration platform, which includes a cloud server, the cloud server is connected to multiple IP devices, The aforementioned plurality of IP devices include a plurality of input devices and a plurality of output devices, A linkage rule is generated and maintained that associates a first input device among the plurality of input devices with a first output device among the plurality of output devices. A device linkage platform that, by referring to the aforementioned linkage rules, causes the first output device associated with the first input device to perform a predetermined output action based on the information input from the first input device.

2. A device collaboration platform according to claim 1, The first input device is one of the following: a camera belonging to a surveillance camera system, a sensor, or an external information distribution server. The first output device is a message notification server for notifying a user terminal of a message, The predetermined output action is a device collaboration platform that includes sending a message notification containing one of the following: the video captured by the camera, the detection information from the sensor, or the distribution information from the information distribution server.

3. A device collaboration platform according to claim 1, The first output device is one of the following: a loudspeaker terminal belonging to an IP audio system, a warning light belonging to a warning light system, or a smart lock terminal belonging to a smart lock system. The predetermined output action is a device collaboration platform that includes any of the following: amplifying a predetermined sound from the loudspeaker terminal, activating the warning light, or locking or unlocking the smart lock terminal.

4. A device collaboration platform according to claim 1, In the aforementioned linkage rule, the first input device is associated with the second output device in addition to the first output device. The first output device is a message notification server for notifying a user terminal of a message, and the second output device is one of the following: a loudspeaker terminal belonging to an IP audio system, a warning light belonging to a warning light system, or a smart lock terminal belonging to a smart lock system. The predetermined output action is a device collaboration platform that includes sending a message notification along with the information input from the first input device, including a link for broadcasting an amplified voice from the loudspeaker terminal, a link for driving the warning light, and a link for locking or unlocking the smart lock terminal.

Images