Data management system and data management method

Abstract

To improve security when collecting data from collection equipment.SOLUTION: A management part and collection equipment are connected to an arrangement part by the MQTT system so as to be capable of detecting messages classified by a specific topic each. The collection equipment transmits data to an integration part when detecting distribution of a message for instructing transmission of data to the collection equipment as a specific topic from the management part to the distribution part during connection to the distribution part by the MQTT system. The integration part distributes a completion message for showing integration of the data as a specific topic to the distribution part when the data are integrated. The management part detects the completion message and determines that the collection equipment is in a responsible state when the completion message is distributed to the distribution part during connection to the distribution part by the MQTT system.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a data management system and a data management method. [Background technology]

[0002] Patent Document 1 discloses a data collection system having a slave data collecting device that collects information from facility devices, and a master data collecting device that collects data from the slave data collecting devices. The master data collecting device transmits a data write frame to the first slave data collecting device, and the slave data collecting device passes a frame into which it has written its collected data to the next slave data collecting device. Each of the subsequent slave data collecting devices passes a frame into which it has written its collected data to the next slave data collecting device. The last, n-th slave data collecting device writes its collected data into a frame, and transmits the written frame to the master data collecting device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-211382 A Summary of the Invention [Problem to be solved by the invention]

[0004] It is desirable for a slave data collection device to operate independently without affecting other slave data collection devices. Also, from the viewpoint of security, there is a demand for a master data collection device to acquire data from a slave data collection device or to monitor the alive status of a slave data collection device without directly accessing the slave data collection device. [Means for solving the problem]

[0005] The present disclosure can be realized in the following forms.

[0006] (1) According to one embodiment of the present disclosure, a data management system is provided. The data management system includes a collection device that outputs collected data, a management unit that manages the collection device, an aggregation unit that aggregates the data output by the collection device, and a distribution unit that mediates between the management unit, the collection device, and the aggregation unit by using a topic-based sorting method to allow other devices to acquire messages distributed by the management unit, any one of the collection device, and the aggregation unit, and the distribution unit is connected to the management unit, the collection device, and the aggregation unit by using a topic-based sorting method to allow other devices to acquire messages distributed by the management unit, any one of the collection device, and the aggregation unit, and when the collection device detects that a message distributed from the management unit to the distribution unit by using a topic specified by the collection device is a data transmission instruction addressed to the collection device, the collection device transmits the collected data to the aggregation unit, and the aggregation unit transmits the collected data to the aggregation unit. Ta's When the aggregation is completed, the management unit distributes a completion message specified by the topic designated by the management unit to the distribution unit, and when the management unit detects that the completion message has been distributed from the aggregation unit to the distribution unit, it determines that the collection device is in a state where it can respond. According to this form of data management system, the collection device can access the distribution unit, but the distribution unit cannot directly access the collection device, so that the management unit can manage the collection device while increasing the security of the collection device. (2) In the data management system of the above form, the aggregation unit may include a collection system having a storage unit and storing the data in the storage unit, and a transmission server that transmits the data from the collection device to the collection system, and the collection system may distribute the completion message to the distribution unit when the data is stored in the storage unit. (3) In the data management system of the above aspect, the collection device may be connected to the distribution unit using a specific input port of the distribution unit. According to the data management system of this aspect, the collection device is connected to the distribution unit using a specific input port of the distribution unit, so that the security of the collection device can be further improved. (4) In the data management system of the above aspect, the distribution unit may obtain device information of the collecting device and execute alive monitoring of the collecting device when connected from the collecting device. According to this aspect, the distribution unit can obtain the device information of the collecting device and execute alive monitoring without accessing the collecting device. (5) According to one embodiment of the present disclosure, a data management method is provided. In this data management method, the management unit and the collection device are connected to the distribution unit by the MQTT method so as to detect messages sorted using a specific topic, and when the collection device detects that a message of a specific topic, addressed to the collection device, has been delivered from the management unit to the distribution unit while connected to the distribution unit by the MQTT method, the collection device transmits data to the aggregation unit, and when the aggregation unit aggregates the data, it delivers a completion message indicating that the data of the specific topic has been aggregated to the distribution unit, and when the management unit detects the completion message delivered to the distribution unit while connected to the distribution unit by the MQTT method, it determines that the collection device is in a state where it can respond. According to this embodiment of the data management method, the collection device can access the distribution unit, but the distribution unit cannot directly access the collection device, so that the management unit can manage the collection device while increasing the security of the collection device.

[0007] The present disclosure may be realized in various forms other than a data management system, for example, a data management method, etc. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is an explanatory diagram illustrating a data management system. [Diagram 2] FIG. 11 is an explanatory diagram showing a data storage process. [Diagram 3] FIG. 11 is a sequence diagram showing a data storage process. [Figure 4] FIG. 2 is an explanatory diagram showing the flow of instructions and data in a data management system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] FIG. 1 is an explanatory diagram showing a data management system 10. The data management system 10 includes a management unit 100, an MQTT Broker (Message Queueing Telemetry Transport) device 110 (hereinafter referred to as "MQTT Broker 110"), transmission servers 120 and 125, a collection device group 130, and collection systems 150 and 155. The collection device group 130 includes collection devices 131 to 142. Through a network such as a LAN, the collection devices 131 to 136 are connected to the transmission server 120, and the collection devices 131 to 136 are connected to the transmission server 125. Through a network such as a LAN, the transmission server 120 is connected to a collection system 150 having a storage unit 160, and the transmission server 125 is connected to a collection system 155 having a storage unit 165. The transmission servers 120 and 125, the collection systems 150 and 155, and the storage units 160 and 165 are collectively referred to as aggregation units 170 and 175. The MQTT Broker 110 is connected to the management unit 100, the collection devices 131-142, and the collection systems 150 and 155 by the MQTT method. In the MQTT method, sorting using topics is used, and a message delivered by any one of the management unit 100, the collection devices 131-142, and the collection systems 150 and 155 is acquired by the other devices themselves.

[0010] The management unit 100 is a device that publishes a message including a data transmission instruction addressed to the collection device group 130 or the collection devices 131 to 142. The management unit 100 is also constantly connected to the MQTT Broker 110 via Subscribe in order to detect that a data storage completion message indicating that data storage in the storage units 160 and 165 has been completed has been published to the MQTT Broker 110 from the collection systems 150 and 155. When the management unit 100 detects that a data storage completion message has been published to the MQTT Broker 110, it stores the message as management information together with device information of the collection devices 131 to 142 that are the senders.

[0011] Here, the Publish distribution means that the sender of the message distributes a message including a specific topic to a specific subscriber. In this embodiment, the topic is, for example, "a data transmission instruction addressed to the collection device group 130 or the collection devices 131 to 142" and "data storage completion in which data storage in the storage units 160 and 165 is completed." The subscriber can subscribe to a message including a specific topic designated by the subscriber by making a Subscribe connection to the message sender. Here, the Subscribe connection is a connection that allows the subscriber to subscribe to a message including a specific topic. In the Subscribe connection, by using a specific input port of the connection destination, the connection source (subscriber) can access the connection destination, but the connection destination cannot access the connection source in the reverse direction. The connection source device can detect and acquire a message including a specific topic that has been Publish-distributed when the connection source device is connected to the connection destination by Subscribe. However, the connection source device cannot detect and acquire a message including a specific topic that has been Publish-distributed before the connection source device is connected to the connection destination by Subscribe. Note that the subscriber may be configured to detect and acquire a message including a specific topic that has been Publish-distributed before the connection destination is connected to Subscribe. In addition, when a destination device receives a Subscribe connection from a source device, the destination device can obtain device information of the source device.

[0012] The MQTT Broker 110 is a distribution unit that distributes messages to subscribers. When the MQTT Broker 110 receives a message including a specific topic distributed by Publish from the management unit 100, the MQTT Broker 110 distributes the message to the collection devices 131 to 142 that are subscribers. Also, when the MQTT Broker 110 receives a message including a specific topic distributed by Publish from the collection systems 150 and 155, the MQTT Broker 110 distributes the message to the management unit 100 that is the subscriber. In this way, the MQTT Broker 110 mediates the distribution of messages.

[0013] The collection devices 131 to 142 of the collection device group 130 are devices such as loggers that record the operation of sensors, which are arranged in the factory 200. The collection devices 131 to 142 are isolated, for example, by a firewall so that they cannot be accessed from other devices such as the management unit 100, the MQTT Broker 110, the transmission servers 120 and 125, and the collection systems 150 and 155. The collection devices 131 to 142 of the collection device group 130 are constantly connected to the MQTT Broker 110 via a specific input port. From the viewpoint of security, a wired LAN is preferable for the network, but a wireless LAN may be used as long as security measures such as encryption are implemented. Of course, even if the network is a wired LAN, security measures such as encryption may be implemented.

[0014] The collection devices 131 to 142 detect and acquire a message including a specific topic while connected to the MQTT Broker 110 via Subscribe. The message including a specific topic is a message that instructs data transmission addressed to the collection device group 130 or to the collection device itself. When the collection devices 131 to 142 detect and acquire that a message that instructs data transmission addressed to the collection device group 130 or to the collection device itself has been Published to the MQTT Broker 110, the collection devices 131 to 142 collect data and transmit it to the corresponding transmission servers 120 and 125. In this embodiment, the collection devices 131 to 136 transmit data to the transmission server 120, and the collection devices 137 to 142 transmit data to the transmission server 125. Note that when the collection devices 131 to 142 have already collected data, they may transmit the collected data without acquiring new data.

[0015] The transmission server 120 is a transmission server that transmits data transmitted from the collection devices 131 to 146 to the collection system 150, and the transmission server 125 is a transmission server that transmits data transmitted from the collection devices 137 to 142 to the collection system 155. The transmission servers 120 and 125 are configured, for example, by an HTTP (HyperText Transfer Protocol) server, an FTP (File Transfer Protocol) server, and an MQTT server.

[0016] The collection system 150 stores the data transmitted from the transmission server 120 in the storage unit 160. When the collection system 150 stores the data transmitted from the transmission server 120 in the storage unit 160, the collection system 150 publishes to the MQTT Broker 110 a data storage completion message, which is a message including a specific topic and indicates that the data has been stored in the storage unit 160, together with device information of the collection devices 131 to 136.

[0017] Fig. 2 is an explanatory diagram showing the data storage process. Fig. 3 is a sequence diagram showing the data storage process. In step S100, the collection system 150 makes a constant Subscribe connection to the MQTT Broker 110. In step S110, the management unit 100 makes a constant Subscribe connection to the MQTT Broker 110. Note that either step S100 or S110 may be performed first.

[0018] In step S120, the management unit 100 publishes a data transmission instruction message addressed to the collection device group 130 or the collection device 131 to the MQTT Broker 110. In step S130, the collection device 131 acquires from the MQTT Broker 110 a data transmission instruction message addressed to itself that has been published to the MQTT Broker 110 while the collection device 131 is connected to the MQTT Broker 110 via Subscribe.

[0019] In step S140, the collecting device 131 collects data. In step S150, the collecting device 131 transmits the data and its own device information to the transmission server 120. Note that the collecting device 131 may omit step S140 and transmit the collected data and its own device information to the transmission server 120 at the time of acquiring from the MQTT Broker 110 a data transmission instruction message addressed to itself and distributed by Publish to the MQTT Broker 110. In step S160, the transmission server 120 transmits the data and the device information of the collecting device 131 to the collection system 150.

[0020] In step S170, the collection system 150 associates the data with the device information of the collection device 131 and stores the data in the storage unit 160. In step S180, the collection system 150 publishes to the MQTT Broker 110 a data storage completion message indicating that the data has been stored in the storage unit 160, together with the device information of the collection device 131.

[0021] In step S190, when the management unit 100 detects and acquires that a data storage completion message has been distributed to the MQTT Broker 110 via Publish while connected to the MQTT Broker 110 via Subscribe, the process proceeds to step S200. In step S200, the management unit 100 stores the data storage completion message as management information.

[0022] 4 is an explanatory diagram showing the flow of instructions and data in the data management system 10. A data transmission instruction flows as a message from the management unit 100 to the MQTT Broker 110 and the collection device 131, data flows from the collection device 131 to the collection system 150 via the transmission server 120, and a data storage completion message flows from the collection system 150 to the MQTT Broker 110. In this manner, messages and data flow in one direction in a loop, and do not flow in the opposite direction.

[0023] As described above, according to this embodiment, the collection devices 131 to 142 of the collection device group 130 access the MQTT Broker 110 by making a Subscribe connection, and detect and acquire the data transmission instruction distributed to the MQTT Broker 110 by Publish as a message. However, since the MQTT Broker 110 does not directly access the collection devices 131 to 142, the security of the collection device group 130 and the collection devices 131 to 142 when collecting data from the collection device group 130 and the collection devices 131 to 142 can be improved.

[0024] According to this embodiment, the MQTT Broker 110 acquires device information of the collecting devices 131 to 142 when a Subscribe connection is made from the collecting devices 131 to 142 of the collecting device group 130. As a result, the MQTT Broker 110 can execute alive monitoring of the collecting devices 131 to 142. In addition, the management unit 100 can acquire the results of alive monitoring of the collecting devices 131 to 142 from the MQTT Broker 110, or determine the data collection status.

[0025] In this embodiment, the data management system 10 includes two collection systems 150 and 155. The collection systems 150 and 155 store data in the storage units 160 and 165, respectively. However, the data management system 10 may include one of the collection systems 150 and 155, or may include three or more collection systems. The collection systems 150 and 155 may obtain a relationship between data, rather than the data itself, and store the relationship in the storage units 160 and 165. The collection systems 150 and 155 may detect anomalies from the data and publish them to the MQTT Broker 110. The two collection systems 150 and 155 may have different configurations. In this embodiment, the data management system 10 includes a plurality of collection devices 131 to 142, but may include only one collection device.

[0026] In this embodiment, the aggregation units 170 and 175 are respectively configured by the transmission servers 120 and 125, the collection systems 150 and 155, and the storage units 160 and 165, but may have other configurations or may be configured from a single computer device. For example, the aggregation units 170 and 175 may be configured as a diagnosis system that performs abnormal / normal judgment and outputs and stores the result.

[0027] In the present embodiment, the management unit 100 is always connected to the MQTT Broker 110 via Subscribe, and the collection devices 131 to 142 are always connected to the MQTT Broker 110 via Subscribe. However, they do not have to be always connected to Subscribe. The collection devices 131 to 142 may be connected to the MQTT Broker 110 via Subscribe at a predetermined interval, or may be connected to Subscribe upon receiving an instruction from another higher-level device in the factory 200. Note that a message that is Publish-distributed to the MQTT Broker 110 during a period when the management unit 100 or the collection devices 131 to 142 are not connected to the MQTT Broker 110 via Subscribe cannot be acquired even if the management unit 100 or the collection devices 131 to 142 subsequently connect to Subscribe. Therefore, it is preferable that the management unit 100 or the collection devices 131 to 142 connect to Subscribe during a period when a message may be Publish-distributed.

[0028] The present disclosure is not limited to the above-mentioned embodiment, and can be realized in various configurations without departing from the spirit of the present disclosure. For example, the technical features of the embodiments corresponding to the technical features in each aspect described in the Summary of the Invention column can be appropriately replaced or combined in order to solve some or all of the above-mentioned problems or to achieve some or all of the above-mentioned effects. Furthermore, if a technical feature is not described as essential in this specification, it can be appropriately deleted. [Explanation of symbols]

[0029] 10... data management system, 100... management unit, 110... MQTT Broker, 120, 125... transmission server, 130... collection device group, 131 to 142... collection device, 150, 155... collection system, 160, 165... storage unit, 170, 175... aggregation unit

Claims

1. 1. A data management system comprising: A collection device that outputs the collected data; A management unit that manages the collection device; an aggregation unit that aggregates the data output by the collection device; A delivery unit that mediates between the management unit, the collection device, and the aggregation unit by using a topic-based sorting method to allow other devices to acquire a message delivered by any one of the management unit, the collection device, and the aggregation unit by themselves, using an MQTT method; Equipped with The delivery unit is connected to the management unit, the collection device, and the aggregation unit by an MQTT method in which a message delivered to the delivery unit by any one of the management unit, the collection device, and the aggregation unit is acquired by the other device by using a sorting method using a topic, When the collecting device detects that a message distributed from the managing unit to the distributing unit using a topic designated by the collecting device is a data transmission instruction addressed to the collecting device, the collecting device transmits the collected data to the aggregating unit; When the aggregation unit completes the data aggregation, the aggregation unit distributes a completion message to the distribution unit, the completion message being specified by using a topic designated by the management unit; the management unit, when detecting that the completion message has been delivered from the aggregation unit to the delivery unit, determines that the collection device is in a state capable of responding. Data management system.

2. 2. The data management system according to claim 1, The collecting unit includes: a collection system having a storage unit and storing the data in the storage unit; A transmission server for transmitting the data from the collection device to the collection system; Equipped with A data management system, wherein the collection system delivers the completion message to the delivery unit when the data is stored in the storage unit.

3. 3. The data management system according to claim 1, A data management system in which the collection device connects to the distribution unit using a specific input port of the distribution unit.

4. A data management system according to any one of claims 1 to 3, The data management system wherein the distribution unit, when connected to the collecting device, acquires device information of the collecting device and performs alive monitoring of the collecting device.

5. 1. A data management method, comprising: The management unit and the collection device are each connected to the distribution unit via the MQTT method so that they can detect messages sorted using a specific topic, When the collection device detects that a message instructing data transmission addressed to the collection device, which is a specific topic, has been delivered from the management unit to the distribution unit while connected to the distribution unit by the MQTT method, the collection device transmits data to the aggregation unit; When the aggregator aggregates the data, the aggregator distributes a completion message to the distributor indicating that the data of a specific topic has been aggregated; When the completion message is delivered to the delivery unit while the management unit is connected to the delivery unit by the MQTT method, the management unit detects the message and determines that the collection device is in a state where it can respond. Data management methods.

Images