Distributed industrial SCADA system measurement data processing method based on time sequence library

Abstract

The invention discloses a distributed industrial SCADA system measurement data processing method based on a time sequence library. The method comprises the following steps: electing from a distributed application deployment server cluster by adopting an election mechanism to generate a Leader node and a Follower node; adopting a heartbeat detection method to keep normal communication between the Leader node and each Follower node; enabling the Leader node to perform virtual partition division by adopting a partition mapping method of a virtual node in combination with a Hash algorithm, and averagely distributing the virtual node to each time sequence database node; and according to a received measurement data reading / writing request, determining a virtual partition in a cache by taking the measurement point ID as a keyword, and positioning the virtual partition to a corresponding physical time sequence library server, so that measurement data reading / writing is performed on the physical time sequence library server. According to the invention, a uniform interface and a dynamic expansion service can be provided for measurement data reading / writing, and the real-time performance of data reading / writing is improved.

Description

technical field [0001] The invention relates to a method for processing measurement data of a distributed industrial SCADA system based on a time series library, and belongs to the technical field of data processing. Background technique [0002] In the actual application process of the industrial SCADA system, because many applications require multi-dimensional data, there are many data collection points. At the same time, due to the actual needs of the application, it is usually necessary to keep the collected data for a long time for query, analysis and statistics. On the other hand, the collection of a lot of data requires high real-time performance and a high collection frequency, so that the data in the database is bound to increase. Therefore, under the premise of ensuring system stability and normal access, it will be inevitable Faced with the problem of processing large amounts of data. [0003] At present, the storage of industrial SCADA systems mostly stays in r...

AI Technical Summary

Problems solved by technology

The other part uses a time series database for storage. Although it meets the requirements for read and write performance, because the supplier of the time series database does not open source the way of cluster deployment and only opens storage on a single node, it is a bottleneck in terms of storage capacity.

Another part adopts a big data solution similar to HBase. The reading and writing performance of this solution is between the relational library and the time series library, and supports dynamic expansion. However, it does not have the function of simple SQL statement query and needs to introduce other middleware deployment. High complexity of deployment and problem location

Images