Data processing method for real-time data acquisition and time series of equipment operation

Abstract

The invention discloses a data processing method for real-time data collection and time sequence of equipment operation. The method is as follows: the energy station side abstracts equipment into an object model, and uses the model concept to take the index data of equipment operation as the basic attribute of equipment to carry out the uniqueness of the whole station. number, collect the time series data of the device in real time according to different industrial protocols and carry the time stamp to form a data object for memory storage. After determining that the time series data is mutation data, send the time series data with the time stamp to the data center, and the data center will The time stamped time series data is processed. The invention can improve the read-write performance of big data and the utilization rate of disk storage, and reduce the operation cost for the enterprise.

Description

technical field [0001] The invention belongs to the technical field of the industrial Internet, and in particular relates to a data processing method for real-time data acquisition and time sequence of equipment operation. Background technique [0002] With the widespread application of the Industrial Internet, a new digital era of the Internet of Everything has opened up. During the production and operation process of enterprises, in order to achieve real-time monitoring of equipment operating status, timely alerts to abnormal operating equipment, and use historical equipment operating data to improve existing services. , it is necessary to collect and analyze the equipment operation data in real time, which has higher requirements for the real-time, authenticity and integrity of the data. [0003] At present, most of the processing of a large amount of time series data adopts commercial architecture platforms such as Microsoft and Alibaba or open source technology platform...

AI Technical Summary

Problems solved by technology

[0004] In the existing open source technology environment, non-relational databases are usually chosen to store time-series data, but in traditional algorithm processing, periodic sampling of equipment operating data can no longer meet the integrity requirements of big data, and millisecond-level change data Storage With the increase of terabytes of data, the read and write performance of the data disk has performance problems such as reading and writing to varying degrees, and the consumption of disk storage is huge, so solve the big data read and write performance and improve the use of disk storage under the framework of open source technology The rate can reduce the operating cost for the enterprise

Images