Multi-source heterogeneous data processing system and method based on industrial system

Abstract

According to the multi-source heterogeneous data processing system and method based on the industrial system provided by the invention, a part of calculation tasks (data cleaning, screening, encryption processing and the like are performed on the preprocessed data) are completed by adopting the edge calculation module, so that the calculation pressure of a cloud data center can be effectively relieved; meanwhile, heterogeneous data are coded in a multi-path parallel mode to form a unified identifier, subsequent calculation is facilitated, the processing speed can be improved, and furthermore, data screening is performed based on unified coding by adopting an edge calculation module, so that the data storage expenditure of a cloud data center can be greatly saved. Meanwhile, data screening of the edge computing module is also an efficient data cleaning mode, the computing burden of the cloud data center can be relieved, and in addition, the timeliness requirement of abnormal alarm can be met by detecting vulnerability data in real time and directly uploading the vulnerability data to the cloud data center.

Description

technical field [0001] The invention relates to the technical field of industrial data processing, in particular to a multi-source heterogeneous data processing system and method based on an industrial system. Background technique [0002] The rapidity, timeliness and professional demands of enterprises for industrial data collection are increasing day by day. In traditional industrial informatization, data is collected on site, and data transmission is mainly carried out in the local area network. At present, industrial data is gradually migrated to the public cloud, which is a general trend. There are challenges in the high-speed transmission of data to the cloud, and traditional wireless data collection technology is not competent. High-precision, low-latency industrial scene data collection cannot meet the real-time monitoring requirements of highly automated production processes. [0003] With the continuous development of industrial automation and Internet application...

AI Technical Summary

Problems solved by technology

However, a large amount of industrial data will inevitably bring difficulties in analysis and application, especially when the current data processing devices are very backward

At the same time, in order to ensure the normal and stable operation of the industrial system, the historical data that needs to be recorded is more diverse. If these data are directly stored or sent from the edge of the network to the data center for processing, it will not only waste a lot of storage space, but also make the data The query, transmission, and call of the data become very troublesome. Therefore, it is urgent to use certain means to filter and compress the data to solve the above-mentioned problems existing in the existing technology.

Images