A multi-source heterogeneous data processing system and method based on industrial system

Abstract

The multi-source heterogeneous data processing system and method based on an industrial system provided by the present invention can effectively alleviate cloud data by using an edge computing module to complete a part of computing tasks (data cleaning, screening and encryption processing for preprocessed data, etc.). At the same time, the heterogeneous data is encoded in a multi-channel parallel way to form a unified identification, which is convenient for subsequent calculation and can improve the processing speed. Furthermore, the edge computing module is used to screen data based on unified encoding, which can greatly save cloud data. The data storage expenses of the center, and the data screening of the edge computing module is also an efficient data cleaning method, which can reduce the computing burden of the cloud data center. In addition, real-time detection of vulnerability data and uploading directly to the cloud data center can also meet the requirements of abnormal alarms. timeliness requirements.

Description

technical field [0001] The invention relates to the technical field of industrial data processing, in particular to a multi-source heterogeneous data processing system and method based on an industrial system. Background technique [0002] The rapidity, timeliness and professional demands of enterprises for industrial data collection are increasing day by day. Traditional industrial informatization is based on data collection on site, and data transmission is mainly carried out in the local area network. At present, it is a general trend to gradually migrate industrial data to the public cloud. There are challenges in the high-speed transmission of data to the cloud, and traditional wireless data collection technology is difficult to do High-precision, low-latency industrial scene data collection cannot meet the real-time monitoring requirements of highly automated production processes. [0003] With the continuous development of industrial automation and Internet applicati...

AI Technical Summary

Problems solved by technology

However, a large amount of industrial data will inevitably bring difficulties in analysis and application, especially when the current data processing devices are very backward

At the same time, in order to ensure the normal and stable operation of the industrial system, the historical data that needs to be recorded is more diverse. If these data are directly stored or sent from the edge of the network to the data center for processing, it will not only waste a lot of storage space, but also make the data The query, transmission, and call of the data become very troublesome. Therefore, it is urgent to use certain means to filter and compress the data to solve the above-mentioned problems existing in the existing technology.

Images