Enterprise-level real-time production data analysis system based on Hadoop

Abstract

The invention discloses an enterprise-level real-time production data analysis system based on Hadoop. The system comprises: S1, through production equipment and a control system, inputting data information; S2, storing and querying the data information; S3, processing and analyzing the data information; S4, learning an information processing algorithm in a deep learning mode; and S5, analyzing, displaying, warning and storing the data information. The system is based on a Hadoop technical framework, adopts a big data storage technology, supports a parallel computing infrastructure, has the capabilities of big data storage access and distributed computing task scheduling, adopts a distributed search engine technology, and has a database synchronization technology and an ETL technology; and machine learning and artificial intelligence technologies are adopted to carry out data standardization, structuring and other processing on the data, a disease knowledge graph is constructed based on a semantic analysis technology, data information transmission processing can be realized, and the accuracy of the data is ensured.

Description

technical field [0001] The invention belongs to the technical field of data analysis systems, in particular to a Hadoop-based enterprise-level real-time production data analysis system. Background technique [0002] Data analysis refers to the use of appropriate statistical and analytical methods to analyze a large amount of collected data, summarize, understand and digest them, in order to maximize the development of data functions and play the role of data. Data analysis is the process of detailed research and summary of data in order to extract useful information and form conclusions. The purpose of data analysis is to concentrate and extract information hidden in a large number of seemingly disorderly data, so as to find out The internal laws of the object. In practical terms, data analysis can help people make judgments so that appropriate actions can be taken. Data analysis is the process of collecting data in an organized and purposeful way, analyzing the data, and ...

AI Technical Summary

Problems solved by technology

[0003] Such as the data analysis system and data analysis method disclosed in CN102880503B with the authorization announcement number, although it has been realized because the bottom layer of the data analysis system utilizes the Hadoop system to carry out data analysis, and the upper layer of the data analysis system is realized by the task scheduling module. The overall management of tasks can not only simplify the data analysis process by using the Hadoop system, but also provide a system for scheduling and managing tasks more conveniently, but it does not solve the existing problems of data information transmission, storage and deep learning. problem, for which we propose an enterprise-level real-time production data analysis system based on Hadoop

Images