Large-scale hot continuous rolling data scheme customizing system based on cloud computing

Abstract

The invention provides a large-scale hot continuous rolling data theme customizing system based on cloud computing. The large-scale hot continuous rolling data theme customizing system comprises an ETL (electron transport layer) module, a data persistence layer and a theme customizing layer. The ETL module is used for realizing original hot continuous rolling system data analysis, a cloud data warehouse data sheet building and a data extraction; the data persistence layer organizes and stores structuralized data extracted from the ETL module by utilizing the cloud data warehouse; and the theme customizing module, aiming at solving the problem of data theme analysis in the cloud data warehouse, provides users with reasonable customizing schemes through a theme pool and an experience pool, and provides users with a general data analytical function through a public data mining method pool and a MapReduce module container, so that working efficiency of data management staff can be improved. The theme customizing system has flexible expandability, can be integrated in any original hot continuous rolling system data system, can solve a complicated data theme clarifying problem when a user's requirement is unclear, and can provide a reliable data set guarantee to the hot continuous rolling system data analysis.

Description

Technical field [0001] The invention relates to the technical field of large-scale data processing in the iron and steel metallurgical industry, in particular to the pre-processing field of data mining for hot tandem rolling. Background technique [0002] In the daily production process of the hot strip rolling production line, a large amount of real-time data is generated, which contains rich scientific research value. For a long time, due to insufficient attention to massive data and poor management, the data has been stored scattered for a long time and has not been effectively used. From the perspective of data mining, it is a great waste. To a certain extent, this has greatly affected the development of hot rolling technology. [0003] With the development of computer technology, basically all hot-rolled steel strip mills have realized electronic and information management. However, these are just some storage, statistics and display of existing data, such as direct display ...

AI Technical Summary

Problems solved by technology

[0005] The technical problem to be solved by the present invention is to build a cloud data warehouse that can be used for analysis and mining for the original hot-rolled steel system, and provide an expandable theme customization function for flexible processing of complex data sets under unknown demand conditions. theme customization for further data mining and analysis

Images