An industrial big data processing system and method

A big data processing and industrial technology, applied in the direction of database management system, structured data retrieval, etc., can solve the problems of complex industrial process, difficult large amount of data query and analysis, and slow statistical analysis speed of data processing side, so as to improve the analysis speed and Accuracy, ensuring robustness, and performance-enhancing effects

Active Publication Date: 2019-04-23
CHENGDU UNION BIG DATA TECH CO LTD
View PDF5 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Since the industrial process of factory production is relatively complicated, and the storage time cannot reflect the business increment, business partition conversion cannot be performed
In the face of massive and complex industrial data, commonly used data processing methods are slow in statistical analysis, making it difficult to query and analyze large amounts of data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An industrial big data processing system and method
  • An industrial big data processing system and method
  • An industrial big data processing system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] In order to make the purpose, technical solution and advantages of the present invention clearer, the present invention will be further elaborated below in conjunction with the accompanying drawings.

[0040] In this example, see figure 1 As shown, the present invention proposes a kind of industrial big data processing system, comprises ETL service cluster, data source and client, and described client and data source are respectively connected to ETL service cluster; Described ETL service cluster comprises management server and distributed Multiple execution servers parallel in parallel, each execution server is connected to the same or different data source, and all execution servers are connected to the management server;

[0041] Described management server comprises the control node of background and embedded Web server, provides the state management, distribution management and result management of ETL execution program;

[0042] The execution server is a containe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an industrial big data processing system and method, and the system comprises an ETL service cluster, a data source, and a user terminal. The user terminal and the data sourceare connected to the ETL service cluster, the ETL service cluster comprises a management server and a plurality of distributed parallel execution servers, each execution server is connected to the same or different data sources, and all the execution servers are connected to the management server. The whole process of industrial data processing is deployed in a distributed and high-availability mode, so that the robustness of the system and the safety and the consistency of data are ensured; the industrial data processing and analyzing speed and precision can be rapidly improved, and a large amount of data can be inquired and analyzed.

Description

technical field [0001] The invention belongs to the technical field of industrial data processing, and in particular relates to an industrial big data processing system and method. Background technique [0002] Data is an important resource of modern enterprises and the basis for enterprises to use scientific management and decision analysis. At present, most enterprises spend a lot of money and time to build an online transaction processing system, which is used to record various related data of transaction processing. According to statistics, the amount of data will double every 2 to 3 years. These data contain huge commercial value, but the use of enterprises usually only accounts for 2% to 4% of the total amount of data, which is still not maximized. Existing data resources. Therefore, how enterprises convert data into information and knowledge through various technical means has become the main bottleneck in improving their core competitiveness. [0003] Since the in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25
Inventor 不公告发明人
Owner CHENGDU UNION BIG DATA TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap