Dynamically configurable big data analysis system

A dynamic configuration and analysis system technology, applied in data processing applications, electrical digital data processing, special data processing applications, etc., to achieve the effect of enhancing risk control capabilities and improving reliability

Pending Publication Date: 2019-09-10
FUJIAN NORMAL UNIV
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, although the real-time performance and fault-tolerant performance of this new real-time stream computing framework have been greatly improved, the high reliability and high availability of the system are still a challenging problem.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamically configurable big data analysis system
  • Dynamically configurable big data analysis system
  • Dynamically configurable big data analysis system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] In order to describe the technical content, achieved goals and effects of the present invention in detail, the following descriptions will be made in conjunction with the embodiments and accompanying drawings.

[0027] The most critical idea of ​​the present invention is: through the synergistic effect of each module of the system, the configuration optimization of the system performance is realized, and then a high-efficiency big data analysis and computing platform is obtained.

[0028] Please refer to figure 1 , the embodiment of the present invention provides a dynamically configurable big data analysis system, including:

[0029] The real-time data storage management module is used to obtain real-time streaming data in the distributed service cluster, dynamically configure relevant control parameters, and store them;

[0030] The real-time stream analysis and calculation module is used to statistically analyze real-time data, obtain real-time calculation results, ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a dynamically configurable big data analysis system. The system comprises a real-time data storage management module, a real-time flow analysis and calculation module, an offline analysis module and a visualization module. At least one component capable of performing dynamic configuration management is designed in each module, such as a data management configuration component, a real-time flow analysis and calculation configuration component, an offline analysis and calculation configuration component and a dynamic configuration component. The invention further providesa dynamic configuration method of the big data analysis system. A data structure and a message structure of each composition module are designed; dynamic configuration of the system is driven throughstate information of the warning data structure in the dynamic configuration manager; by means of the method, the system can run at a high-efficiency big data analysis and calculation level, and theoptimization process of big data analysis platform management is effectively solved.

Description

[0001] This case is a divisional application based on the patent application with the application number 201510577285.X, the application date is September 11, 2015, and the title is "Dynamic Configurable Big Data Analysis System and Method". technical field [0002] The invention relates to the application field of big data analysis, in particular to a dynamically configurable big data analysis system. Background technique [0003] Today's business intelligence systems, decision support systems, etc. are increasingly required to support big data integration and analysis. Due to the large amount of data, complex process, and long processing time of big data analysis and calculation, big data analysis and applications are also facing a new challenge. Challenges: The system must have high reliability, and the software system is required to be adaptive to changes. These systems need to have the ability to update the configuration without interrupting the system service. Fault tol...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q10/06G06F16/2458
Inventor 肖如良彭行雄丘志鹏倪友聪杜欣蔡声镇
Owner FUJIAN NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap