Dynamically configured big data analysis system and method

A technology for dynamically configuring and analyzing systems, applied in data processing applications, electrical digital data processing, special data processing applications, etc., to achieve the effect of improving reliability and enhancing risk control capabilities

Active Publication Date: 2016-01-27
FUJIAN NORMAL UNIV
View PDF6 Cites 41 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, although the real-time performance and fault-tolerant performance of this new real-time stream computing framework have been greatly improved, the high reliability and high availability of the system are still a challenging problem.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamically configured big data analysis system and method
  • Dynamically configured big data analysis system and method
  • Dynamically configured big data analysis system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] In order to describe the technical content, achieved goals and effects of the present invention in detail, the following descriptions will be made in conjunction with the embodiments and accompanying drawings.

[0026] The most critical idea of ​​the present invention is: through the synergistic effect of each module of the system, the configuration optimization of the system performance is realized, and then a high-efficiency big data analysis and computing platform is obtained.

[0027] Please refer to figure 1 , the embodiment of the present invention provides a dynamically configurable big data analysis system, including:

[0028] The real-time data storage management module is used to obtain real-time streaming data in the distributed service cluster, dynamically configure relevant control parameters, and store them;

[0029] The real-time stream analysis and calculation module is used to statistically analyze real-time data, obtain real-time calculation results, ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a dynamically configured big data analysis system and method. The system includes a real-time data storage management module, a real-time flow analysis and calculating module, an off-line analysis module, and a visualization module. At least one assembly capable of performing dynamical configuration management is arranged in each module, for example, a data management configuration assembly, a real-time flow analysis and calculating configuration assembly, an off-line analysis and calculating configuration assembly, and a dynamic configuration assembly. The invention further provides a dynamical configuration method of the big data analysis system. A data structure and an information structure of each module are designed, and a calculating method of warning redundancy and a dynamic configuration method are provided through the dynamic configuration of a state information driving system of a warning data structure in a dynamic configuration manager. According to the invention, the system can run at an efficient big data analysis and calculating level, and the optimization process of big data analysis platform management is effectively solved.

Description

technical field [0001] The invention relates to the application field of big data analysis, in particular to a dynamically configurable big data analysis system and method. Background technique [0002] Today's business intelligence systems, decision support systems, etc. are increasingly required to support big data integration and analysis. Due to the large amount of data, complex process, and long processing time of big data analysis and calculation, big data analysis and applications are also facing a new challenge. Challenges: The system must have high reliability, and the software system is required to be adaptive to changes. These systems need to have the ability to update the configuration without interrupting the system service. Fault tolerance management issues, how to handle exceptions in the case of update failure, make The system maintains normal and stable operation. That is, dynamic configuration technology is an important means to realize the adaptive reliab...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q10/06G06F17/30
Inventor 肖如良彭行雄丘志鹏倪友聪杜欣蔡声镇
Owner FUJIAN NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap