Distributed data analyzing and processing method and system

A technology of distributed data and processing methods, which is applied in the fields of data analysis and processing and databases. It can solve the problems of prolonging the generation cycle of statistical analysis results and inability to share the load of database hosts, so as to shorten data processing time, improve concurrent processing capabilities, and shorten generation time. cycle effect
CN102479225AActive Publication Date: 2012-05-30CHINA MOBILE GROUP SICHUAN
7 Cites 24 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
CHINA MOBILE GROUP SICHUAN
Publication Date
2012-05-30

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention provides a distributed data analyzing and processing method, comprising the following steps that: A, a load-sharing server transmits a request for obtaining an executable object script to a script server, and the script server judges whether the executable object scrip is found, if so, a step C is executed, otherwise, a step B is executed; B, the script server reads script source codes from a database host, and edits the script source codes to obtain the executable object script; C, the script server obtains the executable object script from the script server, calls an entrance method of a script object, and executes data acquisition, clearing, counting, analysis and processing types of function codes defined by the executable object script; and D, the load-sharing server transmits the processing result of executing the executable object script back to the database host through a remote database connection. The invention further provides a distributed data analyzing and processing system.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to the field of data analysis and processing and database technology, in particular to a distributed data analysis and processing method and system. Background technique

[0002] The existing online analytical processing (OLAP) process often adopts centralized data processing, and there is serious competition for database resources. Data collection, cleaning, analysis, and execution have become bottlenecks, prolonging the generation cycle of result data.

[0003] figure 1 It is a simple schematic diagram of an existing online analytical processing (OLAP) type data processing system. The system includes a database host 101 and three Web servers, namely a Web server 102, a Web server 103 and a Web server 104.

[0004] figure 2 Shown is the existing online analytical processing (OLAP) type data processing flow, including the following steps:

[0005] Step 201: multiple web servers collect various raw data for online analysis and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More