Distributed processing method and system based on WEB analysis

A technology of distributed processing and distributed data, applied in data processing applications, electrical digital data processing, special data processing applications, etc., can solve the lack of effective methods, efficiency, reliability, scalability and manageability. And other issues

Inactive Publication Date: 2009-11-18
北京黑米天成科技有限公司
View PDF2 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The WEB analysis tools currently on the market lack effective methods in the face of s

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed processing method and system based on WEB analysis
  • Distributed processing method and system based on WEB analysis
  • Distributed processing method and system based on WEB analysis

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0013] The technical solution adopted by the present invention is: in the collection, storage, calculation, presentation and other links of WEB analysis, a distributed processing method and system based on WEB analysis is adopted. The system includes data farms, data processing plants, distributed data There are four working modules of warehouse and data presentation center.

[0014] The specific workflow is as follows:

[0015] (1) First, the data farm harvests and collects customer data from various data sources;

[0016] (2) Then, the data farm writes these massive customer raw data into the distributed data warehouse in parallel. The distributed data warehouse includes multiple storage nodes, and these nodes work together to store the original data of these customers in a distributed manner;

[0017] (3) The data processing factory reads out the original customer data from the distributed data warehouse and performs secondary processing;

[0018] (4) The data processing...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed processing method and a system based on WEB analysis, wherein the system comprises four working modules of a data farm, a data processing plant, a distributed data warehouse and a data presentation center. The core concepts of the invention are as follows: (1) the data farm collects client data from various data sources; (2) the enormous client original data are parallel written into the distributed data warehouse; (3) the data processing plant reads out the client original data from the distributed data warehouse and conducts calculation and secondary process; (4) the result data after the secondary process are written back to the distributed data warehouse; and (5) the data presentation center utilizes parallel query technique to lead a user to conveniently view the original data and the data after the secondary process through the WEB. Aiming at the enormous WEB marketing data, the processing method and system can conduct high-efficiency process, have breakthrough in aspects of high efficiency, reliablity, scalability, manageability and the like, and can be applied to the fields of internet WEB analysis and the like.

Description

technical field [0001] The invention relates to the related field of Internet WEB analysis. Background technique [0002] With the development of the Internet, WEB analysis has become an important means for enterprises to understand and optimize online business. In the field of WEB analysis, the amount of data that needs to be processed is very large. How to efficiently process these massive online business data in parallel in real-time or quasi-real-time (generally can be delayed by one day, that is: today shows yesterday's latitude Analyzing data) is presented to customers, and the capacity can be expanded arbitrarily by adding servers, which is a difficult problem that many WEB analysis tool providers need to solve. [0003] The WEB analysis tools currently on the market lack effective methods in the face of such massive data, and are lacking in efficiency, reliability, scalability, and manageability. Contents of the invention [0004] In order to solve the above exis...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30G06Q30/00G06Q30/02
Inventor 李存刚鲁雪林张渔冯帅崇晓云
Owner 北京黑米天成科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap