Method and system for distributed calculating and enquiring magnanimity data in on-line analysis processing
A technology of online analysis processing and distributed computing, which is applied in computing, electrical digital data processing, special data processing applications, etc., and can solve problems such as computing and query tasks that have not studied MapReduce data cubes
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment Construction
[0027] Embodiments of the present invention will be further described below in conjunction with the accompanying drawings, but the present invention is not limited thereto.
[0028] As shown in FIG. 1 , the cluster system structure adopted by the present invention is mainly divided into a name node and a data node. The name node divides data into blocks, distributes data blocks to each node, and reads and writes data blocks, that is, manages data nodes and schedules distributed computing tasks; data nodes store data blocks and process Map computing tasks and Reduce computing tasks.
[0029] As shown in Figure 2, the process of processing large-capacity data sets on the cluster system shown in Figure 1 in the present invention is:
[0030] 1) MapReduce divides the large-capacity data set to be calculated into blocks, and the size of each block is equal to the size of the data set divided by the number of Map tasks, and distributes the data blocks to the nodes;
[0031] 2) The ...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com