Method and device for data aggregate query

A data aggregation and data technology, applied in the field of data processing, can solve the problems of high data transmission network communication overhead and low aggregation query efficiency, and achieve the effects of avoiding aggregation query performance degradation, reducing network communication overhead, and improving efficiency

Active Publication Date: 2015-04-08
DAWNING INFORMATION IND BEIJING +1
View PDF4 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The embodiment of the present invention proposes a method and device for data aggregation query, which is used to solve the problems of large data transmission network communication overhead and low aggregation query efficiency existing in the aggregation query mode of the existing parallel database

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for data aggregate query
  • Method and device for data aggregate query
  • Method and device for data aggregate query

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] In order to be more clearly understood through the technical solutions and advantages of the present invention, the exemplary embodiments of the present invention will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all implementations. Exhaustive list of examples.

[0021] An embodiment of the present invention provides a method for data aggregation query, which will be described below.

[0022] figure 1 The implementation flow diagram of the data aggregation query method provided by the embodiment of the present invention, as shown in the figure, the data query method may include the following steps:

[0023] Step 101: the first-level nodes perform aggregated queries on the data stored respectively, and the nodes are nodes under the shared-nothing architecture;

[0024] Step 102: Summarize the data obtained after the aggregation que...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and device for data aggregate query. The method comprises the following steps: executing the aggregate query to the self-stored data by a first node, wherein the node is the node of non-share architecture; gathering the data obtained by executing the aggregate query of the first node to a second node; and executing the aggregate query to the data obtained by executing the aggregate query of the first node through a second node. The device comprises a first executing module for executing the aggregate query to the self-stored data by the first node, wherein the node is the node of non-share architecture; a gathering module for gathering the data obtained by executing the aggregate query of the first node to the second node; and a second executing module for executing the aggregate query to the data obtained by executing the aggregate query of the first node through the second node. The technical scheme of the method and device is used for effectively reducing the network communication overhead of the data aggregate query, and improving the efficiency of the data aggregate query.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a method and device for data aggregation query. Background technique [0002] With the advent of the era of big data, compared with traditional data analysis, we now encounter greater challenges, on the one hand, the explosive growth of data volume, and on the other hand, the increase of data types. Hadoop emerged as the times require to solve the problem of offline data analysis, but for real-time data analysis, due to the characteristics of Hadoop itself, it cannot be applied to real-time data analysis. Therefore, parallel database is still the main tool for real-time data analysis. In parallel database systems, aggregate query and relational query are the main methods to perform data analysis. The query of the parallel database involves multiple nodes in the cluster. If the aggregation query is directly executed on each node, a wrong result may be obtained in the end....

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/24556
Inventor 李晋钢宋怀明狄静舒惠润海
Owner DAWNING INFORMATION IND BEIJING
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap