Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A data online aggregation method in cloud computing environment

A cloud computing environment and data technology, applied in computing, database models, relational databases, etc., can solve the problems of complex implementation methods, online aggregation implementation without considering multi-table connections, etc.

Active Publication Date: 2017-01-18
RENMIN UNIVERSITY OF CHINA
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method assumes that the longer the processing time of the data block, the greater the aggregation value. However, this assumption is not true in all aggregation operations, and the implementation method is more complicated.
In addition, it only solves the single-table online aggregation problem composed of one MapReduce job, and does not consider the multi-table connection online aggregation based on multiple MapReduce jobs.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data online aggregation method in cloud computing environment
  • A data online aggregation method in cloud computing environment
  • A data online aggregation method in cloud computing environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] The present invention will be described in detail below in conjunction with the accompanying drawings and embodiments.

[0018] The data online aggregation method of the present invention is realized based on the online aggregation system, such as figure 1 As shown, the online aggregation system includes an application interface layer 1 , a query processing layer 2 , an online aggregation processing layer 3 and a data storage layer 4 . The application interface layer 1 sets SQL statements according to user needs; provides users with the display of SQL and query results, and displays the online aggregation results to users in real time in digital or graphical form. The application interface layer 1 transmits the SQL statement submitted by the user to the query processing layer 2. The query processing layer 2 converts the SQL statement submitted by the user into a MapReduce online execution plan after grammatical analysis, and transmits it to the online aggregation processi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a data online gathering method in a cloud computing environment. The method comprises the steps of setting an SQL (Structured Query Language) query statement Q according to requirement of a user by an SQL interface module at an application interference layer, and transmitting the SQL query statement Q to a query processing layer; analyzing the received query statement Q through a grammar analyzing module, and transmitting an analyzing result to a MapReduce online performing plan module; starting MapReducer operation by the MapReduce online performing plan module if the analyzed query statement Q is query on account of a single form, starting two MapReduce operations by the MapReduce online performing plan module if the analyzed query statement Q is on account of query of a plurality of forms, processing a query request of the query statement Q through an online gathering processing layer according to one or two received MapReduce operations, and transmitting a processing result to the application interface layer for display. The data online gathering method can be widely applied to the cloud computing environment.

Description

technical field [0001] The invention relates to an online data gathering method, in particular to an online data gathering method under a cloud computing environment. Background technique [0002] Online aggregation was first proposed by Hellerstein et al. The earliest online aggregation research mainly focused on the realization of single-table online aggregation in relational databases. Subsequently, this problem has been studied to a certain extent in the field of relational databases. Extending the work of Hellerstein, Haas et al. provide methods for computing large sample-based confidence intervals and deterministic confidence intervals. Aiming at the online aggregation of multi-table joins, Haas et al. gave a series of ripple join algorithms. Ripple join is based on the nested join and hash join design in offline query processing, and its purpose is to get the estimated result as soon as possible under the premise of ensuring incremental calculation. Luo et al. impr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/24554G06F16/284
Inventor 孟小峰
Owner RENMIN UNIVERSITY OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com