Unlock instant, AI-driven research and patent intelligence for your innovation.

Query processing method being suitable for large-scale real-time data stream

A processing method and data flow technology, applied in the field of query optimization processing technology, can solve the problem that the data flow cannot be optimized, and achieve the effect of high query efficiency

Active Publication Date: 2012-10-17
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] Using the existing optimal processing method for database data to process the data flow can not achieve the optimal processing, in view of the particularity of the data flow, a special optimized calculation and processing data query processing method is required

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Query processing method being suitable for large-scale real-time data stream
  • Query processing method being suitable for large-scale real-time data stream
  • Query processing method being suitable for large-scale real-time data stream

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] According to the FROM clause of the input query task, the query is decomposed into separate queries for each data stream in the FROM clause, and the individual query results of all data streams are combined to form the final query result; take a data stream Stream in the FROM clause as example:

[0023] The individual query of the data stream Stream is realized by the mixed optimization combined query chain of the SELECT clause and the WHERE clause:

[0024] Suppose there are multiple queries as follows:

[0025] Query 1: SELECT A,D FROM Stream WHERE B1,C1,

[0026] Query 2: SELECT A FROM Stream WHERE B3, C2

[0027] Query 3: SELECTA,D FROM Stream WHERE B2,C3,E

[0028] Query 4: SELECT D FROM Stream WHERE F

[0029] Query 5: SELECT D FROM Stream WHERE B4,F

[0030] The above query statements all have the same atomic query SELECT*FROM Stream WHERE*, based on the same data stream, such as figure 1 As shown, therefore, query optimization can be performed on the above five query statem...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a query processing method being suitable for a large-scale real-time data stream, and the method is characterized in that according to an FROM clause of an inputted query task, the query is decomposed into a plurality of independent queries of each data stream in the FROM clause, an independent query result of each data stream is merged to form a final query result; and the independent query of each data stream is realized through a combined optimized merged query chain for an SELECT clause and a WHERE clause.

Description

Technical field [0001] The invention relates to large-scale data stream processing technology and query optimization processing technology. Background technique [0002] With the rapid development of information technology and the widespread application of Internet technology, many industries are facing the processing of massive streaming data. As the amount of data continues to grow, the data stream processing system platform will further require the ability to provide real-time and efficient services. It is foreseeable that in the future, there will be more and more data sources (for example, sensors and other devices) connected to the network, the amount of data that needs to be processed online and real-time analysis will increase, and the services that system units need to provide will also increase. Therefore, the system must quickly process massive amounts of data, respond to requests in a timely manner, and provide high-performance and highly available services to users ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 罗光春田玲陈爱国秦科
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA