SQL (structured query language) query plan generation method oriented to streaming data processing

A query plan, streaming data technology, applied in electrical digital data processing, special data processing applications, computing, etc., can solve problems such as low parsing efficiency, lack of query analysis processing engines, and no support for continuous query, and shorten execution time. , High analytical efficiency, and the effect of improving efficiency

Inactive Publication Date: 2012-07-25
HUAZHONG UNIV OF SCI & TECH
View PDF2 Cites 54 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, the existing SQL query plan generation technology has the following problems: 1. Using rule-based optimization technology, it cannot always generate efficient query plans; 2. It does not support continuous query and is not suitable for streaming data processing; 3. Lack of Complete query analysis processing engine, low parsing efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • SQL (structured query language) query plan generation method oriented to streaming data processing
  • SQL (structured query language) query plan generation method oriented to streaming data processing
  • SQL (structured query language) query plan generation method oriented to streaming data processing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] Firstly, the technical vocabulary of the present invention will be explained and described below.

[0038] Continuous task: A task that is submitted only once and runs continuously on the database. Continuous task query continuously returns query results as new data arrives.

[0039] Streaming tasks: query tasks arranged in a timestamp manner using data stream characteristics and sliding window mechanism, and the query results will be converted into data streams.

[0040] Open source syntax analyzer: an open source syntax analysis tool that provides a framework for automatically constructing custom language recognizers, compilers, and interpreters through syntax descriptions for languages ​​including Java, C++, C#, and SQL.

[0041] SQL abstract syntax tree: is the tree-like representation of the abstract syntax structure of SQL statements and the data structure in memory.

[0042] Logical plan tree: A tree structure composed of relational algebraic expressions. The non-leaf nod...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an SQL(structured query language) query plan generation method oriented to streaming data processing, which is characterized by including the following steps of receiving SQL commands input by users; judging whether grammars of the SQL commands are correct or wrong; preprocessing the SQL commands if the grammars of the SQL commands are correct; switching the continuous duty to the streaming duty, analyzing and optimizing the streaming duty to generate query plans if the SQL commands indicate the continuous duty; and finally (7) carrying out the query plans. The SQL query plan generation method oriented to streaming data processing is capable of generating the optimum SQL query analysis plans according to characteristics of data, is high in processing speed and analysis efficiency and particularly suitable for the field of streaming data processing, while users are allowed to use user-defining SQL data format.

Description

Technical field [0001] The invention relates to the field of computer applications, in particular to a method for generating a SQL query plan for stream data processing. Background technique [0002] In a distributed database system based on MapReduce, for the SQL query plan generation method, the prior art creates a series of MapReduce jobs according to the user's SQL query commands. The MapReduce jobs are composed of directed acyclic graphs and operate in the form of iterators. After the data of each operator is processed, the resulting tuple is passed to the next operator. [0003] However, the existing SQL query plan generation technology has the following problems: 1. The rule-based optimization technology cannot always produce an efficient query plan; 2. It does not support continuous query and is not suitable for the needs of streaming data processing; 3. Lack Complete query analysis processing engine, low analysis efficiency. Summary of the invention [0004] The purpose o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 金海赵峰袁平鹏刘述曦张冬洁
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap