Implementation method for operator reuse in parallel database

Abstract

The invention discloses an implementation method for operator reuse in a parallel database, comprising the following steps of: step 1, generating a serial query plan for query through a normal query planning method, wherein the query plan is a binary tree structure; step 2, executing the query plane by scanning from top to bottom, searching materialized reusable operators, changing the query plane structure, and changing thread level materialized operators into global reusable materialized operators; step 3, parallelizing the query plan changed in the step 2, and generating a plan forest for parallel execution of a plurality of threads; step 4, executing global reusable operator combination on the plan forest generated in the step 3, and generating a directed graph plan for the materialized reusable operators capable of being executed by the plurality of threads in parallel; step 5, executing own plan part in the directed graph by each thread in parallel, wherein the thread which executes the global reusable operator firstly is called a main thread, the main thread locks the global reusable operator and truly executes the operator and the plan of the operator, and other threads wait; step 6, unlocking the global reusable operator by the main thread after execution, wherein other threads start to read data from the global reusable operator and continue to execute own plan tree;and step 7, releasing the materialized data of the operator by the main thread after all the plans read the data of the global reusable operator.

Description

technical field

[0001] The invention relates to a database system, in particular to a method for realizing operator multiplexing of a parallel database. Background technique

[0002] With the development and popularization of information technology, data is rapidly expanding at an exponential rate, and processing massive data has become an important problem in the computer field. The research on OLAP, DSS, data mining, etc. emerging in the database field is essentially the research on massive data processing.

[0003] At present, the popular technologies for solving massive data processing problems are parallel query technology and cluster technology. Parallel query technology has always been a research hotspot in the database field. The academic community has proposed a variety of parallel query architectures: Share-Everything (completely shared) architecture, Share-Memory (shared memory) architecture, Share-Disk (shared disk) Architecture and Share-Nothing (no sharing) a...

Images