Unlock instant, AI-driven research and patent intelligence for your innovation.
Multi-version parallel hybrid processing method based on online aggregation
What is Al technical title?
Al technical title is built by PatSnap Al team. It summarizes the technical point description of the patent document.
An online aggregation and mixed processing technology, applied in the database field, achieves the effect of being easy to use and improving computing efficiency
Inactive Publication Date: 2019-07-16
哈尔滨汇拓投资中心(有限合伙)
View PDF5 Cites 2 Cited by
Summary
Abstract
Description
Claims
Application Information
AI Technical Summary
This helps you quickly interpret patents by identifying the three key elements:
Problems solved by technology
Method used
Benefits of technology
Problems solved by technology
[0003] The purpose of the present invention is: for most systems in the prior art all rely on the Multi-Version Parallel Control (MVCC) of a single execution engine to handle affairs, MVCC can't carry out the mixed workload problem that comprises long-time OLAP inquiry preferably
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more
Image
Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
Click on the blue label to locate the original text in one second.
Reading with bidirectional positioning of images and text.
Smart Image
Examples
Experimental program
Comparison scheme
Effect test
specific Embodiment approach 1
[0021] Specific implementation mode one: the following combination figure 1 and figure 2 This embodiment will be specifically described. In this embodiment, a multi-version parallel hybrid processing method based on online aggregation is characterized in that it includes the following steps:
[0022] Step 1: When performing OLTP processing and OLAP query at the same time, assume that the original data table is C, and the virtual copy of the data table is C’;
[0023] Step 2: Make C' the latest version of the column in the OLTP engine, the data table C and its build version chain are logically moved to the OLAP engine and become read-only;
[0024] Step 3: Use the online aggregation method for OLAP query analysis, and use aggregation operators to provide uninterrupted feedback after analyzing SQL statements;
[0025] Step 4: While performing step 3, perform OLTP transaction processing on the virtual copy C', and directly submit the result to the virtual copy C' after execut...
Embodiment
[0033] according to figure 1 and figure 2 Specifically illustrate this embodiment, this embodiment is specifically as follows:
[0034] Step 1: table C is provided in the OLTP engine;
[0035] Step 2: Three operation requests W appear in OLTP 5 (1), W 2 (2) and W 3 (3);
[0036] Step three: W 5 (1) and W 2 (2) Commit operation, write in C, W 3 (3) The operation was suspended in the middle and was not saved to C;
[0037] Step 4: An OLAP query accesses Q1. At this time, move table C to the OLAP engine, and create a snapshot C’ in the OLTP engine. At this time, C in the OLAP engine is read-only;
[0038] Step 5: Parallel processing, OLAP operations are performed in C, while OLTP operations are performed in C';
[0039] Step 6: The OLTP operation is completed. At this time, the OLAP operation has not been completed, so continue to execute the OLAP operation;
[0040] Step 7: When a new OLAP query accesses Q2, move the table C' to the OLAP engine, and create a snapshot...
specific Embodiment approach 2
[0044] Embodiment 2: This embodiment is a further description of Embodiment 1. The difference between this embodiment and Embodiment 1 is that the method for obtaining the virtual copy C' in Step 1 is: using a custom system
[0045] vm_snapshot calls and obtains a snapshot of data table C, and generates a virtual copy C' of the data table.
[0046]In this embodiment, the custom system vm_snapshot is adopted when acquiring a virtual copy (snapshot), which significantly improves the running speed.
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More
PUM
Login to View More
Abstract
The invention discloses a multi-version parallel hybridprocessing method based on online aggregation, and relates to the technical field of databases, which can solve the problem that in the prior art, most systems depend on multi-version parallel control (MVCC) of a single execution engine to process transactions, and the MVCC cannot well execute the mixed workload including the long-time OLAP query. According to the method, snapshot of the versioned data table is realized in a virtual snapshot form, the virtual snapshot process is speeded up by introducing a custom system call to VM_snapshot to the Linux kernel, so as to virtually delete the obsolete version sequence and timestamp information, and switch the current version chain so that online transactions are executed in the latest version, and hybrid execution processing of multi-version parallel transactions is achieved.. According to the method, the output result is continuously fed back through online aggregation, visualization of the query result is achieved, the calculation efficiency of OLAP query analysis and the operability of a user are improved, and the method is easier to use.
Description
technical field [0001] The invention relates to the technical field of databases, in particular to a multi-version parallel mixed processing method. Background technique [0002] For multi-version database systems, system transactions include short-term online transaction processing (OLTP) and long-term online analytical processing (OLAP). OLTP, also known as transaction-oriented processing, processes input data and responds in a timely manner, aiming to enable transactional applications to write only the required data in order to process a single transaction as quickly as possible. The main application of OLAP is to support decision-making management analysis, which requires a large number of calculation and analysis of multi-dimensional databases, so as to understand the original data from multiple angles. Most systems today rely on a single execution engine's Multiversion Concurrency Control (MVCC) to process transactions, processing OLAP queries and OLTP transactions on...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More
Application Information
Patent Timeline
Application Date:The date an application was filed.
Publication Date:The date a patent or application was officially published.
First Publication Date:The earliest publication date of a patent with the same application number.
Issue Date:Publication date of the patent grant document.
PCT Entry Date:The Entry date of PCT National Phase.
Estimated Expiry Date:The statutory expiry date of a patent right according to the Patent Law, and it is the longest term of protection that the patent right can achieve without the termination of the patent right due to other reasons(Term extension factor has been taken into account ).
Invalid Date:Actual expiry date is based on effective date or publication date of legal transaction data of invalid patent.
Login to View More 
Login to View More