Transaction analysis hybrid processing method for distributed memory database and database
A hybrid processing and transaction analysis technology, applied in the field of data processing, can solve the problems of biased data processing, high performance, and resource utilization defects, and achieve the effect of making full use of resources, small additional overhead, and efficient service.
Pending Publication Date: 2020-03-10
SHANGHAI JIAO TONG UNIV
View PDF6 Cites 2 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
The design of dual systems generally uses "extract-transpose-load" (ETL) middleware to connect the original transactional database and data warehouse. This design can maximize the use of the characteristics of the original two databases to achieve better processing performance, but it is lacking in the freshness of data obtained in data analysis and the utilization of resources
In a single system with one format, all data is stored in one data format (or row or column format). This method can improve data freshness and resource utilization, but it is biased towards data processing and cannot be processed at the same time. Efficient performance in satisfying two requests
A single system with two data formats stores the same data in two formats: row data and column data, which can ensure the freshness of data analysis and the processing performance will be disturbed to a certain extent, and there are some defects in resource utilization
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0043] The present invention will be described in detail below in conjunction with specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be noted that those skilled in the art can make several changes and improvements without departing from the concept of the present invention. These all belong to the protection scope of the present invention.
[0044] Such as figure 1 As shown in FIG. 1 , it is a flow chart of the mixed load-oriented distributed memory database of the present invention. Such as figure 2 Shown is a topology diagram of client and server node deployment. The following combination figure 1 A detailed description of the mixed transaction and analysis processing steps of the distributed memory database:
[0045] In step S0, the request scheduler at the server side receives the request from the client, and judges whether it is a...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a transaction analysis hybrid processing method for a distributed memory database and the database. The transaction analysis hybrid processing method comprises the steps of processing a transaction processing request on a main node, processing an analysis processing request on a backup node, synchronizing the main node and the backup node, and reusing an original fault-tolerant data synchronization protocol. According to the method, the fault-tolerant protocol and data backup of the original transactional database can be fully utilized to support distributed transactionand analysis hybrid processing, the effect of high resource utilization rate is achieved, meanwhile, the performance of the original transactional database and the performance of the original analysisdatabase can be kept, the purpose of efficient service is achieved, and the freshness of data is guaranteed.
Description
technical field [0001] The invention relates to the field of data processing, in particular to a transaction analysis hybrid processing method of a distributed memory database and the database. Background technique [0002] The hybrid transaction and analytical processing (HTAP, Hybrid Transaction and Analytical Processing) workload is a demand raised by some enterprises and business consulting companies in recent years. It is necessary to support both transaction processing and analytical processing on a database system so that Real-time data analysis can be performed while supporting high-throughput transaction processing. [0003] For decades, in the development and application of database technology, databases are often divided into two categories: transactional databases and analytical databases (data warehouses). The requests processed by transactional databases generally have the characteristics of mixed reading and writing and small data sets, emphasizing the consis...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F11/14G06F9/50G06F16/22
CPCG06F11/1448G06F9/5083G06F16/22Y02D10/00
Inventor 陈榕沈斯杰陈海波臧斌宇
Owner SHANGHAI JIAO TONG UNIV