Application-awareness-free fragmentation database analysis and optimization method

An optimization method and database technology, applied in database management systems, electronic digital data processing, structured data retrieval, etc., can solve problems such as insufficient support, weak and unsupported middleware database functions, etc., to improve access efficiency and shorten the The effect of the access path

Active Publication Date: 2019-11-05
北京快立方科技有限公司
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Middleware technology: This technology requires fewer changes on the client side and is more versatile, but it also has two disadvantages: First, the access function to the database is subject to the functions of the middleware itself, and various middleware technologies themselves realize The functions are quite different, especially the database function of the middleware itself is very weak, and the support for some operations that require secondary processing, such as combined queries across tables, subqueries, and aggregation functions (such as SUM, AVG), is not optimized enough. Some do not even support it; secondly, every operation on the sharded database needs to go through the middleware, which affects the efficiency on the one hand, and on the other hand, the middleware itself is easily called a bottleneck

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Application-awareness-free fragmentation database analysis and optimization method
  • Application-awareness-free fragmentation database analysis and optimization method
  • Application-awareness-free fragmentation database analysis and optimization method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The method for analyzing and optimizing the fragmented database without application perception provided by the present invention is to establish a management mechanism of the fragmented database, and analyze the management mechanism of the fragmented database into the following parts:

[0028] (1) Client sharding driver: provide database access interface to the application program, so that the application program does not need to care about whether the SQL statement is a distributed query or a centralized query, and does not need to care about the sharding rules of the database;

[0029] (2) Fragmented database: a data storage and management system composed of multiple fragments. Each shard is an independent database node, which stores a part of data information and is responsible for managing local data. Multiple shards together form a complete set of data storage;

[0030] (3) Fragmentation manager: used to store the fragmentation information of the fragmented databas...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an application-awareness-free fragmented database analysis and optimization method, which comprises the following steps that S1, when an application program executes query operation of a fragmented database, statements are sent to a query analyzer and an optimizer through a client fragmentation driver; S2, a query analyzer and an optimizer perform grammar check and analysison the query statement, and whether the query is a distributed query or a centralized query is judged according to whether the query content or the query condition contains a centralized processing keyword or not; S3, the query analyzer and the optimizer analyze which data fragments of the fragment database the query needs to be executed according to the query condition in combination with the data fragment information stored in the fragment manager; S4, the query analyzer and the optimizer notify the fragmentation driver of the query mode of this time; and S5, the fragmentation driver operates the fragmentation database through the distributed query executor or the centralized query executor, and returns a query result to the client.

Description

technical field [0001] The invention relates to a method for processing a fragmented database, in particular to an application-insensitive method for analyzing and optimizing a fragmented database. Background technique [0002] As the amount of data increases, the data in a single database table of a relational database will become very large. As the amount of data increases, on the one hand, the performance of accessing the data will decrease, and on the other hand, the data will be concentrated in one database table. It will also bring about the problem of concurrency support. Fragmented databases can solve the above problems by sharding the data in the database table according to the hash value or range value of the primary key, and can store the data in one database table into multiple fragmented tables in multiple databases. However, the sharded database brings another problem, that is, the original access operation to one table has now become the access operation to m...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2453G06F16/2458G06F16/25
CPCG06F16/2453G06F16/2471G06F16/25
Inventor 骆彬
Owner 北京快立方科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products