Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

An application-aware fragmented database analysis and optimization method

An optimization method and database technology, applied in database management systems, structured data retrieval, electronic digital data processing, etc., can solve problems such as insufficient support, weak middleware database functions, and no support, so as to improve access efficiency and shorten The effect of the access path

Active Publication Date: 2022-05-27
北京快立方科技有限公司
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Middleware technology: This technology requires fewer changes on the client side and is more versatile, but it also has two disadvantages: First, the access function to the database is subject to the functions of the middleware itself, and various middleware technologies themselves realize The functions are quite different, especially the database function of the middleware itself is very weak, and the support for some operations that require secondary processing, such as combined queries across tables, subqueries, and aggregation functions (such as SUM, AVG), is not optimized enough. Some do not even support it; secondly, every operation on the sharded database needs to go through the middleware, which affects the efficiency on the one hand, and on the other hand, the middleware itself is easily called a bottleneck

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An application-aware fragmented database analysis and optimization method
  • An application-aware fragmented database analysis and optimization method
  • An application-aware fragmented database analysis and optimization method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The application-agnostic sharding database analysis and optimization method provided by the present invention is to establish a sharded database management mechanism, and parse the sharded database management mechanism into the following parts:

[0028] (1) Client sharding driver: Provides database access interface to applications, so that applications do not need to care about whether the SQL statement is a distributed query or a centralized query, and do not need to care about the sharding rules of the database;

[0029] (2) Sharded database: a data storage and management system composed of multiple shards. Each shard is an independent database node, which stores a part of data information and is responsible for managing local data. Multiple shards together form a complete set of data storage;

[0030] (3) Fragmentation manager: used to store fragmentation information of the fragmented database, including which fragments of the fragmented database, data fragmentation ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides an application-insensitive fragmented database analysis and optimization method, which includes the following steps: S1: when the application program executes the query operation of the fragmented database, the statement is sent to the query analyzer and optimized by the client fragmentation driver. S2: The query analyzer and optimizer check and analyze the syntax of the query statement, and judge whether the query is a distributed query or a centralized query according to whether the query content or query conditions contain centralized processing keywords; S3: The query analyzer and optimizer will analyze which data fragments of the fragmented database the query needs to be executed on based on the query conditions and combined with the data fragmentation information stored in the fragmentation manager; S4: The query analyzer and the optimizer notify the fragmentation The query mode of this query of the slice driver; S5: The slice driver operates the slice database through the distributed query executor or the centralized query executor, and then returns the query result to the client.

Description

technical field [0001] The present invention relates to a method for processing a fragmented database, in particular to a method for parsing and optimizing a fragmented database with no application perception. Background technique [0002] As the amount of data increases, the data in a single database table of a relational database will become very large. As the amount of data increases, on the one hand, the performance of accessing the data will be reduced, and on the other hand, the data will be concentrated in one database table. There will also be problems with concurrency support. The sharded database can solve the above problems by sharding the data in the database table according to the hash value or range value of the primary key. But the sharded database brings another problem, that is, the original access operation to a table has now become an access operation to multiple tables in multiple databases, and the ACID characteristics of the database require a new mech...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/2453G06F16/2458G06F16/25
CPCG06F16/2453G06F16/2471G06F16/25
Inventor 骆彬
Owner 北京快立方科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products