Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Distributed database system based on HTAP

A database and distributed technology, applied in the database field, can solve problems such as limited vertical expansion space, intrusive business and application, high cost, etc., and achieve reliable building performance, saving upgrade costs, and good consistency and integrity.

Pending Publication Date: 2022-05-31
SHANGHAI PUDONG DEVELOPMENT BANK
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Easily limited by hardware configuration, vertical expansion space is limited
There is asynchronous delay in master-slave replication; partition tables need to maintain partitions manually on a regular basis; the scheme of sub-database and sub-table cannot provide strong consistency and completeness in commercial bank transaction scenarios at the database layer. Distributed transaction requirements have great impact on business and applications It is intrusive and requires certain technical adjustments and transaction compromises in the application system; cross-database queries need to be combined on the middle layer; if the capacity of a single database is insufficient, it needs to be split again, which is costly

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed database system based on HTAP
  • Distributed database system based on HTAP
  • Distributed database system based on HTAP

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0027] A distributed database system based on HTAP, such as Figures 1 to 3 As shown, HTAP refers to a hybrid transaction / analytical processing database, including TiDB layer 1, TiKV layer 2 and cluster scheduling module 3. TiDB layer 1 is used to receive database access requests, and through cluster scheduling module 3 to query the storage access request to calculate the required data TiKV address, the calculation task is sent to the corresponding TiKV storage unit 201, and the calculation result returned by TiKV is obtained; TiKV layer 2 includes TiKV layer 2 includes three or more TiKV storage units 201, TiKV storage units 201 are used for Store data, and perform data calculation according to the computing tasks issued by TiDB layer 1; cluster scheduling module 3 is used to store storage information of TiKV units for TiDB layer 1 to query. In this embodiment, cluster scheduling module 3 is Placement Driver Module, referred to as PD.

[0028] In this embodiment, the TiDB la...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an HTAP-based distributed database system, which comprises a TiDB layer, a TiKV layer and a cluster scheduling module, and is characterized in that the TiDB layer is used for receiving a database access request, querying a storage access request through the cluster scheduling module, calculating a TiKV address of required data, issuing a calculation task to a corresponding TiKV storage unit, and obtaining a calculation result returned by the TiKV; the TiKV layer comprises a plurality of TiKV storage units, and the TiKV storage units are used for storing data and performing data calculation according to a calculation task issued by the TiDB layer; and the cluster scheduling module is used for storing the storage information of the TiKV unit for a TiDB layer to query. Compared with the prior art, the method has the advantages of being high in expandability, low in cost, good in data integrity and consistency and the like.

Description

technical field [0001] The invention relates to the field of databases, in particular to a distributed database system based on HTAP. Background technique [0002] With the rise of the concept of big data and the implementation of massive data requirements in various industries, the scenarios of traditional centralized database processing are gradually limited. As a new type of data storage solution, distributed data has received more and more attention. When the distributed database is applied to the financial industry, due to the higher requirements for risk control in the financial industry, the distributed database cannot effectively solve the high-complexity transaction scenarios, and the business real-time performance and consistency are poor. Distributed databases are often based on MySQL master-slave replication combined with partition tables and sub-database and sub-table middleware. When the data volume and access volume increase, the hardware upgrade method is use...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/242G06F16/27
CPCG06F16/2291G06F16/242G06F16/27Y02D10/00
Inventor 陈成路进锋吴建华孙敏
Owner SHANGHAI PUDONG DEVELOPMENT BANK
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com