Database horizontal capacity expansion method and device, equipment and storage medium

A database and horizontal technology, applied in the database field, can solve the problems of several hours to dozens of hours, system group paralysis, data confusion, etc., and achieve the effect of solving poor user experience, strong reliability, and high accuracy

Pending Publication Date: 2021-06-15
SHANGHAI DONGPU INFORMATION TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The reasons are as follows: After expansion, if the number of sub-databases and tables changes, it is necessary to re-hash the modulus to migrate and distribute the stock data according to the new number of tables and databases. This process is very difficult for systems with huge data Said that the downtime may last from several hours to dozens of hours, and most businesses cannot afford such a long downtime
In addition, when migrating data, it may involve the data migration of several to dozens of related tables. Once the migration fails to write scripts or other reasons, it will lead to data confusion and the system group may be directly paralyzed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Database horizontal capacity expansion method and device, equipment and storage medium
  • Database horizontal capacity expansion method and device, equipment and storage medium
  • Database horizontal capacity expansion method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0046] This embodiment is aimed at the horizontal expansion of sub-databases and sub-tables. Traditional methods generally require data migration and downtime. For systems with huge data volumes, the business stop time will be too long and data confusion will easily occur, resulting in poor user experience. Even for the problem of business system paralysis, a method of horizontal expansion of database (also called horizontal expansion) is proposed, by providing enough tables at one time when establishing the initial database, avoiding later expansion of tables and redistribution of table data; At the same time, the table structure and data of the sub-database are initialized by establishing a slave database, and the sub-database is configured into the business application after a short shutdown to achieve capacity expansion. Overall, the downtime for capacity expansion is equivalent to the time-consuming of a small release. It does not affect the business and has no risk of dat...

Embodiment 2

[0154] This embodiment provides a database horizontal expansion device, please refer to figure 2 , the database horizontal expansion device includes:

[0155] The table quantity planning module 1 is used to predict and count the total business volume after several years according to the historical annual business volume of the enterprise when establishing the initial database, and calculate the expected number of data tables based on the total business volume. Quantity, calculate the number of tables in the initial database;

[0156] The capacity expansion module 2 is used to determine whether the initial database needs to be expanded according to the query and write concurrency of the initial database. In business applications, keep the number of tables in the entire database unchanged.

[0157] The functions and implementation methods of the table quantity planning module 1 and the expansion module 2 are as described in the first embodiment above, and will not be repeated...

Embodiment 3

[0159] The second embodiment above describes in detail the database horizontal expansion device of the present invention from the perspective of modularized functional entities, and the following describes the database horizontal expansion device of the present invention in detail from the perspective of hardware processing.

[0160] Please see image 3 , the database horizontal expansion device 500 may have relatively large differences due to different configurations or performances, and may include one or more processors (central processing units, CPU) 510 (for example, one or more processors) and memory 520, One or more storage media 530 (such as one or more mass storage devices) storing application programs 533 or data 532 . Wherein, the memory 520 and the storage medium 530 may be temporary storage or persistent storage. The program stored in the storage medium 530 may include one or more modules (not shown in the figure), and each module may include a series of instruct...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a database horizontal capacity expansion method and device, equipment and a storage medium. For horizontal capacity expansion of sub-libraries and sub-tables, a traditional method generally needs data migration, and shutdown is needed; for a system with a huge data volume, the service stop time is too long and data chaos is easy to occur, so that the user experience is poor and even the service system is paralyzed; yet, according to the invention, when the initial database is established, the table quantity is given at a time, so that table capacity expansion and table data redistribution in the later period are avoided; meanwhile, table structures and data of the sub-libraries are initialized through a method of establishing the sub-libraries, and the sub-libraries are configured to the business application through transient shutdown, so that capacity expansion is realized. Overall downtime of capacity expansion is equivalent to time consumed by one-time small release, business is not affected, the risk of data migration is avoided, and the problem that in the prior art, user experience is poor and even a business system is paralyzed due to capacity expansion and data migration of sub-libraries and sub-tables is solved.

Description

technical field [0001] The invention belongs to the technical field of databases, and in particular relates to a database horizontal expansion method, device, equipment and storage medium. Background technique [0002] For transactional systems, especially systems with large data volume and high concurrency, with the development of business and the increase of visits, the data volume is also increasing. The database used to access system business data will become the bottleneck of system development, including the storage bottleneck of data storage and the performance bottleneck of data query. In the face of these two problems, the technical solution of horizontally sub-database and sub-table of the database is generally adopted. [0003] The traditional design method will be more painful when the horizontal expansion of sub-database and sub-table is required. The reasons are as follows: After expansion, if the number of sub-databases and tables changes, it is necessary to...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/21G06F16/22G06F16/27
CPCG06F16/2282G06F16/275G06F16/211
Inventor 杨周龙肖广明
Owner SHANGHAI DONGPU INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap