Capacity expansion method and device, electronic equipment and computer readable medium

A database and cluster technology, applied in computing, database design/maintenance, electrical digital data processing, etc., can solve problems such as key value loss, timeout failure, failure to ensure safe and stable expansion, etc., to facilitate storage and avoid timeout failure , to ensure the effect of safe, controllable and smooth operation

Pending Publication Date: 2022-04-05
CHINA CONSTRUCTION BANK
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the huge amount of information, a single Key (key name) of the Redis cluster stores hundreds of millions of data. When these data are migrated, there is a risk of timeout failure, and the failure is irreversible. After the failure, the Key value will be lost. Unable to guarantee safe and smooth expansion

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Capacity expansion method and device, electronic equipment and computer readable medium
  • Capacity expansion method and device, electronic equipment and computer readable medium
  • Capacity expansion method and device, electronic equipment and computer readable medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0083] figure 1 is a schematic diagram of main steps of the method for expanding the capacity of a database cluster according to Embodiment 1 of the present invention. like figure 1 As shown, the expansion method of the database cluster in Embodiment 1 of the present invention mainly includes the following steps:

[0084] Step S101: Find the big key data stored in the original database cluster, export the big key data to a local file, and delete the big key data in the original database cluster after the export is successful. Execute the bigkeys command on the slave nodes of the original database cluster to obtain big Key data of various data types. Then export the big key data to a local file. After the export is successful, delete the big key data of the original database cluster.

[0085] Among them, the syntax format of the bigkeys command is: redis-cli-h{ip}-p{port}bigkeys, ip is the host IP address, and port is the port. After executing the bigkeys command, you can g...

Embodiment 2

[0091] figure 2 is a schematic diagram of the main flow of the method for expanding the capacity of a database cluster according to Embodiment 2 of the present invention. like figure 2 As shown, the expansion method of the database cluster in the second embodiment of the present invention mainly includes the following steps:

[0092] Step S201: Find the large Key data stored in the original database cluster, and back up the AOF file and RDB file generated by the original database cluster during persistent storage. By executing the bigkeys command, you can find out the big key data of various data types stored in the original database cluster. In order to increase security and rollback, on the premise of ensuring that the data will not change, the AOF file and RDB file of the original database cluster can be backed up.

[0093] Step S202: Export the big key data to a local file. After the export is successful, delete the big key data of the original database cluster accord...

Embodiment 3

[0102] image 3 is a schematic diagram of the main flow of the method for expanding the capacity of a database cluster according to Embodiment 3 of the present invention. like image 3 As shown, the expansion method of the database cluster in the third embodiment of the present invention mainly includes the following steps:

[0103] Step S301: Execute the bigkeys command to find the big key data stored in the original Redis cluster, and back up the AOF file and RDB file generated by the original Redis cluster during persistent storage. By executing the bigkeys command, you can find out the big key data of various data types stored in the original Redis cluster. The bigkeys command can be as follows: . / redis-cli-c-p 7001 --bigkeys

[0104] In the embodiment, in order to avoid occupying the master node for a long time and causing other business requests to be blocked, the bigkeys command can be executed on the slave node of the original Redis cluster to reduce network overhea...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a capacity expansion method and device, electronic equipment and a computer readable medium, and relates to the technical field of big data storage. A specific embodiment of the method comprises the following steps: searching big Key data stored in an original database cluster, exporting the big Key data to a local file, and deleting the big Key data of the original database cluster after the big Key data is successfully exported; expanding the original database cluster, and in the expansion process, migrating non-large Key data stored in the original database cluster to a new database cluster after expansion; and determining that the non-large Key data of the new database cluster is consistent with the non-large Key data of the original database cluster, and importing the large Key data of the local file into the new database cluster. According to the implementation mode, independent processing of the large Key data is achieved, timeout failure caused by the large Key data is avoided, and safe, controllable and stable operation of the capacity expansion process is guaranteed.

Description

technical field [0001] The present invention relates to the technical field of big data data storage, in particular to a capacity expansion method, device, electronic equipment and computer readable medium. Background technique [0002] With the development of current information technology and the popularization of mobile terminal equipment, massive amounts of information will be disseminated through mobile terminals, and users can receive various information from the outside world without leaving home. As a message transfer and processing node, the message push system can push various messages to the application program (Application, APP) of the user's mobile terminal. In order to improve the stability, immediacy and push experience of message push, the prior art uses the Redis service of cache and data storage in the message push system. [0003] With the growth of users, the capacity of the Redis cluster will reach the upper limit. In order to ensure the stability and i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F16/22G06F16/215G06F16/21
Inventor 谭豪杰陈大平胡江罗蕾陈宏尧
Owner CHINA CONSTRUCTION BANK
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap