Online fragmentation capacity expansion method and device for a distributed system cluster

A distributed system and cluster technology, applied in the field of distributed systems, can solve the problems of waste of resources, insufficient database performance and capacity, and large impact, and achieve the effect of saving resource costs.

Pending Publication Date: 2021-10-15
INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in actual production, the distribution of data may not be uniform. Some clusters are relatively active in business and the amount of data increases rapidly. The performance and capacity of the database of these clusters will soon be insufficient.
Doubling the capacity every time not only wastes resources, but also involves full data migration every time, which has a large impact and a large workload

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Online fragmentation capacity expansion method and device for a distributed system cluster
  • Online fragmentation capacity expansion method and device for a distributed system cluster
  • Online fragmentation capacity expansion method and device for a distributed system cluster

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] The embodiment of the present invention provides a distributed system cluster online sharding expansion method and device, which can be used in the financial field or other fields. It should be noted that the distributed system cluster online sharding expansion method and device of the present invention can be used in the financial field , can also be used in any field except the financial field, and the application field of the distributed system cluster online sharding expansion method and device of the present invention is not limited.

[0049] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art wi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an online fragmentation capacity expansion method and device for a distributed system cluster, which can be used in the financial field or other fields. The method comprises the following steps: updating a cluster routing configuration rule in a distributed system according to a preset maximum cluster fragment number; determining a to-be-fragmented cluster in a plurality of clusters of the distributed system according to the updated cluster routing configuration rule, and splitting the to-be-fragmented cluster to obtain a new fragmented cluster; according to a received external data request, determining a Hash value corresponding to the external data request by using a Hash algorithm, and calculating a remainder value of the Hash value and the maximum fragment number of the cluster; and comparing the remainder value with the updated cluster routing configuration rule, determining a specified cluster corresponding to the remainder value, and routing the cluster data corresponding to the remainder value to the specified cluster. According to the invention, fragmentation capacity expansion under the distributed system is realized, and the hotspot cluster is split and expanded, so that the expansion nodes, the change time and the influence on a service system are reduced, and the resource cost is saved.

Description

technical field [0001] The invention relates to the technical field of distributed systems, in particular to a distributed system cluster online fragmentation expansion method and device. Background technique [0002] At present, when a new business system is first launched, the business volume is small. In order to save resources and costs, the smallest cluster deployment is generally adopted. For systems using unitized or microservice architectures, the database and application containers are deployed together. Database sharding generally adopts the method of moduloing the initial cluster after the hash of the business field to determine the cluster where the data resides. The formula is expressed as: mod(hash(business field), number of clusters n). The number of clusters n is relatively small at the initial stage of business launch. Under the deployment architecture of active-active in the same city, n generally takes an even number, and the two parks are deployed equall...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/24H04L29/08G06F16/27G06F16/22G06F16/2455G06F16/2458
CPCH04L41/0896H04L67/10G06F16/27G06F16/24564G06F16/2255G06F16/2474H04L67/63
Inventor 廖宸毛淑平万旭阮文浩
Owner INDUSTRIAL AND COMMERCIAL BANK OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products