Unlock instant, AI-driven research and patent intelligence for your innovation.

Data redistribution method and device

A technology of redistribution and data, applied in the field of data redistribution control, can solve the problems of high overhead and low efficiency of data redistribution processing methods, and achieve the effects of improving efficiency, reducing system overhead, and reducing data migration.

Pending Publication Date: 2021-12-28
金篆信科有限责任公司
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] The data redistribution method and device provided by the embodiments of the present invention solve the problems of low efficiency and high overhead of data redistribution processing methods in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data redistribution method and device
  • Data redistribution method and device
  • Data redistribution method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] In order to solve the problem of inefficiency caused by creating a new table in the prior art, the core idea of ​​this embodiment is to create a rule table according to the new fragmentation rule after receiving the data redistribution request, and save the fragmentation in the rule table. Shard key and metadata information. The so-called metadata information refers to the node information corresponding to the shard key data. For example, there are 3 nodes, which can be represented by 1, 2, and 3 respectively. Before the redistribution task ends, the computing nodes of the distributed database access data according to the old table. After the redistribution task ends, the computing nodes access data according to the rule table.

[0031] See figure 1 , the data redistribution method involved in this embodiment includes:

[0032] Step 102: In response to the data redistribution request sent by the computing node, create a rule table corresponding to the request according...

Embodiment 2

[0039] See figure 2 , the data redistribution method involved in this embodiment may include:

[0040] Step 202: Create a rule table.

[0041] After a data redistribution request is initiated, a new rule table is created based on the original table information. The sharding key of the new rule table is the same as the sharding method of the original table in the redistribution request. For example, the original table is hashed to 3 according to the field col1 On the node, redistribution requires hashing to 4 nodes, and the rule table is hashed to 4 nodes according to the field col1.

[0042] In this embodiment, the redistribution of changing the distribution mode from 3 nodes to 4 nodes is taken as an example for illustration. The original table name is tbs_info_detail, and the distribution mode is hash(uuid)(g1,g2,g3). The processor creates a hidden rule table tbs_info_detail_res_rule, and the distribution mode is hash(uuid)(g1,g2,g3,g4). There are two fields in the rule ...

Embodiment 3

[0065] See image 3 , the data redistribution device 300 involved in this embodiment includes:

[0066] computing node 301 , processor 302 and storage node 303 . The processor 302 is configured to respond to the data redistribution request sent by the computing node 301, and create a rule table corresponding to the request according to the original table information. There are multiple storage nodes 303, which are used to generate rule table data and send them to the storage node 303 corresponding to the rule table data, import the rule table data into the rule table, and complete the data of the rule table according to the original table. The computing node 301 is configured to access data in the form of a rule table.

[0067] The data redistribution device provided by Embodiment 3 of the present invention migrates data by creating a rule table instead of creating a new table, thereby improving the efficiency of data redistribution and reducing the impact of data migration....

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a data redistribution method and device.The data redistribution method comprises the steps of responding to a data redistribution request sent by a computing node and creating a rule table corresponding to the request according to original table information; generating rule table data and sending the rule table data to a storage node corresponding to the rule table data; importing the rule table data into a rule table; supplementing data of the rule table according to the original table; and accessing the data according to a rule table mode. By generating the new rule table, original data does not need to be migrated, the data redistribution efficiency is improved, and the influence caused by data migration in the redistribution process is effectively reduced.

Description

technical field [0001] Embodiments of the present invention relate to but are not limited to the field of databases, and specifically, relate to but are not limited to a data redistribution control method and device. Background technique [0002] The currently applied database has high concurrency, fast data growth, and provides services 7*24 hours. With the expansion of business, the expansion of data may increase by orders of magnitude, so distributed databases with good horizontal expansion capabilities are widely used. Distributed databases generally adopt a share nothing architecture, that is, each node has its own independent storage, and the storage is not shared between nodes. Data is distributed to multiple nodes according to rules, and nodes are generally connected through networks such as optical fibers. [0003] The distributed database has good scalability and can flexibly distribute node data according to business scenarios. For example, as the amount of data...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/22G06F16/2455G06F16/27
CPCG06F16/2282G06F16/27G06F16/24564G06F16/2255G06F16/2455G06F16/24568
Inventor 严俊
Owner 金篆信科有限责任公司