Inter-node data migration method, device, computing device and computer storage medium

An inter-node and data technology, applied in the field of data processing, can solve the problems of increasing data migration costs, manpower consumption, complexity, etc., and achieve the effect of avoiding high data migration costs and reducing manual intervention

Active Publication Date: 2021-07-23
BEIJING QIHOO TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Among them, with the development of business and the increase or decrease of the amount of data in the distributed storage system, there will inevitably be expansion and shrinkage requirements. In addition, the data nodes in the distributed storage system may also need to realize the load due to excessive load. Therefore, data migration is required. However, the existing data migration methods are too complicated and require too much manual intervention. Moreover, if the amount of data to be migrated is too large, the migration time may be very long, and it is necessary to keep Manual intervention consumes manpower and increases the cost of data migration

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Inter-node data migration method, device, computing device and computer storage medium
  • Inter-node data migration method, device, computing device and computer storage medium
  • Inter-node data migration method, device, computing device and computer storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0026] figure 1 A schematic flowchart of a method for data migration between nodes according to an embodiment of the present invention is shown. This method is applied to distributed systems containing central nodes, such as figure 1 As shown, the method includes the following steps:

[0027] Step S100, receiving a data migration request sent by a management terminal and carrying data migration information and a version number of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data migration method, device, computing equipment and computer storage medium between nodes. Wherein, the method includes: receiving a data migration request sent by the management terminal and carrying data migration information and a version number of the first metadata information, wherein the data migration information includes: table identifier, data fragmentation identifier, source node IP port information, destination node IP port information; compare the first meta information version number with the second meta information version number recorded by the central node; if the first meta information version number is consistent with the second meta information version number, then store the data migration information in In the disk of the central node; obtain a preset amount of data migration information from the disk of the central node for processing, so as to realize the data migration between the source node and the destination node, reduce manual intervention, and avoid the problem caused by excessive data migration. The cost of data migration is too high due to large and labor-intensive operations. In addition, the data migration operation is simple and easy to implement.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a data migration method, device, computing device and computer storage medium between nodes. Background technique [0002] With the continuous development of information technology, distributed storage systems appear. Distributed storage systems are highly cohesive and transparent, and meet the needs of large-scale data storage. Therefore, they have been widely used. Among them, with the development of business and the increase or decrease of the amount of data in the distributed storage system, there will inevitably be expansion and shrinkage requirements. In addition, the data nodes in the distributed storage system may also need to realize the load due to excessive load. Therefore, data migration is required. However, the existing data migration methods are too complicated and require too much manual intervention. Moreover, if the amount of data to be migrated ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/0647G06F3/067
Inventor 王康
Owner BEIJING QIHOO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap