Inter-cluster data migration method and system, server and computer storage medium
An inter-cluster and intermediate storage technology, applied in the computer field, can solve problems such as non-support, process blocking, migration, etc., and achieve the effects of wide application range, reduced time, and improved migration speed
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0026] figure 1 A schematic flowchart of a method for data migration between clusters according to Embodiment 1 of the present invention is shown. The method is used for data migration between the first cluster and the second cluster, and the first cluster and the second cluster both include a master node and at least one child node, such as figure 1 As shown, the method includes the following steps:
[0027] Step S100 , according to the data migration request, each child node in the first cluster writes their respective data in parallel to a designated path of the intermediate storage system.
[0028] The inter-cluster data migration method provided by the embodiment of the present invention can be used to perform data migration between the first cluster and the second cluster, for example, to migrate the data in the first cluster to the second cluster, after receiving the data migration request , each child node in the first cluster writes their respective data to the spec...
Embodiment 2
[0035] figure 2 A schematic flowchart of a method for migrating data between clusters according to Embodiment 2 of the present invention is shown. Such as figure 2 As shown, the method includes the following steps:
[0036] Step S200, according to the data migration request, start the data writing service for connecting each child node in the first cluster with the HDFS system.
[0037] Among them, the intermediate storage system includes: HDFS system. The HDFS system has the advantages of large bandwidth, large capacity, and large I / O throughput. Therefore, it can support each sub-node of the data storage system to write data into the HDFS system in parallel.
[0038] The following will take the HDFS system as an example for a detailed introduction.
[0039]After receiving the data migration request, each child node in the first cluster starts the data writing service used to connect the child node and the HDFS system according to the data migration request, wherein the ...
Embodiment 3
[0072] image 3 A schematic structural diagram of an inter-cluster data migration system according to Embodiment 3 of the present invention is shown. The system is used for data migration between the first cluster and the second cluster, such as image 3 As shown, the system includes: a first cluster 300, a second cluster 310, and an intermediate storage system 320, wherein the first cluster includes a master node 301 and at least one sub-node 302, and the second cluster includes a master node 311 and at least one A child node 312.
[0073] Each child node in the first cluster is suitable for writing respective data to a specified path of the intermediate storage system in parallel according to the data migration request;
[0074] The master node of the first cluster is suitable for the master node of the first cluster to back up the data table structure to the local master node in the form of a table file, and send the table file to the master node in the second cluster for t...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com