Data migration method and apparatus

Abstract

The invention discloses a data migration method and apparatus, and belongs to the technical field of a network. The method comprises the steps of obtaining multiple relation chains according to calculation task logs of an original service cluster, wherein the calculation task logs are used for recording correlation relationships between calculation tasks in the original service cluster and business data, and each relation chain is used for indicating a group of the calculation tasks and the business data with the correlation relationship; by taking the relation chains as units, migrating the business data and the calculation tasks indicated by the multiple relation chains to a target service cluster in sequence; and when migration is performed based on any relation chain, normally runningthe calculation tasks indicated by the relation chains not subjected to migration in the multiple relation chains. By representing the business data and the calculation tasks with the correlation relationships by adopting the relation chains, in the data migration process, the calculation tasks indicated by the relation chains not subjected to the migration still can normally run, so that normal use of businesses indicated by the relation chains not subjected to the migration is not influenced.

Description

technical field

[0001] The invention relates to the field of network technology, in particular to a data migration method and device. Background technique

[0002] With the development of network technology, the amount of business data of various businesses is growing rapidly, reaching the order of magnitude of PB (Petabyte, petabyte) or even above, making the Internet and information industry enter the era of big data. In the era of big data, service clusters composed of a large number of servers are usually used for business data storage, business processing and business management. In practical applications, service clusters are usually deployed in the same IDC (Internet Data Center, data center) computer room. However, with the continuous growth of business data, the scale of the service cluster is also expanding, and the scale of the IDC computer room is limited, which may not be able to store all the servers of the service cluster, thus limiting the scale of the servi...

Examples

Embodiment Construction

[0030] In order to make the object, technical solution and advantages of the present invention clearer, the implementation manner of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0031] Figure 1A It is a schematic diagram of the implementation scenario of data migration provided by the embodiment of the present invention, see Figure 1A , the implementation scenario includes the original service cluster, target service cluster and migration platform.

[0032] Among them, the original service cluster can include multiple storage clusters and multiple computing clusters. The storage clusters are used to store business data, and the computing clusters are used to run computing tasks and store related data of computing tasks, such as the size of computing resources and computing resources of computing tasks. location etc. Wherein, the storage cluster and the computing cluster may be deployed on different servers, ...

technical field

[0001] The invention relates to the field of network technology, in particular to a data migration method and device. Background technique

[0002] With the development of network technology, the amount of business data of various businesses is growing rapidly, reaching the order of magnitude of PB (Petabyte, petabyte) or even above, making the Internet and information industry enter the era of big data. In the era of big data, service clusters composed of a large number of servers are usually used for business data storage, business processing and business management. In practical applications, service clusters are usually deployed in the same IDC (Internet Data Center, data center) computer room. However, with the continuous growth of business data, the scale of the service cluster is also expanding, and the scale of the IDC computer room is limited, which may not be able to store all the servers of the service cluster, thus limiting the scale of the servi...

Examples

Embodiment Construction

[0030] In order to make the object, technical solution and advantages of the present invention clearer, the implementation manner of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0031] Figure 1A It is a schematic diagram of the implementation scenario of data migration provided by the embodiment of the present invention, see Figure 1A , the implementation scenario includes the original service cluster, target service cluster and migration platform.

[0032] Among them, the original service cluster can include multiple storage clusters and multiple computing clusters. The storage clusters are used to store business data, and the computing clusters are used to run computing tasks and store related data of computing tasks, such as the size of computing resources and computing resources of computing tasks. location etc. Wherein, the storage cluster and the computing cluster may be deployed on different servers, ...

Images