Data migration method in cloud computing environment-oriented layered storage system

Abstract

Disclosed is a data migration method in a tiered storage system in a cloud computing environment. The tiered storage system comprises an on-line service platform and a big data platform, and data comprises structured data and unstructured data, and migrates between the on-line service platform and the big data platform. The method comprises: determining a type of data under migration; and migrating between the on-line service platform and the big data platform according to the type of the data. When it is determined that the data under migration is the structured data, parallel migration is implemented by using the MapReduce architecture; and when it is determined that the data under migration is the unstructured data, parallel migration is implemented in an FTP manner.

Description

technical field [0001] The present invention relates to layered storage technology, more specifically, to a data migration method in a cloud computing environment-oriented layered storage system. Background technique [0002] In most existing application scenarios, an application system includes its own set of business systems, backup systems, and archiving systems. In the case of multiple systems, due to the large number of platforms, the management of the system is more complicated, and it is easy to cause waste of capacity space, which limits the storage capacity of each system. [0003] Under the current plan, if an enterprise has many systems, the administrator must be responsible for the maintenance of multiple systems at the same time, and design a backup system and archiving system for each system. Data backup and archiving, data backup and archiving systems require a certain degree of scalability, and the storage space between general businesses cannot be shar...

AI Technical Summary

Problems solved by technology

In the case of multiple systems, due to the large number of platforms, the management of the system is more complicated, and it is easy to cause waste of capacity space, which limits the storage capacity of each system

[0003]Under the current plan, if an enterprise has many systems, the administrator must be responsible for the maintenance of multiple systems at the same time, and design a backup system and Archiving system, and with the increase of business data, regular data backup and archiving is required. The data backup and archiving system requires certain scalability, and the storage space between general businesses cannot be shared, resulting in some systems using more space , some systems have very low space utilization

If you need to query data from a long time ago, you need to restore the data in the archive system. When the amount of data is large, the cost is high, and it is not easy to find the required data.

[0004] It can be seen from the above that the existing system cannot well satisfy the unified management of multi-application systems and cannot use the space reasonably

Images