Cloud data migration method

A cloud data and data technology, which is applied in the field of cloud data migration, can solve the problems of unconsidered migration cost and unsuitable cloud storage system, etc., and achieve the effect of easy promotion, reducing load tilt, and improving load balance

Inactive Publication Date: 2016-01-06
QILU UNIV OF TECH
View PDF1 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

2) The data migration strategy based on the greedy method is mainly aimed at the data migration problem of the Key/Value storage system. The basic idea is to use statistical methods to monitor hotspot partitions online, and preferentially migrate some data of hotspot partitions to neighboring nodes with lighter loads. In order to simplify the compl

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cloud data migration method
  • Cloud data migration method
  • Cloud data migration method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0053] The present invention provides a cloud data migration method, and its specific implementation process is as follows:

[0054] In order to more effectively identify hot data and reduce the amount of data migration as much as possible, we use the concept of blocks used by HDFS. The default size is 64M. HDFS divides a file into one or several blocks for storage, and each block is independent Storage units allocate storage on cluster servers in units of blocks. In this paper, each block is regarded as a partition, and the partition is regarded as the basic unit of data migration and load monitoring. Before invoking the data migration algorithm, all storage nodes are classified into the migration-in node set In_set and the migration-out node set Out_set according to the relationship between the standardized load value and the total number of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a cloud data migration method. The cloud data migration method comprises the following specific steps: dividing one file into one or more blocks to store, and distributing and storing on a cluster server by taking the block as a unit, wherein each block is an independent storage unit; taking each block as one partition, and taking the partition as a basic unit for data migration and load monitoring; respectively classifying all storage nodes in an immigration node set and an emigration node set according to the relationship of standardized load values and the total node number of a system; and achieving load balance of the system among various nodes in a cloud environment through a data migration algorithm. Compared with the prior art, the cloud data migration method disclosed by the invention has the advantages that: a data migration strategy is made on the basis of the balance degree; an optimal data migration operation is selected; therefore, the load balance of the system is achieved; the load skew is reduced; and the cloud data migration method is high in practicability and easy to popularize.

Description

technical field [0001] The invention relates to the technical field of data storage, in particular to a highly practical cloud data migration method. Background technique [0002] Massive data storage with high reliability and scalability is a huge challenge for Internet companies. Traditional databases are often difficult to meet this demand, and most of the searches for specific systems are based on primary keys. In this case, using a relational database will make the efficiency low, and expansion will become a big problem in the future. In such cases, using storage will be a good choice. For storage systems deployed in cloud environments, data migration is a key technology to realize node dynamic expansion and elastic load balancing, mainly including migration plan formulation, routing information synchronization, user request forwarding, and data consistency management. . A large amount of state synchronization accompanying the data migration process will have a certa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08
CPCH04L67/1097H04L67/1001
Inventor 赵晶姜雪松袁家恒
Owner QILU UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap