Data storage and dynamic migration method and device

A data storage and dynamic migration technology, applied in the direction of electrical digital data processing, data processing input/output process, instruments, etc., can solve the problems of massive small files, large memory space pressure, performance and load balancing effects, etc., to improve and slow down Effects of bandwidth pressure, consumption reduction, and storage efficiency improvement

Inactive Publication Date: 2018-07-06
广东南华工商职业学院 +1
View PDF5 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The present invention provides a method and device for data storage and dynamic migration to solve the problem of large memory space pressure duri...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage and dynamic migration method and device
  • Data storage and dynamic migration method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is an embodiment of a part of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0022] refer to figure 1 As shown, the embodiment of the present invention provides a method for dynamic data migration, including:

[0023] 101. After the client submits a data storage request, sequentially select at least one data node for storing data according to the magnitude of the scheduling evaluation value.

[0024] Preferabl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data storage and dynamic migration method. The method comprises the steps that after a client side submits a data storage request, according to the size of a dispatching evaluating value, sequentially selecting at least one data node for storing data; obtaining a relative load value of the data nodes and an average load value of all the data nodes; if the relative load value of the data nodes is not smaller than the average load value, determining the data nodes as heavy load nodes, and adding the heavy load nodes into a heavy load node set in a descending sorting mode; otherwise, determining the data nodes as light load nodes, and adding the light load nodes into a light load node set in an ascending sorting mode; migrating the data in the heavy load nodes in theheavy load node set to the light load nodes in the light load node set. The execution efficiency during node load balancing can be improved, consumption of node hardware resources is lowered, and themethod is of an important and practical significance in improving the storage efficiency of a cloud storage system and relieving the bandwidth pressure.

Description

technical field [0001] The invention relates to the technical field of data storage, in particular to a data storage and dynamic migration method and device. Background technique [0002] With the rapid development of the Internet, the amount of data generated in today's society is increasing rapidly. Most of the information data on the Internet is expressed in the form of high-frequency small files, and there are relatively many operations on the storage and access of small files in the information storage and access of general users. [0003] In the cloud storage system, massive data storage, high performance, and high scalability are its main features. However, when the number of small files reaches a certain level, storing a large number of small files will bring huge pressure on the memory space of the data nodes. Frequent and repeated access to a large number of small files will also affect the performance and load balancing of data nodes. [0004] In the cloud stora...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
CPCG06F3/0607G06F3/0655G06F3/067
Inventor 夏建兵魏文国
Owner 广东南华工商职业学院
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products