Unlock instant, AI-driven research and patent intelligence for your innovation.

A data automatic migration optimization method in a hierarchical storage system

A hierarchical storage and optimization method technology, applied in the direction of electrical digital data processing, special data processing applications, data processing input/output process, etc., can solve problems affecting storage system application performance, increase memory and disk IO overhead, etc., to achieve Optimize data migration efficiency, stabilize load levels, and improve application performance

Active Publication Date: 2017-11-10
LANGCHAO ELECTRONIC INFORMATION IND CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when using this method, once the amount of data in the high-performance storage device reaches the specified threshold (space occupancy rate) and triggers data migration, it will inevitably increase the CPU, memory and disk IO overhead of the system, which will affect the performance of the entire storage system. application performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data automatic migration optimization method in a hierarchical storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] The present invention will be described in detail below in conjunction with the accompanying drawings. The data automatic migration optimization method in the hierarchical storage system includes two parts: storage device load judgment and data refresh;

[0018] Storage device load judgment: Obtain the average load of storage devices, judge whether the average load of each storage device exceeds the load threshold, and use this as a basis to judge whether the data in each storage device should be included in the refresh list;

[0019] Data refresh mechanism: Copy the dirty data in the high-performance storage space to the low-performance storage device, but still retain the source data in the high-performance storage device, and mark the source data as clean data.

[0020] The storage device is provided with a timer similar to a heartbeat mechanism, which is used to periodically check the load of the storage device and continuously judge the load of the storage device; ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention particularly relates to a data automatic migration optimization method in a hierarchical storage system. The automatic data migration optimization method in the hierarchical storage system uses system functions to obtain the average load of storage devices, judges whether the average load of each storage device exceeds the load threshold, and judges based on this whether the data in each storage device should be listed to refresh the list. The automatic data migration optimization method in the tiered storage system can automatically and periodically migrate the data in the high-performance storage devices whose space occupancy rate has not reached the refresh water level threshold according to the load situation of the tiered storage system when the load is low. Copy the data in the high-performance storage device to the low-performance storage device in advance, so as to optimize the data migration efficiency, maintain the system at a relatively stable load level, and improve the application performance of the entire cluster storage system.

Description

technical field [0001] The invention relates to the field of computer application technology, in particular to a data automatic migration optimization method in a hierarchical storage system. Background technique [0002] With the rapid growth of the amount of stored data and people's deep understanding of the value of data, the high parallelism, high reliability and high cost performance of storage systems are becoming more and more important. Traditional data storage methods can no longer meet the needs of mass storage and performance, and the performance of storage devices with high data access frequency has become the bottleneck of access. Based on the physical characteristics of different storage devices, people consider combining storage devices with different performance, reliability and price to construct a hierarchical storage system, and use multi-level storage media to store data with different access frequencies. Allocate high-performance, high-cost storage devi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F3/0647G06F3/0685
Inventor 于涛张立强
Owner LANGCHAO ELECTRONIC INFORMATION IND CO LTD