Method and device for data block migration

A data block and data feature technology, applied in the field of data processing, can solve the problems that affect the application effect of data classification management, frequent migration, low efficiency of hot data migration, etc., and achieve the effect of improving real-time performance and migration efficiency

Active Publication Date: 2014-01-08
INSPUR BEIJING ELECTRONICS INFORMATION IND
View PDF7 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the existing hierarchical storage migration scheme based on data blocks, the migration operation of hot data has frequent migration, that is, whenever a hot data block appears, it will be migrated immediately, resulting in low migration efficiency of hot data and wasting resources. Practical application effect of data hierarchical management

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for data block migration
  • Method and device for data block migration
  • Method and device for data block migration

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0036] Such as figure 1 As shown, this embodiment provides a data block migration method, including the following steps:

[0037] S101: Set the maximum bandwidth that allows the upper layer application to input / output I / O requests to the bottom tiered storage device;

[0038] The maximum bandwidth setting is the maximum bandwidth that the underlying tiered storage device can provide to upper-layer applications, rather than the access capability that the underlying tiered storage device itself has. When setting, the value of the maximum bandwidth should be smaller than the access capability of the underlying tiered storage device itself.

[0039] S102: Monitor the flow of I / O requests from the upper layer application to the bottom layer storage device, and count the remaining bandwidth of the bottom layer storage device;

[0040] The remaining bandwidth is the set maximum bandwidth minus the bandwidth used by upper-layer applications to access I / O requests.

[0041] S103: Wh...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and device for data block migration. The method includes the steps that the maximum bandwidth which permits an I/O request of an upper-layer application on a bottom-layer hierarchical storage device is set, flow of the I/O request of the upper-layer application on the bottom-layer hierarchical storage device is monitored, remaining bandwidth of the bottom-layer hierarchical storage device is calculated, when a data block needs to be migrated, whether the remaining bandwidth of the bottom-layer hierarchical storage device exists is judged, and if yes, migration I/O operation of the data block is executed. According to the method and device, under the condition that intensive migration I/O operation occurs, sufficient bandwidth can be supplied for the migration I/O operation. The remaining bandwidth is used for executing the migration I/O operation of data blocks needing migration, batch data migration is achieved, real-time performance and migration efficiency of data migration are improved, meanwhile a user defined bandwidth is set, the minimum bandwidth is used as the migration bandwidth, and influence on normal I/O operation is reduced as much as possible.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a data block migration method and device. Background technique [0002] In the tiered storage system based on block-level data, infrequently accessed data is automatically migrated to devices with lower storage costs, releasing higher-cost storage space for more frequently accessed or higher-priority data , thereby greatly reducing the space occupied by non-important data on the first-level local disk, speeding up the storage performance of the entire system, reducing the cost of ownership of the entire storage system, and obtaining better cost performance. Hierarchical storage based on data blocks is a fine-grained data hierarchical management solution, which can refine the granularity of data management to the extended block level defined according to application requirements, so the management of data is more precise. When intensive I / O accesses the underlying data, hot data wi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F12/08G06F12/0802
Inventor 施光源张宇梁志诚
Owner INSPUR BEIJING ELECTRONICS INFORMATION IND
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap