Feature processing method for block-level data in hierarchical storage system

A data feature and hierarchical storage technology, applied in the direction of input/output to record carrier, etc., can solve the problems of block-level hotspot data judgment, which is not conducive to improving system performance, system resource consumption and other problems, so as to improve utilization rate and management efficiency , easy promotion, and high data distribution efficiency

Inactive Publication Date: 2014-02-26
LANGCHAO ELECTRONIC INFORMATION IND CO LTD
View PDF3 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the acquisition and analysis of data features is difficult, especially for the determination of block-level hotspot data.
If the data migration decision is made solely based on the comparison between the number of references to the block and the threshold value as the criterion for ju

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Feature processing method for block-level data in hierarchical storage system
  • Feature processing method for block-level data in hierarchical storage system
  • Feature processing method for block-level data in hierarchical storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] A method for processing block-level data characteristics in a hierarchical storage system according to the present invention will be described in detail below in conjunction with the accompanying drawings.

[0021] The present invention analyzes and counts the data characteristics based on the block level. Since the block data object is basically at the logical or physical bottom layer in the storage hierarchy, the data structure is relatively simple compared with the file object, and the most important operations for the bottom data block include Reading and writing, therefore, the frequency of reading / writing to a data block becomes the main feature for judging whether the data is a hotspot. The block-level data feature analysis method mainly counts the number of references to the data block. When the data block is read / written, the number of read / write times is recorded respectively, so as to calculate the reference frequency, that is, the data of the block is used wi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a feature processing method for block-level data in a hierarchical storage system. The method includes: setting a hierarchical storage system architecture comprising a data feature collector, a storage resource manager, a strategy configuration manger and a migration manager; allowing the storage resource manager to integrate storage resources to form a storage resource pool capable of hierarchical storage, and mapping the storage resources into a logical volume to use in an upper-level file system; allowing the data feature collector to be responsible for monitoring upper-level transmitted I/O requests, counting reference frequency features for a certain data block, analyzing by a data feature analysis method, and informing the migration manager of analysis results to allow for subsequent hierarchical management. Compared to the prior art, the feature processing method for block-level data in the hierarchical storage system allows hot spot data to be discovered and judged during the process of hierarchical data storage and management and allows the hot spot data to be judged more accurately.

Description

technical field [0001] The invention relates to the field of intelligent data management, in particular to a block-level data feature processing method in a hierarchical storage system. Background technique [0002] Data hierarchical storage technology is mainly based on the data characteristics of the monitored object to reasonably match storage resources with hot data at the storage virtual layer to achieve efficient utilization of storage resources. Among the existing hierarchical storage data feature analysis methods, one is to use various data feature attributes included in the file object, such as file size, type, etc. to obtain and analyze data features, and classify and manage data with different features. However, the hierarchical storage based on the file level uses the file as the basic unit of data feature statistics. If the file is relatively large and only local information is frequently accessed, then there is a problem of inaccurate positioning of hot data, w...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
Inventor 施光源张宇
Owner LANGCHAO ELECTRONIC INFORMATION IND CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap