Unlock instant, AI-driven research and patent intelligence for your innovation.

Data hierarchical storage processing method, device and storage device

A technology of layered storage and processing methods, applied in the storage field, can solve the problems of waste of storage space and low space utilization rate, and achieve the effects of improving utilization rate, controlling consumption, and reducing waste of storage space

Active Publication Date: 2016-12-14
HUAWEI TECH CO LTD
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this method of setting a fixed-size migration unit has the following problems: If the size of the migration unit is set to be large, the consumption of metadata storage resources will be small, but there will be the above-mentioned phenomenon that cold data follows hot data, which will make expensive The storage space of the high-level storage medium is wasted, and the space utilization rate is low; if the size of the migration unit is set to be small, the waste of the high-level storage medium will naturally be reduced, but the more metadata storage resources will be consumed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data hierarchical storage processing method, device and storage device
  • Data hierarchical storage processing method, device and storage device
  • Data hierarchical storage processing method, device and storage device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0035] figure 1 It is a schematic flowchart of an embodiment of the data hierarchical storage processing method of the present invention, such as figure 1 As shown, the method of this embodiment may include:

[0036] 101. When a migration unit of a low-level disk is migrated to a high-level disk, split the migration unit into multiple sub-migration units, and respectively detect the data access frequency of each sub-migration unit;

[0037] Wherein, the low-level disk refers to a disk with a slower access speed, such as HDD; the high-level disk refers to a disk with a faster access speed, such as an SSD; Lower tier disks perform better and are faster.

[0038] Wherein, the above-mentioned migration unit and sub-migration unit refer to a data block that is stored in the disk as a whole unit and migrated as a whole. The migration unit of the low-level disk usually refers to a larger-sized migration unit, such as 256MB; when the migration unit becomes hot and migrated to a hig...

Embodiment 2

[0048] figure 2 It is a schematic diagram of the principle of another embodiment of the data hierarchical storage processing method of the present invention. In this embodiment, the low-level disk is HDD and the high-level disk is SSD as an example, and the data hierarchical storage processing method of the present invention is described in detail. Wherein, the HDD and SSD may be two hierarchical disks arranged hierarchically in a certain storage device, and the storage device also includes a related control unit for controlling data migration between the two hierarchical disks, for example , a thermal identification unit for detecting data access frequency, a migration control unit for controlling data migration, etc.

[0049] Such as figure 2 As shown, the storage space in the HDD and SSD will first be divided into multiple storage units according to the granularity of the large size. For example, this storage unit can be used to store the migration unit 11 with a size of...

Embodiment 3

[0063] image 3It is a schematic structural diagram of an embodiment of the data hierarchical storage processing device of the present invention. The device can execute the data hierarchical storage processing method of any embodiment of the present invention. This embodiment only briefly describes the structure of the device. The specific working principle can be Refer to the description of the method embodiments in conjunction.

[0064] Such as image 3 As shown, the device may include: a resource adjustment unit 31, a thermal identification unit 32, a migration control unit 33, and an address recording unit 34; wherein,

[0065] A resource adjustment unit 31, configured to split the migration unit into multiple sub-migration units, and to merge the multiple sub-migration units into the migration unit;

[0066] A hotness identification unit 32, configured to respectively detect the data access frequency of each sub-migration unit;

[0067] A migration control unit 33, con...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a data hierarchical storage processing method, device, and storage device, wherein the method includes: when a migration unit of a low-level disk migrates to a high-level disk, split the migration unit into multiple sub-migration units, and respectively detect The data access frequency of each sub-migration unit; when it is detected that the data access frequency of the sub-migration unit is lower than the set threshold, the sub-migration unit is migrated to the low-level disk; When the multiple sub-migration units are all migrated to the low-level disk, the multiple sub-migration units are merged into the migration unit. The invention improves the utilization rate of the storage medium and effectively controls the consumption of metadata storage resources.

Description

technical field [0001] The present invention relates to storage technology, in particular to a data layered storage processing method, device and storage device. Background technique [0002] Hierarchical storage means that existing storage devices can be configured as disk layers, and different types of disks are placed on different layers. According to data access requirements, data can be migrated between different layers. For example, a solid state disk (SSD for short) is a high-level disk with a high access speed, and a hard disk drive (HDD) is a low-level disk with a low access speed. In this method, the data that is not frequently accessed is stored in a disk layer with a slow access speed, such as HDD, and the data that is frequently accessed is stored in a disk layer with a fast access speed, such as SSD, so that when frequently used data is accessed, the data rate is improved. Reading speed and access efficiency of storage devices. [0003] A disk usually stores ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
Inventor 林宇梁尚冬
Owner HUAWEI TECH CO LTD