Cold and hot data identification threshold value calculation method, device and system

A technology of cold and hot data and calculation methods, which is applied in the directions of calculation, electrical digital data processing, and data processing input/output process, etc., and can solve the problems of storage systems without hot and cold identification standards, hierarchical storage functions of storage systems, and practicality. issues such as reduced usability

Active Publication Date: 2014-03-12
HUAWEI TECH CO LTD
View PDF4 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Under the existing technology, the data monitoring function module, the data hot and cold identification function module and the data migration function module are distributed in each storage node of the storage system, but the whole storage system does not have a uniform hot and cold identificatio

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cold and hot data identification threshold value calculation method, device and system
  • Cold and hot data identification threshold value calculation method, device and system
  • Cold and hot data identification threshold value calculation method, device and system

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0047] In the following description, for the purpose of illustration rather than limitation, specific details such as a specific system structure, interface, technology, etc. are proposed for a thorough understanding of the present invention. However, it should be clear to those skilled in the art that the present invention can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known devices, circuits, and methods are omitted to avoid unnecessary details from obstructing the description of the present invention.

[0048] The method for calculating the recognition threshold of cold and hot data provided by the embodiment of the present invention can be applied to, for example, figure 1 In the storage system shown, such as figure 1 As shown, the storage system provided by the embodiment of the present invention includes a storage control server and multiple storage nodes. The storage control server is networked with...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a cold and hot data identification threshold value calculation method, device and system. The method comprises the following steps of transmitting a data block IO (input/output) statistical information query command to each storage node; receiving IO statistical information from each storage node; performing addition operation on IO count field values in the same count ranges in the IO statistical information received from each storage node, generating an IO count statistical value corresponding to each count range, and obtaining a minimum IO count value in the count range corresponding to a minimum IO count statistical value in high IO count statistical values when data blocks corresponding to the high IO count statistical values are filled with hot data storage media as a cold and hot data identification threshold value according to the overall capacity of the hot data storage media, the sizes of the data blocks and the IO count statistical values in each storage node. According to the method, the device and the system, each storage node in a storage system can independently finish the hierarchical data storage of the whole storage system in a coordination way.

Description

technical field [0001] The invention relates to the technical field of data storage, in particular to a method, device and system for calculating a threshold value for hot and cold data identification. Background technique [0002] With the development of storage technology, people have higher and higher requirements on the capacity and performance of storage systems, but storage systems with large capacity and high performance are also expensive. The need to meet the performance and capacity requirements of storage systems at low prices has given rise to tiered storage technology. [0003] Hierarchical data storage technology is the mainstream technology to meet the needs of data lifecycle management. By monitoring business data, data access frequency, IO count and other parameter values ​​can be recorded. According to the monitored IO and other parameter values, it can be determined which layer of the storage system the business data should be stored in. Hot data can be m...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/0649G06F3/067G06F3/0685G06F3/0605G06F3/0617G06F3/064G06F3/0653
Inventor 王辰林宇
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap