A method for online hierarchical storage of data in a cluster storage system

A hierarchical storage and cluster storage technology, applied in the transmission system, electrical components, etc., can solve the problems of data value reduction and access frequency reduction, and achieve the effect of improving overall performance and saving storage costs

Active Publication Date: 2011-12-21
LANGCHAO ELECTRONIC INFORMATION IND CO LTD
View PDF5 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, data has a life cycle. In the first few days after the data is generated, the frequency of access is the highest, which generates benefits and incom

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for online hierarchical storage of data in a cluster storage system
  • A method for online hierarchical storage of data in a cluster storage system

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0024] Example

[0025] The steps for online hierarchical storage of data are as follows:

[0026] The data node and the back-end storage are connected by optical fiber; the data node, control node, client and hierarchical storage server are connected by an IB switch. Set up the LNET network inside the file system, and mount the cluster file system to the tiered storage server.

[0027] Use the internal commands of the cluster file system to create a storage pool.

[0028] Write the file system scanning module, scan the file information and file access situation in the file system based on the scanning strategy, and update the scanned information to the database.

[0029] Write a storage pool monitoring module to detect the utilization rate of the storage pool in real time.

[0030] Write a data migration module, query and scan the database based on the migration strategy, determine the list of files that meet the migration conditions, and execute data migration in multiple threads.

[0...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data online hierarchical storage method in a cluster storage system. Data has a life cycle, and particularly has different meanings in different periods; a cluster storage system stores mass data; however, only 20% of the mass data is key data at high access frequency, and 80% of the mass data is non-key data at low access frequency that the non-key data is generally not accessed in one month or even one year; and the mass data stored in the cluster storage system is classified for storage according to the data access frequency and the characteristic that data has a life cycle so as to save the storage cost. According to the invention, different storage pools are established in the cluster storage system based on the life cycle of data, online hierarchical storage in the cluster storage system is realized by use of scanning software and migration software, thereby saving the storage cost and improving the overall performance of the system.

Description

[0001] technical field [0002] The invention relates to a computer application technology, in particular to an online hierarchical storage management method applied to data in a cluster network storage system. Background technique [0003] A large amount of data is stored in the cluster storage system, and a large number of disks are used. If the cluster storage system uses high-performance [0004] The cost of a powerful disk is considerable. However, data has a life cycle. In the first few days after the data is generated, the frequency of access is the highest, which generates benefits and income for the enterprise, and brings the highest value; as time goes by, the frequency of access decreases, and the value of the data also increases. the decline. Therefore, disks with different performance can be added to the cluster storage system. Based on the locality of data access, data with low access frequency can be stored on low-performance disks, and high-cost storage spa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08
Inventor 郭秋雨张立强
Owner LANGCHAO ELECTRONIC INFORMATION IND CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap