A method for online hierarchical storage of data in a cluster storage system

A hierarchical storage and cluster storage technology, applied in the transmission system, electrical components, etc., can solve the problems of data value reduction and access frequency reduction, and achieve the effect of improving overall performance and saving storage costs

Active Publication Date: 2011-12-21
LANGCHAO ELECTRONIC INFORMATION IND CO LTD
5 Cites 35 Cited by

AI-Extracted Technical Summary

Problems solved by technology

However, data has a life cycle. In the first few days after the data is generated, the frequency of access is the highest, which generates benefits and incom...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Abstract

The invention provides a data online hierarchical storage method in a cluster storage system. Data has a life cycle, and particularly has different meanings in different periods; a cluster storage system stores mass data; however, only 20% of the mass data is key data at high access frequency, and 80% of the mass data is non-key data at low access frequency that the non-key data is generally not accessed in one month or even one year; and the mass data stored in the cluster storage system is classified for storage according to the data access frequency and the characteristic that data has a life cycle so as to save the storage cost. According to the invention, different storage pools are established in the cluster storage system based on the life cycle of data, online hierarchical storage in the cluster storage system is realized by use of scanning software and migration software, thereby saving the storage cost and improving the overall performance of the system.

Application Domain

Technology Topic

Image

  • A method for online hierarchical storage of data in a cluster storage system
  • A method for online hierarchical storage of data in a cluster storage system

Examples

  • Experimental program(1)

Example Embodiment

[0024] Example
[0025] The steps for online hierarchical storage of data are as follows:
[0026] The data node and the back-end storage are connected by optical fiber; the data node, control node, client and hierarchical storage server are connected by an IB switch. Set up the LNET network inside the file system, and mount the cluster file system to the tiered storage server.
[0027] Use the internal commands of the cluster file system to create a storage pool.
[0028] Write the file system scanning module, scan the file information and file access situation in the file system based on the scanning strategy, and update the scanned information to the database.
[0029] Write a storage pool monitoring module to detect the utilization rate of the storage pool in real time.
[0030] Write a data migration module, query and scan the database based on the migration strategy, determine the list of files that meet the migration conditions, and execute data migration in multiple threads.
[0031] Write the data back migration module, query and scan the database based on the back migration strategy, determine the file list that meets the back migration conditions, and execute the data back migration in multiple threads.
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

no PUM

Description & Claims & Application Information

We can also present the details of the Description, Claims and Application information to help users get a comprehensive understanding of the technical details of the patent, such as background art, summary of invention, brief description of drawings, description of embodiments, and other original content. On the other hand, users can also determine the specific scope of protection of the technology through the list of claims; as well as understand the changes in the life cycle of the technology with the presentation of the patent timeline. Login to view more.
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Similar technology patents

Classification and recommendation of technical efficacy words

  • Reduce storage costs
  • Improve overall performance

Content distribution network system and content distribution method

ActiveCN105187848AReduce central storage access pressureReduce storage costsSelective content distributionContent distributionContent delivery network
Owner:INSPUR SOFTWARE TECH CO LTD

High-precision distributed pulse signal time difference of arrival detection system

ActiveCN102023290AReduce target positioning errorImprove overall performancePosition fixationSatellite radio beaconingTime of arrivalMultilateration
Owner:THE SECOND RES INST OF CIVIL AVIATION ADMINISTRATION OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products