Hierarchical storage method

A technology of hierarchical storage and storage layer, applied in the computer field, it can solve the problems of low price, low processing capacity, scattered servers, etc., and achieve the effects of high performance, optimized data scheduling strategy, and low cost.

Active Publication Date: 2013-06-12
南方电网互联网服务有限公司
View PDF4 Cites 44 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The servers in the current Hadoop cluster are mostly equipped with SATA hard disk

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hierarchical storage method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0026] Such as figure 1 As shown, it is a schematic flow chart of a hierarchical storage method according to an embodiment of the present invention. The hierarchical storage method of the present invention includes the following steps:

[0027] Step S1: Storage automatic grading.

[0028] The cluster starts to automatically identify the storage levels of different types of hosts. In this embodiment, when the hadoop cluster starts, the system can automatically identify the access performance of each node through the "host name identification method" (grading basis). If the host name contains "high", the access performance is the best, and it is listed as the first-level storage; if it contains "middle", the access performance is moderate, and it is listed as the second-level storage; if it contains "low", it is listed as the third-lev...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a hierarchical storage method. The method comprises the following steps of automatically classifying storage: starting a cluster and automatically identifying storage hierarchies on which hosts of various types are located; performing oriented access: selecting short-distance high-storage-hierarchy light-load nodes for data storage and reading; seeking hot data: recording access information of each data block in a document, judging migration time, obtaining the value of each accessed data block according to the recorded information in the coming of the migration time, and forming a queue from high to low according to the values; and migrating the data blocks: migrating the high-value data blocks to high-storage-hierarchy storage layers, and migrating the low-value blocks to low-storage-hierarchy storage layers. With the adoption of the hierarchical storage method provided by the invention, the arrangement is easy, the hardware is low in price and the cost performance is higher; and meanwhile, the data scheduling of the cluster is improved, so that the access performance of the cluster is optimized.

Description

technical field [0001] The invention relates to a storage technology in the computer field, in particular to a hierarchical storage method. Background technique [0002] With the rapid increase of data volume, the traditional storage system has bottlenecks due to its physical composition and functional limitations, which can no longer fully meet the needs of massive data storage, so cluster storage emerges as the times require. Cluster storage refers to a storage cluster composed of several "universal storage devices". Compared with traditional storage systems, it has the characteristics of strong scalability, easy management, and superior performance. The core of cluster storage is its distributed storage system, which generally has a unified namespace, can uniformly schedule and distribute all operations in the cluster, and coordinate many storage devices to work together. In recent years, cluster storage has achieved remarkable results in parallel I / O, especially in hand...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F12/08G06F3/06
Inventor 张森林冯圣中
Owner 南方电网互联网服务有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap